The subphylum of chordates that includes the animals that possess a spinal chord protected by a segmented vertebral column of cartilage and/or bone.