This paper describes a technique to assess the correspondence between patterns of similarity in the brain’s response to speech sounds, and the patterns of similarity encoded in phonological feature systems. The technique is applied to three published phonological feature systems, which are found to differ in their ability to recover certain speech sound contrasts from the neural data.