Speech-to-song illusion

The speech-to-song illusion is an auditory illusion discovered by Diana Deutsch in 1995. A spoken phrase is repeated several times, without altering it in any way, and without providing any context. This repetition causes the phrase to transform perceptually from speech into song.^[1][2] Though mostly notable with languages that are non-tone, like English and German, it is possible to happen with tone languages, like Thai and Mandarin.^[3][4]

The illusion was discovered by Deutsch in 1995 when she was preparing the spoken commentary on her CD ‘Musical Illusions and Paradoxes'. She had the phrase ‘sometimes behave so strangely' on a loop, and noticed that after it had been repeated several times it appeared to be sung rather than spoken.^[1] Later she included this illusion on her CD ‘Phantom Words and other Curiosities'^[2] and noted that once the phrase had perceptually morphed into song, it continued to be heard as song when played in the context of the full sentence in which it occurred.

Deutsch, Henthorn, and Lapidis^[5][6] examined the illusion in detail. They showed that when this phrase was heard only once, listeners perceived it as speech, but after several repetitions, they perceived it as song. This perceptual transformation required that the intervening repetitions be exact; it did not occur when they were transposed slightly, or presented with the syllables in jumbled orderings. In addition, when listeners were asked to repeat back the phrase after hearing it once, they repeated it back as speech. Yet when they were asked to repeat back the phrase after hearing it ten times, they repeated it back as song.

Theories of the neurological substrates of speech and song perception have been based on responses to speech and song stimuli, and these differ in their features. For example, the pitch content within spoken syllables generally changes dynamically, while the pitches of musical notes tend to be stable and the notes tend to be of longer duration. For this reason, theories of the brain substrates of speech and song perception have invoked explanations in terms of the acoustic features involved.^[7] Yet in the speech-to-song illusion a phrase is repeated exactly, with no change in its features; however, it can be heard either as speech or as song. For this reason, several studies have explored the brain regions that are involved in the illusion. Increased activation has been found in the frontal and temporal lobes of both hemispheres when the listener was perceiving a repeated spoken phrase as sung rather than spoken.^[8][9] The activated regions included several that other researchers had found to be activated while listening to song.^[10][11]

Phrases that are marked by syllables with stable pitches and that favor a metrical interpretation tend to be conducive to the illusion.^[8][12] However, the illusion is not enhanced by regular repetitions of the entire phrase.^[12][4] Further, the illusion is stronger for phrases in languages that are more difficult to pronounce^[4] and when listeners are unable to understand the language of the utterance.^[3]

The speech-to-song illusion occurs in listeners both with and without musical training.^{[8][5][6][9][12][4][3]} It occurs in listeners who speak different languages, including the non-tone languages English, Irish, Catalan, German, Italian, Portuguese, French, Croatian, and Hindi, and the tone languages Thai and Mandarin; however, it is weaker in speakers of tone languages than non-tone languages.^[4][3]

Margulis and Simchi-Gross have reported related illusions in which different types of sound are transformed into music by repetition. Random sequences of tones were heard as more musical when they were looped,^[13] and clips consisting of a mix of environmental sounds sounded more musical following repetition.^[14] These effects were weaker than that of the original speech-to-song illusion, perhaps because speech and song are particularly intertwined perceptually, and also because the characteristics of the speech producing the original illusion are particularly conducive to a strong effect.

Repetition is a particularly important characteristic of music, and so provides an important cue that a phrase should be considered as music rather than speech.^[15][16] More specifically, in song, the pitches of vowels are distinctly heard, but in speech they appear watered down. It has been suggested that in speech the neural circuitry underlying pitch perception is somewhat inhibited, enabling the listener to focus attention on consonants and vowels, which are important to verbal meaning. Exact repetition of spoken words may cause this circuitry to become disinhibited, so that pitches are heard more saliently, and so as sung.^[16] Indeed, the brain structures that are activated when the illusion occurs correspond largely to those that are activated in response to song.^[8][10][11]

In addition, several features of a spoken phrase that are likely to occur in song are conducive to the illusion. These include syllables with more stable pitches, and phrases with more regular distributions of accents.^[12] Other explanations invoke higher-level musical structure and memory. Listeners are better able to discriminate pitches in repeated rather than unrepeated phrases when the pitches violate the structure Western of tonal music.^[17] Long term memory for melodies may also be involved: If the prosodic features of a spoken phrase are similar to those of a well-known melody, the brain circuitries underlying musical pitch patterns and rhythms can be invoked, so that the phrase is heard as song.^[16]

Many composers, including Gesualdo, Monteverdi, and Mussorgsky, have argued that expressivity in music can be derived from inflections in speech, and they have included features of speech in their music.^[16] Another relationship was invoked by Steve Reich, in his compositions such as Come Out and It's Gonna Rain. He presented spoken phrases in stereo and looped them, gradually offsetting the sounds from the two sources so as to create musical effects, and these were enhanced as the discrepancy widened.^[18][19] Further, in Reich’s composition Different Trains brief excerpts of speech were embedded in instrumental music so as to bring out their musical quality.^[20] Today, much popular music, particularly rap music, consists of chanting rhythmic speech with musical accompaniment.

• Elizabeth Hellmuth Margulis (2013). On Repeat: How Music Plays the Mind. Oxford University Press. ISBN 978-0199990825.
• Deutsch, D. (2019). Musical Illusions and Phantom Words: How Music and Speech Unlock Mysteries of the Brain. Oxford University Press. ISBN 9780190206833. LCCN 2018051786.

• "Behaves So Strangely" Interview with Jad Abrumrad, Radiolab, WNYC Studios, 2007, September
• "Sounds sometimes behave so strangely" Interview with Georgia Mills, Naked Scientists, BBC Radio and ABC Radio, 2018, April
• "Auditory Illusions", BBC Radio 4, 2019, August
• "Diana Deutsch's Speech-to-Song Illusion site
• "Sometimes behaves so strangely", Metafilter, 2019, September
• "How often does speech turn into song?", Esther Inglis-Arkell, Gizmodo, 2014, March.