Voice, Intonation and the Brain

Instructions

Watch the video about bundles. 

This bundle was created to edify and support your research interests. Recommended resources have the first word of the reference highlighted with light text over a dark background (e.g., Akbarian).

Some of the links go to research paper vendor sites with just the abstract available. To read the full article, sign in to HOLLIS Library and do the title search there.

If you wish, you can download this bundle.

Resources

Abrams, D. A., Chen, T., Odriozola, P., Cheng, K. M., Baker, A. E., Padmanabhan, A., ... & Menon, V. (2016). Neural circuits underlying mother’s voice perception predict social communication abilities in children. Proceedings of the National Academy of Sciences, 113(22), 6295-6300.

Alsius, A., Paré, M., & Munhall, K. G. (2018). Forty years after hearing lips and seeing voices: the McGurk effect revisited. Multisensory Research, 31(1-2), 111-144.

Chen, C., Sung, J. Y., & Cheng, Y. (2016). Neural dynamics of emotional salience processing in response to voices during the stages of sleep. Frontiers in Behavioral Neuroscience, 10, 117.

Cheng, Y., Lee, S. Y., Chen, H. Y., Wang, P. Y., & Decety, J. (2012). Voice and emotion processing in the human neonatal brain.Journal of cognitive neuroscience, 24(6), 1411-1419.

Dediu, D., & Ladd, D. R. (2007). Linguistic tone is related to the population frequency of the adaptive haplogroups of two brain size genes, ASPM and Microcephalin. Proceedings of the National Academy of Sciences, 104(26), 10944-10949.

Dehaene-Lambertz, G. (2017). The human infant brain: A neural architecture able to learn language. Psychonomic Bulletin & Review, 24(1), 48-55.

Grady, C. L., Yu, H., & Alain, C. (2007). Age-related differences in brain activity underlying working memory for spatial and nonspatial auditory information. Cerebral cortex, 18(1), 189-199.

Graham, A. M., Fisher, P. A., & Pfeifer, J. H. (2013). What sleeping babies hear: A functional MRI study of interparental conflict and infants’ emotion processing. Psychological Science, 24(5), 782-789.

Hasan, B. A. S., Valdes-Sosa, M., Gross, J., & Belin, P. (2016). “Hearing faces and seeing voices”: Amodal coding of person identity in the human brain. Scientific Reports, 6, 37494.

Hisanaga, S., Sekiyama, K., Igasaki, T., & Murayama, N. (2016). Language/culture modulates brain and gaze processes in audiovisual speech perception. Scientific Reports, 6, 35265.

Holmes, E., Domingo, Y., & Johnsrude, I. S. (2018). Familiar voices are more intelligible, even if they are not recognized as familiar. Psychological Science, 29(10), 1575-1583.

Hyde, D. C., Flom, R., & Porter, C. L. (2016). Behavioral and neural foundations of multisensory face-voice perception in infancy. Developmental Neuropsychology, 41(5-8), 273-292.

Irwin, J., Avery, T., Brancazio, L., Turcios, J., Ryherd, K., & Landi, N. (2018). Electrophysiological indices of audiovisual speech perception: beyond the McGurk effect and speech in noise. Multisensory Research, 31(1-2), 39-56.

Ishii, K., Kobayashi, Y., & Kitayama, S. (2009). Interdependence modulates the brain response to word–voice incongruity.Social Cognitive and Affective Neuroscience, 5(2-3), 307-317.

Kim, C., Shin, H. V., Oh, T. H., Kaspar, A., Elgharib, M., & Matusik, W. (2018). On learning associations of faces and voices. arXiv preprint arXiv:1805.05553.

Klofstad, C. A., Anderson, R. C., & Nowicki, S. (2015). Perceptions of competence, strength, and age influence voters to select leaders with lower-pitched voices. PloS one, 10(8), e0133779.

Krestar, M. L., & McLennan, C. T. (2013). Examining the effects of variation in emotional tone of voice on spoken word recognition. Quarterly Journal of Experimental Psychology, 66(9), 1793-1802.

Kuhn, L. K., Wydell, T., Lavan, N., McGettigan, C., & Garrido, L. (2017). Similar representations of emotions across faces and voices. Emotion, 17(6), 912.

Kumar, G. V., Halder, T., Jaiswal, A. K., Mukherjee, A., Roy, D., & Banerjee, A. (2016). Large scale functional brain networks underlying temporal integration of audio-visual speech perception: An EEG study. Frontiers in Psychology, 7, 1558.

Lavan, N., Burston, L. F., & Garrido, L. (2018). How many voices did you hear? Natural variability disrupts identity perception from unfamiliar voices. British Journal of Psychology.

Liebenthal, E., Silbersweig, D. A., & Stern, E. (2016). The language, tone and prosody of emotions: neural substrates and dynamics of spoken-word emotion perception. Frontiers in Neuroscience, 10, 506.

Liu, P., Cole, P. M., Gilmore, R. O., Pérez-Edgar, K. E., Vigeant, M. C., Moriarty, P., & Scherf, K. S. (2019). Young children's neural processing of their mother’s voice: An fMRI study. Neuropsychologia, 122, 11-19.

Loui, P., Wu, E. H., Wessel, D. L., & Knight, R. T. (2009). A generalized mechanism for perception of pitch patterns.Journal of Neuroscience, 29(2), 454-459.

MacDonald, J. (2018). Hearing lips and seeing voices: the origins and development of the ‘McGurk Effect’and reflections on audio–visual speech perception over the last 40 years. Multisensory Research, 31(1-2), 7-18.

Magnotti, J. F., & Beauchamp, M. S. (2017). A causal inference model explains perception of the McGurk effect and other incongruent audiovisual speech. PLoS Computational Biology, 13(2), e1005229.

Marie, C., & Trainor, L. J. (2012). Development of simultaneous pitch encoding: infants show a high voice superiority effect.Cerebral Cortex, 23(3), 660-669.

McDonald, N. M., Perdue, K. L., Eilbott, J., Loyal, J., Shic, F., & Pelphrey, K. A. (2019). Infant brain responses to social sounds: a longitudinal functional near-infrared spectroscopy study. Developmental Cognitive Neuroscience, 100638.

McGettigan, C. (2015). The social life of voices: studying the neural bases for the expression and perception of the self and others during spoken communication. Frontiers in Human Neuroscience, 9, 129.

Meaux, E., & Vuilleumier, P. (2016). Facing mixed emotions: analytic and holistic perception of facial emotion expressions engages separate brain networks. NeuroImage, 141, 154-173.

Morin, A., & Hamper, B. (2012). Self-reflection and the inner voice: activation of the left inferior frontal gyrus during perceptual and conceptual self-referential thinking. The open neuroimaging journal, 6, 78.

Morningstar, M., Mattson, W. I., & Nelson, E. E. (2022). Longitudinal change in neural response to vocal emotion in adolescence. Social Cognitive and Affective Neuroscience, 17(10), 890–903. https://doi.org/10.1093/scan/nsac021

Nagrani, A., Albanie, S., & Zisserman, A. (2018). Seeing voices and hearing faces: Cross-modal biometric matching. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 8427-8436).

Nan, Y., Skoe, E., Nicol, T., & Kraus, N. (2015). Auditory brainstem's sensitivity to human voices. International Journal of Psychophysiology, 95(3), 333-337.

Parmentier, F. B., Maybery, M. T., & Elsley, J. (2010). The involuntary capture of attention by novel feature pairings: A study of voice—location integration in auditory sensory memory.Attention, Perception, & Psychophysics, 72(2), 279-284.

Pinheiro, A. P., Lima, D., Albuquerque, P. B., Anikin, A., & Lima, C. F. (2019). Spatial location and emotion modulate voice perception. Cognition and Emotion, 1-10.

Rachman, L., Aucouturier, J. J., & Dubal, S. (2019). Happy you, happy me: expressive changes on a stranger's voice recruit faster implicit processes than self-produced expressions. bioRxiv, 518324.

Ryan, N. P., Anderson, V., Godfrey, C., Beauchamp, M. H., Coleman, L., Eren, S., ... & Catroppa, C. (2014). Predictors of very-long-term sociocognitive function after pediatric traumatic brain injury: evidence for the vulnerability of the immature “social brain”. Journal of Neurotrauma, 31(7), 649-657.

Schirmer, A. (2010). Mark my words: Tone of voice changes affective word representations in memory. PLoS One, 5(2), e9080.

Schirmer, A., & Adolphs, R. (2017). Emotion perception from face, voice, and touch: comparisons and convergence. Trends in Cognitive Sciences, 21(3), 216-228.

Schirmer, A., Chen, C. B., Ching, A., Tan, L., & Hong, R. Y. (2013). Vocal emotions influence verbal memory: neural correlates and interindividual differences. Cognitive, Affective, & Behavioral Neuroscience, 13(1), 80-93.

Shahin, A. J., Picton, T. W., & Miller, L. M. (2009). Brain oscillations during semantic evaluation of speech.Brain and cognition, 70(3), 259-266.

Stothart, G., & Kazanina, N. (2016). Auditory perception in the aging brain: the role of inhibition and facilitation in early processing. Neurobiology of Aging, 47, 23-34.

Trainor, L. J., Marie, C., Gerry, D., Whiskin, E., & Unrau, A. (2012). Becoming musically enculturated: effects of music classes for infants on brain and behavior. Annals of the New York Academy of Sciences, 1252(1), 129-138.

Tsantani, M. S., Belin, P., Paterson, H. M., & McAleer, P. (2016). Low vocal pitch preference drives first impressions irrespective of context in male voices but not in female voices. Perception, 45(8), 946-963.

Tsantani, M., Kriegeskorte, N., McGettigan, C., & Garrido, L. (2018). Faces and voices in the brain: a modality-general person-identity representation in superior temporal sulcus. bioRxiv, 338475.

Van Berkum, J. J., Van den Brink, D., Tesink, C. M., Kos, M., & Hagoort, P. (2008). The neural integration of speaker and message. Journal of cognitive neuroscience, 20(4), 580-591.

Van Rijn, S., Aleman, A., Swaab, H., Krijn, T., Vingerhoets, G., & Kahn, R. S. (2007). What it is said versus how it is said: comprehension of affective prosody in men with Klinefelter (47, XXY) syndrome.Journal of the International Neuropsychological Society, 13(6), 1065-1070.

Webb, A. R., Heller, H. T., Benson, C. B., & Lahav, A. (2015). Mother’s voice and heartbeat sounds elicit auditory plasticity in the human brain before full gestation. Proceedings of the National Academy of Sciences, 112(10), 3152-3157.

Young, K. S., Parsons, C. E., LeBeau, R. T., Tabak, B. A., Sewart, A. R., Stein, A., ... & Craske, M. G. (2017). Sensing emotion in voices: Negativity bias and gender differences in a validation study of the Oxford Vocal (‘OxVoc’) sounds database. Psychological Assessment, 29(8), 967.

Zougkou, K., Weinstein, N., & Paulmann, S. (2017). ERP correlates of motivating voices: quality of motivation and time-course matters. Social Cognitive and Affective Neuroscience, 12(10), 1687-1700.

Date of last update: 15-Dec-2022

This resource is protected under a Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0) license.