Attention to sound

Visual selective attention is thought to facilitate performance both through enhancement and inhibition of sensory processing of goal-relevant and irrelevant (or distracting) information. While much insight has been gained over the past few decades into the neural mechanisms underlying facilitatory effects of attention, much less is known about inhibitory mechanisms in visual attention. In particular, it is still unclear as to whether target facilitation and distractor inhibition are simply different sides of the same coin or whether they are controlled by distinct neural mechanisms. Moreover, recent work indicates that suppression of visual distractors only emerges when information about the distractor can be derived directly from experience, consistent with a predictive coding model of expectation suppression. This also raises the question as to how visual attention and expectation interact to bias information processing. In this talk, Professor Slagter will discuss recent findings from several behavioural and EEG studies that examined how expectations about upcoming target or distractor locations and/or features influence facilitatory and inhibitory effects of attention on visual information processing and representation using ERPs, multivariate decoding analyses, and inverted encoding models. Collectively, these confirm an important role for alpha oscillatory activity in town-down biasing of visual attention to, and sharpening of representations of target locations. Yet, they also show that target facilitation and distractor suppression are differentially influenced by expectation, and rely at least in part on different neural mechanisms, with distractor suppression selectively occurring after stimulus presentation. This latter finding raises the question as to whether voluntary preparatory inhibition is possible at all.

Professor Heleen Slagter, University of Amsterdam, The Netherlands

Professor Heleen Slagter, University of Amsterdam, The Netherlands

Heleen Slagter is Associate Professor of Brain and Cognition at the University of Amsterdam, where she also received her PhD in cognitive neuroscience in 2005. After a 4-year postdoc at the University of Wisconsin-Madison, USA, she returned to Amsterdam to set up her own lab in 2009. Her research focuses on (the neural basis of) core cognitive functions, such as attention, and the plasticity of these functions. What are the mechanisms that allow us to perceive, select, suppress, and become aware of information in the environment? How does learning based on prior experience or mental training as cultivated by meditation influence these mechanisms that adaptively control information processing? Dr Slagter’s work has garnered awards and funding, including a prestigious VIDI grant by the Netherlands Organization for Scientific research, an ERC starting grant, and an early career award by the Society for Psychophysiological Research.

In a crowded visual scene, attention must be efficiently and flexibly distributed over time and space to accommodate different task contexts. In this talk, Professor Luo would like to present several works in the lab investigating the temporal structure of visual attention. First, by using a time-resolved behavioral measurement, the group demonstrates that attentional behavioural performance contains temporal fluctuations (theta-band, alpha-band, etc), supporting that neuronal oscillatory profile might be directly revealed at behavioural level. These behavioural oscillations display a temporal alternating relationship between locations, suggesting that attention samples multiple items in a time-based rhythmic manner. Second, by employing EEG recordings in combination with a TRF approach, the group extracted object-specific neuronal impulse responses during multi-object selective attention. The results show that attention rhythmically switches among visual objects every ~200 ms, and the spatiotemporal sampling profile adaptively changes in various task contexts. Finally, by using MEG recordings in combination with a decoding approach, the group demonstrates that attention fluctuates between attended orientation features in a theta-band rhythm, suggesting that feature-based attention is mediated by rhythmic sampling similar to that for spatial attention. In summary, attention is not stationary but dynamically samples multiple visual objects in a periodic or serial-like way. This work advocates a generally central role of temporal organisation in attention by flexibly and efficiently organising resources in time dimension.

Professor Huan Luo, Peking University, China

Professor Huan Luo, Peking University, China

Dr Huan Luo is currently an associate professor at School of Psychological and Cognitive Sciences, Peking University, China. She is also a PI of McGovern Institute for Brain Research at PKU. Before joining PKU in 2015, she has worked at the Institute of Biophysics, Chinese Academy of Sciences (2008-2014). She got her PhD from University of Maryland College Park, USA, under the supervision of David Poeppel. Her previous work (2007-2013) used MEG recordings to explore the phase-based neural oscillatory mechanism for natural speech processing, audiovisual integration, and auditory memory. Her recent interest focuses on the temporal dynamics in visual processing, including multi-object attention, perceptual integration, and working memory, by employing various time-resolved approaches (time-resolved behavioural measurement, Meg, EEG, etc).

Load Theory of attention and cognitive control offers a hybrid model that combines capacity limits in perception with automaticity of processing. The model proposes that perception has limited capacity but proceeds automatically and involuntarily in parallel on all stimuli within capacity: relevant as well as irrelevant. Much evidence accumulated to support load theory in vision research so far. However the cross modal effects of perceptual load across the senses are less clear. In her talk, Professor Lavie will present recent work on the effects of visual perceptual load on auditory perception and the related neural activity as assessed with magnetoencephalography. The results showed that the level of unattended auditory perception and the related neural signal critically depends on the level of perceptual processing load in the visual attention task. Task conditions of high perceptual load that takes up all capacity with attended task processing, lead to reduced processing of unattended stimuli. In contrast in conditions of low perceptual load that leave spare capacity ignored task-irrelevant stimuli are nevertheless perceived, and elicit neural response. These findings demonstrate the value of understanding the role of attention in auditory processing within the framework of Load Theory.

Professor Nilli Lavie FBA, University College London, UK

Professor Nilli Lavie FBA, University College London, UK

Nilli Lavie is a Professor of Psychology and Brain Sciences at UCL Institute of Cognitive Neuroscience, where she heads the Attention and Cognitive Control laboratory. She is the originator of the Load Theory of attention, perception and cognitive control and renowned for having provided a resolution to the four-decades long debate in psychology on the locus of capacity limits in human information processing. She is an elected fellow of the British Academy, Royal Society of Biology, British Psychological Society, and the Association for Psychological Science, US; and an honorary life member of the Experimental Psychological Society, UK. Her current research concerns attention, perception, multi-sensory integration, emotion, and cognitive control over behaviour. She uses a combination research methods spanning neuroimaging (fMRI, VBM, EEG, spectroscopy), behavioural experiments, psychophysics, and machine learning.

Neuroimaging with fMRI shows that there are distinct networks biased towards the processing of visual and auditory information. These networks include inter-digitated areas in frontal cortex as well as corresponding primary and secondary sensory regions. In Professor Shinn-Cunningham's studies, she sees these distinct frontal regions consistently in individual subjects across multiple studies spanning years; however, the inter-digitated structural organization of the 'visual' and 'auditory' regions in frontal cortex is not clear using standard methods for co-registering and averaging fMRI results across subjects. Although the networks that include these inter-digitated frontal control regions are 'sensory biased', they are also recruited to process information in the other sensory modality as needed. Specifically, areas that are always engaged by auditory attention are recruited when visual tasks require processing of temporal structure, but not when the same visual inputs are accessed for tasks requiring processing of spatial information. Conversely, processing of auditory spatial information preferentially engages the visually biased brain network – a network that is traditionally associated with spatial visual attention. This visuo-spatial network includes retinotopically organised spatial maps in parietal cortex. Recent EEG results from Professor Shinn-Cunningham's lab confirm that auditory spatial attention makes use of the parietal maps in the 'visual spatial attention' network. Together, these results reveal that visual networks for attention are a shared resource used by the auditory system.

Professor Barbara Shinn-Cunningham, Carnegie Mellon University, USA

Professor Barbara Shinn-Cunningham, Carnegie Mellon University, USA

Barbara Shinn-Cunningham trained as an electrical engineer (Brown University, ScB; MIT, MS and PhD). Her research uses behavioural, neuroimaging, and computational methods to understand auditory processing. In 2018, she became the Director of the new Carnegie Mellon University Neuroscience Institute and Professor of the Center of Neural Basis of Cognition, Psychology, Biomedical Engineering, and Electrical & Computer Engineering at CMU. Before joining CMU, she spent 21 years on the faculty of Boston University. Her work has been recognised by the Alfred P. Sloan Foundation, the Whitaker Foundation, and the Vannevar Bush Fellows program. She is a Fellow of the Acoustical Society of America and the American Institute for Medical and Biological Engineers, and a lifetime National Associate of the National Research Council "in recognition of extraordinary service to the National Academies in its role as advisor to the Nation in matters of science."

Auditory attention is a fascinating feat. For example, it is most astonishing how our brain 'does away' with considerable differences in sound pressure between a behaviourally relevant sound source and other interferences. Meanwhile, auditory attention has remained this elusive phenomenon: do we really understand enough just yet of auditory attention to build machines that attend, or machines that help us attend? Illustrated by behavioural, electrophysiological, and functional imaging data from his own lab and others, Professor Obleser will take stock of the evidence: are top-down selective-attention abilities indeed a stable, trait-like feature of the individual listener, with predictable decline in older adults? And, what are we really getting from our current go-to neural measures of auditory attention, speech tracking aka 'neural entrainment' versus alpha-power fluctuations? Luckily, Professor Obleser will probably be out of time as the talk reaches the main question: what are we measuring when we measure auditory attention?

Professor Jonas Obleser, University of Lübeck, Germany

Professor Jonas Obleser, University of Lübeck, Germany

Jonas Obleser studies processes of auditory cognition and neuroscience. Since 2016, he has been Chair of Physiological Psychology at the University of Lübeck, Germany. After training and a PhD in Psychology at the University of Konstanz, he worked at the Institute of Cognitive Neuroscience, University College London, as well as at the Max Planck Institute in Leipzig where he set up the Research group 'Auditory Cognition'. His current research interests include neural oscillations in sensation, perception and cognition as well as executive functions like attention and memory, and how these processes interface neurally in human listeners. His research is currently being funded by the European Research Council (ERC).

A fundamental assumption in attention research is that, since processing resources are limited, the core function of attention is to manage these resources and allocate them among concurrent stimuli or tasks, according to current behavioural goals and environmental needs. However, despite decades of research, we still do not have a full characterisation of the nature these processing limitations, or ‘bottlenecks’ – ie what processes can be in performed in parallel and where the need for attentional selection kicks in. This question is particularly pertinent in the auditory system, which has been studied far less extensively than the visual system, and is proposed to have a wider capacity for parallel processing of incoming stimuli.

In this talk Dr Golumbic will discuss a series of experiments studying the depth of processing applied to task-irrelevant sounds and their neural encoding in auditory cortex. She will look at how this is affected by the acoustic properties, temporal structure, and linguistic structure of unattended sounds, as well as by overall acoustic load and task demands, in attempt to understand what levels suffer most from processing bottlenecks. In addition, she will discuss what we can learn about the capacity of parallel processing of auditory stimuli from pushing the system to its limits and requiring the division of attention among multiple concurrent inputs.

Dr Elana Golumbic, Bar Ilan University, Israel

Dr Elana Golumbic, Bar Ilan University, Israel

Elana Zion Golumbic is a Senior Lecturer at the Multidisciplinary Center for Brain Research at Bar Ilan University, where she heads the Human Brain Dynamics Laboratory. Her main research interest is studying how the brain processes dynamic information under real-life conditions and environments. Research in the Human Brain Dynamics lab focuses on understanding the neural mechanisms underlying the processing of natural continuous stimuli, such as speech and music, on-line multisensory integration and focusing attention on one particular speaker in noisy and cluttered environments. Research in her lab utilises a range of techniques for recording electric and magnetic signals from the human brain (EEG, MEG and ECoG), as well as advanced psychophysical tools (eye-tracking, virtual reality, psychoacoustics). This rich methodological repertoire allows studying the system at multiple levels, and to gain a wide perspective on the link between Brain and Behaviour.

Auditory attention is a crucial component of real-life listening and is required, for instance, to enhance a particularly relevant aspect of a sound or to separate a sound of interest from noisy backgrounds. When listening to simple tones, attending to a certain frequency range induces a rapid and specific adaptation of neuronal tuning, which ultimately results in enhanced processing of that frequency range and suppression of the other frequencies. But which are the neural mechanisms enabling attentive selection and enhancement when listening to complex real-life sounds and scenes? At which levels of neural sound representation does attention operate? And how do these mechanisms depend on the specific behavioural requirements? High-resolution fMRI and computational modelling of sound representations both provide a relevant contribution to address these questions. Sub-millimetre fMRI enables distinguishing the activity and connectivity of neuronal populations across cortical layers non-invasively in humans (laminar fMRI). This is required for disentangling feedforward/feedback processing in primary and non-primary auditory areas and the communication between auditory and other areas (eg frontal areas). Modelling of sound representations allows formulating well-defined hypotheses on the nature of simple and complex features processed in the network of auditory areas and how the neural sensitivity for these features is affected by attention and behavioural task demands. The combination of laminar fMRI and sound representation models is thus ideally positioned to unravel the neural circuitry and the computational architecture of auditory attention in naturalistic listening scenarios.

Professor Elia Formisano, Maastricht University, The Netherlands

Professor Elia Formisano, Maastricht University, The Netherlands

Elia Formisano is Professor of Analysis methods in Neuroimaging and Scientific Director of the Maastricht Brain Imaging Center (MBIC). He is principal investigator of the Auditory Cognition research group at the Department of Cognitive Neuroscience, Maastricht University and principal investigator of the research line Computational Biology of Neural and Genetic Systems at the Maastricht Centre for Systems biology (MaCSBio). 

His research aims at discovering the neural basis of human auditory perception and cognition by combining multimodal functional neuroimaging with methods of advanced signal analysis and computational modelling. He pioneered the use of functional MRI at ultra-high magnetic field and machine learning for the investigation of human audition.

Professor Johnsrude and colleagues have previously demonstrated that, whereas the pattern of brain (fMRI) activity elicited by clearly spoken sentences does not seem to depend on attention, patterns are markedly different when attending or not to highly intelligible but degraded (6-band noise vocoded) sentences (Wild et al, J Neurosci, 2012). They have replicated and extended this work to sentences that, although slightly degraded (12-band noise vocoded), can be reported word-for-word with 100% accuracy. Even for these very intelligible materials, a marked dissociatation was observed in patterns of brain activity when people attended to these compared to when they were performing a multiple object tracking task. Furthermore, in both of these experiments, memory for degraded items was enhanced by attention, whereas memory for clear sentences was not, suggesting that even perfectly intelligible but degraded sentences are processed in a qualitatively different, attentionally gated, way, compared to clear sentences. Supported by a Canadian Institutes of Health Research operating grant (MOP 133450) and Canadian Natural Sciences and Engineering Research Council Discovery grant (3274292012).

Professor Ingrid Johnsrude, Western University, Canada

Professor Ingrid Johnsrude, Western University, Canada

Dr Johnsrude (PhD McGill) is Professor and Western Research Chair at Western University. She trained as a clinical neuropsychologist but for the last 20 years has been using neuroimaging (particularly EEG and fMRI) and psychoacoustic methods to study the importance of knowledge and attention in guiding auditory and speech perception. Dr Johnsrude is the author of more than 100 peer-reviewed publications which have been cited nearly 19700 times (Google Scholar). She has won multiple awards for her research, including the EWR Steacie Fellowship (2009) from the Natural Sciences and Engineering Research Council of Canada. She lives in London, Canada with her husband and two children.