Gesture and Speech in interaction
"Broadening perspectives, integrating views"
GeSpIn is an interdisciplinary event for researchers working on the interaction between speech and visual communicative signals, such as articulatory, manual, and bodily gestures co-occurring with speech. At GeSpIn 2023 we hope to bring together researchers working on visual signals together with vocalization or speech, from multidisciplinary perspectives in order to exchange ideas and present the cutting edge of their field. This 8th edition of GeSpIn will be held in Nijmegen, the Netherlands and will focus on the theme of “Broadening Perspectives, Integrating Views: Towards General Principles of Multimodal Signaling Systems”.
As such, we encourage researchers working on (multimodal) prosody, social anthropology, philosophy, (psycho)linguistics, psychology, cognitive science, neuroscience, human movement science, computer science (e.g., human-computer interaction), comparative biology, and more to submit their research to address topics such as:
Please note that all researchers and theoreticians/philosophers working on the interaction between gesture/visual and sound-producing cues (e.g., in terms of pragmatics, prosody, semantics) should feel invited, also if their particular study does not fit these topics exactly.
Hans Rutger Bosker
Linda Drijvers
Marieke Hoetjes
Judith Holler
Lieke van Maastricht
Ivy Mok
Ezgi Mamus
Asli Ozyurek
Nuria Esteve
Gibert investigates language acquisition in infancy and childhood, both
in typical and atypical populations. She is particularly interested in
how speech prosody interacts with body movements in the expression and
comprehension of linguistic meaning. Nuria Esteve Gibert has an
experimental approach, using behavioral tasks and eye-tracking
methodologies.
Yifei He works as a postdoc researcher at the Translational Neuroimaging Lab, Philipps University Marburg. He is primarily interested in the underlying brain mechanisms of how gesture interacts and integrates with speech during online processing in both healthy and clinical populations. He also investigates sentence processing, speech perception, and action perception. These research questions were mainly answered through EEG, fMRI, simultaneous EEG-fMRI, and behavioral methods.
Susanne Fuchs investigates the biopsychosocial foundations of human interaction and focuses specifically on physiological processes, such as breathing and motor control.
Her main areas of interests are:
1) The interplay between motion, breathing and cognition,
2) Speech preparation and pauses,
3) Multimodality and iconicity,
4) Biological and social aspects shaping individual behaviour in speech production and perception.
She uses manifold techniques, among them optitrack, inductance plethysmography, electropalatography and intraoral pressure sensors.
Franz Goller
studies the behavioral physiology of sound production and song learning
in birds. Current projects focus on 1) physical mechanisms of sound
production; 2) the motor coordination between all motor systems involved
in singing; 3) coordination between vocal and visual displays (i.e.,
multimodal signaling); 4) motor aspects of vocal development; 5)
acoustic models and song syntax; 6) energetics of song production. The
integrative aspects of these studies at the interface of neurobiology
and behavior provide a unique opportunity to bridge neural control of a
complex learned behavior to its evolutionary and ecological relevance in
the natural environment.
Multi-modal signaling is widespread among non-human animals and covers all functional aspects of communication behaviors. A diverse array of sensory modalities is used for communication, and I will highlight a few of the most remarkable multimodal display behaviors. After this overview, a few examples will be presented in which integration of auditory and visual communication signals has been studied from the perspective of neural control. Detailed understanding of the neuromuscular control strategies of producing two independent challenging signals simultaneously allows inferences about the selection scenarios leading to complex displays. Comparative analyses provide additional insights into the evolution of multimodal signals, as will be shown with a few examples. The review of studies of non-human animal multimodal signaling illustrates a remarkable diversity, which provides a feature landscape with highly extreme display characteristics. This landscape facilitates comparative assessment of human multimodal communication from the perspective of proximate and ultimate mechanisms.
Early-bird |
Standard |
|||
|---|---|---|---|---|
| Student | Regular | Student | Regular | |
| Registration | €65 | €90 | €115 | €140 |
| Conference dinner | €30 | €50 |
Early-bird registration deadline: July 12 2023
Standard registration deadline: August 31 2023
If you need financial assistance in order to attend the conference, you can apply for a travel grant. We have funding available for 4 travel grants of 500 euros each, one of which is a Donders Institute Travel Grant, kindly provided by the Donders Institute for Brain, Cognition, and Behaviour.
Deadline: June 30 2023 (anywhere in the world).
You will be notified of the outcome before the early bird registration deadline of July 12. If demand exceeds availability, priority will be given to presenting authors (oral or poster).
Contributors are invited to submit either an abstract (1 page + 1 page for figures and references) or a 6-page paper. The 6-page proceedings papers will be published in the online proceedings (and will be indexable and will have doi's). Please, also note that either type of submission (abstract or paper) can lead to an acceptance for a talk or a poster, without favour being given to a poster or paper during review or acceptance/selection.
MS Word templates are available for the 2-page abstract and 6-page proceedings paper. A LaTeX template is available for the 6-page proceedings paper. Click the image or follow the link HERE to download the package (note that it will download a .zip file).
GeSpIn 2023 will take place on the Radboud campus in Nijmegen. The oral and poster sessions will take place in the Max Planck Institute for Psycholinguistics, Wundtlaan 1, 6525 XD, Nijmegen.
You can use this map to find the main conference venue, but also suggestions for hotels and restaurants in Nijmegen.
We kindly ask everyone to think of the environment and travel by train when possible. We of course understand this may not be possible for everyone, for various reasons. In that case we encourage you to donate to carbon offsetting sites. For more information: The Best Carbon Offset Programs for 2023.
You can use website 9292 (also as an app) to find information about local trains and buses, including timetables, fares and up-to-date information.
Seat 61 and NS International are useful sites for booking international train travel. For local trains, you can use NS (available also as an app) or 9292.
The nearest airports to Nijmegen are Schiphol and Eindhoven (Netherlands), and Dusseldorf and Weeze (Germany). Nijmegen is about 90 minutes by train from each of these airports.
For information about local bus services, use 9292.