Visual Communication. Theoretical, Empirical, and Applied Perspectives (ViCom) (SPP 2392)
Termin:
01.09.2021
Fördergeber:
Deutsche Forschungsgemeinschaft (DFG)
In March 2021, the Senate of the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) established the Priority Programme "Visual Communication. Theoretical, Empirical, and Applied Perspectives (ViCom)" (SPP 2392). The programme is designed to run for six years. The present call invites proposals for the first three-year funding period.
The overall goal of ViCom is to investigate the special features and linguistic significance of visual communication. Central fields of interest are sign languages as fully developed natural languages and visual means that enhance spoken language such as pointing and other manual and non-manual gestures, as well as further visual strategies as in pictures, comics or films where the use of linguistic methodology seems promising.
With a focus on developing linguistic theory, ViCom strives to bring together different research foci and the joint expertise of communities which usually work on similar research objects, but without a great deal of interaction. The Priority Programme addresses researchers in linguistics, semiotics, psychology, neuroscience, philosophy, animal communication, visual studies, computational linguistics, didactics and related fields who seek to advance our understanding of the linguistics of visual and multimodal communication by
o formulating formally explicit models of the linguistic structures and cognitive mechanisms underlying visual communication, and
o testing these models using different empirical methods, or
o by developing new applications in technological, therapeutic, and didactic environments to improve the usage of visual communication in these areas.
Visual communication is a young and developing field in theoretical linguistic research and to date visual phenomena have been analysed by applying the linguistic vocabulary originally established for spoken languages. It is now becoming evident that the formal linguistic repertoire can fruitfully be applied to other fields and domains but that it also needs to be extended to meet the specific requirements of visual communication. This is due to the fact that visual phenomena are often different in nature from spoken language phenomena, which form the main basis of most linguistic research. Visual input, for example, is often more iconic than auditory material. ViCom bridges the gap from these new dynamics in theoretical linguistics to other disciplines, where the investigation of visual communication phenomena has a longstanding tradition.
All research activities within ViCom adopt the following three perspectives, which form the basic pillars of the Priority Programme and determine its main objectives:
o Theoretical perspective: ViCom aims at unifying recent theoretical research on all aspects of communication in the visual modality. The main aim is to develop new theories that are prepared to meet the specific needs of visual phenomena to cover different phenomena of gesture, sign language, pictorial linguistics, and other visual communication phenomena.
o Empirical perspective: ViCom aims at bringing together researchers from different fields to gather new comprehensive empirical knowledge about the different kinds of phenomena in visual communication across disciplines. Empirical advances include multimodal corpus studies, motion capture studies as well as psycho- and neurolinguistic studies on the acquisition, production, and comprehension of multimodal communication in different settings.
o Applied perspective: ViCom aims at improving the utilisation of sign language and gestures in different therapeutic and didactic settings. Additionally, ViCom hopes to contribute to the development of multimodal corpora including the integration of motion tracking technologies, automatic annotation programmes, gesture and sign recognition/generation systems, and human-computer interaction systems.
Adopting these three perspectives in research has already yielded accounts for certain aspects of visual communication and there is clearly potential in these approaches which can be exploited in future work.
We expect ViCom to bring about major progress in the analysis of visual communication in the following respects:
o Developing new theories to capture multimodality in comprehensive models of human communication as well as linguistic and non-linguistic aspects of visual communication, in particular cross-modal formal and cognitive theories that properly deal with gestural meaning contributions and the modality-specific interaction of gestures and sign languages as well as gesture and spoken languages.
o Developing new formal tools and extending the existing formal apparatus to account for iconic, demonstration-based and sociolinguistic components of multimodal communication.
o Comparing different linguistic and non-linguistic domains of visual communication that rely on iconicity as one important component and crucially make use of certain management systems to regulate, for instance, viewpoint and co-reference.
o Designing and conducting new experimental studies on the syntactic and semantic interaction of language and gesture and the acquisition of the form and meaning of gestures.
o Designing and conducting new corpus-based studies on the interaction of gesture with typologically different spoken and sign languages.
o Advancing empirical and experimental methodology to gain new empirical evidence to prove or challenge aspects of existing theories on visual communication in human and animal communication.
o Integrating theories of animal communication to develop new formal models that can also address evolutionary aspects of human language by applying an innovative combination of different research traditions.
o Developing new didactic theories and tools as well as new computational systems which are capable of transferring research findings on visual communication to digital learning settings or virtual world environments.
The scientific ambition of ViCom is best met by a broad collaboration involving researchers from different disciplines such as linguistics, semiotics, psychology, neuroscience, philosophy, animal communication, visual studies, computational linguistics and didactics. To accomplish its ambitious scientific goals, ViCom implements a well-balanced, extensive suite of individual measures to support diversity, networking and dissemination, and to ensure the success of especially female, Deaf, and early career researchers. Early career researchers are explicitly encouraged to submit proposals.
For scientific enquiries please contact the Priority Programme coordinator:
Professor Dr. Cornelia Ebert
Goethe-Universität Frankfurt am Main
Fachbereich Neuere Philologien
Institut für Linguistik
Norbert-Wollheim-Platz 1, 60323 Frankfurt
phone +49 69 798 32394
contact@vicom.info
Questions on the DFG proposal process can be directed to:
Programme contact:
Dr. Helga Weyerts-Schweda, phone +49 228 885-2046, helga.weyerts-schweda@dfg.de
Administrative contact:
Heike Kuhn, phone +49 228 885-2593, heike.kuhn@dfg.de
Further information:
https://www.dfg.de/foerderung/info_wissenschaft/2021/info_wissenschaft_21_45
The overall goal of ViCom is to investigate the special features and linguistic significance of visual communication. Central fields of interest are sign languages as fully developed natural languages and visual means that enhance spoken language such as pointing and other manual and non-manual gestures, as well as further visual strategies as in pictures, comics or films where the use of linguistic methodology seems promising.
With a focus on developing linguistic theory, ViCom strives to bring together different research foci and the joint expertise of communities which usually work on similar research objects, but without a great deal of interaction. The Priority Programme addresses researchers in linguistics, semiotics, psychology, neuroscience, philosophy, animal communication, visual studies, computational linguistics, didactics and related fields who seek to advance our understanding of the linguistics of visual and multimodal communication by
o formulating formally explicit models of the linguistic structures and cognitive mechanisms underlying visual communication, and
o testing these models using different empirical methods, or
o by developing new applications in technological, therapeutic, and didactic environments to improve the usage of visual communication in these areas.
Visual communication is a young and developing field in theoretical linguistic research and to date visual phenomena have been analysed by applying the linguistic vocabulary originally established for spoken languages. It is now becoming evident that the formal linguistic repertoire can fruitfully be applied to other fields and domains but that it also needs to be extended to meet the specific requirements of visual communication. This is due to the fact that visual phenomena are often different in nature from spoken language phenomena, which form the main basis of most linguistic research. Visual input, for example, is often more iconic than auditory material. ViCom bridges the gap from these new dynamics in theoretical linguistics to other disciplines, where the investigation of visual communication phenomena has a longstanding tradition.
All research activities within ViCom adopt the following three perspectives, which form the basic pillars of the Priority Programme and determine its main objectives:
o Theoretical perspective: ViCom aims at unifying recent theoretical research on all aspects of communication in the visual modality. The main aim is to develop new theories that are prepared to meet the specific needs of visual phenomena to cover different phenomena of gesture, sign language, pictorial linguistics, and other visual communication phenomena.
o Empirical perspective: ViCom aims at bringing together researchers from different fields to gather new comprehensive empirical knowledge about the different kinds of phenomena in visual communication across disciplines. Empirical advances include multimodal corpus studies, motion capture studies as well as psycho- and neurolinguistic studies on the acquisition, production, and comprehension of multimodal communication in different settings.
o Applied perspective: ViCom aims at improving the utilisation of sign language and gestures in different therapeutic and didactic settings. Additionally, ViCom hopes to contribute to the development of multimodal corpora including the integration of motion tracking technologies, automatic annotation programmes, gesture and sign recognition/generation systems, and human-computer interaction systems.
Adopting these three perspectives in research has already yielded accounts for certain aspects of visual communication and there is clearly potential in these approaches which can be exploited in future work.
We expect ViCom to bring about major progress in the analysis of visual communication in the following respects:
o Developing new theories to capture multimodality in comprehensive models of human communication as well as linguistic and non-linguistic aspects of visual communication, in particular cross-modal formal and cognitive theories that properly deal with gestural meaning contributions and the modality-specific interaction of gestures and sign languages as well as gesture and spoken languages.
o Developing new formal tools and extending the existing formal apparatus to account for iconic, demonstration-based and sociolinguistic components of multimodal communication.
o Comparing different linguistic and non-linguistic domains of visual communication that rely on iconicity as one important component and crucially make use of certain management systems to regulate, for instance, viewpoint and co-reference.
o Designing and conducting new experimental studies on the syntactic and semantic interaction of language and gesture and the acquisition of the form and meaning of gestures.
o Designing and conducting new corpus-based studies on the interaction of gesture with typologically different spoken and sign languages.
o Advancing empirical and experimental methodology to gain new empirical evidence to prove or challenge aspects of existing theories on visual communication in human and animal communication.
o Integrating theories of animal communication to develop new formal models that can also address evolutionary aspects of human language by applying an innovative combination of different research traditions.
o Developing new didactic theories and tools as well as new computational systems which are capable of transferring research findings on visual communication to digital learning settings or virtual world environments.
The scientific ambition of ViCom is best met by a broad collaboration involving researchers from different disciplines such as linguistics, semiotics, psychology, neuroscience, philosophy, animal communication, visual studies, computational linguistics and didactics. To accomplish its ambitious scientific goals, ViCom implements a well-balanced, extensive suite of individual measures to support diversity, networking and dissemination, and to ensure the success of especially female, Deaf, and early career researchers. Early career researchers are explicitly encouraged to submit proposals.
For scientific enquiries please contact the Priority Programme coordinator:
Professor Dr. Cornelia Ebert
Goethe-Universität Frankfurt am Main
Fachbereich Neuere Philologien
Institut für Linguistik
Norbert-Wollheim-Platz 1, 60323 Frankfurt
phone +49 69 798 32394
contact@vicom.info
Questions on the DFG proposal process can be directed to:
Programme contact:
Dr. Helga Weyerts-Schweda, phone +49 228 885-2046, helga.weyerts-schweda@dfg.de
Administrative contact:
Heike Kuhn, phone +49 228 885-2593, heike.kuhn@dfg.de
Further information:
https://www.dfg.de/foerderung/info_wissenschaft/2021/info_wissenschaft_21_45