Multimodal research in focus in Hong Kong
By 11 -
Published 30 September 2014
http://www.lucs.lu.se/wp-content/uploads/2014/09/New-image1.jpgJana Holsanova has delivered a plenary talk entitled Reception of Multimodality: Applying eye-tracking methodology in multimodal research at the 7th International Conference on Multimodality organised by the English Department, Hong Kong Polytechnic University.AbstractThe aim of most producers and designers is to create an aesthetically appealing, effective and user-friendly multimodal text design that makes it easy for the user to find, process and understand information (Holsanova & Nord 2010). However, design is not only a product of the design process, an organized arrangement of one or more elements that has been created in order to serve a certain purpose. It can also be conceived of as a starting point for interpretation processes since it invites the user to a certain interaction (Holsanova 2010). Thus, multimodality can be studied from both a production and a reception perspective. Whereas the production aspect focuses on how information in multimodal messages is presented by the sign-maker or designer, the reception aspect emphasizes how multimodal messages are perceived by the users (Holsanova 2012). In my presentation, I will focus on the reception of multimodality and show how eye-tracking measurements, in combination with verbal protocols, interviews, comprehension tests and questionnaires, can be used in research on multimodality. I will summarise various application areas associated with the use of eye-tracking methodology, account for potentials and limitations of this methodology, and provide examples from eye-tracking studies focusing on the integration of various modes. I will argue that interdisciplinary framework and integrated methods are preferable when studying reception aspects of visual communication and multimodality (Holsanova 2014).
2024-04-24
Agneta Gulz was the scientific representative in the Swedish delegation (OECD-Education) at ISTP 2024
2024-04-17
Project funding from the Crafoord Foundation
2024-04-12
Gabriel Vogel defended his PhD-thesis, April 12, 2024
2024-04-04
Peter Gärdenfors i Filosofiska Podden med Mogensen & Tsapos
2024-03-19
Late news: Peter Gärdenfors medverkade i sista sändningen av Filosofiska rummet från Malmö