Holsanova, J. (2005): What eye movement data reveal about integration of text, pictures and graphics.
In my presentation, I will focus on two on-going projects. The first one is an applied project conducted together with Nils Holmberg and Kenneth Holmqvist and concerns reading newspaper information graphics. We are interested in how people integrate text, picture and graphics and how we can use eye-movement data to study this process. Guided by the a number of principles from the semiotic, rhetorical and information-processing theory, we change the layout of information graphics and study how this affects eye movement patterns, in particular the reading time, the reading order, and the integration of text and graphics. The second project concerns perception and production in on-line text writing (cf Andersson et al. 2005). In co-operation with coleagues in linguistics and psycholinguistics, we study the dynamics of picture elicited writing by combining different methodologies: keystroke logging, eye tracking and retrospective protocol. In this way, we get a deeper insight into the attentional processes. In my talk, I will show some data, our analytical tools and describe -what I call - the 'semantic gaze line' analysis. In this project, I focus on how writers integrate information from the picture and from their previously written text in the process of on-line picture descriptions.