Publication Title
The cognitive effectiveness of subtitle processing
Publication Type
Journal article
Journal
Media Psychology
Year of publication
2010
Volume
13
Issue
3
Pages
243-272
Language(s)

English

Modalities
Abstract
In an experimental study, we analyzed the cognitive processing of a subtitled film excerpt by adopting a methodological approach based on the integration of a variety of measures: eye-movement data, word recognition, and visual scene recognition. We tested the hypothesis that the processing of subtitled films is cognitively effective: It leads to a good understanding of film content without requiring a significant tradeoff between image processing and text processing. Following indications in the psycholinguistic literature, we also tested the hypothesis that two-line subtitles whose segmentation is syntactically incoherent can have a disruptive effect on information processing and recognition performance. The results highlighted the effectiveness of subtitle processing: Regardless of the quality of line segmentation, participants had a good understanding of the film content, they achieved good levels of performance in both word and scene recognition, and no tradeoff between text and image processing was detected. Eye-movement analyses enabled a further characterization of cognitive processing during subtitled film viewing. This article discusses the theoretical implications of the findings for both subtitling and multiple-source communication and highlights their methodological and applied implications.
Submitted by Perego Elisa on Tue, 08/01/2019 - 16:32