Breaking Out of the Lab: Measuring Real-Time Responses to Televised Political Content in Real-World Settings.
Real-time response (RTR) measurement is an important technique for analyzing human processing of electronic media stimuli. Although it has been demonstrated that RTR data are reliable and internally valid, some argue that they lack external validity. The reason for this is that RTR measurement is restricted to a laboratory environment due to its technical requirements. This paper introduces a smartphone app that 1) captures real-time responses using the dial technique and 2) provides a solution for one of the most important problems in RTR measurement, the (automatic) synchronization of RTR data. In addition, it explores the reliability and validity of mobile RTR measurement by comparing the real-time reactions of two samples of young and well-educated voters to the 2013 German televised debate. Whereas the first sample participated in a classical laboratory study, the second sample was equipped with our mobile RTR system and watched the debate at home. Results indicate that the mobile RTR system yields similar results to the lab-based RTR measurement, providing evidence that laboratory studies using RTR are externally valid. In particular, the argument that the artificial reception situation creates artificial results has to be questioned. In addition, we conclude that RTR measurement outside the lab is possible. Hence, mobile RTR opens the door for large-scale studies to better understand the processing and impact of electronic media content.
J ürgen M aier is a professor of political communication in the Department of Political Science at the University of Koblenz-Landau, Landau, Germany. J. F elix H ampe is a professor of corporate communication systems in the Department of Information System Research at the University of Koblenz-Landau, Koblenz, Germany. N ico J ahn is a research assistant in the Department of Information System Research at the University of Koblenz-Landau, Koblenz, Germany. The development of the mobile RTR system and the data collection for the smartphone study were supported by a grant from the Rhineland-Palatinate Ministry of Education for the Research Network "Communication, Media, and Politics" at the University of Koblenz-Landau [to J.M. and J. F. H.].
Jürgen
J
Maier
J ürgen M aier is a professor of political communication in the Department of Political Science at the University of Koblenz-Landau, Landau, Germany. J. F elix H ampe is a professor of corporate communication systems in the Department of Information System Research at the University of Koblenz-Landau, Koblenz, Germany. N ico J ahn is a research assistant in the Department of Information System Research at the University of Koblenz-Landau, Koblenz, Germany. The development of the mobile RTR system and the data collection for the smartphone study were supported by a grant from the Rhineland-Palatinate Ministry of Education for the Research Network "Communication, Media, and Politics" at the University of Koblenz-Landau [to J.M. and J. F. H.].
J Felix
JF
Hampe
J ürgen M aier is a professor of political communication in the Department of Political Science at the University of Koblenz-Landau, Landau, Germany. J. F elix H ampe is a professor of corporate communication systems in the Department of Information System Research at the University of Koblenz-Landau, Koblenz, Germany. N ico J ahn is a research assistant in the Department of Information System Research at the University of Koblenz-Landau, Koblenz, Germany. The development of the mobile RTR system and the data collection for the smartphone study were supported by a grant from the Rhineland-Palatinate Ministry of Education for the Research Network "Communication, Media, and Politics" at the University of Koblenz-Landau [to J.M. and J. F. H.].
Nico
N
Jahn