Continuous Emotional Responding to Audio, Video, and Audiovisual Sensory Channels during Television Viewing
DOI:
https://doi.org/10.58997/smc.v28i1.55Abstract
An experiment was conducted to examine the independent and interactive influence of the audio and visual channels of information in television on viewers’ emotional experience. Audio-only, video-only, and audiovisual television content was presented as psychological stimuli, while participants completed continuous-response measures (CRMs) to index over-time changes in emotional experience of positive valence, negative valence, and arousal. Positive valence and arousal means were significantly influenced by channel over time. Participants reported the most positive emotional experience during audiovisual exposure. The channel and time interaction did not significantly affect negative valence ratings. However, positive valence, negative valence, and arousal ratings were significantly influenced by the interaction of channel and specific message content.
References
Baddeley, A. D. (2006). Working memory: An overview. In S. J. Pickering (Ed.), Working memory and education (pp. 1-31). New York: Academic Press.
Barrett, L. F., Mesquita, B., Ochsner, K. N., & Gross, J. J. (2007). The experience of emotion. Annual Review of Psychology, 58, 373-403.
Baumgartner, H., Sujan, M., & Padgett, D. (1997). Patterns of affective reactions to advertisements: The integration of moment-to-moment responses into overall judgments. Journal of Marketing Research, 34(2), 219-232.
Berntson, G. G., & Cacioppo, J. T. (2000). Psychobiology and social psychology: Past, present and future. Personality and Social Psychology Review, 4, 3-15.
Biocca, F., David, P., & West, M. (1994). Continuous response measurement (CRM): A computerized tool for research on the cognitive processing of communication messages. In A. Lang (Ed.), Measuring psychological responses to media messages (pp. 15-65). Hillsdale, NJ: Lawrence Erlbaum Associates.
Bolls, P. D. (2002). I can hear you, but can I see you? The use of visual cognition during exposure to high-imagery radio advertisements. Communication Research, 29(5), 537563.
Bolls, P. D., Lang, A., & Potter, R. F. (2001). The effects of message valence and listener arousal on attention, memory, and facial muscular responses to radio advertisements. Communication Research, 28(5), 627-651.
Bradley, M. M., Codispoti, M., Cuthbert, B. N., & Lang, P. J. (2001). Emotion and motivation I: Defensive and appetitive reactions in picture processing. Emotion, 1(3), 276-298.
Breedlove, S. M., Rosenzweig, M. R., & Watson, N. V. (2010). Biological psychology: An 20 introduction to behavioral, cognitive, and clinical neuroscience (6th ed.). Sunderland, MA: Sinauer Associates.
Cacioppo, J. T., & Berntson, G. G. (1994). Relationship between attitudes and evaluative space: A critical review, with emphasis on the separability of positive and negative substrates. Psychological Bulletin, 115(3), 401-423.
Cacioppo, J. T., & Gardner, W. L. (1999). Emotion. Annual Review of Psychology, 50, 191-214.
Creeber, G. (2008). The television genre book (2nd ed.). London, UK: Palgrave Macmillan. Cuthbert, B. N., Bradley, M. M., & Lang, P. J. (1996). Probing picture perception: Activation and emotion. Psychophysiology, 33(2), 103-111.
Damasio, A. R. (1999). The feeling of what happens: Body and emotion in the making of consciousness. New York: Harcourt Brace.
Davidson, R. J. (2000). Affective style, psychopathology, and resilience: Brain mechanisms and plasticity. American Psychologist, 55(11),1196-1214.
Davidson, R. J., & Fox, N. A. (1988). Cerebral asymmetry and emotion: Developmental and individual differences. In S. Segalowitz & D. Molfese (Eds.), Developmental implications of brain lateralization (pp. 191-206). New York: Guilford Press.
Detenber, B. H., & Lang, A. (2010). The influence of form and presentation attributes of media on emotion. In K. Döveling, C. von Scheve, & E. A. Konijn (Eds.), Handbook of emotions in mass media (pp. 275-293). New York: Routledge, Chapman & Hall.
Fahr, A. M., & Fahr, A., (2009). Reactivity of Real-Time Response Measurement: The influence of employing RTR techniques on processing media content. In J. Maier, M. Maier, V. Meyer, M. Maurer, & C. Reinemann (Eds.), Real-Time Response Measurement in the Social Sciences (pp. 45-61). Frankfurt: Peter Lang. 21
Hampson, P. J., & Morris, P. E. (1996). Understanding cognition. Cambridge, MA: Blackwell. Ito, T. A., Cacioppo, J. T., & Lang, P. J. (1998). Eliciting affect using the International Affective Picture System: Trajectories through evaluative space. Personality and Social Psychology Bulletin, 24(8), 855-879.
Ivory, J. D., & Kalyanaraman, S. (2007). The effects of technological advancement and violent content in video games on players’ feelings of presence, involvement, physiological arousal, and aggression. Journal of Communication, 57(3), 532-555.
Javis, B. G. (2004). MediaLab Research Software (Version 2004). New York: Empirisoft. Lang, A. (1991). Emotion, formal features, and memory for televised political advertisements. In F. Biocca (Ed.), Television and political advertising: Psychological processes (Vol. 1, pp. 221-243). Hillsdale, NJ: Lawrence Erlbaum Associates.
Lang, A. (1995). Defining audio/video redundancy from a limited-capacity information processing perspective. Communication Research, 22(1), 86-115.
Lang, A. (2000). The limited capacity model of mediated message processing. Journal of Communication, 50(1), 46-70.
Lang, A. (2006). Using the limited capacity model of motivated mediated message processing (LC4MP) to design effective cancer communication messages. Journal of Communication, 56(S1), S57-S80.
Lang, A., Bolls, P., Potter, R. F., & Kawahara, K. (1999). The effects of production pacing and arousing content on the information processing of television messages. Journal of Broadcasting & Electronic Media, 43(4), 451-475.
Lang, A., Bradley, S. D., Sparks, J. V., & Lee, S. (2007). The motivation activation measure (MAM): How well does MAM predict individual differences in physiological indicators of appetitive and aversive activation? Communication Methods and Measures, 1(2), 113136.
Lang, A., & Friestad, M. (1993). Emotion, hemispheric specialization, and visual and verbal memory for television messages. Communication Research, 20(5), 647-670.
Lang, A., Potter, R. F., & Bolls, P. D. (1999). Something for nothing: Is visual encoding automatic? Media Psychology, 1(2), 145-163.
Lang, A., Shin, M., & Lee, S. (2005). Sensation seeking, motivation, and substance use: A dual system approach. Media Psychology, 7(1), 1-29.
Lang, A., Zhou, S., Schwartz, N., Bolls, P. D., & Potter, R. F. (2000). The effects of edits on arousal, attention, and memory for television messages: When an edit is an edit can an edit be too much? Journal of Broadcasting & Electronic Media, 44(1), 94-109.
Lang, P. J. (1995). The emotion probe: Studies of motivation and attention. American Psychologist, 50(5), 372-385.
Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (1990). Emotion, attention, and the startle reflex. Psychological Review, 97(3), 377-395.
Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (1997). Motivated attention: Affect, activation, and action. In P. J. Lang, R. F. Simons, & M. Balaban (Eds.), Attention and orienting: Sensory and motivational processes (pp. 97-135). Hillsdale, NJ: Lawrence Erlbaum Associates.
Lang, P. J., Greenwald, M. K., Bradley, M. M., & Hamm, A. O. (1993). Looking at pictures: Affective, facial, visceral, and behavioral reactions. Psychophysiology, 30(3), 261-273. Leahy, W., & Sweller, J. (2011). Cognitive load theory, modality of presentation and the transient information effect. Applied Cognitive Psychology, 25(6), 943-951. 23
LeDoux J. E. (2002) Emotion, memory, and the brain. Scientific American, 12, 62-71.
Lee, S., & Lang, A. (2009). Discrete emotion and motivation: Relative activation in the appetitive and aversive motivational systems as a function of anger, sadness, fear, and joy during televised information campaigns. Media Psychology, 12(2), 148-170.
Mayer, R. E. (2009). Multimedia learning (2nd ed). New York: Cambridge University Press.
Mayer, R. E., & Johnson, C. I. (2008). Revising the redundancy principle in multimedia learning. Journal of Educational Psychology, 100(2), 380-386.
Moreno, R., & Mayer, R. E. (2002). Verbal redundancy in multimedia learning: When reading helps listening. Journal of Educational Psychology, 94(1), 156-163.
Morgane, P. J., Galler, J. R., & Mokler, D. J. (2005). A review of systems and networks of the limbic forebrain/limbic midbrain. Progress in Neurobiology, 75(2), 143-160.
Murphy, F. C., Nimmo-Smith, I., & Lawrence, A. D. (2003). Functional neuroanatomy of emotions: a meta-analysis. Cognitive, Affective, & Behavioral Neuroscience, 3(3), 207233.
Poels, K., & Dewitte, S. (2008). Getting a line on print ads: Pleasure and arousal reactions reveal an implicit advertising mechanism. Journal of Advertising, 37(4), 63-74.
Potter, R. F., & Choi, J. (2006). The effects of auditory structural complexity on attitudes, attention, and memory. Media Psychology, 8(4), 395-419.
Schneider, E. F., Lang, A., Shin, M., & Bradley, S. D. (2004). Death with a store: How story impacts emotional, motivational, and physiological responses to first-person shooter video games. Human Communication Research, 30(3), 361-375.
Sparks, J. V., & Lang, A. (2010). An initial examination of the post-auricular reflex as a physiological indicator of appetitive activation during television viewing. Communication Methods and Measures, 4(4), 311-330.
Sparks, J. V., Matthews, C., & Chung, S. (2011). The influence of arousal on encoding and storage of information in pleasant television messages. Southwestern Mass Communication Journal, 27(1), 45-56.
Sternberg, R. J. (2003). Cognitive theory (3rd ed.). Belmont, CA: Thomson Wadsworth. Tabbers, H. K., Martens, R. L., & Van Merriënboer, J. J. G. (2004). Multimedia instructions and cognitive load theory: Effects of modality and cueing. British Journal of Educational Psychology, 74(1), 71-81.
Tran, T. Q., Boring, R. L., Dudenhoeffer, D. D., Hallbert, B. P., Keller, M. D., & Anderson, T. M. (2007). Advantages and disadvantages of physiological assessment for next generation control room design. Proceedings of the joint 8th IEEE conference on human factors and power plants and the 13rd annual workshop on human performance/root cause/trending/operating experience/self assessment. Monterey, CA.
Tsuchiya, N., & Adolphs, R. (2007). Emotion and consciousness. Trends in Cognitive Sciences, 11(4), 158-167.
Wang, Z., Lang, A., & Busemeyer, J. R. (2011). Motivational processing and choice behavior during television viewing: An integrative dynamic approach. Journal of Communication, 61(1), 71-93.
Weaver, J. B., III, Huck, I., & Brosius, H. B. (2009). Biasing public opinion: Computerized continuous response measurement displays impact viewers’ perceptions of media messages. Computers in Human Behavior, 25(1), 50-55.
Yegiyan, N. S., & Lang, A. (2010). Processing central and peripheral detail: How content arousal and emotional tone influence encoding. Media Psychology, 13(1), 77-99.
