Commenter and News Source Credibility: Roles of News Media Literacy, Comment Argument Strength and Civility
DOI:
https://doi.org/10.58997/smc.v36i1.81Abstract
Many news websites allow for audience comments, but there is concern, especially when these comments are negative or low-quality, that the comments could negatively influence how readers perceive the corresponding news story. This experiment explores whether quality characteristics of comments – argument strength and civility – could help improve the perceived credibility of news content. Further, the study looks at whether quality characteristics of audience members, like their level of news media literacy, might reduce the negative influence of low-quality comments on someone’s perception of the credibility of the story. The findings reveal that higher quality comments lead to improved perceptions of the credibility of the news source, even when the comments criticize the journalist. Additionally, the study finds that individuals with higher levels of news media literacy are more capable of distinguishing the quality of journalist content from user-generated content.
References
Anderson, A.A., Brossard, D., Scheufele, D.A., Xenos, M.A., & Ladwig, P. (2014). The “Nasty Effect:” Online Incivility and Risk Perceptions of Emerging Technologies. Journal of Computer-Mediated Communication, 19(2014), 373-387.
Anderson, A.A., Yeo, S.K., Brossard, D., Scheufele, D.A., & Xenos, M.A. (2016). Toxic Talk: How Online Incivility Can Undermine Perceptions of Media. International Journal of Public Opinion Research, 30(1), 156-168.
Areni, C. S., & Lutz, R. J. (1988). The role of argument quality in the Elaboration Likelihood Model. Advances in Consumer Research, 15, 197-203.
Ashley, S., Maksl, A., & Craft, S. (2013). Developing a News Media Literacy Scale. Journalism & Mass Communication Educator, 68(1), 7-21.
Ashley, S., Maksl, A., & Craft, S. (2017). News Media Literacy and Political Engagement: What’s the Connection? Journal of Media Literacy Education, 9(1), 79-98.
Bardac, J.J. (1986). Threats to generalization in the use of elicited, purloined, and contrived messages in human communication research. Communication Quarterly, 34(1), 55-65.
Braun, J., & Gillespie, T. (2011). Hosting the Public Discourse, Hosting the Public: When online news and social media converge. Journalism Practice, 5(4), 383-398.
Chen, G. M., & Lu, S. (2017). Online political discourse: Exploring differences in effects of civil and uncivil disagreement in news website comments. Journal of Broadcasting & Electronic Media, 6(1), 108-125.
Flanagin, A.J., & Metzger, M.J. (2008). The role of site features, user attributes and information verification behaviors, on the perceived credibility of web-based information. New Media & Society, 9(2), 319-342.
Graf, J., Erba, J., & Harn, R-W. (2017). The role of civility and anonymity on perceptions of online comments. Mass Communication & Society, 20(4), 526-549.
Hayes, A. F. (2013). Introduction to mediation, moderation, and conditional process analysis: A regression-based approach. Guilford Press.
Herbst, S. (2010). Rude Democracy: Civility and Incivility in American Politics. Philadelphia, PA: Temple University Press.
Hermida, A. (2011). Mechanisms of Participation: How audience options shape the conversation. In J. Singer, A. Hermida, D. Domingo, A. Heinonen, S. Paulussen, T. Quandt, Z. Reich, & M. Vujnovic (Eds.) Participatory Journalism: Guarding open gates at online newspapers. Malden, MA: Wiley-Blackwell.
Hmielowski, J. D., Hutchens, M. J., & Cicchirillo, V. J. (2014). Living in an age of online incivility: Examining the conditional indirect effects of online discussion on political flaming. Information, Communication & Society, 17(10), 1196-1211.
Hobbs, R. (2008). Debates and challenges facing new literacies in the 21st century. In S. Livingstone & K. Drotner (Eds.) International handbook of children, media and culture. London: Sage Publications.
Hobbs, R., & Jensen, A. (2009). The Past, Present, and Future of Media Literacy Education. Journal of Media Literacy Education, 1(1), 1-11.
Hwang, H., Kim, Y., & Huh, C.U. (2014). Seeing is believing. Effects of uncivil online debate on political polarization and expectations of deliberation. Journal of Broadcasting & Electronic Media, 58(4), 621-633.
Hwang, H., Kim, Y., & Kim, Y. (2018). Influence of discussion incivility on deliberation: An examination of the mediating role of moral indignation. Communication Research, 45(2), 213-240.
Hovland, C. and Weiss, W. (1951). The Influence of Source Credibility on Communication Effectiveness. Public Opinion Quarterly, 15(4), 635-650.
Jeong, S., Cho, H., & Hwang, Y. (2012). Media Literacy Interventions: A Meta-Analytic Review. Journal of Communication, 62, 454-472.
Kahne, J., Lee, N., & Feezell J.T. (2012). Digital Media Literacy Education and Online Civic and Political Participation. International Journal of Communication, 6, 1-24.
Kraker, J.D., Kuijs, S., Cörvers, R., & Offermans, A. (2014). Internet public opinion on climate change: a world views analysis of online reader comments. International Journal of Climate Change Strategies and Management, 6(1), 19-33
Ksiazek, T.B., Peer, L., & Zivic, A. (2015). Discussing the News. Digital Journalism, 3(6), 850-870.
Lai Ku, K.Y., Kong, S.Q., Song, Y., Deng, L.P., Kang, Y., & Hu, A. (in press). What predictions adolescents’ critical thinking about real-life news? The roles of social media news consumption and news media literacy. Thinking Skills and Creativity.
Lee, E.J., & Jang, Y.J. (2010). What do others’ reactions to news on internet portal sites tell us? Effects of presentation format and readers’ need for cognition on reality perception. Communication Research, 37(6), 825-846.
Lee, E. (2012). That’s not the way it is: How user-generated comments on the news affect perceived media bias. Journal of Computer-Mediated Communication, 18, 32-45.
Lee, E., & Jang, Y.J. (2010). What do others’ reactions to news on Internet portal sites tell us? Effects of presentation format and readers’ need for cognition on reality perception. Communication Research, 37(6), 825-846.
Maksl, A., Ashley, S., & Craft, S. (2015). Measuring news media literacy. Journal of Media Literacy Education, 6(3), 29-45.
Martens, H. (2010). Evaluating Media Literacy Education: Concepts, Theories and Future Directions. Journal of Media Literacy Education 2(1), 1-22.
Metzger, M.J., & Flanagin, A.J. (Eds.) (2008). Digital media, youth, and credibility. Cambridge, MA: MIT Press.
Meyer, M.J. (2000). Liberal Civility and the Civility of Etiquette: Public Ideals and Personal Lives. Social Theory & Practice 26(1), 69-84.
Milhailidis, P. (2014). Media literacy and the emerging citizen: Youth, engagement and participation in digital culture. New York: Peter Lang.
Orwin, C. (1991). Civility. American Scholar 60(4), 553-564.
Papacharissi, Z. (2004). Democracy online: Civility, politeness, and the democratic potential of online political discussion groups. New Media & Society, 6(2), 259-283.
Potter, W.J. (2004). Theory of Media Literacy: A Cognitive Approach. Thousand Oaks, CA: Sage Publications.
Prochazka, F., Weber, P., & Schweiger, W. (2018). Effects of civility and reasoning in user comments on perceived journalistic quality. Journalism Studies, 19(1), 62-78.
Rains, S. A. (2007). The Impact of Anonymity on Perceptions of Source Credibility and Influence in Computer-Mediated Group Communication: A Test of Two Competing Hypotheses. Communication Research, 34, 100-125.
Reese, S. (2012). Global News Literacy: Challenges for the Educator. In P. Mihailidis (Ed.) News Literacy: Global perspectives for the newsroom and the classroom (pp. 63-80). New York: Peter Lang.
Rösner, L., Winter, S., & Krämer, N. C. (2016). Dangerous minds? Effects of uncivil online comments on aggressive cognitions, emotions, and behavior. Computers in Human Behavior, 58, 461-470.
Santana, A. (2011). Online Readers’ Comments Represent New Opinion Pipeline. Newspaper Research Journal, 32(3), 66-81.
Santana, A. (2014). Virtuous or Vitriolic. Journalism Practice, 8(1), 18-33.
Santana, A. D. (2015). Incivility dominates online comments on immigration. Newspaper Research Journal, 36(1), 92-107.
Schumann, D. W., Kotowski, M.R., Ahn, Ho-Young (Anthony), & Haugtvedt, C. P. (2012). The elaboration likelihood model: A 30-year review. In S. Rodgers & E. Thorson (Eds.), Advertising Theory (pp. 51-68). New York: Routledge.
Shi, R., Messaris, P., & Cappella, J.N. (2014). Effects of Online Comments on Smokers’ Perception of Antismoking Public Service Announcements. Journal of Computer-Mediated Communication, 19(2014), 975-990.
Tully, M., & Vraga, E. (2018). A mixed methods approach to examining the relationship between news media literacy and political efficacy. International Journal of Communication, 12(2018), 766-787.
Tully, M., Vraga, E., & Bode, L. (in press). Designing and testing news literacy messages for social media. Mass Communication and Society.
Tully, M., Vraga, E., & Smithson, A. (in press). News media literacy, perceptions of bias, and interpretation of news. Journalism.
von Sikorski, C., & Hänelt, M. (2016). Scandal 2.0: How valenced reader comments affect recipients’ perception of scandalized individuals and the journalistic quality of online news. Journalism & Mass Communication Quarterly, 93(3), 551-571.
Vraga, E.K., Tully, M., & Rojas, H. (2009). Media Literacy Training Reduces Perception of Bias. Newspaper Research Journal, 30(4), 68-81.
Vraga, E.K., Tully, M., Akin, H., & Rojas, H. (2012). Modifying perceptions of hostility and credibility of news coverage of an environmental controversy through media literacy. Journalism, 13(7), 942-959.
Walter, S., Brüggemann, M., & Engesser, S. (2018). Echo chambers of denial: Explaining user
comments on climate change. Environmental Communication, 12(2), 204-217.
Walther, J.B., DeAndrea, D., Kim, J., & Anthony, J.C. (2010). The Influence of Online Comments on perceptions of Antimarijuana Public Service Announcements on YouTube. Human Communication Research, 36(2010), 469-492.
Winter, S., Brückner, C., & Krämer, N. C. (2015). They came, they liked, they commented: Social influence on Facebook news channels. Cyberpsychology, Behavior, and Social Networking, 18(8), 431-436.
