<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20120330//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd">
<!--<?xml-stylesheet type="text/xsl" href="article.xsl"?>-->
<article article-type="research-article" dtd-version="1.2" xml:lang="en" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
<front>
<journal-meta>
<journal-id journal-id-type="issn">2634-0488</journal-id>
<journal-title-group>
<journal-title>Journal of Deliberative Democracy</journal-title>
</journal-title-group>
<issn pub-type="epub">2634-0488</issn>
<publisher>
<publisher-name>University of Westminster Press</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.16997/jdd.967</article-id>
<article-categories>
<subj-group>
<subject>Symposium</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Characterizing Disagreement in Online Political Talk: Examining Incivility and Opinion Expression on News Websites and Facebook in Brazil</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Rossini</surname>
<given-names>Patricia</given-names>
</name>
<email>patricia.rossini@liverpool.ac.uk</email>
<xref ref-type="aff" rid="aff-1">1</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Maia</surname>
<given-names>Rousiley C. M.</given-names>
</name>
<xref ref-type="aff" rid="aff-2">2</xref>
</contrib>
</contrib-group>
<aff id="aff-1"><label>1</label>University of Liverpool, UK</aff>
<aff id="aff-2"><label>2</label>Federal University of Minas Gerais, BR</aff>
<pub-date publication-format="electronic" date-type="pub" iso-8601-date="2021-04-23">
<day>23</day>
<month>04</month>
<year>2021</year>
</pub-date>
<pub-date pub-type="collection">
<year>2021</year>
</pub-date>
<volume>17</volume>
<issue>1</issue>
<fpage>90</fpage>
<lpage>104</lpage>
<history>
<date date-type="received" iso-8601-date="2019-02-06">
<day>06</day>
<month>02</month>
<year>2019</year>
</date>
<date date-type="accepted" iso-8601-date="2020-02-11">
<day>11</day>
<month>02</month>
<year>2020</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright: &#x00A9; 2021 The Author(s)</copyright-statement>
<copyright-year>2021</copyright-year>
<license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/4.0/">
<license-p>This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International License (CC-BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. See <uri xlink:href="http://creativecommons.org/licenses/by/4.0/">http://creativecommons.org/licenses/by/4.0/</uri>.</license-p>
</license>
</permissions>
<self-uri xlink:href="https://delibdemjournal.org/articles/10.16997/jdd.967/"/>
<abstract>
<p>This article examines the ways people engage in political conversation triggered by exposure to political news in two different informal platforms in Brazil: Facebook and news websites. We analyze the extent to which disagreement is associated to discursive traits that are commonly associated with deliberative behavior, such as directly engaging with others, and trying to justify one&#8217;s views, and negative traits, such as incivility. The contributions of this article can be summarized as follows. First, this article emphasizes the importance of looking beyond a single platform and a single topic to understand political discussion online. Second, we demonstrate that online disagreement is positively associated with both deliberative traits, such as justified opinion expression, and nondeliberative traits, such as incivility, and argue that the latter is not enough to dismiss the value of political talk. We also demonstrate that the topic of a news story is relevant both to drive political conversation and to spark political disagreement: controversies involving celebrities and stories covering international affairs are more likely to drive heterogeneous conversations than more conventional political topics (e.g., government, policy), even though these are the topics that tend to attract more political talk. Finally, this study contributes to fill an important gap in the literature, looking beyond the United States and Western European contexts by examining political talk in Brazil, the fourth largest digital market in the world.</p>
</abstract>
<kwd-group>
<kwd>political talk</kwd>
<kwd>disagreement</kwd>
<kwd>online discussion</kwd>
<kwd>incivility</kwd>
<kwd>deliberative system</kwd>
</kwd-group>
<funding-group specific-use="crossref">
<award-group>
<funding-source id="gs1" country="BRA">
<institution-wrap>
<institution>Coordena&#231;&#227;o de Aperfei&#231;oamento de Pessoal de N&#237;vel Superior&#8212;Brasil (CAPES)</institution>
<institution-id institution-id-type="doi" vocab="open-funder-registry" vocab-identifier="10.13039/open_funder_registry">10.13039/501100002322</institution-id>
</institution-wrap>
</funding-source>
</award-group>
</funding-group>
</article-meta>
</front>
<body>
<sec>
<title>Introduction</title>
<p>Talking about politics with family, friends, and acquaintances is a crucial activity in democratic societies, as it enables citizens to come together as a community and understand matters of public concern (<xref ref-type="bibr" rid="B4">Barber 2003</xref>; <xref ref-type="bibr" rid="B17">Conover &amp; Searing 2005</xref>; <xref ref-type="bibr" rid="B49">Mansbridge 1999</xref>; <xref ref-type="bibr" rid="B53">Neblo 2005</xref>). Along with sociability, there are intrinsic democratic benefits to everyday political talk, such as improving political knowledge; enabling citizens to rehearse, refine, and elaborate arguments and opinions; articulating personal and collective identities; and yielding meaning to daily facts (<xref ref-type="bibr" rid="B39">Huckfeldt &amp; Mendez 2008</xref>; <xref ref-type="bibr" rid="B42">Maia 2012</xref>; <xref ref-type="bibr" rid="B47">Maia et al. 2020a</xref>; <xref ref-type="bibr" rid="B48">Maia et al. 2020b</xref>; <xref ref-type="bibr" rid="B49">Mansbridge 1999</xref>; <xref ref-type="bibr" rid="B51">Moy &amp; Gastil 2006</xref>; <xref ref-type="bibr" rid="B71">Stromer-Galley &amp; Wichowski 2011</xref>; <xref ref-type="bibr" rid="B90">Xenos &amp; Moy 2007</xref>).</p>
<p>With the pervasive use of the internet and social media, everyday conversation is increasingly taking place online, ranging from inherently political environments&#8212;such as e-deliberation or e-participation platforms, political forums, and discussion boards&#8212;to social media and news websites (<xref ref-type="bibr" rid="B31">Graham 2012</xref>; <xref ref-type="bibr" rid="B44">Maia 2017</xref>; <xref ref-type="bibr" rid="B46">Maia &amp; Rezende 2016</xref>; <xref ref-type="bibr" rid="B64">Shah 2016</xref>; <xref ref-type="bibr" rid="B71">Stromer-Galley &amp; Wichowski 2011</xref>). Although few would question that the internet can foster political talk, scholars have been concerned with both the tone and the quality of these discussions as they consistently fail to live up to expected standards of public deliberation (<xref ref-type="bibr" rid="B8">Black et al. 2010</xref>; <xref ref-type="bibr" rid="B14">Coleman &amp; Blumler 2009</xref>; <xref ref-type="bibr" rid="B26">Freelon 2013</xref>; <xref ref-type="bibr" rid="B72">Stroud et al. 2014</xref>).</p>
<p>Social networking sites, such as Facebook, promote inadvertent exposure to heterogeneous information, which can also lead to political disagreement (<xref ref-type="bibr" rid="B6">Barnidge 2018</xref>; <xref ref-type="bibr" rid="B48">Maia et al. 2020b</xref>). The use of social media platforms may enable citizens to learn about others&#8217; views through their exposure to heterogeneous information, a core value of informal political discussion from the standpoint of deliberative democracy (<xref ref-type="bibr" rid="B17">Conover &amp; Searing 2005</xref>; <xref ref-type="bibr" rid="B32">Gutmann &amp; Thompson 1996</xref>; <xref ref-type="bibr" rid="B45">Maia 2018</xref>; <xref ref-type="bibr" rid="B52">Mutz 2006</xref>). Although many people might refrain from disagreeable conversations face-to-face, there is evidence that digital platforms can potentially provide a venue for engaging in such debates (<xref ref-type="bibr" rid="B70">Stromer-Galley, Bryant &amp; Bimber 2015</xref>; <xref ref-type="bibr" rid="B78">Vaccari et al. 2016</xref>; <xref ref-type="bibr" rid="B79">Valenzuela &amp; Bachmann 2015</xref>; <xref ref-type="bibr" rid="B86">Wojcieszak &amp; Mutz 2009</xref>).</p>
<p>In this study, we examine political conversation triggered by exposure to political news on Facebook and news websites in Brazil and investigate the discursive and contextual characteristics associated with expressions of disagreement. In particular, we analyze the presence of disagreement in different discussion platforms (Facebook and news websites), focusing on types of news stories that elicit heterogeneous discussions, and the extent to which disagreement is associated with deliberative behavior, such as providing justification for one&#8217;s views. Considering the widespread concern around incivility online, we also investigate the relationship between disagreement and uncivil discourse, building an argument to distinguish between incivility and intolerant behaviors. This distinction is important because one should not assume that incivility is necessarily incompatible with democratic interactions, whereas intolerance poses an inherent threat to pluralism and democratic conversations (<xref ref-type="bibr" rid="B60">Rossini 2019</xref>).</p>
<p>Adopting the premise that argumentative interactions, even if not fully deliberative in everyday communication, may enhance a deliberative system (<xref ref-type="bibr" rid="B59">Parkinson &amp; Mansbridge 2012</xref>), we argue that heterogeneous discussions online do not need to conform to high standards of political deliberation to be democratically relevant. Our results suggest that platforms hosting communication may influence the heterogeneity of discussion: comments are more likely to express disagreement on news websites than on Facebook. However, while expressions of disagreement posted on news websites address primarily news stories about formal politics, disagreements on Facebook focus on a wide range of story topics, suggesting that a more plural conversation occurs in online social networks. We find that disagreement is not a frequent feature of online political discussions, but, when it takes place, it tends to be associated with desirable discursive traits, such as reason-giving for one&#8217;s view and reciprocal replies. Taking into consideration the merits of heated debates for processing controversial issues, we argue that incivility underlying disagreement online may not be inherently problematic for democracy, insofar as divergence is expressed with a heated tone, but is not intolerant in substance.</p>
<p>Our study contributes to the understanding of online political talk as a process that is shaped and affected by distinct platforms, and suggests that the medium in which discussions take place influences the ways people express their political views. Moreover, this study suggests that more attention should be given to different types of disagreement, framed in terms of uncivil or intolerant expressions, to better understand the conditions and challenges for deliberative engagement in everyday discussions. Finally, by focusing on the Brazilian context, this study contributes to expand research on online political talk beyond English-speaking countries, which have been extensively scrutinized. Brazil has the fifth largest population and the fourth largest online population in the world&#8212;being the largest internet market in Latin America and one of the most active on social media<xref ref-type="fn" rid="n1">1</xref>&#8212;making it a relevant country to help understand the practice of online political talk in the Global South.</p>
</sec>
<sec>
<title>Informal Political Talk Online</title>
<p>The internet, with its many channels, increases the amount and the availability of political content, and provides its users with opportunities to engage in informal discussions about topics of public concern&#8212;a practice that is central to democratic citizenship (<xref ref-type="bibr" rid="B4">Barber 2003</xref>; <xref ref-type="bibr" rid="B19">Dewey 1927</xref>; <xref ref-type="bibr" rid="B33">Habermas 1996</xref>). These conversations among citizens are at the heart of a <italic>strong democracy</italic> (<xref ref-type="bibr" rid="B4">Barber 2003</xref>), crucial to building communities and negotiating conflict. In spite of being a primarily social activity, informal political talk enables citizens to clarify their own views, learn about what others around them think and feel, and understand the issues that their communities face (<xref ref-type="bibr" rid="B71">Stromer-Galley &amp; Wichowski 2011</xref>; <xref ref-type="bibr" rid="B81">Walsh, 2003</xref>).</p>
<p>Scholars have been scrutinizing the internet&#8217;s democratic potential and its ability to foster political talk for over two decades (<xref ref-type="bibr" rid="B14">Coleman &amp; Blumler 2009</xref>; <xref ref-type="bibr" rid="B15">Coleman &amp; Moss 2012</xref>; <xref ref-type="bibr" rid="B43">Maia 2014</xref>, <xref ref-type="bibr" rid="B45">2018</xref>; <xref ref-type="bibr" rid="B48">Maia et al. 2020b</xref>; <xref ref-type="bibr" rid="B71">Stromer-Galley &amp; Wichowski 2011</xref>). Given the characteristics of online communication, many scholars claim that it is unrealistic to expect that the deliberative criteria will be met in most political conversations online (<xref ref-type="bibr" rid="B15">Coleman &amp; Moss 2012</xref>; <xref ref-type="bibr" rid="B26">Freelon 2013</xref>). It is relevant to note that the demanding criteria of deliberation are rarely met in most political discussions&#8212;even in formal and structured forums designed to foster political debate (<xref ref-type="bibr" rid="B33">Habermas 1996</xref>; <xref ref-type="bibr" rid="B59">Parkinson &amp; Mansbridge 2012</xref>; <xref ref-type="bibr" rid="B67">Steiner 2012</xref>; <xref ref-type="bibr" rid="B68">Steiner et al. 2017</xref>). Thus, the lack of deliberative qualities is not enough to dismiss online political talk or prevent it from having positive political outcomes&#8212;such as increasing political knowledge, fostering shared values, and providing meaning on matters of public concern.</p>
<p>In this article, we turn our attention to disagreement as a key aspect of democratically relevant political talk. Exposure to, and engagement with, crosscutting perspectives is among one of the main characteristics of democratic deliberation: discussions should be inclusive of diverse views, and the goal of deliberation is to enable mutual recognition of diverse claims (<xref ref-type="bibr" rid="B22">Esterling, Fung &amp; Lee 2015</xref>). Esterling et al. have argued that &#8216;disagreement is at once a condition and a challenge for deliberation&#8217; (<xref ref-type="bibr" rid="B22">2015: 529</xref>), because while some people might welcome heterogeneous discussions and are open to learn from them, others may refrain from these debates or become more entrenched in their own positions. A number of studies have inquired into how individuals respond to disagreement. Mutz (2002, <xref ref-type="bibr" rid="B52">2006</xref>), for instance, finds that exposure to disagreement and &#8216;crosscutting views,&#8217; while promoting tolerance and understanding of opposing views, may also lead to avoidance of controversy and to political apathy. The key argument is that demand for providing explanation to one&#8217;s view when disagreeing with others would reduce the individuals&#8217; willingness to express their preferences and leave them ambivalent about complex issues (Mutz 2002, <xref ref-type="bibr" rid="B52">2006</xref>).</p>
<p>Some scholars contend that exposure to controversial views may increase individuals&#8217; political knowledge and willingness to participate in public discussions (<xref ref-type="bibr" rid="B23">Eveland 2004</xref>; <xref ref-type="bibr" rid="B51">Moy &amp; Gastil 2006</xref>; Rojas 2008). Other studies, taking into account the individual network-size level, did not identify a significant relationship between exposure to political disagreement and avoidance of controversies (Huckfeldt, Johnson &amp; Sprague 2004; Lee, Kwak &amp; Campbell 2015; Nir 2005). Esterling et al. (<xref ref-type="bibr" rid="B22">2015</xref>) further suggest that the discussants&#8217; perception of levels of disagreement&#8212;i.e., moderate disagreement and intractable disagreement&#8212;yields different effects for democratic discussions. In spite of the nuances in how disagreement is measured or perceived, research on informal political conversation emphasizing its intrinsic and extrinsic benefits provides evidence that relatively unstructured, informal heterogeneous discussions that happen in people&#8217;s daily lives have democratic value even when they are not characterized by deliberative norms and processes (<xref ref-type="bibr" rid="B23">Eveland 2004</xref>; <xref ref-type="bibr" rid="B24">Eveland &amp; Hively 2009</xref>; <xref ref-type="bibr" rid="B47">Maia et al. 2020a</xref>; <xref ref-type="bibr" rid="B48">Maia et al. 2020b</xref>; <xref ref-type="bibr" rid="B63">Scheufele et al. 2004</xref>; <xref ref-type="bibr" rid="B80">Valenzuela, Kim &amp; Gil de Z&#250;&#241;iga 2012</xref>).</p>
<p>Contrary to early expectations that the internet would expose users to <italic>echo-chambers</italic>, predicting negative consequences of selective exposure in high-choice and algorithmically curated online environments (<xref ref-type="bibr" rid="B58">Pariser 2011</xref>; <xref ref-type="bibr" rid="B74">Sunstein 2009</xref>), there is substantial empirical support suggesting that the internet, in general, and social media, in particular, exposes users to more diverse information, on purpose or inadvertently (<xref ref-type="bibr" rid="B2">Anspach 2017</xref>; <xref ref-type="bibr" rid="B9">Brundidge 2010</xref>; <xref ref-type="bibr" rid="B78">Vaccari et al. 2016</xref>). Several studies have revealed that social media&#8212;platforms in which users are responsible for producing, sharing, or curating content&#8212;weakens social boundaries and facilitates inadvertent exposure to political differences (<xref ref-type="bibr" rid="B9">Brundidge 2010</xref>; <xref ref-type="bibr" rid="B27">Garrett, Carnahan &amp; Lynch 2013</xref>; <xref ref-type="bibr" rid="B78">Vaccari et al. 2016</xref>). The weaker the social ties are in online networks, the more numerous and diverse the types and sources of information that users are exposed to (<xref ref-type="bibr" rid="B30">Gil de Z&#250;&#241;iga, Jung &amp; Valenzuela 2012</xref>). Even in platforms designed to prioritize content that aligns with users&#8217; preferences through algorithmic filtering and ranking (e.g., Facebook), challenging views still surface because most people&#8217;s personal connections are made for reasons other than sharing political views (<xref ref-type="bibr" rid="B3">Bakshy, Messing &amp; Adamic 2015</xref>). Relationships play a crucial role in influencing access to information on Facebook, as users are more likely to select political news that is shared by their peers (<xref ref-type="bibr" rid="B2">Anspach 2017</xref>). Research has also found that social media users tend to perceive more disagreement (with the content they are exposed to, such as posts and discussions) than nonsocial media users, and that they also tend to perceive it more on social media than in anonymous online environments or face-to-face (<xref ref-type="bibr" rid="B5">Barnidge 2017</xref>).</p>
<p>In this context, it is important to investigate the role of platform affordances in structuring interpersonal communication online (<xref ref-type="bibr" rid="B25">Fox &amp; McEwan 2017</xref>). Our study focuses on two popular venues for informal political talk: Facebook and the comments section of news websites. These environments differ in many ways, such as levels of identification, presence and visibility of social ties, and moderation&#8212;all of which can influence the extent to which participants engage with political disagreement (<xref ref-type="bibr" rid="B5">Barnidge 2017</xref>; <xref ref-type="bibr" rid="B34">Halpern &amp; Gibbs 2013</xref>; <xref ref-type="bibr" rid="B48">Maia et al. 2020b</xref>). Considering these different affordances, it is plausible to expect that the social constraints of a social media platform&#8212;having a personal and identifiable profile, or maintaining visible social ties (<xref ref-type="bibr" rid="B21">Ellison &amp; Boyd 2013</xref>)&#8212;might affect the extent to which Facebook users engage in disagreeable political talk when commenting on news&#8212;as the presence of others whom they know personally may act as a social constraint, as is the case in face-to-face discussions (<xref ref-type="bibr" rid="B52">Mutz 2006</xref>). If we consider that anonymous online environments are often associated with a &#8216;disinhibition effect&#8217; (<xref ref-type="bibr" rid="B73">Suler 2004</xref>), that is, users feel less connected to their &#8216;real&#8217; identities and are therefore less concerned about social sanctions, it follows that news websites should have less constraints than social media for users to engage in heated discussions, as those who comment on news websites routinely use nicknames or aliases that protect their identities, and their personal connections are neither revealed nor visible. Thus, we hypothesize that we will find different levels of disagreement in the two platforms selected for this study, with crosscutting perspectives being expressed more frequently on news websites:</p>
<disp-quote>
<p><italic>H1: Comments on news websites will have more disagreement than comments on news shared on Facebook.</italic></p>
</disp-quote>
<p>Research examining the benefits of crosscutting exposure and disagreement in political talk is often based on self-reported measures of types and frequency of conversation, without measuring its quality, and conflicting results in the literature can be partially explained by methodological differences in how disagreement is measured and conceptualized. Studies have shown significant differences between perceived disagreement and objective disagreement in actual discussion practices (<xref ref-type="bibr" rid="B88">Wojcieszak &amp; Price 2012</xref>) and variations in the nature of disagreement in online settings and face-to-face settings (<xref ref-type="bibr" rid="B70">Stromer-Galley et al. 2015</xref>). Moreover, the type of issue being discussed is an important factor that influences disagreement (<xref ref-type="bibr" rid="B38">Hong &amp; Rojas 2016</xref>; <xref ref-type="bibr" rid="B85">Wojcieszak, Baek &amp; Carpini 2010</xref>; <xref ref-type="bibr" rid="B87">Wojcieszak &amp; Price 2010</xref>), and research on online political talk tends to focus on particular topics and issues&#8212;often contentious ones (<xref ref-type="bibr" rid="B37">Hmielowski, Hutchens &amp; Cicchirillo 2014</xref>; <xref ref-type="bibr" rid="B57">Papacharissi 2004</xref>; <xref ref-type="bibr" rid="B61">Rowe 2015</xref>; <xref ref-type="bibr" rid="B91">Zhang &amp; Chang 2014</xref>). In addition to the context of interaction, the type of issue being discussed is an important factor that influences disagreement (<xref ref-type="bibr" rid="B38">Hong &amp; Rojas 2016</xref>; <xref ref-type="bibr" rid="B83">Wojcieszak et al. 2010</xref>; <xref ref-type="bibr" rid="B87">Wojcieszak &amp; Price 2010</xref>). Taking into consideration that people who discuss politics on news websites might be different (e.g., in terms of interests, demographics, or motivations) from those who engage with political talk on Facebook, it is relevant to investigate whether there are differences between the nature of news stories that will drive more disagreement in the two platforms. Because these relationships have not been sufficiently explored, we ask:</p>
<disp-quote>
<p><italic>RQ1: Are there differences in which news topics are more likely to generate disagreeable comments on Facebook and news websites?</italic></p>
</disp-quote>
<p>Disagreement is seen as a desirable discussion trait because it enables people to better understand each other&#8217;s views, as well as to reflect on their own (<xref ref-type="bibr" rid="B22">Esterling et al. 2015</xref>; <xref ref-type="bibr" rid="B32">Gutmann &amp; Thompson 1996</xref>; <xref ref-type="bibr" rid="B33">Habermas 1996</xref>; <xref ref-type="bibr" rid="B52">Mutz 2006</xref>; <xref ref-type="bibr" rid="B59">Parkinson &amp; Mansbridge 2012</xref>; <xref ref-type="bibr" rid="B67">Steiner 2012</xref>). Several studies about online discussion, being framed by Habermas&#8217; concept of public deliberation, have attempted to measure the extent to which online discussions conform to a set of normative ideals&#8212;such as rational and respectful exchange of arguments that are justified and driven by the common good instead of personal gains (<xref ref-type="bibr" rid="B49">Mansbridge 1999</xref>). It is, however, well known that less structured discussions take place in many internet channels that are not designed to promote deliberation (Chadwick 2011; Eveland, Morey &amp; Hutchens 2011). Given the characteristics of online discussions, many scholars claim that it is unrealistic to expect that the deliberative criteria will be met in most political discussions online (<xref ref-type="bibr" rid="B15">Coleman &amp; Moss 2012</xref>; <xref ref-type="bibr" rid="B26">Freelon 2013</xref>). Furthermore, it is relevant to note that the demanding criteria of deliberation are rarely met in most political discussions&#8212;even in formal and structured forums for political debate (<xref ref-type="bibr" rid="B33">Habermas 1996</xref>; <xref ref-type="bibr" rid="B59">Parkinson &amp; Mansbridge 2012</xref>; <xref ref-type="bibr" rid="B67">Steiner 2012</xref>). That said, we understand that the lack of deliberative qualities does not prevent online political talk from having positive political outcomes&#8212;such as increasing political knowledge, fostering shared values, and providing meaning on matters of public concern (<xref ref-type="bibr" rid="B39">Huckfeldt &amp; Mendez 2008</xref>; <xref ref-type="bibr" rid="B42">Maia 2012</xref>; <xref ref-type="bibr" rid="B49">Mansbridge 1999</xref>; <xref ref-type="bibr" rid="B51">Moy &amp; Gastil 2006</xref>; <xref ref-type="bibr" rid="B71">Stromer-Galley &amp; Wichowski 2011</xref>; <xref ref-type="bibr" rid="B90">Xenos &amp; Moy 2007</xref>).</p>
<p>In this context, we argue that the aforementioned benefits are grounded on the premise that people are able to articulate their opinions in the context of disagreement so that participants in a discussion can proactively know about others&#8217; positions, understand their perspectives, and engage with their arguments. To assess the democratic value of online disagreement, we should investigate the extent to which expressions of divergence are associated with reason giving to back up one&#8217;s opinion. Then we ask:</p>
<disp-quote>
<p><italic>RQ2: Is disagreement online positively associated with justified opinion expression?</italic></p>
</disp-quote>
</sec>
<sec>
<title>Uncivil Disagreement?</title>
<p>Although scholars have adopted different standards to analyze the quality of online conversations, most agree that the presence of incivility can undermine the potential benefits of political discussion (<xref ref-type="bibr" rid="B37">Hmielowski et al. 2014</xref>; <xref ref-type="bibr" rid="B55">O&#8217;Sullivan &amp; Flanagin 2003</xref>). Online incivility is facilitated by many of the affordances that have been historically associated with the internet&#8217;s potential to foster democratically relevant political talk, such as the ability to talk with others beyond geographical barriers and engage with homogeneous and heterogeneous groups, and the possibility to express oneself without fear of discrimination (<xref ref-type="bibr" rid="B57">Papacharissi 2004</xref>).</p>
<p>In particular, research has consistently associated anonymity&#8212;the ability to use aliases or nicknames&#8212;with incivility, flaming, and trolling (<xref ref-type="bibr" rid="B37">Hmielowski et al. 2014</xref>; <xref ref-type="bibr" rid="B39">Huckfeldt &amp; Mendez 2008</xref>; <xref ref-type="bibr" rid="B77">Turner 2010</xref>). One explanation is that users become disconnected from their real identities and may become more inclined to adopt antinormative behaviors without the fear of sanctions (<xref ref-type="bibr" rid="B73">Suler 2004</xref>). With the rise of social media, political talk online, however, increasingly takes place in environments that are not anonymous. Facebook, for instance, has a policy of &#8216;real names&#8217; and is designed around personal profiles with pictures and publicly available lists of friends that are mostly comprised real relationships&#8212;even though many connections listed are acquaintances or colleagues (<xref ref-type="bibr" rid="B21">Ellison &amp; Boyd 2013</xref>). Studies comparing comments on news websites with those made on Facebook pages have found similar levels of uncivil behaviors&#8212;suggesting that anonymity is not the only factor influencing incivility<xref ref-type="fn" rid="n2">2</xref> (<xref ref-type="bibr" rid="B60">Rossini 2019</xref>; <xref ref-type="bibr" rid="B61">Rowe 2015</xref>).</p>
<p>A problem with online incivility research is the lack of conceptual clarity, and studies often conflate inherently harmful behaviors (such as expressions of racism, sexism, or hate speech) with expressions that, while disrespectful, vulgar, harsh, or intense, are not necessarily offensive (<xref ref-type="bibr" rid="B1">Anderson et al. 2014</xref>; <xref ref-type="bibr" rid="B13">Coe, Kenski &amp; Rains 2014</xref>; <xref ref-type="bibr" rid="B37">Hmielowski et al. 2014</xref>; <xref ref-type="bibr" rid="B61">Rowe 2015</xref>; <xref ref-type="bibr" rid="B65">Sobieraj &amp; Berry 2011</xref>). In spite of the lack of nuance, the presence of incivility has led scholars to deem online political talk as being of low quality (<xref ref-type="bibr" rid="B62">Santana 2014</xref>). As warned by Papacharissi (<xref ref-type="bibr" rid="B57">2004</xref>), dismissing online discussions due to the presence of incivility means dismissing the value of heated conversations. Calls for civility can also be criticized as attempts to limit the types of discourse that are accepted in the public sphere, which can silence particular forms of expression (<xref ref-type="bibr" rid="B7">Benson 2011</xref>).</p>
<p>Aligned with the argument that incivility might be compatible, or even normalized, by those who discuss politics online (<xref ref-type="bibr" rid="B37">Hmielowski et al 2014</xref>; <xref ref-type="bibr" rid="B75">Sydnor 2018</xref>), this study adopts a conceptual distinction between incivility and intolerance. In this framework, incivility is operationalized as a set of features that determine the &#8216;tone&#8217; of political discourse, such as the use of vulgar or profane words, personal attacks, attacks toward arguments, and other rhetorical features that may make discourse potentially offensive (<xref ref-type="bibr" rid="B13">Coe et al. 2014</xref>; <xref ref-type="bibr" rid="B75">Sydnor 2018</xref>). Intolerance, on the contrary, comprises behaviors that denote profound disrespect toward others based primarily on individual characteristics, preferences, or beliefs, as well as expressions of hatred, and violent threats (<xref ref-type="bibr" rid="B29">Gibson 1992</xref>; <xref ref-type="bibr" rid="B60">Rossini 2019</xref>). These behaviors are independent: comments can be uncivil but tolerant, or civil but intolerant. While the former refers to tone of discourse (e.g., shouting, interrupting, using profanities, lack of interpersonal respect), the latter refers to substance: rhetoric that is inherently abusive, exclusionary, or in violation of moral respect.</p>
<p>Disagreement practices alongside uncivil and intolerant expressions can vary and have distinct consequences for democratic political talk. In the context of citizens&#8217; everyday discussions, both uncivil expressions and intolerant expressions have the potential to block discursive engagement, lead to hostile reactions, or a painful silence. Both forms of disagreement can, at times, foster critical reflections and lead to a strong pushback. When a broader perspective of democratic political talk is considered; however, intolerance is toxic because it denies pluralism and the equal status of citizens, providing a fertile ground for advancing similarly minded disrespectful and cruel forms of domination such as discrimination, stigmatization, exclusion, exploitation, etc. (<xref ref-type="bibr" rid="B43">Maia 2014</xref>, <xref ref-type="bibr" rid="B44">2017</xref>). Incivility, on the contrary, may have fewer problematic effects to the extent that some expressions of incivility&#8212;for instance, toward political arguments&#8212;are perceived as acceptable by citizens (<xref ref-type="bibr" rid="B37">Hmielowski et al 2014</xref>; Muddiman 2017; <xref ref-type="bibr" rid="B76">Sydnor 2019</xref>).</p>
<p>Following the argument that incivility may be used as a rhetorical asset that can help make positions stand out amidst noisy and crowded debates, the diversity of viewpoints in online political discussions might encourage participants to rely on uncivil discourse as a means of expressing themselves (Herbst 2010; <xref ref-type="bibr" rid="B57">Papacharissi 2004</xref>; <xref ref-type="bibr" rid="B60">Rossini 2019</xref>). For instance, comparing online and offline discussions, Stromer-Galley et al. (<xref ref-type="bibr" rid="B70">2015</xref>) found that people are significantly more likely to be uncivil online in the context of political disagreement. The same is not necessarily true for political intolerance, as these behaviors tend to be more salient in more homogeneous environments (<xref ref-type="bibr" rid="B18">Crawford &amp; Pilanski 2014</xref>; <xref ref-type="bibr" rid="B29">Gibson 1992</xref>; <xref ref-type="bibr" rid="B83">Wojcieszak 2010</xref>, <xref ref-type="bibr" rid="B84">2011</xref>). Although prior research has given us some indication of the direction of the relationships of these behaviors with the heterogeneity of a discussion space, the conceptual distinction between incivility and intolerance in online political talk warrants a set of exploratory questions to investigate the extent to which these behaviors are associated with disagreement.</p>
<disp-quote>
<p><italic>RQ3: Are expressions of disagreement associated with incivility?</italic></p>
<p><italic>RQ4: Are expressions of disagreement associated with intolerance?</italic></p>
</disp-quote>
<p>If one of the benefits of exposure to disagreement is learning about others&#8217; views, it should follow that opinions need to be explained so that others can understand them. Although incivility may affect participants&#8217; openness to opposing views and may have detrimental effects on people&#8217;s willingness to participate in a discussion (<xref ref-type="bibr" rid="B28">Gervais 2014</xref>; <xref ref-type="bibr" rid="B76">Sydnor 2019</xref>), it also improves recall and attention to arguments (Mutz 2016; <xref ref-type="bibr" rid="B48">Maia et al. 2020b</xref>). Thus, it should follow that expressions of disagreement that are uncivil should still enable people who are exposed to them to learn about others&#8217; perspectives when these are justified, regardless of the tone used to express them. To explore this relationship, we examine interaction effects between justified opinion expression and incivility in predicting disagreement in online comments.</p>
<disp-quote>
<p><italic>RQ5: What is the relationship between incivility and justified opinion expression in predicting comments with disagreement?</italic></p>
</disp-quote>
</sec>
<sec sec-type="methods">
<title>Methods</title>
<sec>
<title>Data collection</title>
<p>We analyzed comments from news stories shared by Portal UOL&#8217;s Facebook page&#8212;the most popular online news outlet in Brazil, with more than 6.7 million Facebook followers in 2016. Portal UOL was selected as the source for news stories and comments due to the fact that it is the largest online content portal in Brazil, hosting several media outlets ranging from national and local newspapers, entertainment websites, and opinion blogs, along with proprietary news content. On Facebook, UOL shares a mix of stories from these news partners as well as its own content, allowing for a varied range of sources in the sample. We used constructed week sampling to account for the variability of the media cycle, and selected two constructed weeks to represent a 6-month period of online news&#8212;from February to July 2015 (<xref ref-type="bibr" rid="B16">Connolly-Ahern, Ahern &amp; Bortree 2009</xref>; <xref ref-type="bibr" rid="B36">Hester &amp; Dougall 2007</xref>). Each week was constructed by randomly selected weekdays within the timeframe of the analysis.</p>
<p>We compared comments on the same stories to ensure that differences in the comments were not derived from the discussion of different news stories&#8212;given the nature of the data, we are unable to make inferences about the public in these two platforms. We build a comparative dataset following the links to political stories shared on Facebook posts to scrape the comments from their original source&#8212;most frequently UOL and Folha de S&#227;o Paulo, Brazil&#8217;s main newspaper, and blogs specializing in politics.<xref ref-type="fn" rid="n3">3</xref> Portal UOL shared 1,669 news stories on Facebook during the two constructed weeks. These stories were initially classified as political or nonpolitical, using a broad notion of political news, which includes stories about formal political affairs, as well as policy-related public issues (e.g., education, security), organized civil society, international affairs, minorities, and celebrities engaged in social causes or that were the subject of discriminatory scandals. After removing duplicated news stories (i.e., those posted on Facebook more than once), stories with zero or one comment, and stories from sources that used a Facebook plugin for comments, the final sample of political news had 156 stories from eight news sources and a universe of 55,053 comments, with around 70% of this total (<italic>n</italic> = 38,594) being on Facebook. The three main sources of comments, Portal UOL (55.9%), UOL Blogs (19.2%), and Folha de S. Paulo (16.9%) had similar commenting affordances, with participants registered under pseudonyms and systematic human moderation to filter out violations to terms of service. Manual content analysis was conducted on a random stratified sample<xref ref-type="fn" rid="n4">4</xref> of these comments (<italic>N</italic> = 12,337) to account for differences in the proportion of comments in each platform, and in the number of comments on each story. Our sample includes discussion threads instead of isolated messages: consecutive messages were selected using a random number in the universe of comments of a story as a starting point to collect comments in each story.</p>
</sec>
<sec>
<title>Content analysis</title>
<p>We used systematic content analysis to classify public comments (<xref ref-type="bibr" rid="B54">Neuendorf 2002</xref>), using a coding scheme broadly inspired by prior research (<xref ref-type="bibr" rid="B13">Coe et al. 2014</xref>; <xref ref-type="bibr" rid="B69">Stromer-Galley 2007</xref>), with original categories created for this study. The analysis was conducted by two independent coders, and all categories were considered reliable (Krippendorff&#8217;s alpha greater than 0.68).<xref ref-type="fn" rid="n5">5</xref></p>
<p>The codebook operates with two distinct units of analysis: news stories and messages. The news stories were coded by their topics: politics (government, congress, politicians); civil society (NGOs, activism, social movements); celebrities; minorities; public policy; and international affairs. Due to a low number of comments, stories featuring celebrities were recoded as the broader political issue they addressed&#8212;minorities&#8212;as the stories featured celebrities targeted by racism or homophobia.</p>
<p>Messages were coded in the following main categories<xref ref-type="fn" rid="n6">6</xref>: target of interaction; disagreement; opinion expression; incivility; and intolerance. Target of interaction identified whether the message was a direct reply to a previous comment (using a reply feature or mentioning someone else&#8217;s name). Incivility was classified using the following subcategories: mockery, disdain, dismissive or pejorative language, profanity, and personal attacks<xref ref-type="fn" rid="n7">7</xref> (e.g., referring to personality, ideas, or arguments). Intolerant messages were coded in the following subcategories: xenophobia, racism, hate speech, violence, homophobia, religious intolerance, and attacks toward gender, sexual preferences, or economic status. Intolerant and uncivil messages were also coded by focus, which can be other users, political actors, people or groups featured on the news, the media, political minorities, or unfocused. This variable identifies whether uncivil and intolerant discourse is targeted at other discussants, signaling lack of interpersonal respect, or at other actors who are not a part of the conversation. Messages were coded as disagreement when they (1) diverged with the general tone of the discussion (considering the previous message in a thread as the baseline),<xref ref-type="fn" rid="n8">8</xref> which indicates heterogeneity in the thread or (2) explicitly diverged from another commenter in the form of either name tagging or reply. The category of opinion expression also had two subcategories: (a) unjustified opinion expression, coded as any remark that revealed a commenter&#8217;s take on a topic without any elaboration and (b) justified opinion expression, coded when there was any explanation or elaboration to substantiate an opinion.</p>
</sec>
</sec>
<sec>
<title>Results</title>
<p>We identified disagreement in only 11.6% of the sample (<italic>N</italic> = 1,425), with significant differences between Facebook and news websites at the bivariate level. Proportionally, disagreement occurred more frequently in news websites (15.1%) than on Facebook comments (10%), <italic>X</italic><sup>2</sup> (1) = 68.160, <italic>p</italic> &lt; 0.0001 (Table <xref ref-type="table" rid="T1">1</xref>). The table presents the frequency of disagreement per story topic, showing significant differences in the types of stories that trigger heterogeneous debates. The bivariate analysis suggests that platforms influence the extent to which participants are exposed to disagreement (Table <xref ref-type="table" rid="T1">1</xref>) in the direction hypothesized (H1).</p>
<table-wrap id="T1">
<label>Table 1</label>
<caption>
<p>Frequency of disagreement per platform and topic.</p>
</caption>
<table>
<tr>
<th align="left" valign="top"></th>
<th align="center" valign="top">Disagreement</th>
<th align="center" valign="top">No disagreement</th>
<th align="center" valign="top">Sig.</th>
</tr>
<tr>
<td colspan="4"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Facebook</td>
<td align="right" valign="top">847 (10%)</td>
<td align="right" valign="top">7,664 (90%)</td>
<td align="right" valign="top"><italic>X</italic><sup>2</sup> (1) = 68.160</td>
</tr>
<tr>
<td align="left" valign="top">News sources</td>
<td align="right" valign="top">578 (15.1%)</td>
<td align="right" valign="top">3,248 (84.9%)</td>
<td align="right" valign="top"><italic>p</italic> &lt; 0.0001</td>
</tr>
<tr>
<td align="left" valign="top">News topic</td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;Political news</td>
<td align="right" valign="top">792 (10.7%)</td>
<td align="right" valign="top">6,582 (89.3%)</td>
<td align="right" valign="top"><italic>X</italic><sup>2</sup> (4) = 148.112</td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;Minorities</td>
<td align="right" valign="top">469 (17.2%)</td>
<td align="right" valign="top">2,254 (82.8%)</td>
<td align="right" valign="top"><italic>p &lt; 0.0001</italic></td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;Policy</td>
<td align="right" valign="top">110 (6.8%)</td>
<td align="right" valign="top">1,503 (93.2%)</td>
<td align="right" valign="top"></td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;Civic society</td>
<td align="right" valign="top">48 (13%)</td>
<td align="right" valign="top">321 (87%)</td>
<td align="right" valign="top"></td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;International</td>
<td align="right" valign="top">6 (2.3%)</td>
<td align="right" valign="top">252 (97.7%)</td>
<td align="right" valign="top"></td>
</tr>
<tr>
<td align="left" valign="top">Total</td>
<td align="right" valign="top">1,425 (11.6%)</td>
<td align="right" valign="top">10,912 (88.4%)</td>
<td align="right" valign="top"></td>
</tr>
</table>
<table-wrap-foot>
<fn><p>Only row proportions are displayed.</p></fn>
</table-wrap-foot>
</table-wrap>
<p>The first research question explored the relationship between different news topics and the presence of disagreement. Since disagreement only occurs in a small fraction of the dataset, Table <xref ref-type="table" rid="T2">2</xref> presents the distribution of comments containing disagreement in both platforms. A Fisher&#8217;s exact test for count data indicates significant differences between the topics that foster expressions of disagreement in each platform. Namely, discussions on Facebook have disagreement in a broader range of topics&#8212;being more frequent in response to stories about minorities, followed by formal politics. On news websites, disagreement mainly occurs in stories about formal politics, with very few instances in other topics.</p>
<table-wrap id="T2">
<label>Table 2</label>
<caption>
<p>Distribution of disagreement per story topic and platform.</p>
</caption>
<table>
<tr>
<th align="left" valign="top">Story topic</th>
<th align="center" valign="top">Facebook</th>
<th align="center" valign="top">News sources</th>
<th align="center" valign="top"></th>
</tr>
<tr>
<td colspan="4"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Political news</td>
<td align="right" valign="top">320 (37.8%)</td>
<td align="right" valign="top">472 (81.7%)</td>
<td align="right" valign="top" rowspan="6">Two-sided Fisher&#8217;s exact test: &lt;0.0001</td>
</tr>
<tr>
<td align="left" valign="top">Minorities</td>
<td align="right" valign="top">421 (49.7%)</td>
<td align="right" valign="top">48 (8.3%)</td>
</tr>
<tr>
<td align="left" valign="top">Policy</td>
<td align="right" valign="top">84 (9.9%)</td>
<td align="right" valign="top">26 (4.5%)</td>
</tr>
<tr>
<td align="left" valign="top">Civic society</td>
<td align="right" valign="top">19 (2.2%)</td>
<td align="right" valign="top">29 (5%)</td>
</tr>
<tr>
<td align="left" valign="top">International</td>
<td align="right" valign="top">3 (0.4%)</td>
<td align="right" valign="top">3 (0.5%)</td>
</tr>
<tr>
<td align="left" valign="top">Total</td>
<td align="right" valign="top">847 (100%)</td>
<td align="right" valign="top">578 (100%)</td>
</tr>
</table>
<table-wrap-foot>
<fn><p>Only column proportions are displayed (percentages per platform).</p></fn>
</table-wrap-foot>
</table-wrap>
<p>To address our remaining research questions, we employ predictive modeling using multiple logistic regression, which enables us to investigate a nominal dependent variable (presence of disagreement) in relation to a series of explanatory independent variables, while also controlling for factors such as the platform for each comment (<xref ref-type="bibr" rid="B56">Pampel 2000</xref>). An advantage of this approach is that it identifies the strength of the effect of each independent variable in predicting the dependent variable. We built two logistic regression models to predict the presence of disagreement using incivility, intolerance, replies, platform, justified opinion expression, and the topics of the news stories (civic society, minorities, policy-related topics, international affairs; topic of reference: formal politics) as independent variables.<xref ref-type="fn" rid="n9">9</xref> The second model adds an interaction between justified opinion expression and incivility to address our last research question.</p>
<p>To account for potential differences in comments on popular stories versus less popular ones, we also controlled for the total number of comments in the original story. Log odds (&#946;) were converted to odds ratios (<italic>e</italic><sup>&#946;</sup>) to facilitate interpretation, and we report confidence intervals in addition to <italic>p</italic> values. When odds ratios are within the confidence intervals, one can report 95% confidence that the independent variable has the calculated effect on the dependent variable. Table <xref ref-type="table" rid="T3">3</xref> shows the results of both models.</p>
<table-wrap id="T3">
<label>Table 3</label>
<caption>
<p>Logistic regression predicting disagreement in online comments.</p>
</caption>
<table>
<tr>
<th align="left" valign="top" rowspan="3"></th>
<th align="center" valign="top" colspan="2">Model 1</th>
<th align="center" valign="top" colspan="2">Model 2</th>
</tr>
<tr>
<th colspan="4"><hr/></th>
</tr>
<tr>
<th align="center" valign="top">OR (e<sup><italic>&#946;</italic></sup>)</th>
<th align="center" valign="top">CI 95%</th>
<th align="center" valign="top">OR (e<sup><italic>&#946;</italic></sup>)</th>
<th align="center" valign="top">CI 95%</th>
</tr>
<tr>
<td colspan="5"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Reply</td>
<td align="right" valign="top">51.90***</td>
<td align="right" valign="top">[43.42, 62.04]</td>
<td align="right" valign="top">51.25***</td>
<td align="right" valign="top">[42.91, 61.21]</td>
</tr>
<tr>
<td align="left" valign="top">Justified opinions</td>
<td align="right" valign="top">3.11***</td>
<td align="right" valign="top">[2.66, 3.63]</td>
<td align="right" valign="top">4.23***</td>
<td align="right" valign="top">[3.44, 5.20]</td>
</tr>
<tr>
<td align="left" valign="top">Is uncivil</td>
<td align="right" valign="top">2.36***</td>
<td align="right" valign="top">[2.04, 2.74]</td>
<td align="right" valign="top">3.08***</td>
<td align="right" valign="top">[2.55, 3.72]</td>
</tr>
<tr>
<td align="left" valign="top">Is Intolerant</td>
<td align="right" valign="top">0.87&#160;&#160;&#160;&#160;&#160;&#160;</td>
<td align="right" valign="top">[0.66, 1.16]</td>
<td align="right" valign="top">0.87&#160;&#160;&#160;&#160;&#160;&#160;</td>
<td align="right" valign="top">[0.65, 1.16]</td>
</tr>
<tr>
<td align="left" valign="top">Facebook</td>
<td align="right" valign="top">1.57***</td>
<td align="right" valign="top">[1.32, 1.86]</td>
<td align="right" valign="top">1.57***</td>
<td align="right" valign="top">[1.32, 1.86]</td>
</tr>
<tr>
<td align="left" valign="top">Number of comments</td>
<td align="right" valign="top">1.00&#160;&#160;&#160;&#160;&#160;&#160;</td>
<td align="right" valign="top">[1.00, 1.00]</td>
<td align="right" valign="top">1.00&#160;&#160;&#160;&#160;&#160;&#160;</td>
<td align="right" valign="top">[1.00, 1.00]</td>
</tr>
<tr>
<td align="left" valign="top">News topics:</td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;Minorities</td>
<td align="right" valign="top">1.86***</td>
<td align="right" valign="top">[1.54, 2.25]</td>
<td align="right" valign="top">1.88***</td>
<td align="right" valign="top">[1.55, 2.28]</td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;Policy</td>
<td align="right" valign="top">1.29&#160;&#160;&#160;&#160;&#160;&#160;</td>
<td align="right" valign="top">[0.98, 1.71]</td>
<td align="right" valign="top">1.32&#160;&#160;&#160;&#160;&#160;&#160;</td>
<td align="right" valign="top">[1.00, 1.74]</td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;Civil society</td>
<td align="right" valign="top">1.77**&#160;&#160;</td>
<td align="right" valign="top">[1.17, 2.67]</td>
<td align="right" valign="top">1.76**&#160;&#160;</td>
<td align="right" valign="top">[1.17, 2.66]</td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;International</td>
<td align="right" valign="top">0.30**&#160;&#160;</td>
<td align="right" valign="top">[0.12, 0.73]</td>
<td align="right" valign="top">0.30**&#160;&#160;</td>
<td align="right" valign="top">[0.12, 0.74]</td>
</tr>
<tr>
<td align="left" valign="top">Incivility versus justified opinion</td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top">0.51***</td>
<td align="right" valign="top">[0.38, 0.68]</td>
</tr>
<tr>
<td align="left" valign="top"><italic>N</italic></td>
<td align="right" valign="top">12,337&#160;&#160;&#160;&#160;&#160;&#160;</td>
<td align="right" valign="top"></td>
<td align="right" valign="top">12,337&#160;&#160;&#160;&#160;&#160;&#160;</td>
<td align="right" valign="top"></td>
</tr>
<tr>
<td align="left" valign="top">AIC</td>
<td align="right" valign="top">5,099.45&#160;&#160;&#160;&#160;&#160;&#160;</td>
<td align="right" valign="top"></td>
<td align="right" valign="top">5,081.50&#160;&#160;&#160;&#160;&#160;&#160;</td>
<td align="right" valign="top"></td>
</tr>
<tr>
<td align="left" valign="top">Pseudo <italic>R</italic><sup>2</sup></td>
<td align="right" valign="top">0.51&#160;&#160;&#160;&#160;&#160;&#160;</td>
<td align="right" valign="top"></td>
<td align="right" valign="top">0.52&#160;&#160;&#160;&#160;&#160;&#160;</td>
<td align="right" valign="top"></td>
</tr>
</table>
<table-wrap-foot>
<fn><p>Reference category for topics: Political News.</p>
<p>CI = confidence interval; OR = odds ratio.</p>
<p>*** <italic>p</italic> &lt; 0.001; ** <italic>p</italic> &lt; 0.01; * <italic>p</italic> &lt; 0.05.</p></fn>
</table-wrap-foot>
</table-wrap>
<p>The first hypothesis theorized a relationship between platform and crosscutting discussion, expecting a higher likelihood of disagreement on comments from news websites when compared to those on Facebook. While the bivariate analysis provided some support to this hypothesis, the results of the regression model are in the opposite direction, suggesting that, after controlling for other factors, comments expressing disagreement were more likely to appear on Facebook than on news websites. Thus, the evidence is mixed, and the first hypothesis is partially confirmed.</p>
<p>The second research question focused on democratically desirable conversational traits and asked whether participants in more heterogeneous debates would be more likely to justify their views. The results suggest a positive and strong relationship between these two variables: in the presence of disagreements, comments are significantly more likely to display efforts to justify opinions and perspectives. Replies also have a positive association, indicating that when participants express diverging opinions, they are significantly more likely to directly engage with others in a discussion.</p>
<p>Our third research question inquired about the association between incivility and disagreement. When participants express disagreement, their comments are over two times more likely to be uncivil than civil, suggesting a strong positive association between these two behaviors. The same is not true for expressions of intolerance, which have a negative, but not significant, association with disagreement&#8212;answering the fourth research question.</p>
<p>The last research question explored a relationship between incivility and justified opinion expression in predicting disagreement (Model 2). The significant interaction coefficient suggests that the likelihood of a comment expressing disagreement varies with different levels for incivility (civil/uncivil) and justification (justified/unjustified). To probe these effects, we plotted predicted probabilities for the interaction term (Figure <xref ref-type="fig" rid="F1">1</xref>) using sjPlot (<xref ref-type="bibr" rid="B41">L&#252;decke 2018</xref>). Comments that are uncivil and justified have a greater likelihood to contain disagreement than comments that are uncivil and unjustified. Civil and unjustified comments are the least likely to contain disagreement, whereas the presence of justification increases the likelihood of disagreement in civil comments.</p>
<fig id="F1">
<label>Figure 1</label>
<caption>
<p>Predicted values for comments with disagreement based on justification and incivility.</p>
</caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="jdd-17-1-967-g1.png"/>
</fig>
</sec>
<sec>
<title>Discussion</title>
<p>Exposure to and engagement with disagreement in political discussions are core values in democratic societies, as they enable citizens to understand and respect each other&#8217;s views, and to become aware of different perspectives around topics of public concern (<xref ref-type="bibr" rid="B70">Stromer-Galley et al. 2015</xref>; <xref ref-type="bibr" rid="B78">Vaccari et al. 2016</xref>; <xref ref-type="bibr" rid="B86">Wojcieszak &amp; Mutz 2009</xref>). The internet, with its many venues for discussion, fulfills an important role in offering citizens opportunities to be exposed to, and to participate in, heterogeneous conversations (<xref ref-type="bibr" rid="B35">Heatherly, Lu &amp; Lee 2016</xref>; <xref ref-type="bibr" rid="B78">Vaccari et al. 2016</xref>; <xref ref-type="bibr" rid="B86">Wojcieszak &amp; Mutz 2009</xref>).</p>
<p>Everyday political conversation is complex, messy, and unstructured, and as such it may sometimes benefit, and sometimes detract from, deliberation (<xref ref-type="bibr" rid="B42">Maia 2012</xref>, <xref ref-type="bibr" rid="B44">2017</xref>; <xref ref-type="bibr" rid="B48">Maia et al. 2020b</xref>; <xref ref-type="bibr" rid="B91">Zhang &amp; Chang 2014</xref>). Although previous research has been primarily characterized by single-platform studies, this article adopts a comparative perspective to examine the extent to which disagreement happens in more informal discussion platforms online, such as social media, when compared to spaces designed to foster debates, for example, news websites. In doing so, our study contributes to a better understanding of the conditions in which heterogeneous debates occur, both in terms of the discussion features that are associated with it, and in terms of how it is affected by the platform in which participants are discussing. Instead of looking for elusive deliberative values in online political talk, this article focuses on examining discursive characteristics associated with disagreement to understand how everyday political discussions can help promote democratic citizenship.</p>
<p>Based on prior research, we hypothesized that those who comment on news on Facebook would be less likely to engage in disagreement than commenters on news websites, as identification, social cues, and network effects of Facebook could potentially constrain this type of behavior (<xref ref-type="bibr" rid="B21">Ellison &amp; Boyd 2013</xref>; <xref ref-type="bibr" rid="B35">Heatherly et al. 2016</xref>). Our results were mixed: at the bivariate level the hypothesis was supported, as disagreement was proportionally more frequent on news websites than on Facebook comments. However, when other conversational and contextual features are taken into account in the multivariate analysis, comments on news shared on Facebook were significantly more likely to contain expressions of disagreement, which suggests that Facebook users may not perceive the risks of engaging in heterogeneous debates on social media in a similar way that they do in offline contexts (Mutz 2016). Although it may be surprising that a more anonymous environment is less likely to elicit disagreement given prior research on the effects of anonymity (<xref ref-type="bibr" rid="B12">Chui 2014</xref>; <xref ref-type="bibr" rid="B62">Santana 2014</xref>; <xref ref-type="bibr" rid="B73">Suler 2004</xref>), our results are consistent with Heatherly et al.&#8217;s (<xref ref-type="bibr" rid="B35">2016</xref>), who finds that SNS users engage with substantial levels of crosscutting discussions. A potential explanation is that Facebook allows its users to maintain large social networks which predominantly consist of weak ties (<xref ref-type="bibr" rid="B21">Ellison &amp; Boyd 2013</xref>) and, as such, its users might feel free to express opinions in the context of disagreement because these connections may not represent the same social risks of face-to-face debates. Another explanation is that Facebook users have more &#8216;conversational control&#8217; (<xref ref-type="bibr" rid="B25">Fox &amp; McEwan 2017</xref>)&#8212;the ability to manage the mechanics of an interaction, such as entering or leaving a discussion&#8212;which may reduce the social costs of disagreement.</p>
<p>We must also consider the role of &#8216;invisible&#8217; platform affordances, such as Facebook feed algorithms, which rank the comments based on both engagement and &#8216;relevance to the user&#8217; (<xref ref-type="bibr" rid="B10">Bucher 2017</xref>). As a result of algorithmic filtering and ordering, it may be the case that users only see a fraction of the conversation and are not fully aware of what others are saying&#8212;which may influence their perception of the public opinion climate (<xref ref-type="bibr" rid="B66">Soffer &amp; Gordoni 2018</xref>). Given the nature of our data, we cannot control for how these factors may influence discussion on social media. Finally, it is widely known that Facebook&#8217;s feed algorithms privilege stories that elicit engagement over those that do not, which may also mean that its users are more likely to be exposed to controversial stories than those who consume news on regular websites, which would explain a higher probability of heterogeneous discussions on social media. The news sources investigated in this study also did not have features such as voting to order comments at the time of the study.</p>
<p>Even though our results suggest that comments characterized by disagreement are the exception, not the norm, it is important to note that crosscutting debates are significantly more likely to have justified opinion expression than homogeneous conversations. Although our approach did not scrutinize the quality of these justifications, our results indicate that the types of heterogeneous debates that citizens are exposed to and participate in online spaces, such as public social media feeds and news websites, tend to elicit them to elaborate on their opinions&#8212;which may promote opinion refinement, as well as awareness of others&#8217; views. Given that research has indicated that political disagreement can be avoided face-to-face (<xref ref-type="bibr" rid="B52">Mutz 2006</xref>; <xref ref-type="bibr" rid="B70">Stromer-Galley et al. 2015</xref>; <xref ref-type="bibr" rid="B68">Steiner et al. 2017</xref>), this study suggests that online platforms may fulfill an important role in the deliberative system by fostering the types of heated debates that citizens may refrain from engaging in offline.</p>
<p>By examining news stories across different political issues and actors, this study demonstrates that some topics are associated with more disagreement than others, and sheds light on the importance of going beyond &#8216;<italic>hard news</italic>&#8217; topics when studying online political talk. While our analysis is neither exhaustive of all topics that could be considered political, nor has considered political talk that may occur in discussions about entertainment or sports (see <xref ref-type="bibr" rid="B89">Wright 2012</xref>), our findings suggest that comments on stories about social issues, minorities, international affairs, and civil society were significantly more likely to trigger polarized debates&#8212;indicating that studies that look at a single issue or topic might provide a limited perspective on the characteristics of online discussion. Importantly, we find that heterogeneous discussions about these broader topics are significantly more likely to take place on Facebook than on news websites, where comments are heavily concentrated around stories about formal politics. In line with research suggesting that those who use social media are more likely to be exposed to diverse news stories and perspectives, our study provides further evidence that social media use may also facilitate discursive engagement with heterogeneous views (<xref ref-type="bibr" rid="B70">Stromer-Galley et al. 2015</xref>; <xref ref-type="bibr" rid="B78">Vaccari et al. 2016</xref>; <xref ref-type="bibr" rid="B79">Valenzuela &amp; Bachmann 2015</xref>; <xref ref-type="bibr" rid="B86">Wojcieszak &amp; Mutz 2009</xref>). Furthermore, this work highlights the importance of studying informal discussion spaces that are not specifically designed to talk about politics (<xref ref-type="bibr" rid="B46">Maia &amp; Rezende 2016</xref>; <xref ref-type="bibr" rid="B89">Wright 2012</xref>).</p>
<p>Our findings suggest that heterogeneous discussions are associated with elevated levels of uncivil discourse, which is not particularly surprising (<xref ref-type="bibr" rid="B57">Papacharissi 2004</xref>; <xref ref-type="bibr" rid="B13">Coe et al. 2014</xref>). The fact that online debates are, however, characterized by incivility does neither necessarily mean that the environment is toxic for its participants, nor that it nourishes expressions of intolerance which threaten and harm democratic values and as such would undermine any potential benefit of these interactions (<xref ref-type="bibr" rid="B60">Rossini 2019</xref>). The positive interaction between incivility and justification suggests that heated rhetoric is not merely an indicator of unproductive conversations or shouting matches. As such, albeit uncivil, these comments might still be beneficial for participants insofar as they expose them to diverse opinions. Nevertheless, it is important to note that uncivil messages have a different appeal for people with distinct personalities. Although those who are conflict oriented enjoy participating in heated discussions and are not negatively affected by incivility, people who avoid conflict may refrain from engaging in these conversations (<xref ref-type="bibr" rid="B76">Sydnor 2019</xref>). Thus, even though the pervasiveness of incivility in heterogeneous debates online should not be enough to prevent people from learning about each other&#8217;s perspectives and may be seen as entertaining by those who participate in digital debates (<xref ref-type="bibr" rid="B37">Hmielowski et al. 2014</xref>; <xref ref-type="bibr" rid="B75">Sydnor 2018</xref>), we must recognize that incivility may inhibit some people from joining these conversations&#8212;in particular, people who are conflict avoidant. Likewise, it is worth noting that our discussion of the potential harm of uncivil discourse is based on the content of online comments, and not on actual experiences of those who are exposed to or targeted by uncivil remarks.</p>
<p>On the contrary, the finding that expressions of intolerance are not associated with disagreement may indicate that some of the concerns about the quality and the tone of these debates might have been overstated in the past, perhaps as a result of less nuanced approaches to incivility (<xref ref-type="bibr" rid="B57">Papacharissi 2004</xref>; <xref ref-type="bibr" rid="B60">Rossini 2019</xref>). Similarly, this is consistent with prior research suggesting that extreme opinions are more likely to circulate in homogeneous online forums in which these views are not challenged (<xref ref-type="bibr" rid="B66">Soffer &amp; Gordoni 2018</xref>; <xref ref-type="bibr" rid="B83">Wojcieszak 2010</xref>, <xref ref-type="bibr" rid="B84">2011</xref>). Being exposed to or targeted by discourse that is racist, harassing, misogynistic, or denotes prejudice can have detrimental effects for both participants and bystanders (<xref ref-type="bibr" rid="B11">Chen et al. 2018</xref>; <xref ref-type="bibr" rid="B20">Duggan 2017</xref>; <xref ref-type="bibr" rid="B40">Lindsay et al. 2016</xref>; <xref ref-type="bibr" rid="B50">Mitchell et al. 2016</xref>). The fact that this type of expression is not present in discussions in which opposing views circulate is another indication that heterogeneous online conversations may have intrinsic benefits on their own, regardless of their tone, because they help expose citizens to a broader range of perspectives than they could access otherwise in their offline networks.</p>
<p>While there are many online spaces in which intolerant opinions may circulate, such as discussion groups on Facebook, Gab, 4chan, or Twitter, our study suggests that some of the public and diverse spaces in which people comment on news can be fertile environments for participants to be exposed to and engage with disagreement, particularly because when those conversations do occur they are characterized by justified opinion exchange, allowing for participants and bystanders to better understand the positions at stake. Even if it is true that the tone&#8212;in terms of civility&#8212;of these discussions is not ideal from a deliberative standpoint, our results suggest that the <italic>substance</italic> of these debates is not inherently problematic, at least in terms of expressing intolerance.</p>
<p>This study has limitations. First, online discussions in which participants are exposed to political disagreement are not undoubtedly beneficial for democratic societies. Some authors have found that exposure to disagreement online might influence those who lean partisan to seek more homogeneous information, which could contribute to polarization (<xref ref-type="bibr" rid="B82">Weeks et al. 2017</xref>). Research on disagreement can benefit from experimental studies to understand how being exposed to or participating in these debates affects citizens. Second, we focus on news media outlets that are fairly traditional and mainstream, and our findings can neither be extended to other types of news sources that citizens might encounter online, nor to other online discussion spaces such as online forums, which may have different conversational dynamics&#8212;as well as different affordances&#8212;than the ones we studied. Third, our analysis is limited to textual elements, and does not account for graphic expressions such as emojis, gifs, and memes, which are an increasingly important aspect of online political talk. Future research needs to tackle the challenge of understanding how these visual forms of communication are embedded in political talk and how they may affect users&#8217; experiences. Fourth, we argue that incivility is not incompatible with democratically relevant political talk, assuming that participants in online discussions are not deeply offended or feel personally threatened by these expressions. More research is, however, needed to understand how different types of incivility may affect both participants and bystanders in online discussion. Lastly, we have sought to understand the dynamics of intolerant discourse in the context of disagreement but could not find a significant relationship, which could be in part attributed to the rarity of these behaviors in the platforms we analyzed, or due to the fact that they might be systematically moderated&#8212;the latter being a structural challenge in research that draws upon publicly available data. Research initiatives in collaboration with media and social media companies, as well as qualitative work focusing on moderation, are needed to further understand how these &#8216;invisible&#8217; affordances of online platforms affect discussion dynamics.</p>
</sec>
<sec>
<title>Conclusion</title>
<p>The contributions of this study can be summarized as follows. First, this article emphasizes the need to look beyond a single platform and a single topic to understand political discussion online and provides further evidence of how platforms shape interpersonal interactions. Second, we show that the topic of a news story is relevant both to drive political conversation and to spark political disagreement, and demonstrate that platforms such as Facebook can amplify exposure to diverse viewpoints in a broader array of political topics, when compared to news websites. As such, our article contributes to a growing body of literature investigating how the use of social networking sites contributes to expose people to more diverse information. Third, we find that crosscutting debates on social media and news websites may provide opportunities for people to learn about others&#8217; opinions insofar as they are characterized by justified opinion expression. Although it cannot be argued that the quality of these debates measure up to the standards of deliberation, the fact that those who engage in heterogeneous online discussions are likely to justify themselves suggests that participating in these debates is a valuable experience that may produce beneficial outcomes&#8212;even if users are not open to change their minds. Fourth, we argue that uncivil discourse might be compatible with heated political discussions online and should not undermine their democratic values, as discussions within the deliberative system may not always fulfill the deliberative ideal. Lastly, research on online political talk has been disproportionally focused in the United States and the United Kingdom, with few case studies of non-English speaking countries surfacing internationally. This study contributes to fill an important gap in the literature by examining the Brazilian context and shedding light into how the discussion dynamics in the country are shaped by the different platforms in which citizens can debate politics. Brazil offers a relevant case study given its prominence and population, as it represents the fourth largest digital market worldwide&#8212;only behind China, India, and the United States. Thus, the findings of this study contribute to advance our knowledge about how citizens in modern democracies use digital platforms to engage in political conversation beyond English-speaking countries.</p>
</sec>
</body>
<back>
<fn-group>
<fn id="n1"><p>Data retrieved from Statista in February 5, 2019: <ext-link ext-link-type="uri" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://www.statista.com/topics/2045/internet-usage-in-brazil">https://www.statista.com/topics/2045/internet-usage-in-brazil</ext-link>.</p></fn>
<fn id="n2"><p>Rowe (<xref ref-type="bibr" rid="B61">2015</xref>) draws on Papacharissi&#8217;s (<xref ref-type="bibr" rid="B57">2004</xref>) distinction between politeness and incivility and considers the latter as &#8216;threats to democratic norms.&#8217; This article takes a different approach, drawing on politeness to define incivility and distinguishing it from democratically threatening behaviors identified as political intolerance.</p></fn>
<fn id="n3"><p>We opted to not differentiate blog articles from other stories because these are professional blogs, written by journalists and columnists, and the rules for moderation in blogs hosted by Portal UOL are the same followed by the platform in news stories. It is thus expected that the content considered inappropriate in news stories by moderators would also be moderated in blogs.</p></fn>
<fn id="n4"><p>Confidence interval: 99%; margin of error: 1%.</p></fn>
<fn id="n5"><p>We calculated Krippendorff&#8217;s alpha using a combined sample (news comments and Facebook comments) and separately. In this article, we report the values of the separated samples: disagreement 0.89 (news) and 0.82 (Facebook); incivility 0.87 (news) 0.79 (Facebook); intolerance 0.84 (news) 0.89 (Facebook); opinion expression 0.91 (news); 0.74 (Facebook).</p></fn>
<fn id="n6"><p>We coded messages as being on- and off-topic, with the later representing messages that did not engage with either the topic of the story or another participant in a discussion. This variable was dropped from the analysis, as only 4.8% of the comments were classified as being off-topic.</p></fn>
<fn id="n7"><p>Personal attacks are considered uncivil because while they may be offensive toward an individual, they do not necessarily convey a threat to democratic norms. As well, these are often directed at actors who are not a part of the conversation, and do not necessarily convey interpersonal disrespect.</p></fn>
<fn id="n8"><p>Coders analyzed sequences of messages in each news story, and thus were able to code for disagreement when a comment explicitly disagreed with the previous messages in addition to when participants directly disagreed from others by tagging or replying to them. For example, if two comments criticized a given political party and another commenter subsequently defended the party, this message was coded as disagreement.</p></fn>
<fn id="n9"><p>Given the strong relationship between replies and disagreement, we tested the models removing replies as an independent variable to check if the results would hold. The Pseudo <italic>R</italic><sup>2</sup> was lower (0.12 for both models). Most results were consistent and in the same direction: positive and significant relationships for justified opinion expression, incivility, and stories about minorities, and negative, significant relationships for stories about international affairs and the interaction term. The difference was that Facebook and stories about civic society were not significant in the model without replies. We examined the variance inflation factor for replies in the model included in the article and it was low (1.29 for model 1, 1.28 for model 2), suggesting that the variable was not problematic, in spite of its explanatory power.</p></fn>
</fn-group>
<ack>
<title>Acknowledgements</title>
<p>The authors would like to thank Jennifer Stromer-Galley and Jeff Hemsley for feedback and advice in several aspects of this project, Thais Choucair for helping with the content analysis, and Stu Shulman for supporting this research with enterprise access to DiscoverText. The authors also thank members of the Research Group on Media and Public Sphere (EME/UFMG) and the anonymous referees for their suggestions for improving this article. Any remaining issues or shortcomings are our own.</p>
</ack>
<sec>
<title>Funding Information</title>
<p>This study was supported in part by the Coordena&#231;&#227;o de Aperfei&#231;oamento de Pessoal de N&#237;vel Superior&#8212;Brasil (CAPES)&#8212;Finance Code 001 through a doctorate scholarship to Dr. Rossini.</p>
</sec>
<sec>
<title>Competing Interests</title>
<p>The authors have no competing interests to declare.</p>
</sec>
<sec>
<title>Author Information</title>
<p>Patricia Rossini, PhD in Communication (Federal University of Minas Gerais, Brazil) is an inaugural Derby Fellow in the Department of Communication and Media at the University of Liverpool. Her research in online political talk, uncivil and intolerant discourse, and misinformation has been funded by social media platforms such as Facebook, Twitter, WhatsApp, and by the Knight Foundation. Her work has been published by <italic>Communication Research, New Media &amp; Society, Political Studies, Social Media+Society</italic>, the <italic>International Journal of Communication</italic>, and the <italic>Journal of Information, Technology &amp; Politics.</italic></p>
<p>Rousiley C. M. Maia, PhD in Political Science (University of Nottingham, UK), is a Professor of Political Communication in the Federal University of Minas Gerais, Brazil. She is the author of <italic>Deliberation across deeply divided societies</italic> (with J. Steiner, M. C. Jaramillo, and S. Mameli, Cambridge University Press, 2017), <italic>Recognition and the media</italic> (2014, Palgrave Macmillan), and <italic>Deliberation, the media and political talk</italic> (2012, Hampton Press). Some of her recent publications have appeared <italic>in European Political Science Review, Political Studies, Journal of Computer-Mediated Communicatio</italic>n, <italic>Journal of Human-Communication Research, Journal of Communication, Representation, Journal of Political Power, Journal of Public Deliberation</italic>, and in several Brazilian journals.</p>
</sec>
<ref-list>
<ref id="B1"><label>1</label><mixed-citation publication-type="journal"><string-name><surname>Anderson</surname>, <given-names>A. A.</given-names></string-name>, <string-name><surname>Brossard</surname>, <given-names>D.</given-names></string-name>, <string-name><surname>Scheufele</surname>, <given-names>D. A.</given-names></string-name>, <string-name><surname>Xenos</surname>, <given-names>M. A.</given-names></string-name>, &amp; <string-name><surname>Ladwig</surname>, <given-names>P.</given-names></string-name> (<year>2014</year>). <article-title>The &#8220;nasty effect:&#8221; Online incivility and risk perceptions of emerging technologies: crude comments and concern</article-title>. <source>Journal of Computer-Mediated Communication</source>, <volume>19</volume>(<issue>3</issue>), <fpage>373</fpage>&#8211;<lpage>387</lpage>. DOI: <pub-id pub-id-type="doi">10.1111/jcc4.12009</pub-id></mixed-citation></ref>
<ref id="B2"><label>2</label><mixed-citation publication-type="journal"><string-name><surname>Anspach</surname>, <given-names>N. M.</given-names></string-name> (<year>2017</year>). <article-title>The new personal influence: How our Facebook friends influence the news we read</article-title>. <source>Political Communication</source>, <volume>34</volume>(<issue>4</issue>), <fpage>1</fpage>&#8211;<lpage>17</lpage>. DOI: <pub-id pub-id-type="doi">10.1080/10584609.2017.1316329</pub-id></mixed-citation></ref>
<ref id="B3"><label>3</label><mixed-citation publication-type="journal"><string-name><surname>Bakshy</surname>, <given-names>E.</given-names></string-name>, <string-name><surname>Messing</surname>, <given-names>S.</given-names></string-name>, &amp; <string-name><surname>Adamic</surname>, <given-names>L. A.</given-names></string-name> (<year>2015</year>). <article-title>Exposure to ideologically diverse news and opinion on Facebook</article-title>. <source>Science</source>, <volume>348</volume>(<issue>6239</issue>), <fpage>1130</fpage>&#8211;<lpage>1132</lpage>. DOI: <pub-id pub-id-type="doi">10.1126/science.aaa1160</pub-id></mixed-citation></ref>
<ref id="B4"><label>4</label><mixed-citation publication-type="book"><string-name><surname>Barber</surname>, <given-names>B.</given-names></string-name> (<year>2003</year>). <source>Strong democracy: Participatory politics for a new age</source> (<edition>20th</edition> ed.). <publisher-loc>Berkeley, CA</publisher-loc>: <publisher-name>University of California Press</publisher-name>.</mixed-citation></ref>
<ref id="B5"><label>5</label><mixed-citation publication-type="journal"><string-name><surname>Barnidge</surname>, <given-names>M.</given-names></string-name> (<year>2017</year>). <article-title>Exposure to political disagreement in social media versus face-to-face and anonymous online settings</article-title>. <source>Political Communication</source>, <volume>34</volume>(<issue>2</issue>), <fpage>302</fpage>&#8211;<lpage>321</lpage>. DOI: <pub-id pub-id-type="doi">10.1080/10584609.2016.1235639</pub-id></mixed-citation></ref>
<ref id="B6"><label>6</label><mixed-citation publication-type="journal"><string-name><surname>Barnidge</surname>, <given-names>M.</given-names></string-name> (<year>2018</year>). <article-title>Social affect and political disagreement on social media</article-title>. <source>Social Media + Society</source>, <volume>4</volume>(<issue>3</issue>). DOI: <pub-id pub-id-type="doi">10.1177/2056305118797721</pub-id></mixed-citation></ref>
<ref id="B7"><label>7</label><mixed-citation publication-type="journal"><string-name><surname>Benson</surname>, <given-names>T. W.</given-names></string-name> (<year>2011</year>). <article-title>The rhetoric of civility: Power, authenticity, and democracy</article-title>. <source>Journal of Contemporary Rhetoric</source>, <volume>1</volume>(<issue>1</issue>), <fpage>22</fpage>&#8211;<lpage>30</lpage>.</mixed-citation></ref>
<ref id="B8"><label>8</label><mixed-citation publication-type="book"><string-name><surname>Black</surname>, <given-names>L. W.</given-names></string-name>, <string-name><surname>Burkhalter</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Gastil</surname>, <given-names>J.</given-names></string-name>, &amp; <string-name><surname>Stromer-Galley</surname>, <given-names>J.</given-names></string-name> (<year>2010</year>). <chapter-title>Methods for analyzing and measuring group deliberation</chapter-title>. In <string-name><given-names>E. P.</given-names> <surname>Bucy</surname></string-name> &amp; <string-name><given-names>R. L.</given-names> <surname>Holbert</surname></string-name> (Eds.), <source>Sourcebook for political communication research: Methods, measures, and analytical techniques</source>. <publisher-loc>Hoboken, NJ</publisher-loc>: <publisher-name>Taylor &amp; Francis</publisher-name>.</mixed-citation></ref>
<ref id="B9"><label>9</label><mixed-citation publication-type="journal"><string-name><surname>Brundidge</surname>, <given-names>J.</given-names></string-name> (<year>2010</year>). <article-title>Encountering &#8220;difference&#8221; in the contemporary public sphere: The contribution of the internet to the heterogeneity of political discussion networks</article-title>. <source>Journal of Communication</source>, <volume>60</volume>(<issue>4</issue>), <fpage>680</fpage>&#8211;<lpage>700</lpage>. DOI: <pub-id pub-id-type="doi">10.1111/j.1460-2466.2010.01509.x</pub-id></mixed-citation></ref>
<ref id="B10"><label>10</label><mixed-citation publication-type="journal"><string-name><surname>Bucher</surname>, <given-names>T.</given-names></string-name> (<year>2017</year>). <article-title>The algorithmic imaginary: Exploring the ordinary affects of Facebook algorithms</article-title>. <source>Information, Communication &amp; Society</source>, <volume>20</volume>(<issue>1</issue>), <fpage>30</fpage>&#8211;<lpage>44</lpage>. DOI: <pub-id pub-id-type="doi">10.1080/1369118X.2016.1154086</pub-id></mixed-citation></ref>
<ref id="B11"><label>11</label><mixed-citation publication-type="journal"><string-name><surname>Chen</surname>, <given-names>G. M.</given-names></string-name>, <string-name><surname>Pain</surname>, <given-names>P.</given-names></string-name>, <string-name><surname>Chen</surname>, <given-names>V. Y.</given-names></string-name>, <string-name><surname>Mekelburg</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Springer</surname>, <given-names>N.</given-names></string-name>, &amp; <string-name><surname>Troger</surname>, <given-names>F.</given-names></string-name> (<year>2018</year>). <article-title>&#8216;You really have to have a thick skin&#8217;: A cross-cultural perspective on how online harassment influences female journalists</article-title>. <source>Journalism</source>, <volume>21</volume>(<issue>7</issue>), <fpage>877</fpage>&#8211;<lpage>895</lpage>. DOI: <pub-id pub-id-type="doi">10.1177/1464884918768500</pub-id></mixed-citation></ref>
<ref id="B12"><label>12</label><mixed-citation publication-type="journal"><string-name><surname>Chui</surname>, <given-names>R.</given-names></string-name> (<year>2014</year>). <article-title>A multi-faceted approach to anonymity online: Examining the relations between anonymity and antisocial behaviour</article-title>. <source>Journal for Virtual Worlds Research</source>, <volume>7</volume>(<issue>2</issue>). DOI: <pub-id pub-id-type="doi">10.4101/jvwr.v7i2.7073</pub-id></mixed-citation></ref>
<ref id="B13"><label>13</label><mixed-citation publication-type="journal"><string-name><surname>Coe</surname>, <given-names>K.</given-names></string-name>, <string-name><surname>Kenski</surname>, <given-names>K.</given-names></string-name>, &amp; <string-name><surname>Rains</surname>, <given-names>S. A.</given-names></string-name> (<year>2014</year>). <article-title>Online and uncivil? Patterns and determinants of incivility in newspaper website comments</article-title>. <source>Journal of Communication</source>, <volume>64</volume>(<issue>4</issue>), <fpage>658</fpage>&#8211;<lpage>679</lpage>. DOI: <pub-id pub-id-type="doi">10.1111/jcom.12104</pub-id></mixed-citation></ref>
<ref id="B14"><label>14</label><mixed-citation publication-type="book"><string-name><surname>Coleman</surname>, <given-names>S.</given-names></string-name>, &amp; <string-name><surname>Blumler</surname>, <given-names>J. G.</given-names></string-name> (<year>2009</year>). <source>The internet and democratic citizenship: Theory, practice and policy</source> (<edition>1st</edition> ed.). <publisher-name>Cambridge University Press</publisher-name>. DOI: <pub-id pub-id-type="doi">10.1017/CBO9780511818271</pub-id></mixed-citation></ref>
<ref id="B15"><label>15</label><mixed-citation publication-type="journal"><string-name><surname>Coleman</surname>, <given-names>S.</given-names></string-name>, &amp; <string-name><surname>Moss</surname>, <given-names>G.</given-names></string-name> (<year>2012</year>). <article-title>Under construction: The field of online deliberation research</article-title>. <source>Journal of Information Technology &amp; Politics</source>, <volume>9</volume>(<issue>1</issue>), <fpage>1</fpage>&#8211;<lpage>15</lpage>. DOI: <pub-id pub-id-type="doi">10.1080/19331681.2011.635957</pub-id></mixed-citation></ref>
<ref id="B16"><label>16</label><mixed-citation publication-type="journal"><string-name><surname>Connolly-Ahern</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Ahern</surname>, <given-names>L. A.</given-names></string-name>, &amp; <string-name><surname>Bortree</surname>, <given-names>D. S.</given-names></string-name> (<year>2009</year>). <article-title>The effectiveness of stratified constructed week sampling for content analysis of electronic news source archives: AP newswire, business wire, and PR newswire</article-title>. <source>Journalism &amp; Mass Communication Quarterly</source>, <volume>86</volume>(<issue>4</issue>), <fpage>862</fpage>&#8211;<lpage>883</lpage>. DOI: <pub-id pub-id-type="doi">10.1177/107769900908600409</pub-id></mixed-citation></ref>
<ref id="B17"><label>17</label><mixed-citation publication-type="journal"><string-name><surname>Conover</surname>, <given-names>P. J.</given-names></string-name>, &amp; <string-name><surname>Searing</surname>, <given-names>D. D.</given-names></string-name> (<year>2005</year>). <article-title>Studying &#8216;everyday political talk&#8217; in the deliberative system</article-title>. <source>Acta Politica</source>, <volume>40</volume>(<issue>3</issue>), <fpage>269</fpage>&#8211;<lpage>283</lpage>. DOI: <pub-id pub-id-type="doi">10.1057/palgrave.ap.5500113</pub-id></mixed-citation></ref>
<ref id="B18"><label>18</label><mixed-citation publication-type="journal"><string-name><surname>Crawford</surname>, <given-names>J. T.</given-names></string-name>, &amp; <string-name><surname>Pilanski</surname>, <given-names>J. M.</given-names></string-name> (<year>2014</year>). <article-title>Political intolerance, right <italic>and</italic> left</article-title>. <source>Political Psychology</source>, <volume>35</volume>(<issue>6</issue>), <fpage>841</fpage>&#8211;<lpage>851</lpage>. DOI: <pub-id pub-id-type="doi">10.1111/j.1467-9221.2012.00926.x</pub-id></mixed-citation></ref>
<ref id="B19"><label>19</label><mixed-citation publication-type="book"><string-name><surname>Dewey</surname>, <given-names>J.</given-names></string-name> (<year>1927</year>). <source>The public and its problems: An essay in political inquiry</source>. <publisher-loc>New York</publisher-loc>: <publisher-name>Holt</publisher-name>.</mixed-citation></ref>
<ref id="B20"><label>20</label><mixed-citation publication-type="webpage"><string-name><surname>Duggan</surname>, <given-names>M.</given-names></string-name> (<year>2017</year>). <source>Online Harassment 2017</source>. <publisher-name>Pew Research Center</publisher-name>, <publisher-loc>Washington, DC</publisher-loc>. <uri>http://www.pewinternet.org/2017/07/11/online-harassment-2017</uri>.</mixed-citation></ref>
<ref id="B21"><label>21</label><mixed-citation publication-type="book"><string-name><surname>Ellison</surname>, <given-names>N. B.</given-names></string-name>, &amp; <string-name><surname>Boyd</surname>, <given-names>D. M.</given-names></string-name> (<year>2013</year>). <chapter-title>Sociality through social network sites</chapter-title>. In <string-name><given-names>W. H.</given-names> <surname>Dutton</surname></string-name> (Ed.), <source>The Oxford handbook of internet studies</source> (<edition>1st</edition> ed.). <publisher-loc>Oxford</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>. DOI: <pub-id pub-id-type="doi">10.1093/oxfordhb/9780199589074.013.0008</pub-id></mixed-citation></ref>
<ref id="B22"><label>22</label><mixed-citation publication-type="journal"><string-name><surname>Esterling</surname>, <given-names>K. M.</given-names></string-name>, <string-name><surname>Fung</surname>, <given-names>A.</given-names></string-name>, &amp; <string-name><surname>Lee</surname>, <given-names>T.</given-names></string-name> (<year>2015</year>). <article-title>How much disagreement is good for democratic deliberation?</article-title> <source>Political Communication</source>, <volume>32</volume>(<issue>4</issue>), <fpage>529</fpage>&#8211;<lpage>551</lpage>. DOI: <pub-id pub-id-type="doi">10.1080/10584609.2014.969466</pub-id></mixed-citation></ref>
<ref id="B23"><label>23</label><mixed-citation publication-type="journal"><string-name><surname>Eveland</surname>, <given-names>W. P.</given-names></string-name> (<year>2004</year>). <article-title>The effect of political discussion in producing informed citizens: The roles of information, motivation, and elaboration</article-title>. <source>Political Communication</source>, <volume>21</volume>(<issue>2</issue>), <fpage>177</fpage>&#8211;<lpage>193</lpage>. DOI: <pub-id pub-id-type="doi">10.1080/10584600490443877</pub-id></mixed-citation></ref>
<ref id="B24"><label>24</label><mixed-citation publication-type="journal"><string-name><surname>Eveland</surname>, <given-names>W. P.</given-names></string-name>, &amp; <string-name><surname>Hively</surname>, <given-names>M. H.</given-names></string-name> (<year>2009</year>). <article-title>Political discussion frequency, network size, and &#8220;heterogeneity&#8221; of discussion as predictors of political knowledge and participation</article-title>. <source>Journal of Communication</source>, <volume>59</volume>(<issue>2</issue>), <fpage>205</fpage>&#8211;<lpage>224</lpage>. DOI: <pub-id pub-id-type="doi">10.1111/j.1460-2466.2009.01412.x</pub-id></mixed-citation></ref>
<ref id="B25"><label>25</label><mixed-citation publication-type="journal"><string-name><surname>Fox</surname>, <given-names>J.</given-names></string-name>, &amp; <string-name><surname>McEwan</surname>, <given-names>B.</given-names></string-name> (<year>2017</year>). <article-title>Distinguishing technologies for social interaction: The perceived social affordances of communication channels scale</article-title>. <source>Communication Monographs</source>, <volume>84</volume>(<issue>3</issue>), <fpage>298</fpage>&#8211;<lpage>318</lpage>. DOI: <pub-id pub-id-type="doi">10.1080/03637751.2017.1332418</pub-id></mixed-citation></ref>
<ref id="B26"><label>26</label><mixed-citation publication-type="journal"><string-name><surname>Freelon</surname>, <given-names>D.</given-names></string-name> (<year>2013</year>). <article-title>Discourse architecture, ideology, and democratic norms in online political discussion</article-title>. <source>New Media &amp; Society</source>, <volume>17</volume>(<issue>5</issue>), <fpage>772</fpage>&#8211;<lpage>791</lpage>. DOI: <pub-id pub-id-type="doi">10.1177/1461444813513259</pub-id></mixed-citation></ref>
<ref id="B27"><label>27</label><mixed-citation publication-type="journal"><string-name><surname>Garrett</surname>, <given-names>R. K.</given-names></string-name>, <string-name><surname>Carnahan</surname>, <given-names>D.</given-names></string-name>, &amp; <string-name><surname>Lynch</surname>, <given-names>E. K.</given-names></string-name> (<year>2013</year>). <article-title>A turn toward avoidance? Selective exposure to online political information, 2004&#8211;2008</article-title>. <source>Political Behavior</source>, <volume>35</volume>(<issue>1</issue>), <fpage>113</fpage>&#8211;<lpage>134</lpage>. DOI: <pub-id pub-id-type="doi">10.1007/s11109-011-9185-6</pub-id></mixed-citation></ref>
<ref id="B28"><label>28</label><mixed-citation publication-type="journal"><string-name><surname>Gervais</surname>, <given-names>B. T.</given-names></string-name> (<year>2014</year>). <article-title>Incivility online: Affective and behavioral reactions to uncivil political posts in a web-based experiment</article-title>. <source>Journal of Information Technology &amp; Politics</source>, <volume>12</volume>(<issue>2</issue>), <fpage>1</fpage>&#8211;<lpage>19</lpage>. DOI: <pub-id pub-id-type="doi">10.1080/19331681.2014.997416</pub-id></mixed-citation></ref>
<ref id="B29"><label>29</label><mixed-citation publication-type="journal"><string-name><surname>Gibson</surname>, <given-names>J. L.</given-names></string-name> (<year>1992</year>). <article-title>The political consequences of intolerance: Cultural conformity and political freedom</article-title>. <source>American Political Science Review</source>, <volume>86</volume>(<issue>2</issue>), <fpage>338</fpage>&#8211;<lpage>356</lpage>. DOI: <pub-id pub-id-type="doi">10.2307/1964224</pub-id></mixed-citation></ref>
<ref id="B30"><label>30</label><mixed-citation publication-type="journal"><string-name><surname>Gil de Z&#250;&#241;iga</surname>, <given-names>H.</given-names></string-name>, <string-name><surname>Jung</surname>, <given-names>N.</given-names></string-name>, &amp; <string-name><surname>Valenzuela</surname>, <given-names>S.</given-names></string-name> (<year>2012</year>). <article-title>Social media use for news and individuals&#8217; social capital, civic engagement and political participation</article-title>. <source>Journal of Computer-Mediated Communication</source>, <volume>17</volume>(<issue>3</issue>), <fpage>319</fpage>&#8211;<lpage>336</lpage>. DOI: <pub-id pub-id-type="doi">10.1111/j.1083-6101.2012.01574.x</pub-id></mixed-citation></ref>
<ref id="B31"><label>31</label><mixed-citation publication-type="journal"><string-name><surname>Graham</surname>, <given-names>T.</given-names></string-name> (<year>2012</year>). <article-title>Beyond &#8220;political&#8221; communicative spaces: Talking politics on the wife swap discussion forum</article-title>. <source>Journal of Information Technology &amp; Politics</source>, <volume>9</volume>(<issue>1</issue>), <fpage>31</fpage>&#8211;<lpage>45</lpage>. DOI: <pub-id pub-id-type="doi">10.1080/19331681.2012.635961</pub-id></mixed-citation></ref>
<ref id="B32"><label>32</label><mixed-citation publication-type="webpage"><string-name><surname>Gutmann</surname>, <given-names>A.</given-names></string-name>, &amp; <string-name><surname>Thompson</surname>, <given-names>D.</given-names></string-name> (<year>1996</year>). <source>Democracy and disagreement</source>. <publisher-loc>Cambridge, MA</publisher-loc>: <publisher-name>Harvard University Press</publisher-name>. <uri>http://www.hup.harvard.edu/catalog.php?isbn=9780674197664</uri>.</mixed-citation></ref>
<ref id="B33"><label>33</label><mixed-citation publication-type="book"><string-name><surname>Habermas</surname>, <given-names>J.</given-names></string-name> (<year>1996</year>). <source>Between facts and norms: Contributions to a discourse theory of law and democracy</source>. <publisher-loc>Cambridge, MA</publisher-loc>: <publisher-name>The MIT Press</publisher-name>. DOI: <pub-id pub-id-type="doi">10.7551/mitpress/1564.001.0001</pub-id></mixed-citation></ref>
<ref id="B34"><label>34</label><mixed-citation publication-type="journal"><string-name><surname>Halpern</surname>, <given-names>D.</given-names></string-name>, &amp; <string-name><surname>Gibbs</surname>, <given-names>J.</given-names></string-name> (<year>2013</year>). <article-title>Social media as a catalyst for online deliberation? Exploring the affordances of Facebook and YouTube for political expression</article-title>. <source>Computers in Human Behavior</source>, <volume>29</volume>(<issue>3</issue>), <fpage>1159</fpage>&#8211;<lpage>1168</lpage>. DOI: <pub-id pub-id-type="doi">10.1016/j.chb.2012.10.008</pub-id></mixed-citation></ref>
<ref id="B35"><label>35</label><mixed-citation publication-type="journal"><string-name><surname>Heatherly</surname>, <given-names>K. A.</given-names></string-name>, <string-name><surname>Lu</surname>, <given-names>Y.</given-names></string-name>, &amp; <string-name><surname>Lee</surname>, <given-names>J. K.</given-names></string-name> (<year>2016</year>). <article-title>Filtering out the other side? Cross-cutting and like-minded discussions on social networking sites</article-title>. <source>New Media &amp; Society</source>, <volume>19</volume>(<issue>8</issue>), <fpage>1271</fpage>&#8211;<lpage>1289</lpage>. DOI: <pub-id pub-id-type="doi">10.1177/1461444816634677</pub-id></mixed-citation></ref>
<ref id="B36"><label>36</label><mixed-citation publication-type="journal"><string-name><surname>Hester</surname>, <given-names>J. B.</given-names></string-name>, &amp; <string-name><surname>Dougall</surname>, <given-names>E.</given-names></string-name> (<year>2007</year>). <article-title>The efficiency of constructed week sampling for content analysis of online news</article-title>. <source>Journalism &amp; Mass Communication Quarterly</source>, <volume>84</volume>(<issue>4</issue>), <fpage>811</fpage>&#8211;<lpage>824</lpage>. DOI: <pub-id pub-id-type="doi">10.1177/107769900708400410</pub-id></mixed-citation></ref>
<ref id="B37"><label>37</label><mixed-citation publication-type="journal"><string-name><surname>Hmielowski</surname>, <given-names>J. D.</given-names></string-name>, <string-name><surname>Hutchens</surname>, <given-names>M. J.</given-names></string-name>, &amp; <string-name><surname>Cicchirillo</surname>, <given-names>V. J.</given-names></string-name> (<year>2014</year>). <article-title>Living in an age of online incivility: Examining the conditional indirect effects of online discussion on political flaming</article-title>. <source>Information, Communication &amp; Society</source>, <volume>17</volume>(<issue>10</issue>), <fpage>1196</fpage>&#8211;<lpage>1211</lpage>. DOI: <pub-id pub-id-type="doi">10.1080/1369118X.2014.899609</pub-id></mixed-citation></ref>
<ref id="B38"><label>38</label><mixed-citation publication-type="journal"><string-name><surname>Hong</surname>, <given-names>Y.</given-names></string-name>, &amp; <string-name><surname>Rojas</surname>, <given-names>H.</given-names></string-name> (<year>2016</year>). <article-title>Agreeing not to disagree: Iterative versus episodic forms of political participatory behaviors</article-title>. <source>International Journal of Communication</source>, <volume>10</volume>, <fpage>1743</fpage>&#8211;<lpage>1763</lpage>.</mixed-citation></ref>
<ref id="B39"><label>39</label><mixed-citation publication-type="journal"><string-name><surname>Huckfeldt</surname>, <given-names>R.</given-names></string-name>, &amp; <string-name><surname>Mendez</surname>, <given-names>J. M.</given-names></string-name> (<year>2008</year>). <article-title>Moths, flames, and political engagement: Managing disagreement within communication networks</article-title>. <source>The Journal of Politics</source>, <volume>70</volume>(<issue>01</issue>), <fpage>83</fpage>&#8211;<lpage>96</lpage>. DOI: <pub-id pub-id-type="doi">10.1017/S0022381607080073</pub-id></mixed-citation></ref>
<ref id="B40"><label>40</label><mixed-citation publication-type="journal"><string-name><surname>Lindsay</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Booth</surname>, <given-names>J. M.</given-names></string-name>, <string-name><surname>Messing</surname>, <given-names>J. T.</given-names></string-name>, &amp; <string-name><surname>Thaller</surname>, <given-names>J.</given-names></string-name> (<year>2016</year>). <article-title>Experiences of online harassment among emerging adults: Emotional reactions and the mediating role of fear</article-title>. <source>Journal of Interpersonal Violence</source>, <volume>31</volume>(<issue>19</issue>), <fpage>3174</fpage>&#8211;<lpage>3195</lpage>. DOI: <pub-id pub-id-type="doi">10.1177/0886260515584344</pub-id></mixed-citation></ref>
<ref id="B41"><label>41</label><mixed-citation publication-type="book"><string-name><surname>L&#252;decke</surname>, <given-names>D.</given-names></string-name> (<year>2018</year>). <source>sjPlot&#8212;Data Visualization for Statistics in Social Science</source>. <publisher-name>Zenodo</publisher-name>. DOI: <pub-id pub-id-type="doi">10.5281/ZENODO.1308157</pub-id></mixed-citation></ref>
<ref id="B42"><label>42</label><mixed-citation publication-type="book"><string-name><surname>Maia</surname>, <given-names>R. C. M.</given-names></string-name> (<year>2012</year>). <source>Deliberation, the media and political talk</source>. <publisher-loc>New York</publisher-loc>: <publisher-name>Hampton Press</publisher-name>.</mixed-citation></ref>
<ref id="B43"><label>43</label><mixed-citation publication-type="book"><string-name><surname>Maia</surname>, <given-names>R. C. M.</given-names></string-name> (<year>2014</year>). <source>Recognition and the media</source>. <publisher-loc>London</publisher-loc>: <publisher-name>Palgrave Macmillan</publisher-name>. DOI: <pub-id pub-id-type="doi">10.1057/9781137310439</pub-id></mixed-citation></ref>
<ref id="B44"><label>44</label><mixed-citation publication-type="book"><string-name><surname>Maia</surname>, <given-names>R. C. M.</given-names></string-name> (<year>2017</year>). <chapter-title>Politicization, new media, and everyday deliberation</chapter-title>. In <string-name><given-names>P.</given-names> <surname>Fawcett</surname></string-name>, <string-name><given-names>M.</given-names> <surname>Flinders</surname></string-name>, <string-name><given-names>C.</given-names> <surname>Hay</surname></string-name>, &amp; <string-name><given-names>M.</given-names> <surname>Wood</surname></string-name> (Eds.), <source>Anti-politics, depoliticization, and governance</source> (pp. <fpage>68</fpage>&#8211;<lpage>90</lpage>). <publisher-loc>Oxford</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>. DOI: <pub-id pub-id-type="doi">10.1093/oso/9780198748977.003.0004</pub-id></mixed-citation></ref>
<ref id="B45"><label>45</label><mixed-citation publication-type="book"><string-name><surname>Maia</surname>, <given-names>R. C. M.</given-names></string-name> (<year>2018</year>). <chapter-title>Deliberative media</chapter-title>. In <string-name><given-names>A.</given-names> <surname>B&#228;chtiger</surname></string-name>, <string-name><given-names>J. S.</given-names> <surname>Dryzek</surname></string-name>, <string-name><given-names>J.</given-names> <surname>Mansbridge</surname></string-name>, &amp; <string-name><given-names>M. E.</given-names> <surname>Warren</surname></string-name> (Eds.), <source>The Oxford handbook of deliberative democracy</source> (pp. <fpage>348</fpage>&#8211;<lpage>364</lpage>). <publisher-name>Oxford University Press</publisher-name>. DOI: <pub-id pub-id-type="doi">10.1093/oxfordhb/9780198747369.013.11</pub-id></mixed-citation></ref>
<ref id="B46"><label>46</label><mixed-citation publication-type="journal"><string-name><surname>Maia</surname>, <given-names>R. C. M.</given-names></string-name>, &amp; <string-name><surname>Rezende</surname>, <given-names>T. A. S.</given-names></string-name> (<year>2016</year>). <article-title>Respect and disrespect in deliberation across the networked media environment: Examining multiple paths of political talk: Disrespect in deliberation across digital settings</article-title>. <source>Journal of Computer-Mediated Communication</source>, <volume>21</volume>(<issue>2</issue>), <fpage>121</fpage>&#8211;<lpage>139</lpage>. DOI: <pub-id pub-id-type="doi">10.1111/jcc4.12155</pub-id></mixed-citation></ref>
<ref id="B47"><label>47</label><mixed-citation publication-type="journal"><string-name><surname>Maia</surname>, <given-names>R. C. M.</given-names></string-name>, <string-name><surname>Cal</surname>, <given-names>D.</given-names></string-name>, <string-name><surname>Bargas</surname>, <given-names>J.</given-names></string-name>, &amp; <string-name><surname>Crepalde</surname>, <given-names>J. C.</given-names></string-name> (<year>2020</year>). <article-title>Which types of reason-giving and storytelling are good for deliberation?</article-title> <source>European Political Science Review</source>. DOI: <pub-id pub-id-type="doi">10.1017/S1755773919000328</pub-id></mixed-citation></ref>
<ref id="B48"><label>48</label><mixed-citation publication-type="journal"><string-name><surname>Maia</surname>, <given-names>R. C. M.</given-names></string-name>, <string-name><surname>Hauber</surname>, <given-names>G.</given-names></string-name>, <string-name><surname>Choucair</surname>, <given-names>T.</given-names></string-name>, &amp; <string-name><surname>Crepalde</surname>, <given-names>N. J.</given-names></string-name> (<year>2020</year>). <article-title>What kind of disagreement favors reason-giving? Analyzing online political discussions across the broader public sphere</article-title>. <source>Political Studies</source>, <volume>69</volume>(<issue>1</issue>), <fpage>108</fpage>&#8211;<lpage>128</lpage>. DOI: <pub-id pub-id-type="doi">10.1177/0032321719894708</pub-id></mixed-citation></ref>
<ref id="B49"><label>49</label><mixed-citation publication-type="book"><string-name><surname>Mansbridge</surname>, <given-names>J.</given-names></string-name> (<year>1999</year>). <chapter-title>Everyday talk in the deliberative system</chapter-title>. In <string-name><given-names>S.</given-names> <surname>Macedo</surname></string-name> (Ed.), <source>Deliberative politics: Essays on democracy and disagreement</source> (pp. <fpage>1</fpage>&#8211;<lpage>211</lpage>). <publisher-loc>New York</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>.</mixed-citation></ref>
<ref id="B50"><label>50</label><mixed-citation publication-type="journal"><string-name><surname>Mitchell</surname>, <given-names>K. J.</given-names></string-name>, <string-name><surname>Ybarra</surname>, <given-names>M. L.</given-names></string-name>, <string-name><surname>Jones</surname>, <given-names>L. M.</given-names></string-name>, &amp; <string-name><surname>Espelage</surname>, <given-names>D.</given-names></string-name> (<year>2016</year>). <article-title>What features make online harassment incidents upsetting to youth?</article-title> <source>Journal of School Violence</source>, <volume>15</volume>(<issue>3</issue>), <fpage>279</fpage>&#8211;<lpage>301</lpage>. DOI: <pub-id pub-id-type="doi">10.1080/15388220.2014.990462</pub-id></mixed-citation></ref>
<ref id="B51"><label>51</label><mixed-citation publication-type="journal"><string-name><surname>Moy</surname>, <given-names>P.</given-names></string-name>, &amp; <string-name><surname>Gastil</surname>, <given-names>J.</given-names></string-name> (<year>2006</year>). <article-title>Predicting deliberative conversation: The impact of discussion networks, media use, and political cognitions</article-title>. <source>Political Communication</source>, <volume>23</volume>(<issue>4</issue>), <fpage>443</fpage>&#8211;<lpage>460</lpage>. DOI: <pub-id pub-id-type="doi">10.1080/10584600600977003</pub-id></mixed-citation></ref>
<ref id="B52"><label>52</label><mixed-citation publication-type="book"><string-name><surname>Mutz</surname>, <given-names>D.</given-names></string-name> (<year>2006</year>). <source>Hearing the other side: Deliberative versus participatory democracy</source>. <publisher-loc>New York</publisher-loc>: <publisher-name>Cambridge University Press</publisher-name>. DOI: <pub-id pub-id-type="doi">10.1017/CBO9780511617201</pub-id></mixed-citation></ref>
<ref id="B53"><label>53</label><mixed-citation publication-type="journal"><string-name><surname>Neblo</surname>, <given-names>M.</given-names></string-name> (<year>2005</year>). <article-title>Thinking through democracy: Between the theory and practice of deliberative politics</article-title>. <source>Acta Politica</source>, <volume>40</volume>(<issue>2</issue>), <fpage>169</fpage>&#8211;<lpage>181</lpage>. DOI: <pub-id pub-id-type="doi">10.1057/palgrave.ap.5500102</pub-id></mixed-citation></ref>
<ref id="B54"><label>54</label><mixed-citation publication-type="book"><string-name><surname>Neuendorf</surname>, <given-names>K. A.</given-names></string-name> (<year>2002</year>). <source>The content analysis guidebook</source> (<edition>1st</edition> ed.). <publisher-loc>Los Angeles, CA</publisher-loc>: <publisher-name>SAGE Publications, Inc</publisher-name>.</mixed-citation></ref>
<ref id="B55"><label>55</label><mixed-citation publication-type="journal"><string-name><surname>O&#8217;Sullivan</surname>, <given-names>P. B.</given-names></string-name>, &amp; <string-name><surname>Flanagin</surname>, <given-names>A. J.</given-names></string-name> (<year>2003</year>). <article-title>Reconceptualizing &#8216;flaming&#8217; and other problematic messages</article-title>. <source>New Media &amp; Society</source>, <volume>5</volume>(<issue>1</issue>), <fpage>69</fpage>&#8211;<lpage>94</lpage>. DOI: <pub-id pub-id-type="doi">10.1177/1461444803005001908</pub-id></mixed-citation></ref>
<ref id="B56"><label>56</label><mixed-citation publication-type="book"><string-name><surname>Pampel</surname>, <given-names>F. C.</given-names></string-name> (<year>2000</year>). <source>Logistic regression: A primer</source> (vol. 132). <publisher-loc>Los Angeles, CA</publisher-loc>: <publisher-name>Sage</publisher-name>. DOI: <pub-id pub-id-type="doi">10.4135/9781412984805</pub-id></mixed-citation></ref>
<ref id="B57"><label>57</label><mixed-citation publication-type="journal"><string-name><surname>Papacharissi</surname>, <given-names>Z.</given-names></string-name> (<year>2004</year>). <article-title>Democracy online: Civility, politeness, and the democratic potential of online political discussion groups</article-title>. <source>New Media &amp; Society</source>, <volume>6</volume>(<issue>2</issue>), <fpage>259</fpage>&#8211;<lpage>283</lpage>. DOI: <pub-id pub-id-type="doi">10.1177/1461444804041444</pub-id></mixed-citation></ref>
<ref id="B58"><label>58</label><mixed-citation publication-type="book"><string-name><surname>Pariser</surname>, <given-names>E.</given-names></string-name> (<year>2011</year>). <source>The filter bubble: what the internet is hiding from you</source>. <publisher-loc>London</publisher-loc>: <publisher-name>Penguin Press</publisher-name>.</mixed-citation></ref>
<ref id="B59"><label>59</label><mixed-citation publication-type="book"><string-name><surname>Parkinson</surname>, <given-names>D. J.</given-names></string-name>, &amp; <string-name><surname>Mansbridge</surname>, <given-names>P. J.</given-names></string-name> (Eds.) (<year>2012</year>). <source>Deliberative systems</source>. <publisher-loc>Cambridge</publisher-loc>: <publisher-name>Cambridge University Press</publisher-name>. DOI: <pub-id pub-id-type="doi">10.1017/CBO9781139178914</pub-id></mixed-citation></ref>
<ref id="B60"><label>60</label><mixed-citation publication-type="book"><string-name><surname>Rossini</surname>, <given-names>P.</given-names></string-name> (<year>2019</year>). <chapter-title>Disentangling uncivil and intolerant discourse</chapter-title>. In <string-name><given-names>R.</given-names> <surname>Boatright</surname></string-name>, <string-name><given-names>T.</given-names> <surname>Shaffer</surname></string-name>, <string-name><given-names>S.</given-names> <surname>Sobieraj</surname></string-name>, &amp; <string-name><given-names>D. G.</given-names> <surname>Young</surname></string-name> (Eds.), <source>A crisis of civility? Contemporary research on civility, incivility, and political discourse</source> (pp. <fpage>142</fpage>&#8211;<lpage>157</lpage>). <publisher-loc>New York</publisher-loc>: <publisher-name>Routledge</publisher-name>. DOI: <pub-id pub-id-type="doi">10.4324/9781351051989-9</pub-id></mixed-citation></ref>
<ref id="B61"><label>61</label><mixed-citation publication-type="journal"><string-name><surname>Rowe</surname>, <given-names>I.</given-names></string-name> (<year>2015</year>). <article-title>Civility 2.0: A comparative analysis of incivility in online political discussion</article-title>. <source>Information, Communication &amp; Society</source>, <volume>18</volume>(<issue>2</issue>), <fpage>121</fpage>&#8211;<lpage>138</lpage>. DOI: <pub-id pub-id-type="doi">10.1080/1369118X.2014.940365</pub-id></mixed-citation></ref>
<ref id="B62"><label>62</label><mixed-citation publication-type="journal"><string-name><surname>Santana</surname>, <given-names>A. D.</given-names></string-name> (<year>2014</year>). <article-title>Virtuous or vitriolic: The effect of anonymity on civility in online newspaper reader comment boards</article-title>. <source>Journalism Practice</source>, <volume>8</volume>(<issue>1</issue>), <fpage>18</fpage>&#8211;<lpage>33</lpage>. DOI: <pub-id pub-id-type="doi">10.1080/17512786.2013.813194</pub-id></mixed-citation></ref>
<ref id="B63"><label>63</label><mixed-citation publication-type="journal"><string-name><surname>Scheufele</surname>, <given-names>D. A.</given-names></string-name>, <string-name><surname>Nisbet</surname>, <given-names>M. C.</given-names></string-name>, <string-name><surname>Brossard</surname>, <given-names>D.</given-names></string-name>, &amp; <string-name><surname>Nisbet</surname>, <given-names>E. C.</given-names></string-name> (<year>2004</year>). <article-title>Social structure and citizenship: Examining the impacts of social setting, network heterogeneity, and informational variables on political participation</article-title>. <source>Political Communication</source>, <volume>21</volume>(<issue>3</issue>), <fpage>315</fpage>&#8211;<lpage>338</lpage>. DOI: <pub-id pub-id-type="doi">10.1080/10584600490481389</pub-id></mixed-citation></ref>
<ref id="B64"><label>64</label><mixed-citation publication-type="journal"><string-name><surname>Shah</surname>, <given-names>D. V.</given-names></string-name> (<year>2016</year>). <article-title>Conversation is the soul of democracy: Expression effects, communication mediation, and digital media</article-title>. <source>Communication and the Public</source>, <volume>1</volume>(<issue>1</issue>), <fpage>12</fpage>&#8211;<lpage>18</lpage>. DOI: <pub-id pub-id-type="doi">10.1177/2057047316628310</pub-id></mixed-citation></ref>
<ref id="B65"><label>65</label><mixed-citation publication-type="journal"><string-name><surname>Sobieraj</surname>, <given-names>S.</given-names></string-name>, &amp; <string-name><surname>Berry</surname>, <given-names>J. M.</given-names></string-name> (<year>2011</year>). <article-title>From incivility to outrage: Political discourse in blogs, talk radio, and cable news</article-title>. <source>Political Communication</source>, <volume>28</volume>(<issue>1</issue>), <fpage>19</fpage>&#8211;<lpage>41</lpage>. DOI: <pub-id pub-id-type="doi">10.1080/10584609.2010.542360</pub-id></mixed-citation></ref>
<ref id="B66"><label>66</label><mixed-citation publication-type="journal"><string-name><surname>Soffer</surname>, <given-names>O.</given-names></string-name>, &amp; <string-name><surname>Gordoni</surname>, <given-names>G.</given-names></string-name> (<year>2018</year>). <article-title>Opinion expression via user comments on news websites: Analysis through the perspective of the spiral of silence</article-title>. <source>Information, Communication &amp; Society</source>, <volume>21</volume>(<issue>3</issue>), <fpage>388</fpage>&#8211;<lpage>403</lpage>. DOI: <pub-id pub-id-type="doi">10.1080/1369118X.2017.1281991</pub-id></mixed-citation></ref>
<ref id="B67"><label>67</label><mixed-citation publication-type="book"><string-name><surname>Steiner</surname>, <given-names>J.</given-names></string-name> (<year>2012</year>). <source>The foundations of deliberative democracy</source>. <publisher-loc>Cambridge</publisher-loc>: <publisher-name>Cambridge University Press</publisher-name>. DOI: <pub-id pub-id-type="doi">10.1017/CBO9781139057486</pub-id></mixed-citation></ref>
<ref id="B68"><label>68</label><mixed-citation publication-type="book"><string-name><surname>Steiner</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Jaramillo</surname>, <given-names>M. C.</given-names></string-name>, <string-name><surname>Maia</surname>, <given-names>R. C. M.</given-names></string-name>, &amp; <string-name><surname>Mameli</surname>, <given-names>S.</given-names></string-name> (<year>2017</year>). <source>Deliberation across deep divisions: Transformative moments</source>. <publisher-loc>Cambridge, MA</publisher-loc>: <publisher-name>Cambridge University Press</publisher-name>.</mixed-citation></ref>
<ref id="B69"><label>69</label><mixed-citation publication-type="journal"><string-name><surname>Stromer-Galley</surname>, <given-names>J.</given-names></string-name> (<year>2007</year>). <article-title>Measuring deliberation&#8217;s content: A coding scheme</article-title>. <source>Journal of Public Deliberation</source>, <volume>3</volume>(<issue>1</issue>), <fpage>12</fpage>. DOI: <pub-id pub-id-type="doi">10.16997/jdd.50</pub-id></mixed-citation></ref>
<ref id="B70"><label>70</label><mixed-citation publication-type="journal"><string-name><surname>Stromer-Galley</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Bryant</surname>, <given-names>L.</given-names></string-name>, &amp; <string-name><surname>Bimber</surname>, <given-names>B.</given-names></string-name> (<year>2015</year>). <article-title>Context and medium matter: Expressing disagreements online and face-to-face in political deliberations</article-title>. <source>Journal of Public Deliberation</source>, <volume>11</volume>(<issue>1</issue>), <fpage>1</fpage>. DOI: <pub-id pub-id-type="doi">10.16997/jdd.218</pub-id></mixed-citation></ref>
<ref id="B71"><label>71</label><mixed-citation publication-type="book"><string-name><surname>Stromer-Galley</surname>, <given-names>J.</given-names></string-name>, &amp; <string-name><surname>Wichowski</surname>, <given-names>A.</given-names></string-name> (<year>2011</year>). <chapter-title>Political discussion online</chapter-title>. In <string-name><given-names>M.</given-names> <surname>Consalvo</surname></string-name> &amp; <string-name><given-names>C.</given-names> <surname>Ess</surname></string-name> (Eds.), (vol. <volume>11</volume>, pp. <fpage>168</fpage>&#8211;<lpage>187</lpage>). <publisher-loc>Malden, MA</publisher-loc>: <publisher-name>Wiley-Blackwell</publisher-name>. DOI: <pub-id pub-id-type="doi">10.1002/9781444314861.ch8</pub-id></mixed-citation></ref>
<ref id="B72"><label>72</label><mixed-citation publication-type="journal"><string-name><surname>Stroud</surname>, <given-names>N. J.</given-names></string-name>, <string-name><surname>Scacco</surname>, <given-names>J. M.</given-names></string-name>, <string-name><surname>Muddiman</surname>, <given-names>A.</given-names></string-name>, &amp; <string-name><surname>Curry</surname>, <given-names>A. L.</given-names></string-name> (<year>2014</year>). <article-title>Changing deliberative norms on news organizations&#8217; Facebook sites</article-title>. <source>Journal of Computer-Mediated Communication</source>, <volume>20</volume>(<issue>2</issue>), <fpage>188</fpage>&#8211;<lpage>203</lpage>. DOI: <pub-id pub-id-type="doi">10.1111/jcc4.12104</pub-id></mixed-citation></ref>
<ref id="B73"><label>73</label><mixed-citation publication-type="journal"><string-name><surname>Suler</surname>, <given-names>J.</given-names></string-name> (<year>2004</year>). <article-title>The online disinhibition effect</article-title>. <source>CyberPsychology &amp; Behavior</source>, <volume>7</volume>(<issue>3</issue>), <fpage>321</fpage>&#8211;<lpage>326</lpage>. DOI: <pub-id pub-id-type="doi">10.1089/1094931041291295</pub-id></mixed-citation></ref>
<ref id="B74"><label>74</label><mixed-citation publication-type="book"><string-name><surname>Sunstein</surname>, <given-names>C. R.</given-names></string-name> (<year>2009</year>). <source>Republic.com 2.0</source>. <publisher-loc>Oxford</publisher-loc>: <publisher-name>Princeton University Press</publisher-name>.</mixed-citation></ref>
<ref id="B75"><label>75</label><mixed-citation publication-type="journal"><string-name><surname>Sydnor</surname>, <given-names>E.</given-names></string-name> (<year>2018</year>). <article-title>Platforms for incivility: Examining perceptions across different media formats</article-title>. <source>Political Communication</source>, <volume>35</volume>(<issue>1</issue>), <fpage>97</fpage>&#8211;<lpage>116</lpage>. DOI: <pub-id pub-id-type="doi">10.1080/10584609.2017.1355857</pub-id></mixed-citation></ref>
<ref id="B76"><label>76</label><mixed-citation publication-type="book"><string-name><surname>Sydnor</surname>, <given-names>E.</given-names></string-name> (<year>2019</year>). <source>Disrespectful democracy: The psychology of political incivility</source>. <publisher-loc>New York</publisher-loc>: <publisher-name>Columbia University Press</publisher-name>. DOI: <pub-id pub-id-type="doi">10.7312/sydn18924</pub-id></mixed-citation></ref>
<ref id="B77"><label>77</label><mixed-citation publication-type="webpage"><string-name><surname>Turner</surname>, <given-names>D. D.</given-names></string-name> (<year>2010</year>). <source>Comments gone wild: Trolls, frames, and the crisis at online newspapers</source>. mimeo. Retrieved from <uri>http://twoangstroms.com/s/CrisisInCommenting.pdf</uri>.</mixed-citation></ref>
<ref id="B78"><label>78</label><mixed-citation publication-type="journal"><string-name><surname>Vaccari</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Valeriani</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Barber&#225;</surname>, <given-names>P.</given-names></string-name>, <string-name><surname>Jost</surname>, <given-names>J. T.</given-names></string-name>, <string-name><surname>Nagler</surname>, <given-names>J.</given-names></string-name>, &amp; <string-name><surname>Tucker</surname>, <given-names>J. A.</given-names></string-name> (<year>2016</year>). <article-title>Of echo chambers and contrarian clubs: Exposure to political disagreement among German and Italian users of twitter</article-title>. <source>Social Media+ Society</source>, <volume>2</volume>(<issue>3</issue>). DOI: <pub-id pub-id-type="doi">10.1177/2056305116664221</pub-id></mixed-citation></ref>
<ref id="B79"><label>79</label><mixed-citation publication-type="journal"><string-name><surname>Valenzuela</surname>, <given-names>S.</given-names></string-name>, &amp; <string-name><surname>Bachmann</surname>, <given-names>I.</given-names></string-name> (<year>2015</year>). <article-title>Pride, anger, and cross-cutting talk: A three-country study of emotions and disagreement in informal political discussions</article-title>. <source>International Journal of Public Opinion Research</source>, <volume>27</volume>(<issue>4</issue>), <fpage>544</fpage>&#8211;<lpage>564</lpage>. DOI: <pub-id pub-id-type="doi">10.1093/ijpor/edv040</pub-id></mixed-citation></ref>
<ref id="B80"><label>80</label><mixed-citation publication-type="journal"><string-name><surname>Valenzuela</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Kim</surname>, <given-names>Y.</given-names></string-name>, &amp; <string-name><surname>Gil de Z&#250;&#241;iga</surname>, <given-names>H.</given-names></string-name> (<year>2012</year>). <article-title>Social networks that matter: Exploring the role of political discussion for online political participation</article-title>. <source>International Journal of Public Opinion Research</source>, <volume>24</volume>(<issue>2</issue>), <fpage>163</fpage>&#8211;<lpage>184</lpage>. DOI: <pub-id pub-id-type="doi">10.1093/ijpor/edr037</pub-id></mixed-citation></ref>
<ref id="B81"><label>81</label><mixed-citation publication-type="book"><string-name><surname>Walsh</surname>, <given-names>K. C.</given-names></string-name> (<year>2003</year>). <source>Talking about politics: Informal groups and social identity in American life</source> (<edition>1st</edition> ed.). <publisher-loc>Chicago, IL</publisher-loc>: <publisher-name>University of Chicago Press</publisher-name>. DOI: <pub-id pub-id-type="doi">10.7208/chicago/9780226872216.001.0001</pub-id></mixed-citation></ref>
<ref id="B82"><label>82</label><mixed-citation publication-type="journal"><string-name><surname>Weeks</surname>, <given-names>B. E.</given-names></string-name>, <string-name><surname>Lane</surname>, <given-names>D. S.</given-names></string-name>, <string-name><surname>Kim</surname>, <given-names>D. H.</given-names></string-name>, <string-name><surname>Lee</surname>, <given-names>S. S.</given-names></string-name>, &amp; <string-name><surname>Kwak</surname>, <given-names>N.</given-names></string-name> (<year>2017</year>). <article-title>Incidental exposure, selective exposure, and political information sharing: Integrating online exposure patterns and expression on social media</article-title>. <source>Journal of Computer-Mediated Communication</source>, <volume>22</volume>(<issue>6</issue>), <fpage>363</fpage>&#8211;<lpage>379</lpage>. DOI: <pub-id pub-id-type="doi">10.1111/jcc4.12199</pub-id></mixed-citation></ref>
<ref id="B83"><label>83</label><mixed-citation publication-type="journal"><string-name><surname>Wojcieszak</surname>, <given-names>M.</given-names></string-name> (<year>2010</year>). <article-title>&#8216;Don&#8217;t talk to me&#8217;: Effects of ideologically homogeneous online groups and politically dissimilar offline ties on extremism</article-title>. <source>New Media &amp; Society</source>, <volume>12</volume>(<issue>4</issue>), <fpage>637</fpage>&#8211;<lpage>655</lpage>. DOI: <pub-id pub-id-type="doi">10.1177/1461444809342775</pub-id></mixed-citation></ref>
<ref id="B84"><label>84</label><mixed-citation publication-type="journal"><string-name><surname>Wojcieszak</surname>, <given-names>M.</given-names></string-name> (<year>2011</year>). <article-title>Pulling toward or pulling away: Deliberation, disagreement, and opinion extremity in political participation</article-title>. <source>Social Science Quarterly</source>, <volume>92</volume>(<issue>1</issue>), <fpage>207</fpage>&#8211;<lpage>225</lpage>. DOI: <pub-id pub-id-type="doi">10.1111/j.1540-6237.2011.00764.x</pub-id></mixed-citation></ref>
<ref id="B85"><label>85</label><mixed-citation publication-type="journal"><string-name><surname>Wojcieszak</surname>, <given-names>M. E.</given-names></string-name>, <string-name><surname>Baek</surname>, <given-names>Y. M.</given-names></string-name>, &amp; <string-name><surname>Carpini</surname>, <given-names>M. X. D.</given-names></string-name> (<year>2010</year>). <article-title>Deliberative and participatory democracy? Ideological strength and the processes leading from deliberation to political engagement</article-title>. <source>International Journal of Public Opinion Research</source>, <volume>22</volume>(<issue>2</issue>), <fpage>154</fpage>&#8211;<lpage>180</lpage>. DOI: <pub-id pub-id-type="doi">10.1093/ijpor/edp050</pub-id></mixed-citation></ref>
<ref id="B86"><label>86</label><mixed-citation publication-type="journal"><string-name><surname>Wojcieszak</surname>, <given-names>M.</given-names></string-name>, &amp; <string-name><surname>Mutz</surname>, <given-names>D.</given-names></string-name> (<year>2009</year>). <article-title>Online groups and political discourse: Do online discussion spaces facilitate exposure to political disagreement?</article-title> <source>Journal of Communication</source>, <volume>59</volume>(<issue>1</issue>), <fpage>40</fpage>&#8211;<lpage>56</lpage>. DOI: <pub-id pub-id-type="doi">10.1111/j.1460-2466.2008.01403.x</pub-id></mixed-citation></ref>
<ref id="B87"><label>87</label><mixed-citation publication-type="journal"><string-name><surname>Wojcieszak</surname>, <given-names>M.</given-names></string-name>, &amp; <string-name><surname>Price</surname>, <given-names>V.</given-names></string-name> (<year>2010</year>). <article-title>Bridging the divide or intensifying the conflict? How disagreement affects strong predilections about sexual minorities</article-title>. <source>Political Psychology</source>, <volume>31</volume>(<issue>3</issue>), <fpage>315</fpage>&#8211;<lpage>339</lpage>. DOI: <pub-id pub-id-type="doi">10.1111/j.1467-9221.2009.00753.x</pub-id></mixed-citation></ref>
<ref id="B88"><label>88</label><mixed-citation publication-type="journal"><string-name><surname>Wojcieszak</surname>, <given-names>M.</given-names></string-name>, &amp; <string-name><surname>Price</surname>, <given-names>V.</given-names></string-name> (<year>2012</year>). <article-title>Perceived versus actual disagreement: Which influences deliberative experiences?</article-title> <source>Journal of Communication</source>, <volume>62</volume>(<issue>3</issue>), <fpage>418</fpage>&#8211;<lpage>436</lpage>. DOI: <pub-id pub-id-type="doi">10.1111/j.1460-2466.2012.01645.x</pub-id></mixed-citation></ref>
<ref id="B89"><label>89</label><mixed-citation publication-type="webpage"><string-name><surname>Wright</surname>, <given-names>S.</given-names></string-name> (<year>2012</year>). <article-title>From &#8220;third place&#8221; to &#8220;third space&#8221;: Everyday political talk in non-political online spaces</article-title>. <source>Javnost &#8211; The Public</source>, <volume>19</volume>(<issue>3</issue>). DOI: <uri>http://javnost-thepublic.org/article/2012/3/1/</uri></mixed-citation></ref>
<ref id="B90"><label>90</label><mixed-citation publication-type="journal"><string-name><surname>Xenos</surname>, <given-names>M.</given-names></string-name>, &amp; <string-name><surname>Moy</surname>, <given-names>P.</given-names></string-name> (<year>2007</year>). <article-title>Direct and differential effects of the internet on political and civic engagement</article-title>. <source>Journal of Communication</source>, <volume>57</volume>(<issue>4</issue>), <fpage>704</fpage>&#8211;<lpage>718</lpage>. DOI: <pub-id pub-id-type="doi">10.1111/j.1460-2466.2007.00364.x</pub-id></mixed-citation></ref>
<ref id="B91"><label>91</label><mixed-citation publication-type="journal"><string-name><surname>Zhang</surname>, <given-names>W.</given-names></string-name>, &amp; <string-name><surname>Chang</surname>, <given-names>L.</given-names></string-name> (<year>2014</year>). <article-title>Perceived speech conditions and disagreement of everyday talk: A proceduralist perspective of citizen deliberation: Perceived speech conditions and disagreement</article-title>. <source>Communication Theory</source>, <volume>24</volume>(<issue>2</issue>), <fpage>124</fpage>&#8211;<lpage>145</lpage>. DOI: <pub-id pub-id-type="doi">10.1111/comt.12034</pub-id></mixed-citation></ref>
</ref-list>
</back>
</article>