<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20120330//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd">
<!--<?xml-stylesheet type="text/xsl" href="article.xsl"?>-->
<article article-type="research-article" dtd-version="1.2" xml:lang="en" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
<front>
<journal-meta>
<journal-id journal-id-type="issn">2634-0488</journal-id>
<journal-title-group>
<journal-title>Journal of Deliberative Democracy</journal-title>
</journal-title-group>
<issn pub-type="epub">2634-0488</issn>
<publisher>
<publisher-name>University of Westminster Press</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.16997/jdd.1335</article-id>
<article-categories>
<subj-group>
<subject>Research article</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>The Influence of Leaders on the Quality of Citizen Deliberation: An Exploratory Assessment of Online Deliberation in New Zealand</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Susin</surname>
<given-names>Audrey</given-names>
</name>
<email>audreyasusin@outlook.com</email>
<xref ref-type="aff" rid="aff-1">1</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Ordonez-Ponce</surname>
<given-names>Eduardo</given-names>
</name>
<xref ref-type="aff" rid="aff-2">2</xref>
</contrib>
</contrib-group>
<aff id="aff-1"><label>1</label>Athabasca University, CA</aff>
<aff id="aff-2"><label>2</label>Faculty of Business, Athabasca University, CA</aff>
<pub-date publication-format="electronic" date-type="pub" iso-8601-date="2023-09-22">
<day>22</day>
<month>09</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="collection">
<year>2023</year>
</pub-date>
<volume>19</volume>
<issue>1</issue>
<fpage>1</fpage>
<lpage>14</lpage>
<history>
<date date-type="received" iso-8601-date="2022-06-13">
<day>13</day>
<month>06</month>
<year>2022</year>
</date>
<date date-type="accepted" iso-8601-date="2023-07-11">
<day>11</day>
<month>07</month>
<year>2023</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright: &#x00A9; 2023 The Author(s)</copyright-statement>
<copyright-year>2023</copyright-year>
<license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/4.0/">
<license-p>This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International License (CC-BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. See <uri xlink:href="http://creativecommons.org/licenses/by/4.0/">http://creativecommons.org/licenses/by/4.0/</uri>.</license-p>
</license>
</permissions>
<self-uri xlink:href="https://delibdemjournal.org/articles/10.16997/jdd.1335/"/>
<abstract>
<p>Leaders can be essential in setting the tone of deliberation in the public sphere, but can their discursive style influence the wider public sphere? Mass communication usually mediates leader-citizen interactions, and the proliferation of social media has presented new, large-scale opportunities to support deliberation. Further, leaders using these platforms have widespread reach. Using deliberative discourse analysis, this exploratory research studies whether leaders influence the quality of citizen deliberation and whether this is dependent on the online arena. Two leaders with contrasting communication styles were chosen: New Zealand prime minister Jacinda Ardern and opposition leader Judith Collins. Two online arenas were included: a national news media Facebook page and the leaders&#8217; respective Facebook pages. The results found that deliberative quality was variable within the news mass media arena; however, citizens displayed higher deliberative quality when the leader did so in the leader-led online media arena.</p>
<p>This study suggests that leaders can use deliberative dialogue to foster more deliberative discussion among citizens when they engage as both participants and facilitators in arenas with greater access to directly support deliberation. It presents theoretical arguments for leaders to participate in legitimation processes as part of the response to the problem of scale and introduces a communication model for leaders to support deliberation in the public sphere. The model suggests that the leader&#8217;s ability to affect the deliberative quality of citizens&#8217; discussions is mediated by their level of influence within that space.</p>
</abstract>
<kwd-group>
<kwd>deliberative communication</kwd>
<kwd>online deliberation</kwd>
<kwd>deliberative quality</kwd>
<kwd>systemic approach to deliberation</kwd>
<kwd>deliberative democracy</kwd>
<kwd>deliberative leadership</kwd>
<kwd>leadership influence</kwd>
<kwd>leadership style</kwd>
</kwd-group>
</article-meta>
</front>
<body>
<sec>
<title>Introduction</title>
<p>Leaders can be essential in setting the tone of deliberation in the public sphere (<xref ref-type="bibr" rid="B11">Chambers 2009</xref>; <xref ref-type="bibr" rid="B24">Dryzek 2010</xref>). But can leaders&#8217; discursive style influence the wider public sphere? This exploratory research studies whether leaders influence the quality of citizen deliberation. Since mass communication usually mediates leader-citizen interactions, there is a need to examine deliberation in systemic terms and consider the relevant technological affordances. To explore this, this study looks at whether a political leader&#8217;s use, or lack thereof, of deliberative communication style online, in turn, impacts citizens&#8217; use, or lack thereof, of deliberative dialogue online, and if so, if this is dependent on the online arena. These questions are examined by analyzing the deliberative quality of former New Zealand Prime Minister Jacinda Ardern&#8217;s and former opposition leader Judith Collins&#8217;s discussions during three periods and in two online arenas. It then analyzes the deliberative quality of online citizen discussions and whether the leaders&#8217; impact on citizen deliberation is dependent on the online arena.</p>
<p>This study presents theoretical arguments for leaders to participate in legitimation processes as part of the response to the problem of scale, introducing a communication model for leaders to support public deliberation. According to the proposed model, the leader&#8217;s ability to affect the deliberative quality of citizens&#8217; discussions is mediated by their level of influence within that space. While exploratory, the study suggests that when leaders have greater access to support deliberative dialogue and actively engage as both participants and facilitators, they can foster more deliberative discussions among citizens. This is an important finding with significant implications for political communication literature, helping in building a communication model for leaders that supports deliberation in the public sphere.</p>
</sec>
<sec>
<title>Literature Review</title>
<sec>
<title>Leaders&#8217; influence in shaping public discourse</title>
<p>Despite deliberative dialogue showing success on a small scale (<xref ref-type="bibr" rid="B12">Chambers 2010</xref>), it goes against the long-understood impossibility of involving all citizens at this level in large-scale decision-making (<xref ref-type="bibr" rid="B23">Dryzek 2001</xref>; <xref ref-type="bibr" rid="B36">Goodin 2000</xref>; <xref ref-type="bibr" rid="B42">Iyengar et al. 2019</xref>). In interpreting Habermas&#8217;s critical theory, many deliberative theorists have sought to recreate the conditions that were meant as theoretical ideals to develop his critical theory of society. In his quest to resurrect the Enlightenment project of a life informed by reason (<xref ref-type="bibr" rid="B56">McCarthy 1984</xref>), Habermas outlined his discourse ethics and ideal speech situations as the conditions that must occur: discourse must be unconstrained, among free and equal competent participants, free from self-deception and strategic interaction (<xref ref-type="bibr" rid="B22">Dryzek 1990</xref>). Within this context, the aims of deliberative democracy have been criticized as unachievable (<xref ref-type="bibr" rid="B46">Knight &amp; Johnson 1997</xref>). As Parkinson (<xref ref-type="bibr" rid="B60">2001</xref>) put it, little in mass public communication can be labeled &#8216;deliberative.&#8217;</p>
<p>Further, the presupposition of political equality renders the idea impossible (<xref ref-type="bibr" rid="B46">Knight &amp; Johnson, 1997</xref>). Mouffe (<xref ref-type="bibr" rid="B58">2000</xref>) argues that a primary shortcoming of the deliberative approach is that Habermas&#8217;s &#8216;no force except that of the better argument&#8217; (1984: 24) requires power to be eliminated in favor of realized rational consensus. This interpretation of Habermasian ideas leaves out the possibility of a leader. Despite the rigorous demands of the ideal speech situation being criticized as unattainable, Dryzek (<xref ref-type="bibr" rid="B22">1990</xref>) clarifies that its primary value is critical. Although Habermas has also since clarified his work, these interpretations have persisted, including the exclusion of the politicians&#8217; role in deliberation.</p>
<p>Applying his theory of communication and rationality specifically to the deliberative project, Habermas (<xref ref-type="bibr" rid="B39">2006</xref>) describes two critical conditions for this realization: a self-regulating media system, independent from its social environment; and the audience (citizens) providing feedback between an informed elite discourse and a responsive civil society. Political elite help to construct public opinion as coauthors and addresses with the expectation of ensuring the plurality of considered public opinion. In response, citizens respond to the issues articulated by the elite by setting the frame for the range of what they would accept as legitimate decisions. According to Habermas (<xref ref-type="bibr" rid="B39">2006</xref>), the issue should be sought with the content and format of political communication, and mediated political communication should not be required to meet the strict demands of full deliberation. In other words, it need not be given that a leader&#8217;s discourse be antithesis to the deliberative project, and informal discussions that do not meet the strict demands of the ideal speech situations should be relaxed in favor of settings that contribute to the whole (<xref ref-type="bibr" rid="B55">Mansbridge et al. 2012</xref>). In fact, Barber (<xref ref-type="bibr" rid="B2">2003</xref>) places informal conversations at the center of democracy as the force that builds communities by shifting the sense of &#8216;<italic>I&#8217;</italic> to the &#8216;<italic>we&#8217;</italic> needed for generating political action. This &#8216;systems&#8217; thinking enables deliberative democracy theory to start addressing its problem of scale (<xref ref-type="bibr" rid="B55">Mansbridge et al. 2012</xref>).</p>
<p>The problem however, with leaders being &#8216;under the glare of publicity&#8217; is that without the influence of a dialogue partner, leaders speak, appealing to the broader public, but with content that is of suspect, in what Chambers calls &#8216;plebiscitary rhetoric&#8217; (2010). Coercion in the form of persuasion cannot be separated from their speech because their authority (<xref ref-type="bibr" rid="B48">Kuyper 2012</xref>) and strategic intentions will arguably be present in their communication. Moreover, what leaders say carries weight; a leader&#8217;s display of incivility increases citizens&#8217; unwillingness to compromise (<xref ref-type="bibr" rid="B33">Gervais 2018</xref>), lowers their political trust, and increases their animosity toward the out-party (<xref ref-type="bibr" rid="B69">Skytte 2021</xref>).</p>
<p>More broadly, how leaders frame their messages to the public remains a primary way they influence citizens&#8217; opinions (<xref ref-type="bibr" rid="B20">Druckman &amp; Nelson 2003</xref>). &#8216;A framing effect occurs when in the course of describing an issue or event, a speaker&#8217;s emphasis on a subset of potentially relevant considerations causes individuals to focus on these considerations when constructing their opinions&#8217; (<xref ref-type="bibr" rid="B19">Druckman 2001: 1042</xref>). Over the past quarter-century, numerous studies have shown that opinions can be substantially shaped by framing effects (<xref ref-type="bibr" rid="B21">Druckman et al. 2013</xref>).</p>
<p>The same forms of strategic communication can also be used for deliberative means. Frames need not be persuasion for one side but can be used to highlight thinking about different perspectives (<xref ref-type="bibr" rid="B31">Friedman 2007</xref>). Romsdahl et al. (<xref ref-type="bibr" rid="B64">2018: 2</xref>) define deliberative framing as a frame that &#8216;emphasizes the importance of advancing and learning from multiple perspectives and empathizing with others&#8217; values.&#8217; Rhetoric is another tool that can be used to persuade citizens to legitimize others&#8217; views (<xref ref-type="bibr" rid="B24">Dryzek 2010</xref>).</p>
<p>Against the backdrop of supporting the creation of a good deliberative system, the role of leaders remains largely unstudied (<xref ref-type="bibr" rid="B48">Kuyper 2012</xref>). To keep mass deliberative democracy from becoming utopian and unrealistic, Chambers (<xref ref-type="bibr" rid="B12">2010</xref>) and Dryzek (<xref ref-type="bibr" rid="B24">2010</xref>) have proposed a monological role for leaders as deliberative orators where asymmetrical and mediated communication follows along deliberative lines. For example, Dryzek (<xref ref-type="bibr" rid="B24">2010</xref>) describes the role of rhetoric as crucial in Mandela demonstrating his understanding of the discursive psychology of his most radical constituents by validating the discourse of struggle while marginalizing the discourse of violence.</p>
<p>Several scholars have put forth the idea of including leaders as active participants in deliberative processes, both within citizen assemblies (<xref ref-type="bibr" rid="B30">Flinders et al. 2016</xref>; <xref ref-type="bibr" rid="B51">Lees-Marshment 2016</xref>; <xref ref-type="bibr" rid="B75">Suiter et al. 2016</xref>) and in everyday informal talk (<xref ref-type="bibr" rid="B51">Lees-Marshment 2016</xref>; <xref ref-type="bibr" rid="B41">Hendriks &amp; Lees-Marshment 2019</xref>). Because elite framing remains a substantive part of public opinion formation (<xref ref-type="bibr" rid="B19">Druckman 2001</xref>) and is largely an elite-driven activity that constitutes most citizens&#8217; democratic experience (<xref ref-type="bibr" rid="B50">Leeper &amp; Slothuus 2018</xref>), more attention should be given to what role leaders should play in support of the deliberative project, especially given their widespread reach and the problem of scale that currently plagues deliberative theory.</p>
<p>Kuyper (<xref ref-type="bibr" rid="B48">2012</xref>) suggests that leaders fill the role of facilitator/moderator in deliberations in mini-publics. This aligns with later research by Strandberg et al. (<xref ref-type="bibr" rid="B72">2015</xref>; <xref ref-type="bibr" rid="B73">2019</xref>), which, although did not look at leaders, demonstrated facilitators&#8217; success in influencing better deliberation in citizen discussions. Despite the enthusiasm of many deliberative democrats toward mini-publics in response to the frustration of finding mechanisms to influence deliberation at the macro level, Lafont (<xref ref-type="bibr" rid="B49">2015</xref>) argues that focusing on mini-publics diminishes the legitimacy of the deliberative system as a whole. &#8216;The lattice structure of leadership&#8217; also fails to account for the counterforce of leadership by intensely focusing on the leader&#8217;s role as representative. If democracy is tasked with tracking citizens&#8217; preferences (actual or counterfactual), Beerbohm (<xref ref-type="bibr" rid="B3">2015</xref>) highlights the insoluble role of democratic leadership when viewed as either opposed to participatory self-government; or as a follower, responsive to citizens&#8217; preferences. In response, he proposes the Commitment Theory of democratic leadership. Though not a deliberative account per se, the Commitment Theory envisions instances of democratic leadership in which leaders do something <italic>with</italic> their followers in a joint cooperative effort. For example, President Lincoln changed citizens&#8217; views on slavery and their commitment to ending it (<xref ref-type="bibr" rid="B3">Beerbohm 2015</xref>). As an action performed with citizens, there is a presupposition of a shared understanding in the interlocking of intentions. Perhaps then, to effectuate a democratic or deliberative account of leadership where shared commitment is created, leaders must first elicit what Habermas described as the mutual understanding that necessitates the formation of rational opinion.</p>
<p>The large-scale influence of a leader&#8217;s communication on the deliberative system has been limited to monological addresses. Social media opens avenues not available to deliberative orators like Mandela where politicians can connect and respond directly with large citizen audiences (<xref ref-type="bibr" rid="B65">Ross &amp; B&#252;rger 2014</xref>; <xref ref-type="bibr" rid="B70">S&#248;rensen 2016</xref>). The internet has helped increase the number of politically active people (<xref ref-type="bibr" rid="B34">Gibson et al. 2005</xref>) and has been suggested as an important new source of political information (<xref ref-type="bibr" rid="B4">Bode 2016</xref>). Indeed, online platforms have advantages that extend beyond reach, with informal talk fostering political disagreement that tends to be avoided offline (<xref ref-type="bibr" rid="B66">Rossini &amp; Maia 2021</xref>). While the relationship between political messaging and political knowledge is weak (<xref ref-type="bibr" rid="B28">Eveland 2004</xref>), interpersonal discussions can increase political learning by engaging in slower, central-route information processing (<xref ref-type="bibr" rid="B44">Jung et al. 2011</xref>). Left to their own accord however, online deliberations tend to be less deliberative than those guided by a facilitator to follow rules of engagement (<xref ref-type="bibr" rid="B72">Strandberg 2015</xref>). Even in groups with like-minded individuals, which usually leads to group polarization (<xref ref-type="bibr" rid="B76">Sunstein 2000</xref>), the presence of facilitators can alleviate opinion polarization (<xref ref-type="bibr" rid="B73">Strandberg et al. 2019</xref>). A study by Esau et al. (<xref ref-type="bibr" rid="B27">2021</xref>) found that as regulatory guides or rules of engagement for discussion decrease, so does the overall quality of deliberation. Political leaders are increasingly using social media to connect to constituents (<xref ref-type="bibr" rid="B65">Ross &amp; B&#252;rger 2014</xref>). Rather than limiting the leader&#8217;s role to facilitators of mini-publics, participants of citizen assemblies, or orators, bolstered by their mass media reach, social media allows them to participate in and facilitate large-scale citizen discussions. This study explores the possibility for leaders to promote listening and understanding amongst citizens of diverse opinions by expanding the transmission of deliberative ideals to the broader, informal public sphere.</p>
<p>As participants with citizens in dialogue, leaders can model deliberation for citizens and influence them through deliberative talk, rhetoric, and deliberative frames. Simultaneously, while facilitating the discussion, they can pass on the rules of engagement for the respectful exchange of opinions.</p>
</sec>
</sec>
<sec sec-type="methods">
<title>Methods</title>
<p>To achieve the purpose of this article, leaders&#8217; speeches were analyzed, along with the corresponding sample of citizen online discussions. Former Prime Minister of New Zealand Jacinda Ardern and former opposition leader Judith Collins were chosen because both use Facebook Live to communicate with citizens in real-time, have different communication styles, and are female leaders within the same geographical area. The leaders&#8217; gender was held constant because perceptions of the effectiveness of female and male leaders can vary according to position and institution (<xref ref-type="bibr" rid="B61">Paustian-Underdahl et al. 2014</xref>). Additionally, New Zealand and its political leaders were considered as a useful context for this exploratory research for three main reasons. First, New Zealand is a country broadly committed to democratic norms and values, being among the top five strongest democracies in the world (<xref ref-type="bibr" rid="B52">Levine 2004</xref>; <xref ref-type="bibr" rid="B79">Willige 2017</xref>). Second, former Prime Minister Ardern has been globally acknowledged for her leadership style (<xref ref-type="bibr" rid="B68">Simpson et al. 2022</xref>), which was tested when faced with a massive shooting and the COVID-19 pandemic, both events that created discussion and opposing views to her policies (<xref ref-type="bibr" rid="B29">Every-Palmer et al. 2021</xref>; <xref ref-type="bibr" rid="B57">McGuire et al. 2020</xref>). And third, just like in other parts of the world, New Zealand society is getting increasingly intolerant and polarised (<xref ref-type="bibr" rid="B63">Porat 2023</xref>; <xref ref-type="bibr" rid="B43">Jaworska &amp; V&#225;squez 2022</xref>), an issue exacerbated by social media that more experienced politicians argue somehow helps explain Arden&#8217;s resignation (<xref ref-type="bibr" rid="B14">Clark 2023</xref>). While these features shed some light on the institutional context that supports deliberative dialogue in New Zealand, highlighting their regulative, normative, and cultural dimensions (<xref ref-type="bibr" rid="B67">Scott 2013</xref>), further research is encouraged to deepen the role that institutional factors play in citizen deliberation.</p>
<p>Video clips of interviews conducted on news and radio channels, as well as sessions in the House of Commons, and their Facebook Live sessions and tweets between July 2020 and June 2021 were assessed to understand Ardern&#8217;s and Collins&#8217; communication styles and use of deliberative talk. Additionally, Ardern&#8217;s interviews and Facebook Live sessions while campaigning before taking office in September 2017 were reviewed to assess for differences in her communication style under this context, of which none were found. Thus, it was decided she would serve as an effective comparison. Since Collins&#8217; Facebook Live sessions only took place during the campaign period, two sets of interviews with the leaders from a national show were included.</p>
<p>Three separate contexts were considered: 1) during the campaign period in August 2020, 2) during the non-COVID lockdown period and on a non-COVID subject in November 2020, and 3) during the COVID lockdown and discussing COVID-related subjects in March 2021. The subject of the discussions was held constant where possible: the housing bubble during the non-lockdown COVID period and COVID during the COVID period. During the campaign period, both conversations had the broader COVID subject. Ardern discussed the decision to push back the election date, vaccination, and initiatives to buffer the impacts of lockdowns. Collins discussed the impact of COVID on farming, current regulations, and international workers&#8217; VISAs. Discussions coded from Facebook comments (citizens) and leaders (videos), female political leaders, New Zealand, and interviews chosen close together in date for the comparison period were held constant.</p>
<p>Three interviews from each leader were analyzed, along with the corresponding comments made by citizens on Facebook, for a total of six leader interviews and six citizen discussions. The interviews and Facebook Live sessions that were closest in date were chosen within the date ranges of the three contexts as comparisons. The interviewer was held constant and, when possible, the specific topic of discussion under the broader topic of COVID-19.</p>
<p>Video posts were transcribed, and the number of comments and views were recorded. Each video post&#8217;s comments were then copied sequentially into a spreadsheet. The first 100 sequential comments were coded from each television interview comment section. Since comments often followed a discussion thread and responses to leaders&#8217; video comments, and because this study aims to explore deliberation within the context of the conversation, this study did not make a random selection of comments as similar studies have done (for example, Esau et al. (<xref ref-type="bibr" rid="B27">2021</xref>)). The first 200 sequential comments out of 395 were copied for analysis from the comment section of Collins&#8217;s Facebook Live video. Because Ardern&#8217;s video had over 10 thousand comments and extracting them in a sequential order was not possible, 418 of the first comments marked as most engaged (number of replies) in sequential order were copied into a document. Ultimately, a final sample of 1,018 user comments and 82 leader speech instances were analyzed across three different contexts.</p>
<p>Comments from the leaders and citizens were analyzed for their deliberative discourse quality using qualitative content analysis based on a combination of a modified version of Steenbergen et al.&#8217;s (<xref ref-type="bibr" rid="B71">2003</xref>) discourse quality index (DQI) and elements from Stromer-Galley&#8217;s (<xref ref-type="bibr" rid="B74">2007</xref>) deliberative coding scheme. The modified version of the DQI was developed to better align with the current research in deliberation: the addition of narrative in the form of storytelling and personal impact to the justification of claims (<xref ref-type="bibr" rid="B5">Boswell 2013</xref>; <xref ref-type="bibr" rid="B80">Young 2002</xref>). Additionally, similar to the modification made by Elstub et al. (<xref ref-type="bibr" rid="B26">2021</xref>), all speech instances were coded, not just those making demands as the original DQI requires (<xref ref-type="bibr" rid="B71">Steenbergen et al. 2003</xref>) to capture the overall level of respect within the discussion. DQI incorporates a participation score to capture the ability of participants to participate freely in the discussion. A score of 1 is provided for a speech instance where normal participation was possible and 0 when it was interrupted by a speaker (<xref ref-type="bibr" rid="B71">Steenbergen et al. 2003</xref>). Because participants&#8217; speech instances are not interrupted in this arena (text-based), the participation code was removed from the DQI score (<xref ref-type="bibr" rid="B26">Elstub et al. 2021</xref>). The scores from each category of the DQI were added to create an index on a scale from 0&#8211;1.</p>
<p>The modified DQI, despite the addition of narrative to content justification, lacked important measures to understand the context of the conversation that is also important for deliberation, such as group heterogeneity (<xref ref-type="bibr" rid="B76">Sunstein 2000</xref>), the degree to which the discussion remained on topic (<xref ref-type="bibr" rid="B74">Stromer-Galley 2007</xref>), and engagement or reciprocity (<xref ref-type="bibr" rid="B37">Habermas 1984</xref>, <xref ref-type="bibr" rid="B38">1985</xref>). As such, additional coding measures were added based on Stromer-Galley&#8217;s (<xref ref-type="bibr" rid="B74">2007</xref>) coding scheme, including the number of participants who agreed and disagreed with the leader&#8217;s position and the number of comments on topic. Furthermore, to supplement the measures of engagement and reciprocity, the number of comments that took the form of metatalk, the number of social talk instances participants engaged in, and the number of replies to other citizens&#8217; comments were coded. <xref ref-type="table" rid="T1">Table 1</xref> summarises the aspects coded in both the leaders&#8217; and citizens&#8217; comments and the measures used to capture these aspects. Coded speech instances and comments from citizens and leaders were analyzed using the individual measures and the modified DQI. The study had one coder; thus, intercoder reliability was not obtained. To account for this, the coder completed several independent revisions for each discussion to ensure consistency.</p>
<table-wrap id="T1">
<label>Table 1</label>
<caption>
<p>Aspects, measures, and definitions of deliberation analyzed.</p>
</caption>
<table>
<thead>
<tr>
<td align="left" valign="top"><bold>Aspect</bold></td>
<td align="center" valign="top"><bold>Measure</bold></td>
<td align="center" valign="top"><bold>Definition</bold></td>
<td align="center" valign="top"><bold>DQI Score</bold></td>
</tr>
</thead>
<tbody>
<tr>
<td colspan="4"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Equality (DQI)<sup>&#945;</sup></td>
<td align="left" valign="top">Participation</td>
<td align="left" valign="top">Equal opportunity to participate.</td>
<td align="left" valign="top">Not included</td>
</tr>
<tr>
<td colspan="4"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Reason Giving (DQI)<sup>&#945;</sup></td>
<td align="left" valign="top">Level of justification</td>
<td align="left" valign="top">Level of justification or completeness of the justifications made of the demands or appeals of the speech including implicit references.</td>
<td align="left" valign="top">(0) No justification. Participants makes an appeal without giving a reason for it.<break/>(1) Inferior justification: Reason provided but the participant does not make the link the appeal to the reason or only supports it using illustration.<break/>(2) Qualified justification: Participant makes one single complete inference for why an appeal should be accepted.<break/>(3) Sophisticated justification: Participant makes a minimum of 2 complete justifications for the same appeal or one complete justification for two separate appeals.</td>
</tr>
<tr>
<td colspan="4"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"></td>
<td align="left" valign="top">Content of justification</td>
<td align="left" valign="top">Whether appeals or demands were made in terms of reference to narrow group interests, the greater good, the difference principle, or personal experience.</td>
<td align="left" valign="top">(0) Explicit Statement concerning group interests<break/>(1) Neutral Statement<break/>(2) Explicit Statement of the common good in utilitarian terms<break/>(2b) Explicit Statement of the common good in terms of the difference principle<break/>(2C) Statement of personal impact</td>
</tr>
<tr>
<td colspan="4"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Respect (DQI)<sup>&#945;</sup></td>
<td align="left" valign="top">Respect for groups</td>
<td align="left" valign="top">Measured respect toward all groups participating in the discussion or affected by the policies discussed in the discussion.</td>
<td align="left" valign="top">(0) No respect<break/>(1) Implicit respect<break/>(2) Explicit respect</td>
</tr>
<tr>
<td align="left" valign="top"></td>
<td align="left" valign="top">Respect for demands</td>
<td align="left" valign="top">Measured whether participants respected the demands or appeals of others.</td>
<td align="left" valign="top">(0) No respect<break/>(1) Implicit respect<break/>(2) Explicit respect</td>
</tr>
<tr>
<td align="left" valign="top"></td>
<td align="left" valign="top">Respect for counterarguments</td>
<td align="left" valign="top">Measured whether participants respected the counterarguments made by others whose views they didn&#8217;t agree with.</td>
<td align="left" valign="top">(0) Counterarguments ignored<break/>(1) Counterarguments included but degraded<break/>(2) Counterarguments included &#8211; neutral<break/>(3) Counterarguments included and valued</td>
</tr>
<tr>
<td colspan="4"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Aim for consensus (DQI)<sup>&#945;</sup></td>
<td align="left" valign="top">Constructive politics</td>
<td align="left" valign="top">Whether participants attempted to reach consensus by making mediated proposals that considers the appeals or goals of each group, or whether they merely sit on their Position without attempt to reconcile or consensus build.</td>
<td align="left" valign="top">(0) Positional politics: No attempt by the Speaker to compromise, reconcile, or build consensus.<break/>(1) Alternative proposal: Speaker makes a proposal that does not fit the current agenda and is not relevant to the current debate.<break/>(2) mediated proposal: Speaker makes a mediated proposal that fits the current debate in attempt to compromise, reconcile, or build consensus.</td>
</tr>
<tr>
<td colspan="4"><hr/></td>
</tr>
<tr>
<td align="left" valign="top" colspan="4">Other aspects measured:</td>
</tr>
<tr>
<td colspan="4"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Engagement<sup>&#946;</sup></td>
<td align="left" valign="top">Reciprocity</td>
<td align="left" valign="top">Engaging in dialogue vs. monologue.</td>
<td align="left" valign="top">This study measured the number of participants who replied to other participants&#8217; comments within the discussion to capture whether they are simply talking past each other and stating their positions or talking to each other in a back-and-forth exchange.</td>
</tr>
<tr>
<td align="left" valign="top"></td>
<td align="left" valign="top">On Topic</td>
<td align="left" valign="top">Number of participant comments on topic.</td>
<td align="left" valign="top"></td>
</tr>
<tr>
<td align="left" valign="top"></td>
<td align="left" valign="top">Metatalk</td>
<td align="left" valign="top">Talk about talk&#8217; when participants demonstrate reflecting on the conversation.</td>
<td align="left" valign="top">Sought clarification or to clarify one&#8217;s own Statements or Statements of others, summarise the consensus of the group, state perceived conflicts in the discussion.</td>
</tr>
<tr>
<td align="left" valign="top"></td>
<td align="left" valign="top">Social Talk</td>
<td align="left" valign="top">Greetings, praise, apologies, general social chit chat</td>
<td align="left" valign="top"></td>
</tr>
<tr>
<td colspan="4"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Heterogeneity<sup>&#946;</sup></td>
<td align="left" valign="top">Disagreement</td>
<td align="left" valign="top">Number of participants with diverse views.</td>
<td align="left" valign="top">This study used the Proportion of people who agreed or disagreed with the opinion of the leader speaking in the Video they were commenting on.</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn><p><sup>&#945;</sup>: (<xref ref-type="bibr" rid="B71">Steenbergen et al., 2003</xref>); <sup>&#946;</sup> (<xref ref-type="bibr" rid="B74">Stromer-Galley, 2007</xref>)</p></fn>
</table-wrap-foot>
</table-wrap>
</sec>
<sec>
<title>Results</title>
<p>All the discussions contained a heterogeneous mix of citizens with views for and against the opinion of leaders (<xref ref-type="table" rid="T2">Table 2</xref>), discussions were on topic for much of each discussion, and citizens displayed reciprocity by responding to one another and the leader.</p>
<table-wrap id="T2">
<label>Table 2</label>
<caption>
<p>Group heterogeneity of citizen discussions.</p>
</caption>
<table>
<thead>
<tr>
<td align="left" valign="top" rowspan="3"></td>
<td align="center" valign="top" colspan="2"><bold>COVID Period</bold></td>
<td align="center" valign="top" colspan="2"><bold>Non-Iockdown COVID Period</bold></td>
<td align="center" valign="top" colspan="2"><bold>Campaign Period</bold></td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="center" valign="top"><bold>CoIIins Mar 9 Citizen&#8217;s Discussion</bold></td>
<td align="center" valign="top"><bold>Ardern Mar 7 Citizen&#8217;s Discussion</bold></td>
<td align="center" valign="top"><bold>Collins Nov 17 Citizen&#8217;s Discussion</bold></td>
<td align="center" valign="top"><bold>Ardern Nov 29 Citizen&#8217;s Discussion</bold></td>
<td align="center" valign="top"><bold>Collins Aug 25 Citizen&#8217;s Discussion</bold></td>
<td align="center" valign="top"><bold>Ardern Aug 18 Citizen&#8217;s Discussion</bold></td>
</tr>
</thead>
<tbody>
<tr>
<td colspan="7"><hr/></td>
</tr>
<tr>
<td valign="top" align="left"><italic>Agree with opinion of leader</italic>*</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">Yes</td>
<td valign="top" align="right">4.17%</td>
<td valign="top" align="right">19.40%</td>
<td valign="top" align="right">8.33%</td>
<td valign="top" align="right">17.54%</td>
<td valign="top" align="right">42.86%</td>
<td valign="top" align="right">67.51%</td>
</tr>
<tr>
<td valign="top" align="left">No</td>
<td valign="top" align="right">79.17%</td>
<td valign="top" align="right">46.27%</td>
<td valign="top" align="right">51.67%</td>
<td valign="top" align="right">40.35%</td>
<td valign="top" align="right">10.71%</td>
<td valign="top" align="right">4.52%</td>
</tr>
<tr>
<td valign="top" align="left">Unsure</td>
<td valign="top" align="right">16.67%</td>
<td valign="top" align="right">29.85%</td>
<td valign="top" align="right">40.00%</td>
<td valign="top" align="right">38.60%</td>
<td valign="top" align="right">41.96%</td>
<td valign="top" align="right">24.86%</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn><p>* only applicable comments were coded</p></fn>
</table-wrap-foot>
</table-wrap>
<p>Though the number of participants who replied to others decreased in both leaders&#8217; Facebook Live discussions with citizens to 32.14% (Collins) and 35.31% for Ardern (<xref ref-type="table" rid="T3">Table 3</xref>), more citizens posted social greetings to Ardern.</p>
<table-wrap id="T3">
<label>Table 3</label>
<caption>
<p>Engagement.</p>
</caption>
<table>
<thead>
<tr>
<td align="center" valign="top" colspan="6"><bold>Engagement</bold> (in percentage of frequency)</td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"></td>
<td align="left" valign="top"></td>
<td align="center" valign="top"><bold>On Topic</bold></td>
<td align="center" valign="top"><bold>Reciprocity</bold></td>
<td align="center" valign="top"><bold>Metatalk</bold></td>
<td align="center" valign="top"><bold>Social Talk</bold></td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top" colspan="6"><bold>News Arena &#8211; COVID Lockdown period</bold></td>
</tr>
<tr>
<td align="left" valign="top"><italic>Collins Mar 9,2021 Trans-</italic></td>
<td align="left" valign="top">Collins&#8217; speech (N = 7)</td>
<td align="right" valign="top">&#8211;</td>
<td align="right" valign="top">&#8211;</td>
<td align="right" valign="top">0</td>
<td align="right" valign="top">14.29</td>
</tr>
<tr>
<td align="left" valign="top" rowspan="3"><italic>Ardern Mar 7, 2021 Community</italic></td>
<td align="left" valign="top">citizen&#8217;s discussion (N = 100)</td>
<td align="right" valign="top">95</td>
<td align="right" valign="top">64.58</td>
<td align="right" valign="top">11</td>
<td align="right" valign="top">2</td>
</tr>
<tr>
<td align="left" valign="top">Ardern&#8217;s speech (N = 13)</td>
<td align="right" valign="top">&#8211;</td>
<td align="right" valign="top">&#8211;</td>
<td align="right" valign="top">7.69</td>
<td align="right" valign="top">0</td>
</tr>
<tr>
<td align="left" valign="top">citizen&#8217;s discussion (N = 100)</td>
<td align="right" valign="top">92</td>
<td align="right" valign="top">64.18</td>
<td align="right" valign="top">18</td>
<td align="right" valign="top">3</td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top" colspan="6"><bold>News Arena &#8211; non-lockdown COVID period</bold></td>
</tr>
<tr>
<td align="left" valign="top"><italic>Collins Nov 17, 2020 Honsing</italic></td>
<td align="left" valign="top">Collins&#8217; speech (N = 9)</td>
<td align="right" valign="top">&#8211;</td>
<td align="right" valign="top">&#8211;</td>
<td align="right" valign="top">0</td>
<td align="right" valign="top">0</td>
</tr>
<tr>
<td align="left" valign="top" rowspan="3"><italic>Ardern Nov 29,2020 Housing</italic></td>
<td align="left" valign="top">citizen&#8217;s discussion (N = 100)</td>
<td align="right" valign="top">93</td>
<td align="right" valign="top">66.67</td>
<td align="right" valign="top">5</td>
<td align="right" valign="top">0</td>
</tr>
<tr>
<td align="left" valign="top">Ardern&#8217;s speech (N = 8)</td>
<td align="right" valign="top">&#8211;</td>
<td align="right" valign="top">&#8211;</td>
<td align="right" valign="top">0</td>
<td align="right" valign="top">25</td>
</tr>
<tr>
<td align="left" valign="top">citizen&#8217;s discussion (N = 100)</td>
<td align="right" valign="top">74</td>
<td align="right" valign="top">87.72</td>
<td align="right" valign="top">50</td>
<td align="right" valign="top">1</td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top" colspan="6"><bold>Leader&#8217;s Facebook &#8211; campaign period</bold></td>
</tr>
<tr>
<td align="left" valign="top"><italic>Collins Aug 25,2020 Campaign</italic></td>
<td align="left" valign="top">Collins&#8217; speech (N = 35)</td>
<td align="right" valign="top">&#8211;</td>
<td align="right" valign="top">28.57</td>
<td align="right" valign="top">0</td>
<td align="right" valign="top">17.14</td>
</tr>
<tr>
<td align="left" valign="top" rowspan="3"><italic><xref ref-type="bibr" rid="B1">Ardern Aug 18, 2020</xref> Campaign</italic></td>
<td align="left" valign="top">citizen&#8217;s discussion (N = 200)</td>
<td align="right" valign="top">59</td>
<td align="right" valign="top">32.14</td>
<td align="right" valign="top">23.5</td>
<td align="right" valign="top">20.5</td>
</tr>
<tr>
<td align="left" valign="top">Ardern&#8217;s speech (N = 10)</td>
<td align="right" valign="top">&#8211;</td>
<td align="right" valign="top">140*</td>
<td align="right" valign="top">0</td>
<td align="right" valign="top">80</td>
</tr>
<tr>
<td align="left" valign="top">citizen&#8217;s discussion (N = 418)</td>
<td align="right" valign="top">86.84</td>
<td align="right" valign="top">35.31</td>
<td align="right" valign="top">4.31</td>
<td align="right" valign="top">51.2</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn><p>*Responded to one or more citizens within a speech instance.</p></fn>
</table-wrap-foot>
</table-wrap>
<p>Little social talk was present within the news mass media conversation threads (1%&#8211;3%). Similarly, leaders used minimal social talk during these. The leaders&#8217; use of social talk increased in their Facebook Live talks, as did citizens, with Collins&#8217; speech instances, comprising 17.14% social talk and the corresponding citizen discussion 20.5%. Ardern used a lot of social talk (80%), and citizens responded using a higher amount as well (51.2%) (<xref ref-type="table" rid="T3">Table 3</xref>).</p>
<p>Only Ardern used metatalk during her COVID period interview, clarifying the interpretation from the interviewer of comments she had made. Citizens&#8217; use of metatalk varied (5%&#8211;50%), with the highest found in response to Ardern&#8217;s interview and the lowest in response to Collins&#8217; interview from the Non-Lockdown COVID period (<xref ref-type="table" rid="T3">Table 3</xref>).</p>
<p>The highest overall deliberative quality (DQI = 0.59) was associated with the leaders&#8217; Facebook mass media arena when Ardern also scored high on deliberative quality (DQI = 0.66). Comparatively, when the leader scored low on deliberative quality within their Facebook mass media arena (DQI = 0.34), so did citizens (DQI = 0.29). Similar results were not observed in the news mass media arena, where DQI scores were variable and did not always align with the leader using more or less deliberative talk (<xref ref-type="table" rid="T4">Table 4</xref>).</p>
<table-wrap id="T4">
<label>Table 4</label>
<caption>
<p>Summary of DQI.</p>
</caption>
<table>
<thead>
<tr>
<td align="center" valign="top" colspan="12"><bold>DQI Score</bold></td>
</tr>
<tr>
<td colspan="12"><hr/></td>
</tr>
<tr>
<td align="center" valign="top" colspan="4"><bold>COVID Period</bold></td>
<td align="center" valign="top" colspan="4"><bold>Non-Iockdown COVID Period</bold></td>
<td align="center" valign="top" colspan="4"><bold>Campaign Period</bold></td>
</tr>
<tr>
<td colspan="12"><hr/></td>
</tr>
<tr>
<td align="center" valign="top" colspan="2"><bold>Collins Mar 9, 2021 Trans-Tasman Bubble TVNZ Breakfast</bold></td>
<td align="center" valign="top" colspan="2"><bold>Ardern Mar 7, 2021 Community Boarder Case TVNZ Breakfast</bold></td>
<td align="center" valign="top" colspan="2"><bold>Collins Nov 17, 2020 Housing Bubble TVNZ Breakfast</bold></td>
<td align="center" valign="top" colspan="2"><bold>Ardern Nov 29, 2020 Housing Bubble TVNZ Breakfast</bold></td>
<td align="center" valign="top" colspan="2"><bold>Collins Aug 25, 2020 Campaign Period Facebook</bold></td>
<td align="center" valign="top" colspan="2"><bold><xref ref-type="bibr" rid="B1">Ardern Aug 18, 2020</xref> Campaign Period Facebook</bold></td>
</tr>
<tr>
<td colspan="12"><hr/></td>
</tr>
<tr>
<td align="center" valign="top"><bold>Collin&#8217;s Speech Instances</bold></td>
<td align="center" valign="top"><bold>Citizen&#8217;s Discussion</bold></td>
<td align="center" valign="top"><bold>Ardern&#8217;s Speech Instances</bold></td>
<td align="center" valign="top"><bold>Citizen&#8217;s Discussion</bold></td>
<td align="center" valign="top"><bold>Collin&#8217;s Speech Instances</bold></td>
<td align="center" valign="top"><bold>Citizen&#8217;s Discussion</bold></td>
<td align="center" valign="top"><bold>Ardern&#8217;s Speech Instances</bold></td>
<td align="center" valign="top"><bold>Citizen&#8217;s Discussion</bold></td>
<td align="center" valign="top"><bold>Collin&#8217;s Speech Instances</bold></td>
<td align="center" valign="top"><bold>Citizen&#8217;s Discussion</bold></td>
<td align="center" valign="top"><bold>Ardern&#8217;s Speech Instances</bold></td>
<td align="center" valign="top"><bold>Citizen&#8217;s Discussion</bold></td>
</tr>
<tr>
<td colspan="12"><hr/></td>
</tr>
</thead>
<tbody>
<tr>
<td align="right" valign="top">0.58</td>
<td align="right" valign="top">0.33</td>
<td align="right" valign="top">0.67</td>
<td align="right" valign="top">0.37</td>
<td align="right" valign="top">0.66</td>
<td align="right" valign="top">0.42</td>
<td align="right" valign="top">0.73</td>
<td align="right" valign="top">0.27</td>
<td align="right" valign="top">0.34</td>
<td align="right" valign="top">0.29</td>
<td align="right" valign="top">0.66</td>
<td align="right" valign="top">0.59</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Regarding features of the DQI, reason-giving was captured by the level of justification or completeness of the justifications made by demands or appeals and the content of the justifications, whether these appeals or demands were made using narrow group interests, the greater good, the difference principle (<xref ref-type="bibr" rid="B71">Steenbergen et al. 2003</xref>) or by a statement of personal impact (<xref ref-type="bibr" rid="B25">Dryzek 2000</xref>; <xref ref-type="bibr" rid="B80">Young 2002</xref>). In the news mass media arenas, leaders made most appeals using sophisticated justification. While scores varied, citizens also used justifications to support their statements in all discussions, and most did so using neutral statements. The only discussion with a high number of citizens making statements containing no justifications (43.27%) was the citizen discussion in Collins&#8217; Facebook Live discussion. Similarly, in this discussion, both the leader (45.45%) and the citizens (26.92%) made more explicit statements concerning narrow group interests rather than neutral statements, referencing the common good, or statements of personal impact. In contrast, Ardern made no statements concerning narrow group interests, and citizens, in response, made a minor percentage of appeals concerning group interests (2.01%) (<xref ref-type="table" rid="T5">Table 5</xref>).</p>
<table-wrap id="T5">
<label>Table 5</label>
<caption>
<p>Breakdown of deliberative quality of leader and citizen discussions.</p>
</caption>
<table>
<thead>
<tr>
<td align="left" valign="top" rowspan="5"></td>
<td align="center" valign="top" colspan="4"><bold>COVID Period</bold></td>
<td align="center" valign="top" colspan="4"><bold>Non-Iockdown COVID Period</bold></td>
<td align="center" valign="top" colspan="4"><bold>Campaign Period</bold></td>
</tr>
<tr>
<td colspan="12"><hr/></td>
</tr>
<tr>
<td align="center" valign="top" colspan="2"><bold>Collins March 9, 2021 Trans-Tasman Bubble TVNZ Breakfast</bold></td>
<td align="center" valign="top" colspan="2"><bold>Ardern March 7, 2021 Community Boarder Case TVNZ Breakfast</bold></td>
<td align="center" valign="top" colspan="2"><bold>Collins Nov 17, 2020 Housing Bubble TVNZ Breakfast</bold></td>
<td align="center" valign="top" colspan="2"><bold>Ardern Nov 29, 2020 Housing Bubble TVNZ Breakfast</bold></td>
<td align="center" valign="top" colspan="2"><bold>Collins Aug 25, 2020 Campaign Period Facebook</bold></td>
<td align="center" valign="top" colspan="2"><bold><xref ref-type="bibr" rid="B1">Ardern Aug 18, 2020</xref> Campaign Period Facebook</bold></td>
</tr>
<tr>
<td colspan="12"><hr/></td>
</tr>
<tr>
<td align="center" valign="top"><bold>Collin&#8217;s Speech Instances</bold></td>
<td align="center" valign="top"><bold>Citizen&#8217;s Discussion</bold></td>
<td align="center" valign="top"><bold>Ardern&#8217;s Speech Instances</bold></td>
<td align="center" valign="top"><bold>Citizen&#8217;s Discussion</bold></td>
<td align="center" valign="top"><bold>Collin&#8217;s Speech Instances</bold></td>
<td align="center" valign="top"><bold>Citizen&#8217;s Discussion</bold></td>
<td align="center" valign="top"><bold>Ardern&#8217;s Speech Instances</bold></td>
<td align="center" valign="top"><bold>Citizen&#8217;s Discussion</bold></td>
<td align="center" valign="top"><bold>Collin&#8217;s Speech Instances</bold></td>
<td align="center" valign="top"><bold>Citizen&#8217;s Discussion</bold></td>
<td align="center" valign="top"><bold>Ardern&#8217;s Speech Instances</bold></td>
<td align="center" valign="top"><bold>Citizen&#8217;s Discussion</bold></td>
</tr>
</thead>
<tbody>
<tr>
<td colspan="13"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"><bold>Level of justification</bold></td>
<td align="left" valign="top"></td>
<td align="left" valign="top"></td>
<td align="left" valign="top"></td>
<td align="left" valign="top"></td>
<td align="left" valign="top"></td>
<td align="left" valign="top"></td>
<td align="left" valign="top"></td>
<td align="left" valign="top"></td>
<td align="left" valign="top"></td>
<td align="left" valign="top"></td>
<td align="left" valign="top"></td>
<td align="left" valign="top"></td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;0 <italic>no justification (as % of applicable comments)</italic></td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">10.13%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">24.29%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">15.85%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">15.52%</td>
<td align="right" valign="top">4.55%</td>
<td align="right" valign="top">43.27%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">4.36%</td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;1 <italic>inferior justification</italic></td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">18.99%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">12.86%</td>
<td align="right" valign="top">12.50%</td>
<td align="right" valign="top">14.63%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">24.14%</td>
<td align="right" valign="top">18.18%</td>
<td align="right" valign="top">15.38%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">46.98%</td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;2 <italic>qualified justification</italic></td>
<td align="right" valign="top">16.67%</td>
<td align="right" valign="top">37.97%</td>
<td align="right" valign="top">23.08%</td>
<td align="right" valign="top">20.00%</td>
<td align="right" valign="top">12.50%</td>
<td align="right" valign="top">29.27%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">39.66%</td>
<td align="right" valign="top">40.91%</td>
<td align="right" valign="top">31.73%</td>
<td align="right" valign="top">25.00%</td>
<td align="right" valign="top">32.55%</td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;3 <italic>sofisticated justification</italic></td>
<td align="right" valign="top">83.33%</td>
<td align="right" valign="top">32.91%</td>
<td align="right" valign="top">76.92%</td>
<td align="right" valign="top">42.86%</td>
<td align="right" valign="top">75.00%</td>
<td align="right" valign="top">40.24%</td>
<td align="right" valign="top">100.00%</td>
<td align="right" valign="top">20.69%</td>
<td align="right" valign="top">36.36%</td>
<td align="right" valign="top">9.62%</td>
<td align="right" valign="top">75.00%</td>
<td align="right" valign="top">16.11%</td>
</tr>
<tr>
<td align="left" valign="top"><bold>Content of justifications</bold></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;0 <italic>explicit statement concerning group interests</italic></td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">3.85%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">5.71%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">3.66%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">45.45%</td>
<td align="right" valign="top">26.92%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">2.01%</td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;1 <italic>neutral statement</italic></td>
<td align="right" valign="top">83.33%</td>
<td align="right" valign="top">67.95%</td>
<td align="right" valign="top">100.00%</td>
<td align="right" valign="top">74.29%</td>
<td align="right" valign="top">100.00%</td>
<td align="right" valign="top">86.59%</td>
<td align="right" valign="top">83.33%</td>
<td align="right" valign="top">79.31%</td>
<td align="right" valign="top">27.27%</td>
<td align="right" valign="top">63.46%</td>
<td align="right" valign="top">75.00%</td>
<td align="right" valign="top">86.24%</td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;2 <italic>explicit statement of the common good (utilitarian)</italic></td>
<td align="right" valign="top">16.67%</td>
<td align="right" valign="top">21.79%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">8.57%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">2.44%</td>
<td align="right" valign="top">16.67%</td>
<td align="right" valign="top">18.97%</td>
<td align="right" valign="top">27.27%</td>
<td align="right" valign="top">5.77%</td>
<td align="right" valign="top">25.00%</td>
<td align="right" valign="top">3.02%</td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;2 <italic>explicit statement of the common good (difference principle)</italic></td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">2.56%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">4.29%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">3.66%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">1.72%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">3.69%</td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;2 <italic>statement of personal impact</italic></td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">3.85%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">7.14%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">3.66%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">3.85%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">5.03%</td>
</tr>
<tr>
<td align="left" valign="top"><bold>Respect toward groups</bold></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;0 <italic>no respect</italic></td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">73.74%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">49.48%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">28.00%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">67.37%</td>
<td align="right" valign="top">53.57%</td>
<td align="right" valign="top">37.35%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">9.60%</td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;1 <italic>implicit respect</italic></td>
<td align="right" valign="top">100.00%</td>
<td align="right" valign="top">26.26%</td>
<td align="right" valign="top">100.00%</td>
<td align="right" valign="top">47.42%</td>
<td align="right" valign="top">100.00%</td>
<td align="right" valign="top">71.00%</td>
<td align="right" valign="top">100.00%</td>
<td align="right" valign="top">29.47%</td>
<td align="right" valign="top">42.86%</td>
<td align="right" valign="top">62.65%</td>
<td align="right" valign="top">88.89%</td>
<td align="right" valign="top">45.33%</td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;2 <italic>explicit respect</italic></td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">3.09%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">1.00%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">3.16%</td>
<td align="right" valign="top">3.57%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">11.11%</td>
<td align="right" valign="top">45.07%</td>
</tr>
<tr>
<td align="left" valign="top"><bold>Respect toward the demands of others</bold></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;0 <italic>no respect</italic></td>
<td align="right" valign="top">16.67%</td>
<td align="right" valign="top">74.47%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">59.77%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">35.87%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">74.42%</td>
<td align="right" valign="top">73.91%</td>
<td align="right" valign="top">54.78%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">13.55%</td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;1 <italic>implicit respect</italic></td>
<td align="right" valign="top">66.67%</td>
<td align="right" valign="top">24.47%</td>
<td align="right" valign="top">84.62%</td>
<td align="right" valign="top">39.08%</td>
<td align="right" valign="top">100.00%</td>
<td align="right" valign="top">63.04%</td>
<td align="right" valign="top">100.00%</td>
<td align="right" valign="top">23.26%</td>
<td align="right" valign="top">17.39%</td>
<td align="right" valign="top">45.22%</td>
<td align="right" valign="top">100.00%</td>
<td align="right" valign="top">32.58%</td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;2 <italic>explicit respect</italic></td>
<td align="right" valign="top">16.67%</td>
<td align="right" valign="top">1.06%</td>
<td align="right" valign="top">15.38%</td>
<td align="right" valign="top">1.15%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">1.09%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">2.33%</td>
<td align="right" valign="top">8.70%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">53.87%</td>
</tr>
<tr>
<td align="left" valign="top"><bold>Respect toward counterarguments</bold></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;0 <italic>counterarguments ignored</italic></td>
<td align="right" valign="top">66.67%</td>
<td align="right" valign="top">7.50%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">17.39%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">19.18%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">51.28%</td>
<td align="right" valign="top">100.00%</td>
<td align="right" valign="top">25.00%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">13.64%</td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;1 <italic>counterarguments included but degraded</italic></td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">62.50%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">43.48%</td>
<td align="right" valign="top">25.00%</td>
<td align="right" valign="top">27.40%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">33.33%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">60.00%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">15.91%</td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;2 <italic>counterarguments included but neutral</italic></td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">30.00%</td>
<td align="right" valign="top">42.86%</td>
<td align="right" valign="top">36.23%</td>
<td align="right" valign="top">25.00%</td>
<td align="right" valign="top">50.68%</td>
<td align="right" valign="top">60.00%</td>
<td align="right" valign="top">14.10%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">10.00%</td>
<td align="right" valign="top">100.00%</td>
<td align="right" valign="top">61.36%</td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;3 <italic>counterarguments included and valued</italic></td>
<td align="right" valign="top">33.33%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">57.14%</td>
<td align="right" valign="top">2.90%</td>
<td align="right" valign="top">50.00%</td>
<td align="right" valign="top">2.74%</td>
<td align="right" valign="top">40.00%</td>
<td align="right" valign="top">1.28%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">5.00%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">9.09%</td>
</tr>
<tr>
<td align="left" valign="top"><bold>Constructive politics</bold></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
<td align="right" valign="top"></td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;0 <italic>positional politics</italic></td>
<td align="right" valign="top">100.00%</td>
<td align="right" valign="top">95.56%</td>
<td align="right" valign="top">66.67%</td>
<td align="right" valign="top">94.20%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">86.75%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">95.18%</td>
<td align="right" valign="top">100.00%</td>
<td align="right" valign="top">100.00%</td>
<td align="right" valign="top">50.00%</td>
<td align="right" valign="top">91.38%</td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;1 <italic>debate</italic></td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">1.11%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">1.45%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">4.82%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">1.20%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">3.45%</td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;2 <italic>mediated proposal that fits current agenda</italic></td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">3.33%</td>
<td align="right" valign="top">33.33%</td>
<td align="right" valign="top">4.35%</td>
<td align="right" valign="top">100.00%</td>
<td align="right" valign="top">8.43%</td>
<td align="right" valign="top">100.00%</td>
<td align="right" valign="top">3.61%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">0.00%</td>
<td align="right" valign="top">50.00%</td>
<td align="right" valign="top">5.17%</td>
</tr>
<tr>
<td align="left" valign="top">&#160;&#160;&#160;&#160;Total DQJ Score (out of 100)</td>
<td align="right" valign="top">0.58</td>
<td align="right" valign="top">0.33</td>
<td align="right" valign="top">0.67</td>
<td align="right" valign="top">0.37</td>
<td align="right" valign="top">0.66</td>
<td align="right" valign="top">0.42</td>
<td align="right" valign="top">0.73</td>
<td align="right" valign="top">0.27</td>
<td align="right" valign="top">0.34</td>
<td align="right" valign="top">0.29</td>
<td align="right" valign="top">0.66</td>
<td align="right" valign="top">0.59</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn><p>Ardern (<xref ref-type="bibr" rid="B1">2020, August 18</xref>); Breakfast (<xref ref-type="bibr" rid="B6">2020a, November 17</xref>); Breakfast (<xref ref-type="bibr" rid="B7">2020b, November 29</xref>); Breakfast (<xref ref-type="bibr" rid="B8">2021a, March 7</xref>); Breakfast (<xref ref-type="bibr" rid="B9">2021b, March 9</xref>); Collins (<xref ref-type="bibr" rid="B17">2020b, August 25</xref>)</p></fn>
</table-wrap-foot>
</table-wrap>
<p>Respect was captured according to the DQI. Results were as expected in the leaders&#8217; Facebook Live arena: the leader displaying high levels of respect showed citizen discussion displaying the same (<xref ref-type="table" rid="T5">Table 5</xref>). In the news mass media arenas, leaders were respectful toward other groups. Collins, however, degraded 25% of counterarguments that she disagreed with in the non-lockdown COVID period. Citizens&#8217; level of respect varied regardless of the leaders&#8217; use of respectful messaging. In the leaders&#8217; Facebook Live arena, while Ardern&#8217;s communication remained consistent with the other arenas, Collins displayed significant differences in the level of respect she conveyed in all categories. Notably, 53.57% of Collins&#8217; discussions showed no respect toward other groups, 73.91% showed no respect toward the demands of others, and 100% of her comments ignored the counterargument of others. The citizens&#8217; discussion in response to Ardern&#8217;s Facebook Live arena, where she displayed zero instances of disrespect, had the highest levels of respect of any of the talks coded. Citizens&#8217; respect was more explicit, and the majority responded to counterarguments of those they disagreed with neutrally or in a way that explicitly valued the opposing opinion.</p>
<p>The percentage of comments made aiming for consensus by displaying constructive politics, where speakers made mediated proposals across all discussions, was variable among leaders ranging from 0%&#8211;100%. Citizens making mediated proposals was low (3.33%&#8211;8.43%), with the highest levels observed in discussions where leaders made them.</p>
</sec>
<sec>
<title>Discussion</title>
<p>The purpose of this study was to explore if leaders influence the quality of citizen deliberation by examining whether their use, or lack thereof, deliberative communication style online, in turn, impacts citizens&#8217; use, or lack thereof, deliberative dialogue online and if so, if this was dependent on the online arena.</p>
<p>The citizens&#8217; discussions in both arenas met the criteria of deliberation. Citizens&#8217; discussions contained opposing views, had relatively high levels of reciprocity and engagement on topic, and used justifications to support statements. This means that citizens heard diverse perspectives, responded to each other on-topic, and did so with justifications to support their statements, rather than simply talking past each other, all criteria for deliberation and deep consideration of issues where opinion change can take place (<xref ref-type="bibr" rid="B74">Stromer-Galley 2007</xref>). This finding was unlike Halpern and Gibbs&#8217; (<xref ref-type="bibr" rid="B40">2013</xref>), who found that although Facebook provides a deliberative space for political discussion, citizens deliberate superficially.</p>
<p>When the leaders stated their appeals without providing justifications, citizens also made a higher number of comments without providing any justifications. Collins&#8217; Facebook Live was the only talk where a leader made comments without providing any justifications. She also produced more comments that provided an inferior level of justification. By comparison, all comments from Ardern during this period contained qualified or sophisticated levels of justification. Generally, citizens&#8217; comments responding to the leaders&#8217; posted videos on Facebook saw a lower level of justification than the discussions from the TVNZ Breakfast interviews. This appeared to be partly because the threads responding directly to the leaders&#8217; Live videos contained many comments without appeals or claims such as greetings or praise.</p>
<p>Looking at the content of justifications, the leaders mainly made neutral comments, followed by statements of the greater good. Citizens also commented neutrally. That is, they did not reference any specific group interests, nor did they reference the common good or make statements of personal impact/storytelling. This was not the case for citizens responding to Collins&#8217; Facebook talk, which had increased comments referencing narrow group interests, as did Collins. Although this talk was about the impact of the current policies on agriculture, there was little in the way of stating impacts in a way that related to the common good or difference principle. Instead, many comments from Collins used an inflammatory tone with unjustified statements.</p>
<p>All citizens&#8217; discussions justified most of their comments, supporting their opinions and considering, through their responses, one another&#8217;s statements. The aim for consensus, where citizens made mediated proposals in an attempt to compromise or reconcile (<xref ref-type="bibr" rid="B71">Steenbergen et al. 2003</xref>), was fairly low throughout all discussions. A finding consistent with other online deliberations (<xref ref-type="bibr" rid="B27">Esau et al. 2021</xref>; <xref ref-type="bibr" rid="B74">Stromer-Galley 2007</xref>).</p>
<p>Level of respect was the most salient factor of the DQI score, followed by level of justification.</p>
<p>Turning to the research question: whether leaders&#8217; use of deliberative talk in discussion elicited greater deliberation amongst citizens online and, if so, was it dependent on the arena, the results suggest that it depends. The discussion with the highest overall deliberative quality was associated with the leaders&#8217; Facebook mass media arena when the leader also scored high on deliberative quality. When the leader scored low on deliberative quality within their Facebook mass media arena, so did citizens. These findings were not observed in the online News mass media arena where DQI scores were variable and did not always align with the leader using more or less deliberative talk, which could be for a variety of reasons.</p>
<p>In the News mass media arena, the leaders&#8217; use of deliberation is largely limited to a participant in dialogue with the interviewer. Here, the interviewer leads the conversation, and the leader responds to their questions. While the leader can respond in varied ways, they do not have control over the tone of the discussion or whether the interviewer raises issues using frames that highlight polarization or conflict. For example, during the opposition leaders&#8217; interview during the non-lockdown COVID period, the interviewer introduced the topic by stating the level of criticism from both sides of the political spectrum of Ardern on &#8216;her government&#8217;s apparent lack of effective action on the housing crisis as house prices continue to go through the roof&#8217; (<xref ref-type="bibr" rid="B6">Breakfast 2020a</xref>: 0:00:08). The topic, before the discussion started, was already framed as conflictual and unfair. Additionally, in the interviews with Collins, the interviewer, Jenny-May Clarkson, did not push back on any of her responses in any of the talks coded. By comparison, Ardern received considerable pushback and critical questioning. While the deliberative style of Ardern&#8217;s responses may have been enough to influence citizens to discuss with higher deliberative quality in the other talks, the frustration from both Labour and National supporters (Ardern&#8217;s and Collins&#8217; parties, respectively) may have had a greater impact on the resulting quality of the discussion.</p>
<p>Alternatively, in other arenas where the leader controls the content, such as their social media page, they can consistently ensure a deliberative frame is delivered to citizens throughout the entire Live discussion. In this arena, leaders also have more freedom to guide citizens to abide by &#8216;rules of engagement&#8217; much as a facilitator/moderator would and support understanding of different viewpoints by the frames and rhetoric they offer. In this way, leaders using this arena can model as participants in dialogue and guide it as facilitators of deliberation. Thus, the following framework is proposed where a leader&#8217;s ability to influence the deliberative quality of citizen&#8217;s discussions is mediated by the leader&#8217;s level of influence on the deliberative space of that discussion (<xref ref-type="fig" rid="F1">Figure 1</xref>).</p>
<fig id="F1">
<label>Figure 1</label>
<caption>
<p>Communication model for leaders supporting deliberation in the public sphere.</p>
</caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="jdd-19-1-1335-g1.jpg"/>
</fig>
<p>This proposed model aligns with Habermas&#8217;s (<xref ref-type="bibr" rid="B39">2006</xref>) view of leaders at the center as coauthors and distributors, along with mass media, of public opinion by constructing and articulating prevailing public opinion back to citizens, who in turn respond to the issues articulated by elite discourse and set the frame for the range of what decisions they would accept as legitimate. Together, politicians, in constructing and articulating public opinion to citizens, and citizens in responding to these articulations, create a filtering and self-regulating mechanism for creating public opinion (<xref ref-type="bibr" rid="B39">Habermas 2006</xref>). The politician&#8217;s use of deliberative communication would positively affect the normative requirements for generating more considered public opinion through framing relevant issues, including required information, and supporting appropriate contributions (<xref ref-type="bibr" rid="B39">Habermas 2006</xref>). First, by framing the relevant issues or range of acceptable issues for citizens to consider in decision making on an issue, leaders act to define the relevant issues for consideration. Second, leaders support the inclusion of required information by supporting citizens by creating an environment where other perspectives are more likely to be heard and considered to support access to the information prerequisite for reasoned opinion formation. Third, leaders can support appropriate contributions by supporting increased mutual understanding among citizens, so a plurality of views is included and considered. The proposed communication model for leaders supporting deliberation in the public sphere suggests that the ability of the leader to influence the quality of citizen deliberation using the mechanisms presented by Habermas (<xref ref-type="bibr" rid="B39">2006</xref>), is dependent on the leader being able to access these mechanisms in that arena and thus dependent on their influence within the deliberative space. Specifically, environments where leaders can guide discussions toward mutual perspective-taking and understanding as participants, facilitators, and rhetoricians of deliberative communication.</p>
<p>Other factors can explain the variability of DQI scores observed apart from the leader&#8217;s influence over the discussion. For example, comparing group heterogeneity, the News arena likely had more diversity in political opinions than the leader-led Facebook arena, which, despite still comprising a heterogeneous group discussion, saw a greater number of each leader&#8217;s followers. Additionally, more citizens commenting in the News mass media arena disagreed with the views of the leader being interviewed. It could be that the leaders&#8217; influence over deliberative quality, if it exists, is bidirectional. As Lisa Disch (<xref ref-type="bibr" rid="B18">2011</xref>) explains, leaders are at one influencers of and influenced by citizen opinions and orient forward in speculation. Citizens elect representatives who they feel would advance their desired direction and preferences (<xref ref-type="bibr" rid="B54">Mansbridge 2009</xref>), even if those preferences are co-created. In this sense, potential constituents who are more deliberative may seek more deliberative leaders, with both updating their opinions accordingly, just as political leaders may adopt a less deliberative style because that is what their constituents want. Future research can seek to answer this by measuring how a leader&#8217;s deliberative communication influences the discussion quality of randomized participants.</p>
<p>Alternatively, the variability could be due to the topic of discussion itself and the degree of controversy (<xref ref-type="bibr" rid="B81">Ziegele et al. 2014</xref>). Leader&#8217;s scoring lower on the DQI also saw corresponding lower DQI in the citizen discussions in the News mass media arena except for the housing bubble talk. In the case of the housing bubble talk, Ardern obtained the highest score in terms of deliberation. At the same time, the subsequent citizen discussion received the second-lowest score among the analyzed conversations. This might reflect the complex nature of the housing crisis and its impact on the perspectives of New Zealanders (<xref ref-type="bibr" rid="B35">Giovannetti 2022</xref>). The housing bubble talk was different in that it was contentious on both sides of the political spectrum, including Ardern&#8217;s party (<xref ref-type="bibr" rid="B6">Breakfast 2020a</xref>). So, while Collins&#8217;s talk on the housing bubble from citizens remained more deliberative, especially concerning the level of respect, she presented suggestions on how to fix the bubble, and her complaints aligned with citizens on both political sides. Ardern, on the other hand, ran on a platform that addressed housing prices (<xref ref-type="bibr" rid="B53">Manon 2020</xref>). During this interview, Ardern stood by the current measures while attempting to explain the external forces for the current sharp increase in house prices as being impacted by the COVID-19 pandemic and how this similar issue was occurring in other comparable OECD countries. The other coded talks had less cross-party conflict, with clear supporters on each side. Prior content analysis of news articles contradicts these results, where topics with clear sides increase incivility (<xref ref-type="bibr" rid="B15">Coe et al. 2014</xref>). However, the same research by Coe et al. (<xref ref-type="bibr" rid="B15">2014</xref>) found that news articles containing quotes from a high-profile source with an identifiable partisan leaning, such as Barack Obama, generated the most incivility in online discussions. It is possible that Ardern&#8217;s high-profile identifiable partisan, coupled with her explanation of the deteriorating housing market despite her mandate to address the issue, played a more significant role in the ensuing incivility of the citizen discussion on housing, despite the absence of a clear partisan divide between Labour and National supporters on the housing issue. Furthermore, housing is an issue that affects millions of New Zealanders across the country, who most probably voted for Ardern based on her housing platform, a promise her government had to work on, something that opposing non-governing parties do not have to achieve.</p>
<p>Another possible factor is the role that previously received cues from a political leader may have played in the level of disrespect observed in the citizen discussion. While Ardern&#8217;s cues to respect differences toward groups and others&#8217; opinions have remained consistently deliberative before and while in office, Collins&#8217;s rhetoric fluctuated depending on the platform she used. Of supporters who would have listened to her on other platforms like Twitter and her personal Facebook page, they would have heard primarily bonding rhetoric from Collins that, in addition to energizing those with similar views and beliefs, showed disrespect toward Labour and &#8216;the left.&#8217; For example, by attacking Ardern&#8217;s character and sowing the seeds of distrust rather than pointing out areas of policy disagreement and why:</p>
<disp-quote>
<p>&#8216;Honestly, we&#8217;ve got to get rid of this government, it&#8217;s just they&#8217;re destroying our country&#8217; (<xref ref-type="bibr" rid="B17">Collins 2020b: 0:09:22</xref>)</p>
<p>&#8216;They&#8217;re completely useless&#8217; (<xref ref-type="bibr" rid="B17">Collins 2020b: 0:06:25</xref>)</p>
<p>&#8216;You can see the same old Left misinformation spread&#8217; (<xref ref-type="bibr" rid="B16">Collins 2020a</xref>)</p>
</disp-quote>
<p>This aligns with research showing that higher levels of incivility among politicians are linked to an unwillingness to compromise (<xref ref-type="bibr" rid="B59">Mutz 2007</xref>), lowers trust toward politicians, and increases animosity toward the opposing party (<xref ref-type="bibr" rid="B69">Skytte 2021</xref>). It should be noted here that opposition leaders have, as Waldron (<xref ref-type="bibr" rid="B78">2012</xref>) points out, an institutional obligation to loyal opposition that is important to democratic systems. Although this study assesses communication against the standards of deliberation and points out the seemingly negative effects that come from displays of incivility from leaders, it remains to be addressed how these interactions may negatively or positively impact the wider deliberative system.</p>
<p>Upon closer inspection of the respect scores from the housing bubble discussion, the higher number of citizens showing no respect toward other groups or demands were those who did not agree with Ardern and/or those who agreed with the opposition party. The majority of citizens who agreed with Ardern also responded in a neutral (respectful) manner toward counterarguments from those they did not agree with. Despite these differences, proponents and those in opposition to Ardern had higher levels of disrespect than in other discussions where the leader displayed higher deliberation. Previous research shows that when citizens are exposed to counter attitudinal incivility from political elites, that is, elites with opposing attitudes from their own, in this case, Ardern&#8217;s supporters hearing incivility from Collins, it increases condemnation toward the other group by triggering defensive anger (<xref ref-type="bibr" rid="B33">Gervais 2018</xref>). In this discussion, both Ardern and Collins&#8217;s supporters displayed higher levels of disrespect, and Ardern&#8217;s supporters could have been triggered by defensive anger of prior exposure of incivility from Collins.</p>
<p>Regardless of the reasons for the variability in the quality of citizen deliberation observed in the News arena, deliberation, at its core, is about having conversations with those who could be affected by a decision. In the News arena, leaders had no opportunity to engage with citizens or respond to their counterarguments. Notably, previous studies of online deliberation highlight the importance that facilitators (<xref ref-type="bibr" rid="B72">Strandberg, 2015</xref>) and passing on rules of engagement (<xref ref-type="bibr" rid="B27">Esau et al. 2021</xref>) have on the quality of deliberation. Moreover, the presence of a facilitator was of greater importance than group heterogeneity: even homogeneous groups that tend to polarize did not when guided by a facilitator (<xref ref-type="bibr" rid="B73">Strandberg et al. 2019</xref>).</p>
<p>Basing the leader&#8217;s level of influence within the backdrop of a <italic>participant in dialogue</italic> aligns with Cho et al&#8217;s. (<xref ref-type="bibr" rid="B13">2009</xref>) OSROR model of communication effects that demonstrates that the influence of opinion leaders is generated in the interpersonal political discussion and cognitive reflection of citizens. Through a two-step flow, political conversation amongst citizens is an intermediary between political messages from leaders and public opinion. This study differs from the OSROR model by developing a theory for leader-led political communication that includes the influence of the democratic principles of normative reasoning. This may be supported by two mechanisms outlined in the Elaborative Likelihood Model of Persuasion (<xref ref-type="bibr" rid="B10">Cacioppo &amp; Petty 1984</xref>), which shows that increasing the personal relevance of messages to the listener and the strength of arguments can act to increase the use of more elaborative, central route processing required for paying careful attention to arguments that conflict with their pre-existing prejudices and rely less on heuristics, making opinion change more likely (<xref ref-type="bibr" rid="B62">Petty &amp; Brinol 2002</xref>). The leader increases the personal relevance of their messages by using deliberative talk within the conversation, legitimizing others&#8217; viewpoints, values, and identities. When combined with the potential for leaders to enhance the likelihood of citizens perceiving stronger arguments during discussions and relying less on heuristics, it can contribute to fostering an environment that values diverse perspectives and legitimizes citizens&#8217; experiences. These may also support social learning processes toward diverse groups as the important precursor to deliberation (<xref ref-type="bibr" rid="B45">Kanra 2020</xref>). Along with other modes of persuasion outlined by Kruglanski et al. (<xref ref-type="bibr" rid="B47">2004</xref>), such as decreasing the processing difficulty by disseminating information on complex policy issues and decreasing ego-defensiveness by creating cues of safety for sharing different opinions, are other ways the leader may influence greater likelihood for the elaboration required to consider opposing views. Facebook itself may increase the perceived accountability of citizens when sharing their opinions, another route for increasing the likelihood of elaboration (<xref ref-type="bibr" rid="B77">Tetlock 1985</xref>; <xref ref-type="bibr" rid="B47">Kruglanski et al. 2004</xref>).</p>
</sec>
<sec>
<title>Limitations</title>
<p>There are some limitations to this study. First, only one talk each from the leader-led mass media arena was included in the analysis, so this is an exploratory research. Further, it was not possible to hold both the date and topics constant for the leader-led mass media arena regarding the study design itself, although they both included topics under the umbrella of COVID. The analysis did not include talks from the leader-led mass media arena outside the campaign period, which may have generated different results. Participants also differed in the talks coded, so that could not remain constant either. Third, the study used as independent variable the institutional input (information provided, type of communication) and the communicative throughput (level of deliberation measured as civility, reason-giving, constructiveness) as the dependent variable. It excluded any measure of the productive outcome of deliberation (consensus, changes in trust, opinion change) (<xref ref-type="bibr" rid="B32">Friess &amp; Eilders 2015</xref>). Finally, the study did not look at how the institutional context of New Zealand may have shaped the quality of deliberation. Reflection on the institutional factors that may impact the influence of the leader on deliberation should be explored in future work.</p>
</sec>
<sec>
<title>Conclusion</title>
<p>This exploratory study suggests that when leaders have greater access to support deliberative dialogue by taking on the role of both participant and facilitator, they can influence citizen deliberation.</p>
<p>This study presents theoretical arguments for leaders to participate in the legitimation process in civil society as part of the response to the problem of scale. It suggests the potential for continuing to explore the leader&#8217;s influence over deliberation and developing the mechanism to draw on for supporting more authentic public opinion. A communication model for leaders supporting deliberation in the public sphere is presented, proposing that a leader&#8217;s ability to influence the deliberative quality of citizen discussions is mediated by the leader&#8217;s influence of the deliberative space. It may be that leaders, as participants and facilitators within citizen deliberation, support creating a safe space for citizens to share and learn from each other by promoting listening and understanding that goes beyond simply <italic>messaging</italic> how citizens should respond to <italic>demonstrating</italic> it by providing the road map for how to. This study invites further research to determine whether leaders can, in dialogue with citizens, influence the quality of deliberation.</p>
<p>Ultimately, to keep the deliberative project practical, it must come to terms with leaders as an inevitable influence within the deliberative system, for better or worse. Thus, it should seek to develop the knowledge base to guide leaders&#8217; communication in support of that goal.</p>
</sec>
</body>
<back>
<sec>
<title>Competing Interests</title>
<p>The authors have no competing interests to declare.</p>
</sec>
<ref-list>
<ref id="B1"><label>1</label><mixed-citation publication-type="webpage"><string-name><surname>Ardern</surname>, <given-names>J.</given-names></string-name> (<year>2020</year>, <month>August</month> <day>18</day>). <article-title>[Live Video]. Facebook</article-title>. <uri>https://www.facebook.com/jacindaardern/videos/905843686604909/</uri></mixed-citation></ref>
<ref id="B2"><label>2</label><mixed-citation publication-type="book"><string-name><surname>Barber</surname>, <given-names>B.</given-names></string-name> (<year>2003</year>). <source>Strong democracy: Participatory politics for a new age</source>. <publisher-name>University of California Press</publisher-name>.</mixed-citation></ref>
<ref id="B3"><label>3</label><mixed-citation publication-type="journal"><string-name><surname>Beerbohm</surname>, <given-names>E.</given-names></string-name> (<year>2015</year>). <article-title>Is democratic leadership possible?</article-title> <source>American Political Science Review</source>, <volume>109</volume>(<issue>4</issue>), <fpage>639</fpage>&#8211;<lpage>652</lpage>. DOI: <pub-id pub-id-type="doi">10.1017/S0003055415000398</pub-id></mixed-citation></ref>
<ref id="B4"><label>4</label><mixed-citation publication-type="journal"><string-name><surname>Bode</surname>, <given-names>L.</given-names></string-name> (<year>2016</year>). <article-title>Political news in the news feed: Learning politics from social media</article-title>. <source>Mass Communication and Society</source>, <volume>19</volume>(<issue>1</issue>), <fpage>24</fpage>&#8211;<lpage>48</lpage>. DOI: <pub-id pub-id-type="doi">10.1080/15205436.2015.1045149</pub-id></mixed-citation></ref>
<ref id="B5"><label>5</label><mixed-citation publication-type="journal"><string-name><surname>Boswell</surname>, <given-names>J.</given-names></string-name> (<year>2013</year>). <article-title>Why and how narrative matters in deliberative systems</article-title>. <source>Political Studies</source>, <volume>61</volume>(<issue>3</issue>), <fpage>620</fpage>&#8211;<lpage>36</lpage>. DOI: <pub-id pub-id-type="doi">10.1111/j.1467-9248.2012.00987.x</pub-id></mixed-citation></ref>
<ref id="B6"><label>6</label><mixed-citation publication-type="webpage"><collab>Breakfast</collab>. (<year>2020a</year>, <month>November</month> <day>17</day>). <source>Judith Collins on Soaring House Prices</source>. [Video]. Facebook. <uri>https://www.facebook.com/Breakfaston1/videos/judith-collins-on-soaring-house-prices/1781930968646979/</uri></mixed-citation></ref>
<ref id="B7"><label>7</label><mixed-citation publication-type="webpage"><collab>Breakfast</collab>. (<year>2020b</year>, <month>November</month> <day>29</day>). <source>The latest From Prime Minister Jacinda Ardern</source>. [Video]. Facebook. <uri>https://www.facebook.com/337418942718/videos/776697659854676</uri></mixed-citation></ref>
<ref id="B8"><label>8</label><mixed-citation publication-type="webpage"><collab>Breakfast</collab>. (<year>2021a</year>, <month>March</month> <day>7</day>, March 9). <source>Latest from Prime Minister Jacinda Ardern: One New Case of Covid-19 Has Been Identified at the Border</source>. [Video]. Facebook. <uri>https://www.facebook.com/Breakfaston1/videos/latest-from-prime-minister-jacinda-ardern/453249499058451/</uri></mixed-citation></ref>
<ref id="B9"><label>9</label><mixed-citation publication-type="webpage"><collab>Breakfast</collab>. (<year>2021b</year>, <month>March</month> <day>9</day>). <source>National Leader Judith Collins on Vaccine Plans and Travel Bubbles</source>. [Video]. Facebook. <uri>https://www.facebook.com/Breakfaston1/videos/national-leader-judith-collins-on-vaccine-plans-and-travel-bubbles/442741510115293/</uri></mixed-citation></ref>
<ref id="B10"><label>10</label><mixed-citation publication-type="journal"><string-name><surname>Cacioppo</surname>, <given-names>J. T.</given-names></string-name>, &amp; <string-name><surname>Petty</surname>, <given-names>R. E.</given-names></string-name> (<year>1984</year>). <article-title>The elaboration likelihood model of persuasion</article-title>. <source>NA &#8211; Advances in Consumer Research</source>, <volume>11</volume>, <fpage>673</fpage>&#8211;<lpage>75</lpage>.</mixed-citation></ref>
<ref id="B11"><label>11</label><mixed-citation publication-type="journal"><string-name><surname>Chambers</surname>, <given-names>S.</given-names></string-name> (<year>2009</year>). <article-title>Rhetoric and the public sphere: Has deliberative democracy abandoned mass democracy?</article-title> <source>Political Theory</source>, <volume>37</volume>(<issue>3</issue>), <fpage>323</fpage>&#8211;<lpage>50</lpage>. DOI: <pub-id pub-id-type="doi">10.1177/0090591709332336</pub-id></mixed-citation></ref>
<ref id="B12"><label>12</label><mixed-citation publication-type="book"><string-name><surname>Chambers</surname>, <given-names>S.</given-names></string-name> (<year>2010</year>). <chapter-title>Open versus closed constitutional negotiation</chapter-title>. In (Eds.), <source>Deliberative Democracy in practice</source>, (<issue>78&#8211;91</issue>). <publisher-name>UBC Press</publisher-name>. DOI: <pub-id pub-id-type="doi">10.59962/9780774816793-005</pub-id></mixed-citation></ref>
<ref id="B13"><label>13</label><mixed-citation publication-type="journal"><string-name><surname>Cho</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Shah</surname>, <given-names>D. V.</given-names></string-name>, <string-name><surname>McLeod</surname>, <given-names>J. M.</given-names></string-name>, <string-name><surname>Scholl</surname>, <given-names>R. M.</given-names></string-name>, &amp; <string-name><surname>Gotlieb</surname>, <given-names>M. R.</given-names></string-name> (<year>2009</year>). <article-title>Campaigns, reflection, and deliberation: Advancing an O-S-R-O-R model of communication effects</article-title>. <source>Communication Theory</source>, <volume>19</volume>(<issue>1</issue>), <fpage>66</fpage>&#8211;<lpage>88</lpage>. DOI: <pub-id pub-id-type="doi">10.1111/j.1468-2885.2008.01333.x</pub-id></mixed-citation></ref>
<ref id="B14"><label>14</label><mixed-citation publication-type="webpage"><string-name><surname>Clark</surname>, <given-names>H.</given-names></string-name> (<year>2023</year>, <month>January</month> <day>19</day>). <source>Statement on resignation of rime Minister Jacinda Ardern</source>. Retrieved from <uri>https://static1.squarespace.com/static/5db70d7dbad4060ba79d3ae6/t/63c8fc01f51fc8571d01568d/1674116097805/Statement+on+Jacinda+Ardern+resignation.pdf</uri></mixed-citation></ref>
<ref id="B15"><label>15</label><mixed-citation publication-type="journal"><string-name><surname>Coe</surname>, <given-names>K.</given-names></string-name>, <string-name><surname>Kens</surname>, <given-names>K.</given-names></string-name>, &amp; <string-name><surname>Rains</surname>, <given-names>S. A.</given-names></string-name> (<year>2014</year>). <article-title>Online and uncivil? patterns and determinants of incivility in newspaper website comments</article-title>. <source>Journal of Communication</source>, <volume>64</volume>(<issue>4</issue>), <fpage>658</fpage>&#8211;<lpage>679</lpage>. DOI: <pub-id pub-id-type="doi">10.1111/jcom.12104</pub-id></mixed-citation></ref>
<ref id="B16"><label>16</label><mixed-citation publication-type="webpage"><string-name><surname>Collins</surname>, <given-names>J.</given-names></string-name> (<year>2020a</year>, <month>July</month> <day>17</day>). <source>You can see the same old Left misinformation spread</source>. Twitter. <uri>https://twitter.com/JudithCollinsMP</uri></mixed-citation></ref>
<ref id="B17"><label>17</label><mixed-citation publication-type="webpage"><string-name><surname>Collins</surname>, <given-names>J.</given-names></string-name> (<year>2020b</year>, <month>August</month> <day>25</day>). <source>Q+A with Judith Collins and David Bennett</source>. [Live Video]. Facebook. <uri>https://www.facebook.com/judithcollinsmp/videos/596924027671702/</uri></mixed-citation></ref>
<ref id="B18"><label>18</label><mixed-citation publication-type="journal"><string-name><surname>Disch</surname>, <given-names>L.</given-names></string-name> (<year>2011</year>). <article-title>Toward a mobilization conception of democratic representation</article-title>. <source>American Political Science Review</source>, <volume>105</volume>(<issue>1</issue>), <fpage>100</fpage>&#8211;<lpage>114</lpage>. DOI: <pub-id pub-id-type="doi">10.1017/S0003055410000602</pub-id></mixed-citation></ref>
<ref id="B19"><label>19</label><mixed-citation publication-type="journal"><string-name><surname>Druckman</surname>, <given-names>J. N.</given-names></string-name> (<year>2001</year>). <article-title>On the limits of framing effects: Who can frame?</article-title> <source>The Journal of Politics</source>, <volume>63</volume>(<issue>4</issue>), <fpage>1041</fpage>&#8211;<lpage>66</lpage>.</mixed-citation></ref>
<ref id="B20"><label>20</label><mixed-citation publication-type="journal"><string-name><surname>Druckman</surname>, <given-names>J. N.</given-names></string-name>, &amp; <string-name><surname>Nelson</surname>, <given-names>K. R.</given-names></string-name> <year>2003</year>. <article-title>Framing and deliberation: How citizens&#8217; conversations limit elite influence</article-title>. <source>American Journal of Political Science</source>, <volume>47</volume>(<issue>4</issue>), <fpage>729</fpage>&#8211;<lpage>45</lpage>. DOI: <pub-id pub-id-type="doi">10.1111/1540-5907.00051</pub-id></mixed-citation></ref>
<ref id="B21"><label>21</label><mixed-citation publication-type="journal"><string-name><surname>Druckman</surname>, <given-names>J. N.</given-names></string-name>, <string-name><surname>Peterson</surname>, <given-names>E.</given-names></string-name>, &amp; <string-name><surname>Slothuus</surname>, <given-names>R.</given-names></string-name> (<year>2013</year>). <article-title>How elite Partisan polarization affects public opinion formation</article-title>. <source>American Political Science Review</source>, <volume>107</volume>(<issue>1</issue>), <fpage>57</fpage>&#8211;<lpage>79</lpage>. DOI: <pub-id pub-id-type="doi">10.1017/S0003055412000500</pub-id></mixed-citation></ref>
<ref id="B22"><label>22</label><mixed-citation publication-type="book"><string-name><surname>Dryzek</surname>, <given-names>J. S.</given-names></string-name> (<year>1990</year>). <source>Discursive democracy: Politics, policy, and political science</source>. <publisher-loc>Cambridge</publisher-loc>: <publisher-name>Cambridge University Press</publisher-name>. DOI: <pub-id pub-id-type="doi">10.1017/9781139173810</pub-id></mixed-citation></ref>
<ref id="B23"><label>23</label><mixed-citation publication-type="journal"><string-name><surname>Dryzek</surname>, <given-names>J. S.</given-names></string-name> (<year>2001</year>). <article-title>Legitimacy and economy in deliberative democracy</article-title>. <source>Political Theory</source>, <volume>29</volume>(<issue>5</issue>), <fpage>651</fpage>&#8211;<lpage>69</lpage>. DOI: <pub-id pub-id-type="doi">10.1177/0090591701029005003</pub-id></mixed-citation></ref>
<ref id="B24"><label>24</label><mixed-citation publication-type="journal"><string-name><surname>Dryzek</surname>, <given-names>J. S.</given-names></string-name> (<year>2010</year>). <article-title>Rhetoric in democracy: A systemic appreciation</article-title>. <source>Political Theory</source>, <volume>38</volume>(<issue>3</issue>), <fpage>319</fpage>&#8211;<lpage>39</lpage>. DOI: <pub-id pub-id-type="doi">10.1177/0090591709359596</pub-id></mixed-citation></ref>
<ref id="B25"><label>25</label><mixed-citation publication-type="journal"><string-name><surname>Dryzek</surname>, <given-names>J. S.</given-names></string-name>, &amp; <string-name><surname>Braithwaite</surname>, <given-names>V.</given-names></string-name> (<year>2000</year>). <article-title>On the prospects for democratic deliberation: Values analysis applied to Australian politics</article-title>. <source>Political Psychology</source>, <volume>21</volume>(<issue>2</issue>), <fpage>241</fpage>&#8211;<lpage>66</lpage>. DOI: <pub-id pub-id-type="doi">10.1111/0162-895X.00186</pub-id></mixed-citation></ref>
<ref id="B26"><label>26</label><mixed-citation publication-type="journal"><string-name><surname>Elstub</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Thompson</surname>, <given-names>R.</given-names></string-name>, <string-name><surname>Escobar</surname>, <given-names>O.</given-names></string-name>, <string-name><surname>Hollinghurst</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Grimes</surname>, <given-names>D.</given-names></string-name>, <string-name><surname>Aitken</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>McKeon</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Jones</surname>, <given-names>K. H.</given-names></string-name>, <string-name><surname>Waud</surname>, <given-names>A.</given-names></string-name>, &amp; <string-name><surname>Sethi</surname>, <given-names>N.</given-names></string-name> (<year>2021</year>). <article-title>The resilience of pandemic digital deliberation: An analysis of online synchronous forums</article-title>. <source>Javnost &#8211; The Public</source>, <volume>28</volume>(<issue>3</issue>), <fpage>237</fpage>&#8211;<lpage>55</lpage>. DOI: <pub-id pub-id-type="doi">10.1080/13183222.2021.1969616</pub-id></mixed-citation></ref>
<ref id="B27"><label>27</label><mixed-citation publication-type="journal"><string-name><surname>Esau</surname>, <given-names>K.</given-names></string-name>, <string-name><surname>Fleu&#223;</surname>, <given-names>D.</given-names></string-name>, &amp; <string-name><surname>Nienhaus</surname>, <given-names>S. M.</given-names></string-name> (<year>2021</year>). <article-title>Different arenas, different deliberative quality? Using a systemic framework to evaluate online deliberation on immigration policy in Germany</article-title>. <source>Policy &amp; Internet</source>, <volume>13</volume>(<issue>1</issue>), <fpage>86</fpage>&#8211;<lpage>112</lpage>. DOI: <pub-id pub-id-type="doi">10.1002/poi3.232</pub-id></mixed-citation></ref>
<ref id="B28"><label>28</label><mixed-citation publication-type="journal"><string-name><surname>Eveland</surname>, <given-names>W. P.</given-names></string-name> (<year>2004</year>). <article-title>The effect of political discussion in producing informed citizens: The roles of information, motivation, and elaboration</article-title>. <source>Political Communication</source>, <volume>21</volume>(<issue>2</issue>), <fpage>177</fpage>&#8211;<lpage>93</lpage>. DOI: <pub-id pub-id-type="doi">10.1080/10584600490443877</pub-id></mixed-citation></ref>
<ref id="B29"><label>29</label><mixed-citation publication-type="journal"><string-name><surname>Every-Palmer</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Cunningham</surname>, <given-names>R.</given-names></string-name>, <string-name><surname>Jenkins</surname>, <given-names>M.</given-names></string-name>, &amp; <string-name><surname>Bell</surname>, <given-names>E.</given-names></string-name> <year>2021</year>. <article-title>The Christchurch osque shooting, the media, and subsequent gun control reform in New Zealand: a descriptive analysis</article-title>. <source>Psychiatry, Psychology and Law</source>, <volume>28</volume>(<issue>2</issue>), <fpage>274</fpage>&#8211;<lpage>285</lpage>. DOI: <pub-id pub-id-type="doi">10.1080/13218719.2020.1770635</pub-id></mixed-citation></ref>
<ref id="B30"><label>30</label><mixed-citation publication-type="journal"><string-name><surname>Flinders</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Ghose</surname>, <given-names>K.</given-names></string-name>, <string-name><surname>Jennings</surname>, <given-names>W.</given-names></string-name>, <string-name><surname>Molloy</surname>, <given-names>E.</given-names></string-name>, <string-name><surname>Prosser</surname>, <given-names>B.</given-names></string-name>, <string-name><surname>Renwick</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Smith</surname>, <given-names>G.</given-names></string-name>, &amp; <string-name><surname>Spada</surname>, <given-names>P.</given-names></string-name> (<year>2016</year>). <article-title>Democracy matters: Lessons from the 2015 citizens&#8217; assemblies on English devolution</article-title>.</mixed-citation></ref>
<ref id="B31"><label>31</label><mixed-citation publication-type="book"><string-name><surname>Friedman</surname>, <given-names>W.</given-names></string-name> (<year>2007</year>). <source>Reframing &#8220;framing&#8221;</source> (occasional paper no 1). <publisher-name>Center for Advances in Public Engagement</publisher-name>.</mixed-citation></ref>
<ref id="B32"><label>32</label><mixed-citation publication-type="journal"><string-name><surname>Friess</surname>, <given-names>D.</given-names></string-name>, &amp; <string-name><surname>Eilders</surname>, <given-names>C.</given-names></string-name> (<year>2015</year>). <article-title>A systematic review of online deliberation research</article-title>. <source>Policy &amp; Internet</source>, <volume>7</volume>(<issue>3</issue>), <fpage>319</fpage>&#8211;<lpage>39</lpage>. DOI: <pub-id pub-id-type="doi">10.1002/poi3.95</pub-id></mixed-citation></ref>
<ref id="B33"><label>33</label><mixed-citation publication-type="journal"><string-name><surname>Gervais</surname>, <given-names>B.</given-names></string-name> (<year>2018</year>). <article-title>Rousing the partisan combatant: Elite incivility, anger, and anti-deliberative attitudes forthcoming in political psychology</article-title>. <source>Political Psychology</source>, <volume>40</volume>(<issue>3</issue>), <fpage>637</fpage>&#8211;<lpage>55</lpage>. DOI: <pub-id pub-id-type="doi">10.1111/pops.12532</pub-id></mixed-citation></ref>
<ref id="B34"><label>34</label><mixed-citation publication-type="journal"><string-name><surname>Gibson</surname>, <given-names>R. K.</given-names></string-name>, <string-name><surname>Lusoli</surname>, <given-names>W.</given-names></string-name>, &amp; <string-name><surname>Ward</surname>, <given-names>S. J.</given-names></string-name> (<year>2005</year>). <article-title>Online participation in the UK: Testing a &#8220;contextualised&#8221; model of internet effects</article-title>. <source>British Journal of Politics and International Relations</source>, <volume>7</volume>(<issue>4</issue>), <fpage>561</fpage>&#8211;<lpage>83</lpage>. DOI: <pub-id pub-id-type="doi">10.1111/j.1467-856x.2005.00209.x</pub-id></mixed-citation></ref>
<ref id="B35"><label>35</label><mixed-citation publication-type="webpage"><string-name><surname>Giovannetti</surname>, <given-names>J.</given-names></string-name> (<year>2022</year>, <month>August</month> <day>6</day>). <article-title>New Zealand shows how a housing crisis can become a catastrophe</article-title>. <source>The Globe and Mail</source>. Retrieved from <uri>https://www.theglobeandmail.com/opinion/article-new-zealand-housing-crisis/</uri></mixed-citation></ref>
<ref id="B36"><label>36</label><mixed-citation publication-type="journal"><string-name><surname>Goodin</surname>, <given-names>R. E.</given-names></string-name> (<year>2000</year>). <article-title>Democratic deliberation within</article-title>. <source>Philosophy &amp; Public Affairs</source>, <volume>29</volume>(<issue>1</issue>), <fpage>81</fpage>&#8211;<lpage>109</lpage>. DOI: <pub-id pub-id-type="doi">10.1111/j.1088-4963.2000.00081.x</pub-id></mixed-citation></ref>
<ref id="B37"><label>37</label><mixed-citation publication-type="book"><string-name><surname>Habermas</surname>, <given-names>J.</given-names></string-name> (<year>1984</year>). <source>The theory of communicative action: Reason and the rationalization of society</source>. (Vol. <volume>1</volume>). <publisher-loc>Boston, MA</publisher-loc>: <publisher-name>Beacon Press</publisher-name>.</mixed-citation></ref>
<ref id="B38"><label>38</label><mixed-citation publication-type="book"><string-name><surname>Habermas</surname>, <given-names>J.</given-names></string-name> (<year>1985</year>). <source>The theory of communicative action: Lifeworld and system: A critique of functionalist reason</source> (<edition>3rd</edition> ed, Vol <volume>2</volume>). <publisher-loc>Boston, MA</publisher-loc>: <publisher-name>Beacon Press</publisher-name>.</mixed-citation></ref>
<ref id="B39"><label>39</label><mixed-citation publication-type="journal"><string-name><surname>Habermas</surname>, <given-names>J.</given-names></string-name> (<year>2006</year>). <article-title>Political communication in media society: Does democracy still enjoy an epistemic dimension? The impact of normative theory on empirical research</article-title>. <source>Communication Theory</source>, <volume>16</volume>(<issue>4</issue>), <fpage>411</fpage>&#8211;<lpage>26</lpage>.</mixed-citation></ref>
<ref id="B40"><label>40</label><mixed-citation publication-type="journal"><string-name><surname>Halpern</surname>, <given-names>D.</given-names></string-name>, &amp; <string-name><surname>Gibbs</surname>, <given-names>J.</given-names></string-name> (<year>2013</year>). <article-title>Social media as a catalyst for online deliberation? Exploring the affordances of Facebook and YouTube for political expression</article-title>. <source>Computers in Human Behavior</source>, <volume>29</volume>(<issue>3</issue>), <fpage>1159</fpage>&#8211;<lpage>68</lpage>. DOI: <pub-id pub-id-type="doi">10.1016/j.chb.2012.10.008</pub-id></mixed-citation></ref>
<ref id="B41"><label>41</label><mixed-citation publication-type="journal"><string-name><surname>Hendriks</surname>, <given-names>C. M.</given-names></string-name>, &amp; <string-name><surname>Lees-Marshment</surname>, <given-names>J.</given-names></string-name> (<year>2019</year>). <article-title>Political leaders and public engagement: The hidden world of informal elite&#8211;citizen interaction</article-title>. <source>Political Studies</source>, <volume>67</volume>(<issue>3</issue>), <fpage>597</fpage>&#8211;<lpage>617</lpage>. DOI: <pub-id pub-id-type="doi">10.1177/0032321718791370</pub-id></mixed-citation></ref>
<ref id="B42"><label>42</label><mixed-citation publication-type="journal"><string-name><surname>Iyengar</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Lelkes</surname>, <given-names>Y.</given-names></string-name>, <string-name><surname>Levendusky</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Malhotra</surname>, <given-names>N.</given-names></string-name>, &amp; <string-name><surname>Westwood</surname>, <given-names>S. J.</given-names></string-name> (<year>2019</year>). <article-title>The origins and consequences of affective polarization in the United States</article-title>. <source>Annual Review of Political Science</source>, <volume>11</volume>(<issue>22</issue>), <fpage>129</fpage>&#8211;<lpage>46</lpage>. DOI: <pub-id pub-id-type="doi">10.1146/annurev-polisci-051117-073034</pub-id></mixed-citation></ref>
<ref id="B43"><label>43</label><mixed-citation publication-type="journal"><string-name><surname>Jaworska</surname>, <given-names>S.</given-names></string-name>, &amp; <string-name><surname>V&#225;squez</surname>, <given-names>C.</given-names></string-name> (<year>2022</year>). <article-title>COVID-19 and the discursive practices of political leadership: Introduction</article-title>. <source>Discourse, Context &amp; Media</source>, <volume>47</volume>, <elocation-id>100605</elocation-id>. DOI: <pub-id pub-id-type="doi">10.1016/j.dcm.2022.100605</pub-id></mixed-citation></ref>
<ref id="B44"><label>44</label><mixed-citation publication-type="journal"><string-name><surname>Jung</surname>, <given-names>N.</given-names></string-name>, <string-name><surname>Kim</surname>, <given-names>Y.</given-names></string-name>, &amp; <string-name><surname>de Z&#250;&#241;iga</surname>, <given-names>H. G.</given-names></string-name> (<year>2011</year>). <article-title>The mediating role of Knowledge and efficacy in the effects of communication on political participation</article-title>. <source>Mass Communication and Society</source>, <volume>14</volume>(<issue>4</issue>), <fpage>407</fpage>&#8211;<lpage>430</lpage>. DOI: <pub-id pub-id-type="doi">10.1080/15205436.2010.496135</pub-id></mixed-citation></ref>
<ref id="B45"><label>45</label><mixed-citation publication-type="journal"><string-name><surname>Kanra</surname>, <given-names>B.</given-names></string-name> (<year>2020</year>). <article-title>Binary deliberation: The role of social learning in divided societies</article-title>. <source>Journal of Deliberative Democracy</source>, <volume>8</volume>(<issue>1</issue>). DOI: <pub-id pub-id-type="doi">10.16997/jdd.123</pub-id></mixed-citation></ref>
<ref id="B46"><label>46</label><mixed-citation publication-type="book"><string-name><surname>Knight</surname>, <given-names>J.</given-names></string-name>, &amp; <string-name><surname>Johnson</surname>, <given-names>J.</given-names></string-name> (<year>1997</year>). <chapter-title>What sort of political equality does deliberative democracy require?</chapter-title> In (Eds.), <source>Deliberative democracy: Essays on reason and politics</source> (pp. <fpage>279</fpage>&#8211;<lpage>320</lpage>). <publisher-loc>Cambridge, MA</publisher-loc>: <publisher-name>MIT Press</publisher-name>.</mixed-citation></ref>
<ref id="B47"><label>47</label><mixed-citation publication-type="book"><string-name><surname>Kruglanski</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Fishback</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Erb</surname>, <given-names>H. P.</given-names></string-name>, <string-name><surname>Pierro</surname>, <given-names>A.</given-names></string-name>, &amp; <string-name><surname>Mannette</surname>, <given-names>L.</given-names></string-name> (<year>2004</year>). <chapter-title>The parametric unimodel as a theory of persuasion</chapter-title>. In (Eds.), <source>contemporary perspectives on the psychology of attitudes: An introduction and overview</source> (<edition>1st</edition> ed., pp. <fpage>399</fpage>&#8211;<lpage>422</lpage>). <publisher-loc>US</publisher-loc>: <publisher-name>Taylor &amp; Francis Group</publisher-name>.</mixed-citation></ref>
<ref id="B48"><label>48</label><mixed-citation publication-type="journal"><string-name><surname>Kuyper</surname>, <given-names>J. W.</given-names></string-name> (<year>2012</year>). <article-title>Deliberative democracy and the neglected dimension of leadership</article-title>. <source>Journal of Public Deliberation</source>, <volume>8</volume>(<issue>1</issue>), <fpage>1</fpage>&#8211;<lpage>32</lpage>. DOI: <pub-id pub-id-type="doi">10.16997/jdd.126</pub-id></mixed-citation></ref>
<ref id="B49"><label>49</label><mixed-citation publication-type="journal"><string-name><surname>Lafont</surname>, <given-names>C.</given-names></string-name> (<year>2015</year>). <article-title>Deliberation, participation, and democratic legitimacy: Should deliberative mini-publics shape public policy?</article-title> <source>Journal of Political Philosophy</source>, <volume>23</volume>(<issue>1</issue>), <fpage>40</fpage>&#8211;<lpage>63</lpage>. DOI: <pub-id pub-id-type="doi">10.1111/jopp.12031</pub-id></mixed-citation></ref>
<ref id="B50"><label>50</label><mixed-citation publication-type="book"><string-name><surname>Leeper</surname>, <given-names>T. J.</given-names></string-name>, &amp; <string-name><surname>Slothuus</surname>, <given-names>R.</given-names></string-name> (<year>2018</year>). <chapter-title>Deliberation and framing. In The Oxford Handbook of deliberative democracy</chapter-title> (<edition>1st</edition> ed., pp. <fpage>556</fpage>&#8211;<lpage>572</lpage>). <publisher-loc>Oxford, UK</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>. DOI: <pub-id pub-id-type="doi">10.1093/oxfordhb/9780198747369.013.37</pub-id></mixed-citation></ref>
<ref id="B51"><label>51</label><mixed-citation publication-type="journal"><string-name><surname>Lees-Marshment</surname>, <given-names>J.</given-names></string-name> (<year>2016</year>). <article-title>Deliberative political leaders: The role of policy input in political leadership</article-title>. <source>Politics and Governance</source>, <volume>4</volume>(<issue>2</issue>), <fpage>25</fpage>&#8211;<lpage>35</lpage>. DOI: <pub-id pub-id-type="doi">10.17645/pag.v4i2.560</pub-id></mixed-citation></ref>
<ref id="B52"><label>52</label><mixed-citation publication-type="journal"><string-name><surname>Levine</surname>, <given-names>S.</given-names></string-name> (<year>2004</year>). <article-title>Parliamentary democracy in New Zealand</article-title>. <source>Parliamentary Affairs</source>, <volume>57</volume>(<issue>3</issue>), <fpage>646</fpage>&#8211;<lpage>665</lpage>. DOI: <pub-id pub-id-type="doi">10.1093/pa/gsh050</pub-id></mixed-citation></ref>
<ref id="B53"><label>53</label><mixed-citation publication-type="webpage"><string-name><surname>Manon</surname>, <given-names>P.</given-names></string-name> (<year>2020</year>, <month>October</month> <day>1</day>). <article-title>Ardern vows to tackle housing crisis as New Zealand readies for early voting</article-title>. <source>Reuters</source>. Retrieved from <uri>https://www.reuters.com/article/newzealand-election-int-idUSKBN26M7PG</uri></mixed-citation></ref>
<ref id="B54"><label>54</label><mixed-citation publication-type="journal"><string-name><surname>Mansbridge</surname>, <given-names>J.</given-names></string-name> (<year>2009</year>). <article-title>A &#8220;selection model&#8221; of political representation</article-title>. <source>Journal of Political Philosophy</source>, <volume>17</volume>(<issue>4</issue>), <fpage>369</fpage>&#8211;<lpage>398</lpage>. DOI: <pub-id pub-id-type="doi">10.1111/j.1467-9760.2009.00337.x</pub-id></mixed-citation></ref>
<ref id="B55"><label>55</label><mixed-citation publication-type="book"><string-name><surname>Mansbridge</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Boman</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Christiano</surname>, <given-names>T.</given-names></string-name>, <string-name><surname>Fung</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Parkinson</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Thompson</surname>, <given-names>D. F.</given-names></string-name>, <string-name><surname>Warren</surname>, <given-names>M. E.</given-names></string-name>, &amp; <string-name><surname>Chambers</surname>, <given-names>S.</given-names></string-name> (<year>2012</year>). <chapter-title>A systemic approach to deliberative democracy</chapter-title>. In (Eds.), <source>Deliberative systems: Deliberative democracy at the large scale</source> (pp. <fpage>1</fpage>&#8211;<lpage>26</lpage>). <publisher-loc>New York</publisher-loc>: <publisher-name>Cambridge University Press</publisher-name>. DOI: <pub-id pub-id-type="doi">10.1017/CBO9781139178914.002</pub-id></mixed-citation></ref>
<ref id="B56"><label>56</label><mixed-citation publication-type="book"><string-name><surname>McCarthy</surname>, <given-names>T.</given-names></string-name> (<year>1984</year>). <chapter-title>Translator&#8217;s introduction</chapter-title>. In <string-name><given-names>J.</given-names> <surname>Habermas</surname></string-name>(Ed.), <source>The theory of communicative action: Reason and the rationalization of society</source>. <publisher-name>Polity Press</publisher-name>.</mixed-citation></ref>
<ref id="B57"><label>57</label><mixed-citation publication-type="journal"><string-name><surname>McGuire</surname>, <given-names>D.</given-names></string-name>, <string-name><surname>Cunningham</surname>, <given-names>J. E.</given-names></string-name>, <string-name><surname>Reynolds</surname>, <given-names>K.</given-names></string-name>, &amp; <string-name><surname>Matthews-Smith</surname>, <given-names>G.</given-names></string-name> (<year>2020</year>). <article-title>Beating the virus: An examination of the crisis communication approach taken by New Zealand Prime Minister Jacinda Ardern during the Covid-19 pandemic</article-title>. <source>Human Resource Development International</source>, <volume>23</volume>(<issue>4</issue>), <fpage>361</fpage>&#8211;<lpage>379</lpage>. DOI: <pub-id pub-id-type="doi">10.1080/13678868.2020.1779543</pub-id></mixed-citation></ref>
<ref id="B58"><label>58</label><mixed-citation publication-type="book"><string-name><surname>Mouffe</surname>, <given-names>C.</given-names></string-name> (<year>2000</year>). <source>Deliberative democracy or agonistic pluralism</source> (series: Reihe Politikwissenschaft/Institut f&#252;r H&#246;here Studien, Abt. Politikwissenschaft, 72). <publisher-loc>Wien</publisher-loc>: <publisher-name>Institut f&#252;r H&#246;here Studien (IHS)</publisher-name>.</mixed-citation></ref>
<ref id="B59"><label>59</label><mixed-citation publication-type="journal"><string-name><surname>Mutz</surname>, <given-names>D. C.</given-names></string-name> (<year>2007</year>). <article-title>Effects of &#8220;In-your-face&#8221; television discourse on perceptions of a legitimate opposition</article-title>. <source>American Political Science Review</source>, <volume>101</volume>(<issue>4</issue>), <fpage>621</fpage>&#8211;<lpage>635</lpage>. DOI: <pub-id pub-id-type="doi">10.1017/S000305540707044X</pub-id></mixed-citation></ref>
<ref id="B60"><label>60</label><mixed-citation publication-type="book"><string-name><surname>Parkinson</surname>, <given-names>J.</given-names></string-name> (<year>2001</year>). <chapter-title>Deliberative democracy and referendums</chapter-title>. In (eds.), <source>Challenges to democracy: Ideas, involvement and institutions</source> (<edition>1st</edition> ed., pp. <fpage>131</fpage>&#8211;<lpage>52</lpage>). <publisher-loc>London</publisher-loc>: <publisher-name>Palgrave Macmillan</publisher-name>. DOI: <pub-id pub-id-type="doi">10.1057/9780230502185_9</pub-id></mixed-citation></ref>
<ref id="B61"><label>61</label><mixed-citation publication-type="journal"><string-name><surname>Paustian-Underdahl</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Walker</surname>, <given-names>L.</given-names></string-name>, &amp; <string-name><surname>Woehr</surname>, <given-names>D.</given-names></string-name> (<year>2014</year>). <article-title>Gender and perceptions of leadership effectiveness: A meta-analysis of contextual moderators</article-title>. <source>The Journal of Applied Psychology</source>, <volume>99</volume>. DOI: <pub-id pub-id-type="doi">10.1037/a0036751</pub-id></mixed-citation></ref>
<ref id="B62"><label>62</label><mixed-citation publication-type="book"><string-name><surname>Petty</surname>, <given-names>R. E.</given-names></string-name>, &amp; <string-name><surname>Brinol</surname>, <given-names>P.</given-names></string-name> (<year>2002</year>). <chapter-title>Attitude change: The elaborative liklihood model of persuasion</chapter-title>. In (Eds.), <source>Marketing for sustainability: Towards transactional policy-making</source> (pp. <fpage>176</fpage>&#8211;<lpage>90</lpage>). <publisher-name>IOS Press</publisher-name>.</mixed-citation></ref>
<ref id="B63"><label>63</label><mixed-citation publication-type="journal"><string-name><surname>Porat</surname>, <given-names>I.</given-names></string-name> (<year>2023</year>). <article-title>Court polarization: A comparative perspective</article-title>. <source>Hastings International and Comparative Law Review</source>, <volume>46</volume>(<issue>1</issue>), <fpage>3</fpage>.</mixed-citation></ref>
<ref id="B64"><label>64</label><mixed-citation publication-type="journal"><string-name><surname>Romsdahl</surname>, <given-names>R.</given-names></string-name>, <string-name><surname>Blue</surname>, <given-names>G.</given-names></string-name>, &amp; <string-name><surname>Kirilenko</surname>, <given-names>A.</given-names></string-name> (<year>2018</year>). <article-title>Action on climate change requires deliberative framing at local governance level</article-title>. <source>Climatic Change</source>, <volume>149</volume>(<issue>3</issue>), <fpage>277</fpage>&#8211;<lpage>87</lpage>. DOI: <pub-id pub-id-type="doi">10.1007/s10584-018-2240-0</pub-id></mixed-citation></ref>
<ref id="B65"><label>65</label><mixed-citation publication-type="journal"><string-name><surname>Ross</surname>, <given-names>K.</given-names></string-name>, &amp; <string-name><surname>B&#252;rger</surname>, <given-names>T.</given-names></string-name> (<year>2014</year>). <article-title>Face to face(book): Social media, political campaigning and the unbearable lightness of being there</article-title>. <source>Political Science</source>, <volume>66</volume>(<issue>1</issue>), <fpage>46</fpage>&#8211;<lpage>62</lpage>. DOI: <pub-id pub-id-type="doi">10.1177/0032318714534106</pub-id></mixed-citation></ref>
<ref id="B66"><label>66</label><mixed-citation publication-type="journal"><string-name><surname>Rossini</surname>, <given-names>P.</given-names></string-name>, &amp; <string-name><surname>Maia</surname>, <given-names>R.</given-names></string-name> (<year>2021</year>). <article-title>Characterizing disagreement in online political talk: Examining incivility and opinion expression on news websites and Facebook in Brazil</article-title>. <source>Journal of Deliberative Democracy</source>, <volume>17</volume>(<issue>1</issue>), <fpage>90</fpage>&#8211;<lpage>104</lpage>. DOI: <pub-id pub-id-type="doi">10.16997/10.16997/jdd.967</pub-id></mixed-citation></ref>
<ref id="B67"><label>67</label><mixed-citation publication-type="book"><string-name><surname>Scott</surname>, <given-names>W. R.</given-names></string-name> (<year>2013</year>). <source>Institutions and organizations: Ideas, interests, and identities</source>. <publisher-name>Sage publications</publisher-name>.</mixed-citation></ref>
<ref id="B68"><label>68</label><mixed-citation publication-type="journal"><string-name><surname>Simpson</surname>, <given-names>A. V.</given-names></string-name>, <string-name><surname>Rego</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Berti</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Clegg</surname>, <given-names>S.</given-names></string-name>, &amp; Pinae <string-name><surname>Cunha</surname>, <given-names>M.</given-names></string-name> (<year>2022</year>). <article-title>Theorizing compassionate leadership from the case of Jacinda Ardern: Legitimacy, paradox and resource conservation</article-title>. <source>Leadership</source>, <volume>18</volume>(<issue>3</issue>), <fpage>337</fpage>&#8211;<lpage>358</lpage>. DOI: <pub-id pub-id-type="doi">10.1177/17427150211055291</pub-id></mixed-citation></ref>
<ref id="B69"><label>69</label><mixed-citation publication-type="journal"><string-name><surname>Skytte</surname>, <given-names>R.</given-names></string-name> (<year>2021</year>). <article-title>Dimensions of elite partisan polarization: Disentangling the effects of incivility and issue polarization</article-title>. <source>British Journal of Political Science</source>, <volume>51</volume>(<issue>4</issue>), <fpage>1457</fpage>&#8211;<lpage>75</lpage>. DOI: <pub-id pub-id-type="doi">10.1017/S0007123419000760</pub-id></mixed-citation></ref>
<ref id="B70"><label>70</label><mixed-citation publication-type="journal"><string-name><surname>S&#248;rensen</surname>, <given-names>M. P.</given-names></string-name> (<year>2016</year>). <article-title>Political conversations on Facebook &#8211; The participation of politicians and citizens</article-title>. <source>Media, Culture and Society</source>, <volume>38</volume>(<issue>5</issue>), <fpage>664</fpage>&#8211;<lpage>685</lpage>. DOI: <pub-id pub-id-type="doi">10.1177/0163443715620924</pub-id></mixed-citation></ref>
<ref id="B71"><label>71</label><mixed-citation publication-type="journal"><string-name><surname>Steenbergen</surname>, <given-names>M. R.</given-names></string-name>, <string-name><surname>B&#228;chtiger</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Sp&#246;rndli</surname>, <given-names>M.</given-names></string-name>, &amp; <string-name><surname>Steiner</surname>, <given-names>J.</given-names></string-name> (<year>2003</year>). <article-title>Measuring political deliberation: A discourse quality index</article-title>. <source>Comparative European Politics</source>, <volume>1</volume>(<issue>1</issue>), <fpage>21</fpage>&#8211;<lpage>48</lpage>. DOI: <pub-id pub-id-type="doi">10.1057/palgrave.cep.6110002</pub-id></mixed-citation></ref>
<ref id="B72"><label>72</label><mixed-citation publication-type="journal"><string-name><surname>Strandberg</surname>, <given-names>K.</given-names></string-name> (<year>2015</year>). <article-title>Designing for democracy? An experimental study comparing the outcomes of citizen discussions in online forums with those of online discussion in a forum designed according to deliberative principles</article-title>. <source>European Political Science Review</source>, <volume>7</volume>, <fpage>451</fpage>&#8211;<lpage>74</lpage>. DOI: <pub-id pub-id-type="doi">10.1017/S1755773914000265</pub-id></mixed-citation></ref>
<ref id="B73"><label>73</label><mixed-citation publication-type="journal"><string-name><surname>Strandberg</surname>, <given-names>K.</given-names></string-name>, <string-name><surname>Himmelroos</surname>, <given-names>S.</given-names></string-name>, &amp; <string-name><surname>Gr&#246;nlund</surname>, <given-names>K.</given-names></string-name> (<year>2019</year>). <article-title>Do discussions in like-minded groups necessarily lead to more extreme opinions? Deliberative democracy and group polarization</article-title>. <source>International Political Science Review</source>, <volume>40</volume>(<issue>1</issue>), <fpage>41</fpage>&#8211;<lpage>57</lpage>. DOI: <pub-id pub-id-type="doi">10.1177/0192512117692136</pub-id></mixed-citation></ref>
<ref id="B74"><label>74</label><mixed-citation publication-type="journal"><string-name><surname>Stromer-Galley</surname>, <given-names>J.</given-names></string-name> (<year>2007</year>). <article-title>Measuring deliberation&#8217; s content: A coding scheme</article-title>. <source>Journal of Public Deliberation</source>, <fpage>7</fpage>&#8211;<lpage>13</lpage>. DOI: <pub-id pub-id-type="doi">10.16997/jdd.50</pub-id></mixed-citation></ref>
<ref id="B75"><label>75</label><mixed-citation publication-type="journal"><string-name><surname>Suiter</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Farrell</surname>, <given-names>D.</given-names></string-name>, &amp; <string-name><surname>Harris</surname>, <given-names>C.</given-names></string-name> (<year>2016</year>). <article-title>The Irish constitutional convention: A case of &#8216;high legitimacy&#8217;?</article-title> <source>Constitutional Deliberative Democracy in Europe</source>, <fpage>33</fpage>&#8211;<lpage>52</lpage>.</mixed-citation></ref>
<ref id="B76"><label>76</label><mixed-citation publication-type="journal"><string-name><surname>Sunstein</surname>, <given-names>C. R.</given-names></string-name> (<year>2000</year>). <article-title>Deliberative trouble &#8211; Why groups go to extremes</article-title>. <source>The Yale Law Journal</source>, <volume>110</volume>(<issue>1</issue>), <fpage>51</fpage>. DOI: <pub-id pub-id-type="doi">10.2307/797587</pub-id></mixed-citation></ref>
<ref id="B77"><label>77</label><mixed-citation publication-type="journal"><string-name><surname>Tetlock</surname>, <given-names>P. E.</given-names></string-name> (<year>1985</year>). <article-title>Accountability: The neglected social context of judgement and choice</article-title>. <source>Research in Organizational Behavior</source>, <volume>7</volume>, <fpage>297</fpage>&#8211;<lpage>32</lpage>.</mixed-citation></ref>
<ref id="B78"><label>78</label><mixed-citation publication-type="book"><string-name><surname>Waldron</surname>, <given-names>J.</given-names></string-name> (<year>2011</year>). <source>The Principle of Loyal Opposition</source>. NYU School of Law, Public Law Research Paper no.12&#8211;22. <publisher-loc>New York</publisher-loc>: <publisher-name>New York University School of Law</publisher-name>.</mixed-citation></ref>
<ref id="B79"><label>79</label><mixed-citation publication-type="journal"><string-name><surname>Willige</surname>, <given-names>A.</given-names></string-name> (<year>2017</year>). <article-title>Which are the world&#8217;s strongest democracies</article-title>. In <source>World Economic Forum</source>. Last modified <month>February</month> (Vol. <volume>23</volume>, pp. <fpage>2017</fpage>).</mixed-citation></ref>
<ref id="B80"><label>80</label><mixed-citation publication-type="book"><string-name><surname>Young</surname>, <given-names>I. M.</given-names></string-name> (<year>2002</year>). <source>Inclusion and democracy</source>. <publisher-loc>New York</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>. DOI: <pub-id pub-id-type="doi">10.1093/0198297556.001.0001</pub-id></mixed-citation></ref>
<ref id="B81"><label>81</label><mixed-citation publication-type="journal"><string-name><surname>Ziegele</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Breiner</surname>, <given-names>T.</given-names></string-name>, &amp; <string-name><surname>Quiring</surname>, <given-names>O.</given-names></string-name> (<year>2014</year>). <article-title>What creates interactivity in online news discussions? An exploratory analysis of discussion factors in user comments on news items</article-title>. <source>Journal of Communication</source>, <volume>64</volume>(<issue>6</issue>), <fpage>1111</fpage>&#8211;<lpage>1138</lpage>. DOI: <pub-id pub-id-type="doi">10.1111/jcom.12123</pub-id></mixed-citation></ref>
</ref-list>
</back>
</article>