The paper
Erik Peterson, Sean J. Westwood, and Shanto Iyengar (2021). Beyond Attitudes: Incorporating Measures of Behavior in Survey Experiments. In James N. Druckman and Donald P. Green (eds.), Advances in Experimental Political Science, 239–254. Cambridge University Press.
doi:10.1017/9781108777919.017 (opens in a new tab) · No public replication archive · Other public data used: doi:10.7910/DVN/IXOMN4 (opens in a new tab)
Main text
p. 243, Section 13.2
Published
Webb and Sheeran (2018) conducted a meta-analysis spanning 47 experiments that included both attitudinal and behavioral outcomes. They reported that the magnitude of a treatment effect on attitudes was typically twice as large as its impact on behaviors.
Correction
Webb and Sheeran (2006) conducted a meta-analysis spanning 47 experiments that changed behavioral intentions and measured subsequent behavior. They reported that the magnitude of a treatment effect on intentions was typically twice as large as its impact on behaviors (d = 0.66 versus d = 0.36).
Basis Webb and Sheeran (2006, Psychological Bulletin 132(2): 249–268) compare experimentally induced changes in intentions with the resulting changes in behavior. See also the correction to the reference list.
p. 244, Section 13.4.1
Published
(see, e.g., De Benedictics-Kessner et al. 2019; Knox et al. 2019) [...] For instance, De Benedictics-Kessner et al. (2019) use a stylized choice set
Correction
(see, e.g., De Benedictis-Kessner et al. 2019; Knox et al. 2019) [...] For instance, De Benedictis-Kessner et al. (2019) use a stylized choice set
p. 245, Section 13.4.2
Published
he detects only a slight decline in affective polarization due to these primes, ranging from 1 to 3 percentage points on a feeling thermometer scale.
Correction
he detects only a slight decline in affective polarization due to these primes, ranging from about 3 to 5 percentage points on a feeling thermometer scale.
Basis Levendusky (2018) reports experimental effects of about 5 degrees (Experiment 1) and 3.6 and 3 degrees (Experiments 2 and 3). His 1.9 to 3.6 degree range comes from an observational analysis of the Fourth of July.
p. 246, Section 13.4.2
Published
The costs of paying the allocations to respondents as a cash bonus are also nontrivial (between $10,000 and $15,000 for 2000 respondents).
Correction
The costs of paying the allocations to respondents as a cash bonus are also nontrivial (about $1,850 to $2,030 for 2000 respondents).
Basis The study described here was published as Westwood and Peterson, Political Behavior (doi:10.1007/s11109-020-09648-9), which pays each respondent’s wallet as a cash bonus after a .05 multiplier. In its public replication data (Harvard Dataverse doi:10.7910/DVN/IXOMN4), mean winnings are 18.5 game units in Study 1 (N = 2,315) and 20.3 in Study 3 (N = 1,997), so the bonuses for 2000 respondents come to $1,850 to $2,030. The largest wallet is 69 units ($3.45); paying the maximum to every one of 2000 respondents would cost $6,900.
p. 246, Section 13.4.2
Published
Finally, some might objects to the use of mild deception
Correction
Finally, some might object to the use of mild deception
p. 246, Section 13.5.1
Published
the Affect Missatribution Procedure (AMP) developed by Payne et al. (2005)
Correction
the Affect Misattribution Procedure (AMP) developed by Payne et al. (2005)
p. 246, Section 13.5.1
Published
Ryan (2017) uses this design to show that response latency for independents is comparable to that of partisans.
Correction
Ryan (2017) uses this design to show that the implicit partisan attitudes of “indifferent” citizens, who report weak liking for both parties, predict their political judgments.
Basis Ryan (2017, American Journal of Political Science 61(4): 892–907) defines indifferent citizens by weak explicit attitudes toward both parties, not by independent identification, and does not compare their response latencies with those of partisans.
p. 246, Section 13.5.1
Published
Valentino et al. (forthcoming) use this approach to capture implicit political and racial attitudes
Correction
Valentino and Zhirkov (2018) use this approach to capture implicit political and racial attitudes
Basis The cited paper is a 2018 Midwest Political Science Association conference paper by Valentino and Zhirkov and did not appear in the American Journal of Political Science. Related work was published as Zhirkov and Valentino (2022) in the Journal of Race, Ethnicity, and Politics. See the correction to the reference list.
p. 247, Section 13.5.1
Published
images generate by the media.
Correction
images generated by the media.
p. 248, Section 13.5.2
Published
Peterson et al. (2019) tracked the web browsing behavior of a sample of YouGov panelists who had installed the toolbar between November 2016 and September 2017 (see also Guess 2018). Over this period, the panelists made 74 million visits to over 330,000 web domains. [...] In the case of the behavioral measure of web browsing over this same period, the partisan gap was cut by two-thirds
Correction
Peterson et al. (2019) tracked the web browsing behavior of a sample of YouGov panelists who had installed the toolbar between August 1 and November 8, 2016 (see also Guess 2018). Over this period, the panelists made about 30 million visits to more than 170,000 web domains. [...] In the case of the behavioral measure of web browsing over the period covered by the self-reports, the partisan gap was cut by two-thirds
Basis Peterson, Goel and Iyengar (Political Science Research and Methods, doi:10.1017/psrm.2019.55) report browsing from August 1 to November 8, 2016, with about 30 million visits to more than 170,000 domains; the November 2016 to September 2017 window and its counts are not in the cited article. The comparison with self-reports comes from the ongoing panel study that the paragraph describes. The Comscore correlations (above 0.9 for the top 500 sites; 0.67 for the news sites) match the article’s online Appendix Table A1.
p. 249, Section 13.5.3
Published
Westwood and Iyengar (2018) developed a method to connect online survey panels with fitness devices so as to capture physiological data.
Correction
Westwood and Iyengar, two of the present authors, developed a method to connect online survey panels with fitness devices so as to capture physiological data.
Basis The reference list contains no entry for Westwood and Iyengar (2018).
pp. 251–254, References
Published
Asch, Solomon E. 1951. [...] ed. Harold Guetzkow. Pittsburg, PA: Carnegie Press, pp. 177–190. De Benedictics-Kessner, Justin, Matthew A. Baum, Adam J. Berinsky, and Teppei Yamamoto. 2019. [...] Druckman, James N., Donald P. Green, James Kulinski, and Arthur Lupia. 2006. [...] Gaines, Brian J., James H. Kuklinksi, and Paul J. Quirk. 2007. [...] Green, Donald P., and Alan S. Gerber. 2002. “The Downstream Benefits of Experimentation.” Political Analysis 4(10): 394–402. Hainmueller, Jens, Daniel J. Hopkins, and Yeppei Yamamoto. 2014. [...] Hainmueller, Jens, Dominik Hangartner, and Yeppei Yamamoto. 2015. [...] Valentino, Nicholas A. et al. Forthcoming. “Blue Is Black and Red is White? Affective Polarization and the Racialized Schemas of US Party Coalitions.” American Journal of Political Science. Webb, Thomas L., and Paschal Sheeran. 2018. “Does Changing Behavioral Intentional Engender Behavior Change? A Meta-Analysis of the Experimental Evidence.” Psychological Bulletion 132(2): 249–268.
Correction
Asch, Solomon E. 1951. [...] ed. Harold Guetzkow. Pittsburgh, PA: Carnegie Press, pp. 177–190.
De Benedictis-Kessner, Justin, Matthew A. Baum, Adam J. Berinsky, and Teppei Yamamoto. 2019. [...]
Druckman, James N., Donald P. Green, James Kuklinski, and Arthur Lupia. 2006. [...]
Gaines, Brian J., James H. Kuklinski, and Paul J. Quirk. 2007. [...]
Green, Donald P., and Alan S. Gerber. 2002. “The Downstream Benefits of Experimentation.” Political Analysis 10(4): 394–402.
Hainmueller, Jens, Daniel J. Hopkins, and Teppei Yamamoto. 2014. [...]
Hainmueller, Jens, Dominik Hangartner, and Teppei Yamamoto. 2015. [...]
Valentino, Nicholas A., and Kirill Zhirkov. 2018. “Blue Is Black and Red is White? Affective Polarization and the Racialized Schemas of US Party Coalitions.” Paper presented at the Annual Meeting of the Midwest Political Science Association, Chicago. Related published work: Zhirkov, Kirill, and Nicholas A. Valentino. 2022. “The Origins and Consequences of Racialized Schemas about U.S. Parties.” Journal of Race, Ethnicity, and Politics 7(3): 484–504.
Webb, Thomas L., and Paschal Sheeran. 2006. “Does Changing Behavioral Intentions Engender Behavior Change? A Meta-Analysis of the Experimental Evidence.” Psychological Bulletin 132(2): 249–268.