Academia.eduAcademia.edu

Outline

Aoir Ethics Panel 2: Platform Challenges

2021, AoIR Selected Papers of Internet Research

Abstract

This panel is one of two sessions organized by the AoIR Ethics Working Committee. It collects five papers exploring a broad (but in many ways common) set of ethical dilemmas faced by researchers engaged with specific platforms such as Reddit, Amazon’s Mechanical Turk, and private messaging platforms. These include: a study of people's online conversations about health matters on Reddit in support of a proposed situated ethics framework for researchers working with publicly available data; an exploration into sourcing practices among Reddit researchers to determine if their sources could be unmasked and located in Reddit archives; a broader systematic review of over 700 research studies that used Reddit data to assess the kinds of analysis and methods researchers are engaging in as well as any ethical considerations that emerge when researching Reddit; a critical examination of the use of Amazon’s Mechanical Turk for academic research; and an investigation into current practices ...

References (61)

  1. Collin, P., Swist, T., Taddeo, C., & Spears, B. (2020). Working with complexity: Between control and care in digital research ethics. Complexities of Researching with Young People, 115-129.
  2. Hine, C. (2015). Ethnography for the Internet: Embedded, Embodied and Everyday. Bloomsbury Publishing Plc.
  3. Roberts, L. D. (2015). Ethical Issues in Conducting Qualitative Research in Online Communities. Qualitative Research in Psychology, 12(3), 314-325. https://doi.org/10.1080/14780887.2015.1008909
  4. Steinmetz, K. F. (2012). Message Received: Virtual Ethnography in Online Message Boards. International Journal of Qualitative Methods, 11(1), 26-39. https://doi.org/10.1177/160940691201100103
  5. Stommel, W., & Rijk, L. de. (2021). Ethical approval: None sought. How discourse analysts report ethical issues around publicly available online data. Research Ethics, 174701612098876. https://doi.org/10.1177/1747016120988767
  6. Taylor, J., & Pagliari, C. (2018). Mining social media data: How are research sponsors and researchers addressing the ethical challenges? Research Ethics, 14(2), 1-39. https://doi.org/10.1177/1747016117738559
  7. Webb, H., Jirotka, M., Stahl, B. C., Housley, W., Edwards, A., Williams, M., Procter, R., Rana, O., & Burnap, P. (2017). The Ethical Challenges of Publishing Twitter Data for Research Dissemination. Proceedings of the 2017 ACM on Web Science Conference - WebSci '17, 339-348. https://doi.org/10.1145/3091478.3091489
  8. References Barbaro, M., & Zeller, T., Jr. (2006, August 9). A face is exposed for AOL searcher no. 4417749. The New York Times. https://www.nytimes.com/2006/08/09/technology/09aol.html
  9. Bruckman, A. (2002). Studying the amateur artist: a perspective on disguising data collected in human subjects research on the Internet. Ethics and Information Technology, 4(3). http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.432.1591&rep=rep1&type=pdf
  10. Brunton, F., & Nissenbaum, H. (2015). Obfuscation: A user's guide for privacy and protest. MIT Press.
  11. Finn, J., & Lavitt, M. (1994). Computer-based self-help groups for sexual abuse survivors. Social Work With Groups, 17(1-2), 21-46. http://dx.doi.org/10.1300/J009v17n01_03
  12. Franzke, A. S., Bechmann, A., Zimmer, M., Ess, C., & AoIR, and. (2020). Internet research: Ethical guidelines 3.0. AoIR. https://aoir.org/reports/ethics3.pdf Haimson, O. L., Andalibi, N., & Pater, J. (2016, December 20). Ethical use of visual social media content in research publications. AHRECS. https://ahrecs.com/ethical-use- visual-social-media-content-research-publications/
  13. King, S. A. (1996). Researching internet communities: Proposed ethical guidelines for the reporting of results. The Information Society, 12(2). https://doi.org/10.1080/713856145
  14. Markham, A. (2012). Fabrication as ethical practice: Qualitative inquiry in ambiguous Internet contexts. Information, Communication & Society, 15(3). https://doi.org/10.1080/1369118x.2011.641993
  15. Ohm, P. (2010). Broken promises of privacy: Responding to the surprising failure of Anonymization. UCLA Law Review, 58(2). https://www.uclalawreview.org/broken- promises-of-privacy-responding-to-the-surprising-failure-of-anonymization-2/
  16. Shklovski, I., & Vertesi, J. (2013, April 27). 'UnGoogling' publications: The ethics and problems of anonymization. Proceedings of CHI 2013. https://pure.itu.dk/portal/files/80190129/p2169_shklovski.pdf
  17. Singer, N. (2015, February 14). Love in the time of Twitter. The New York Times. https://web.archive.org/web/20190412053116/https://bits.blogs.nytimes.com/2015/02/13 /love-in-the-times-of-twitter/
  18. Zimmer, M. (2010). 'But the data is already public': On the ethics of research in Facebook. Ethics and Information Technology, 12(4). https://doi.org/10.1007/s10676- 010-9227-5
  19. Farrell, T., Fernandez, M., Novotny, J., & Alani, H. (2019). Exploring misogyny across the manosphere in Reddit. Proceedings of the 10th ACM Conference on Web Science, 87-96.
  20. Fiesler, C., & Proferes, N. (2018). "Participant" Perceptions of Twitter Research Ethics. Social Media + Society, 4(1).
  21. Marotti, A. (2018). Reddit to open Chicago office as part of advertising push. Chicagotribune.Com. https://www.chicagotribune.com/business/ct-biz-reddit-chicago- office-20180418-story .html
  22. Marwick, A. E. (2017). Scandal or sex crime? Gendered privacy and the celebrity nude photo leaks. Ethics and Information Technology, 19(3), 177-191.
  23. Mills, R. A. (2018). Pop-up political advocacy communities on Reddit.com: SandersForPresident and The Donald. AI & SOCIETY, 33(1), 39-54
  24. Reddit.com. (2020). Reddit's 2020 Year in Review. Reddit.Com Official Blog. https://redditblog.com/2020/12/08/reddits-2020-year-in-review/
  25. Roose, K. (2021, January 28). The GameStop Reckoning Was a Long Time Coming. The New York Times. https://www.nytimes.com/2021/01/28/technology/gamestop- stock.html
  26. Starbird, K., Maddock, J., Orand, M., Achterman, P., & Mason, R. M. (2014). Rumors, false flags, and digital vigilantes: Misinformation on Twitter after the 2013 Boston marathon bombing. iConference 2014 Proceedings.
  27. Tufekci, Z. (2014). Big Questions for Social Media Big Data: Representativeness, Validity and Other Methodological Pitfalls. Proceedings of the International AAAI Conference on Web and Social Media, 8(1).
  28. Zimmer, M., & Proferes, N. J. (2014). A topology of Twitter research: Disciplines, methods, and ethics. Aslib Journal of Information Management, 66(3), 250-261
  29. Alkhatib, A., Bernstein, M. S., & Levi, M. (2017). Examining Crowd Work and Gig Work Through The Historical Lens of Piecework. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 4599-4616. https://doi.org/10.1145/3025453.3025974
  30. Aloisi, A. (2015). Commoditized Workers The Rising of On-Demand Work, A Case Study Research on a Set of Online Platforms and Apps. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.2637485
  31. Antin, J., & Shaw, A. (2012). Social Desirability Bias and Self-Reports of Motivation: A Study of Amazon Mechanical Turk in the US and India. 10.
  32. Bergvall-Kåreborn, B., & Howcroft, D. (2014). Amazon Mechanical Turk and the commodification of labour. 12.
  33. Buhrmester, M., Kwang, T., & Gosling, S. D. (2011). Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data? Perspectives on Psychological Science, 6(1), 3-5.
  34. Durward, D., Blohm, I., & Leimeister, J. M. (2016). Is There PAPA in Crowd Work?: A Literature Review on Ethical Dimensions in Crowdsourcing. 2016 Intl IEEE Conferences on Ubiquitous Intelligence & Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People, and Smart World Congress (UIC/ATC/ScalCom/CBDCom/IoP/SmartWorld), 823-832. https://doi.org/10.1109/UIC-ATC-ScalCom-CBDCom-IoP-SmartWorld.2016.0131
  35. Hitlin, P. (2016). Research in the Crowdsourcing Age, a Case Study (p. 37). Pew Research Center. Available at: http://www.pewinternet.org/2016/07/11/research-in-the- crowdsourcing-age-a-case-study/
  36. Irani, L. C., & Silberman, M. S. (2013). Turkopticon: Interrupting worker invisibility in amazon mechanical turk. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems -CHI '13, 611. https://doi.org/10.1145/2470654.2470742
  37. Jensen-Doss, A., Patel, Z. S., Casline, E., Mora, V. A., & Timpano, K. R. (2021). Using Mechanical Turk to Study Parents and Children: An Examination of Data Quality and Representati. Journal of Clinical Child & Adolescent Psychology, 1-15. https://doi.org/10.1080/15374416.2020.1815205
  38. Kees, J., Berry, C., Burton, S., & Sheehan, K. (2017). An Analysis of Data Quality: Professional Panels, Student Subject Pools, and Amazon's Mechanical Turk. Journal of Advertising, 46(1), 141-155. https://doi.org/10.1080/00913367.2016.1269304
  39. Lee, K., Webb, S., & Ge, H. (2014). The Dark Side of Micro-Task Marketplaces: Characterizing Fiverr and Automatically Detecting Crowdturfing. ArXiv:1406.0574 [Physics]. http://arxiv.org/abs/1406.0574
  40. Silberman, M. S., Tomlinson, B., LaPlante, R., Ross, J., Irani, L., & Zaldivar, A. (2018). Responsible research with crowds: Pay crowdworkers at least minimum wage. Communications of the ACM, 61(3), 39-41. https://doi.org/10.1145/3180492
  41. Xia, H., Wang, Y., Huang, Y., & Shah, A. (2017). "Our Privacy Needs to be Protected at All Costs": Crowd Workers' Privacy Experiences on Amazon Mechanical Turk. Proceedings of the ACM on Human-Computer Interaction, 1(CSCW), 1-22. https://doi.org/10.1145/3134748
  42. Select References
  43. Barbosa, Sérgio, and Stefania Milan. "Do Not Harm in Private Chat Apps: Ethical Issues for Research on and with WhatsApp." Westminster Papers in Communication and Culture 14, no. 1 (August 14, 2019): 49-65. https://doi.org/10.16997/wpcc.313.
  44. Bengani, Priyanjana. "India Had Its First 'WhatsApp Election.' We Have a Million Messages from It." Columbia Journalism Review, October 16, 2019. https://www.cjr.org/tow_center/india-whatsapp-analysis-election-security.php.
  45. Brown, Barry, Alexandra Weilenmann, Donald McMillan, and Airi Lampinen. "Five Provocations for Ethical HCI Research." In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 852-63. New York, NY, USA: Association for Computing Machinery, 2016. https://doi.org/10.1145/2858036.2858313.
  46. Dotto, Carlotta, Rory Smith, and Claire Wardle. "Closed Groups, Messaging Apps, and Online Ads." First Draft, November 2019. https://firstdraftnews.org/wp- content/uploads/2019/11/Messaging_Apps_Digital_AW-1.pdf?x80491.
  47. European Commission and Directorate General for Research. Ethics for Researchers: Facilitating Research Excellence in FP7. Luxembourg: Publications Office, 2013. "Federal Policy for the Protection of Human Subjects." Federal Register (United States), Rules and Regulations, 82, no. 12 (January 19, 2017): 7149-.
  48. Fiesler, Casey, and Nicholas Proferes. "'Participant' Perceptions of Twitter Research Ethics." Social Media + Society 4, no. 1 (January 1, 2018): 2056305118763366. https://doi.org/10.1177/2056305118763366.
  49. Frankel, Mark. "The Promises and Pitfalls of Reporting within Chat Apps and Other Semi-Open Platforms: A Journalist's Guide." Nieman Lab, July 10, 2018. https://www.niemanlab.org/2018/07/a-journalists-guide-to-the-promises-and-pitfalls-of- reporting-within-open-and-closed-and-semi-open-platforms/.
  50. Garimella, Kiran, and Gareth Tyson. "WhatsApp, Doc? A First Look at WhatsApp Public Group Data." In Proceedings of the Twelfth International AAAI Conference on Web and Social Media. Stanford, CA: The AAAI Press, 2018. https://aaai.org/Library/ICWSM/icwsm18contents.php.
  51. Gibson, Kerry. "Bridging the Digital Divide: Reflections on Using WhatsApp Instant Messenger Interviews in Youth Research." Qualitative Research in Psychology, April 17, 2020, 1- 21. https://doi.org/10.1080/14780887.2020.1751902.
  52. Gruzd, Anatoliy, Jenna Jacobsen, and Elisabeth Dubois. "Challenges and Opportunities of Doing Research with Social Media Data." Social Media Data Stewardship (blog). Accessed December 3, 2020. https://socialmediadata.org/2016/04/16/challenges-and- opportunities-of-doing-research-with-social-media-data/.
  53. Kaufmann, Katja, and Corinna Peil. "The Mobile Instant Messaging Interview (MIMI): Using WhatsApp to Enhance Self-Reporting and Explore Media Usage in Situ." Mobile Media & Communication 8, no. 2 (May 1, 2020): 229-46. https://doi.org/10.1177/2050157919852392.
  54. Mac, Ryan, and Pranav Dixit. "The Tip Line WhatsApp Launched to Combat Fake News Isn't Actually Going to Combat Fake News." BuzzFeed News, April 3, 2019. https://www.buzzfeednews.com/article/ryanmac/whatsapp-fake-news-tip-line-indian- election-not-helpline.
  55. Mont'Alverne, Camila, and Isabele Mitozo. "Muito Além da Mamadeira Erótica: As notícias compartilhadas nas redes de apoio a presidenciáveis em grupos de WhatsApp, nas eleições brasileiras de 2018." In Compolítica8 25 (2019). http://ctpol.unb.br/compolitica2019/GT4/gt4_Montalverne_Mitozo.pdf.
  56. Moreno, Andrés, Philip Garrison, and Karthik Bhat. "WhatsApp for Monitoring and Response during Critical Events: Aggie in the Ghana 2016 Election." In Proceedings of the 14th ISCRAM Conference, 11. Albi, France, 2017.
  57. Mpofu, Shepherd, and Shanade Bianca Barnabas. "Citizen Journalism and Moral Panics: A Consideration of Ethics in the 2015 South African Xenophobic Attacks." African Journalism Studies 37, no. 4 (November 2016): 115-36. https://doi.org/10.1080/23743670.2016.1256053.
  58. Narayanan, Vidya, Bence Kollanyi, Ruchi Hajela, Ankita Barthwal, Nahema Marchal, and Philip N. Howard. "News and Information over Facebook and WhatsApp during the Indian Election Campaign." Computational Propaganda Project Data Memo. Oxford Internet Institute, May 13, 2019. https://comprop.oii.ox.ac.uk/research/india-election-memo/ (now at https://comprop.oii.ox.ac.uk/research/posts/news-and-information-over-facebook-and- whatsapp-during-the-indian-election-campaign/).
  59. Rennó, Raquel. "WhatsApp: The Widespread Use of WhatsApp in Political Campaigning in the Global South (Updated Version)." Our Data Our Selves (Tactical Tech) (blog), November 13, 2018. https://ourdataourselves.tacticaltech.org/posts/whatsapp/.
  60. Sandvig v. Barr, No. 16-1368 (D.D.C. March 27, 2020).
  61. U.S. Department of Health and Human Services. Federal Policy for the Protection of Human Subjects ('Common Rule') (2018). https://www.hhs.gov/ohrp/regulations-and- policy/regulations/common-rule/index.html.