A Notebook of Data Imaginaries
Proceedings of the 2023 ACM Designing Interactive Systems Conference
https://doi.org/10.1145/3563657.3596025Abstract
The processes of data collection and transformation are often opaque to users. This means they rely on their imagination to make sense of the data they produce. The images data conjure up, however, tend to be homogenous and flat: black screens, ones and zeros, big server farms in the desert. For designers and researchers who work with data as a material, this small repertoire can be stifling. For device users, it can lead to a removal of agency in how they make sense and engage with the data they produce. In this pictorial, we draw from a two-year data fictionalization project to start building an expanded repertoire of data imaginaries. We worked with seven households and seven writers to transform smart home data sets into fiction stories. Based on the interviews we conducted, we present the images participants shared with us as a step towards more expressive and varied imaginaries of data.
References (47)
- Aloha Hufana Ambe, Margot Brereton, Alessandro Soro, Laurie Buys, and Paul Roe. 2019. The Adven- tures of Older Authors: Exploring Futures through Co-Design Fictions. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Sys- tems (CHI '19), Association for Computing Machin- ery, New York, NY, USA, 1-16. DOI:https://doi. org/10.1145/3290605.3300588
- Hannah Arendt. 1970. Men In Dark Times (First edition ed.). Mariner Books, San Diego, Calif.
- S. Sandra Bae. 2022. Towards a Deeper Under- standing of Data and Materiality. In Creativity and Cognition (C&C '22), Association for Com- puting Machinery, New York, NY, USA, 674-678. DOI:https://doi.org/10.1145/3527927.3533734
- Samuel Barnett, Nico Brand, William Odom, and Kaitlyn Andres. 2022. Exploring Data Interme- diaries as Infrastructure for a Human-Centric Data Economy: Speculations & Critical Reflections. In Nordic Human-Computer Interaction Conference (NordiCHI '22), Association for Computing Machin- ery, New York, NY, USA, 1-20. DOI:https://doi. org/10.1145/3546155.3547286
- Genevieve Bell, Mark Blythe, and Phoebe Sengers. 2005. Making by making strange: Defamiliarization and the design of domestic technologies. ACM Trans. Comput.-Hum. Interact. 12, 2 (June 2005), 149-173. DOI:https://doi.org/10.1145/1067860.1067862
- Genevieve Bell and Paul Dourish. 2007. Yesterday's tomorrows: notes on ubiquitous computing's dominant vision. Pers. Ubiquitous Comput. 11, 2 (February 2007), 133-143. DOI:https://doi.org/10.1007/s00779-006- 0071-x
- Julian Bleecker. Design Fiction: A Short Essay on Design, Science, Fact and Fiction.
- Mark Blythe, Kristina Andersen, Rachel Clarke, and Peter Wright. 2016. Anti-Solutionist Strategies: Seri- ously Silly Design Fiction. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), Association for Computing Machin- ery, New York, NY, USA, 4968-4978. DOI:https://doi. org/10.1145/2858036.2858482
- Chiara Bottici. 2014. Imaginal Politics: Images Beyond Imagination and the Imaginary. Columbia University Press.
- Geoffrey C. Bowker. 2008. Memory Practices in the Sciences (Illustrated edition ed.). MIT Press, Cam- bridge, Mass.
- A.J. Bernheim Brush, Bongshin Lee, Ratul Maha- jan, Sharad Agarwal, Stefan Saroiu, and Colin Dixon. 2011. Home automation in the wild: challenges and opportunities. In Proceedings of the SIGCHI Con- ference on Human Factors in Computing Systems (CHI '11), Association for Computing Machinery, New York, NY, USA, 2115-2124. DOI:https://doi. org/10.1145/1978942.1979249
- Cornelius Castoriadis. 1997. The Imaginary Institution of Society: Creativity and Autonomy in the Social-historical World (Second Edition ed.). Polity Press, Cambridge.
- Andy Crabtree and Peter Tolmie. 2016. A Day in the Life of Things in the Home. In Proceed- ings of the 19th ACM Conference on Computer- Supported Cooperative Work & Social Computing (CSCW '16), Association for Computing Machinery, New York, NY, USA, 1738-1750. DOI:https://doi. org/10.1145/2818048.2819954
- Audrey Desjardins and Heidi R. Biggs. 2021. Data Epics: Embarking on Literary Journeys of Home Internet of Things Data. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21), Association for Computing Ma- chinery, New York, NY, USA, 1-17. DOI:https://doi. org/10.1145/3411764.3445241
- Audrey Desjardins and Cayla Key. 2020. Par- allels, Tangents, and Loops: Reflections on the "Through" Part of RtD. In Proceedings of the 2020 ACM Designing Interactive Systems Conference (DIS '20), Association for Computing Machinery, New York, NY, USA, 2133-2147. DOI:https://doi. org/10.1145/3357236.3395586
- Audrey Desjardins, Afroditi Psarra, and Bonnie A. Whiting. 2021. Voices and Voids: Subverting Voice Assistant Systems through Performative Experiments. In Creativity and Cognition (C&C '21), Association for Computing Machinery, New York, NY, USA, 1-10. DOI:https://doi.org/10.1145/3450741.3466807
- Catherine D'Ignazio and Lauren F. Klein. 2020. Data Feminism. The MIT Press, Cambridge, Massachu- setts.
- Johanna Drucker. 2020. Visualization and Inter- pretation: Humanistic Approaches to Display. The MIT Press, Cambridge, Massachusetts.
- Chris Elsden, Abigail C. Durrant, David Chat- ting, and David S. Kirk. 2017. Designing Documentary Informatics. In Proceedings of the 2017 Conference on Designing Interactive Systems (DIS '17), Association for Computing Machinery, New York, NY, USA, 649-661. DOI:https://doi.org/10.1145/3064663.3064714
- Sarah E. Fox, Samantha Shorey, Franchesca Spe- ktor, and Daniela K. Rosner. 2020. Crafting Everyday Resistance through Lightweight Design. In Proceedings of the 2020 ACM Designing Interactive Systems Con- ference (DIS '20), Association for Computing Machin- ery, New York, NY, USA, 101-113. DOI:https://doi. org/10.1145/3357236.3395571
- Mafalda Gamboa, Sara Ljungblad, and Miriam Sturdee. 2023. Conversational Composites: A Method for Illustration Layering. In Proceedings of the Seven- teenth International Conference on Tangible, Embed- ded, and Embodied Interaction (TEI '23), Association for Computing Machinery, New York, NY, USA, 1-13. DOI:https://doi.org/10.1145/3569009.3572793
- Dize Hilviu and Amon Rapp. 2015. Narrating the quantified self. In Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Com- puters (UbiComp/ISWC'15 Adjunct), Association for Computing Machinery, New York, NY, USA, 1051- 1056. DOI:https://doi.org/10.1145/2800835.2800959
- Sun-ha Hong. 2020. Technologies of Speculation: The Limits of Knowledge in a Data-Driven Society. NYU Press.
- Sun-ha Hong. 2021. Technofutures in Stasis: Smart Machines, Ubiquitous Computing, and the Future That Keeps Coming Back. Int. J. Commun. 15, 0 (April 2021), 21.
- Noura Howell, John Chuang, Abigail De Kosnik, Greg Niemeyer, and Kimiko Ryokai. 2018. Emotional Biosensing: Exploring Critical Alternatives. Proc. ACM Hum.-Comput. Interact. 2, CSCW (November 2018), 69:1-69:25. DOI:https://doi.org/10.1145/3274338
- Robin D. G. Kelley. 2022. Freedom Dreams: The Black Radical Imagination. Beacon Press, Boston.
- David Kirby. 2010. The Future is Now: Diegetic Prototypes and the Role of Popular Films in Generat- ing Real-world Technological Development. Soc. Stud. Sci. 40, 1 (February 2010), 41-70. DOI:https://doi. org/10.1177/0306312709338325
- David Kirsh and Paul Maglio. 1994. On distin- guishing epistemic from pragmatic action. Cogn. Sci. 18, 4 (October 1994), 513-549. DOI:https://doi. org/10.1016/0364-0213(94)90007-8
- Bowen Kong, Rung-Huei Liang, MengChi Liu, Shu-Hsiang Chang, Hsiu-Chen Tseng, and Chian-Huei Ju. 2021. Neuromancer Workshop: Towards Design- ing Experiential Entanglement with Science Fiction. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21), Association for Computing Machinery, New York, NY, USA, 1-17. DOI:https://doi.org/10.1145/3411764.3445273
- Matthew L. Lee-Smith, Jesse Josua Benjamin, Audrey Desjardins, Mathias Funk, William Odom, Doenja Oogjes, Young-Woo Park, James Pierce, Pedro Sanches, and Vasiliki Tsaknaki. Data as a Material for Design: Alternative Narratives, Divergent Pathways, and Future Directions. In CHI 2023 Workshop. Retrieved February 13, 2023 from https://materialfordesign.net/ chi2023_workshop/
- Makayla Lewis, Miriam Sturdee, John Miers, Josh Urban Davis, and Thuong Hoang. 2022. Exploring AltNarrative in HCI Imagery and Comics. In Extended Abstracts of the 2022 CHI Conference on Human Fac- tors in Computing Systems (CHI EA '22), Association for Computing Machinery, New York, NY, USA, 1-13. DOI:https://doi.org/10.1145/3491101.3516394
- Deborah Lupton. 2017. Feeling your data: Touch and making sense of personal digital data. New Media Soc. 19, 10 (October 2017), 1599-1614. DOI:https:// doi.org/10.1177/1461444817717515
- Martha C. Nussbaum. 1997. Poetic Justice: The Literary Imagination and Public Life (1st edition ed.). Beacon Press, Boston, Mass.
- James Pierce and Carl DiSalvo. 2017. Dark Clouds, Io&#!+, and [Crystal Ball Emoji]: Projecting Network Anxieties with Alternative Design Metaphors. In Pro- ceedings of the 2017 Conference on Designing Interac- tive Systems (DIS '17), Association for Computing Ma- chinery, New York, NY, USA, 1383-1393. DOI:https:// doi.org/10.1145/3064663.3064795
- Paul Ricoeur. 1975. La métaphore vive (La Méta- phore Vive edition ed.). Seuil, Paris.
- John Rooksby, Mattias Rost, Alistair Morrison, and Matthew Chalmers. 2014. Personal tracking as lived informatics. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14), Association for Computing Machinery, New York, NY, USA, 1163-1172. DOI:https://doi. org/10.1145/2556288.2557039
- Pedro Sanches, Noura Howell, Vasiliki Tsaknaki, Tom Jenkins, and Karey Helms. 2022. Diffraction- in-action: Designerly Explorations of Agential Real- ism Through Lived Data. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22), Association for Computing Ma- chinery, New York, NY, USA, 1-18. DOI:https://doi. org/10.1145/3491102.3502029
- Stephen Snow, Awais Hameed Khan, Stephen Viller, Ben Matthews, Scott Heiner, James Pierce, Ewa Luger, Richard Gomer, and Dorota Filipczuk. 2020. Speculative Designs for Emergent Personal Data Trails: Signs, Signals and Signifiers. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Com- puting Systems (CHI EA '20), Association for Comput- ing Machinery, New York, NY, USA, 1-8. DOI:https:// doi.org/10.1145/3334480.3375173
- Studio Tilt. Data Epics. Retrieved May 11, 2023 from https://dataepics.webflow.io/
- Miriam Sturdee, Lauren Thornton, Bhagya Wi- malasiri, and Sameer Patil. 2021. A Visual Exploration of Cybersecurity Concepts. In Creativity and Cognition (C&C '21), Association for Computing Machin- ery, New York, NY, USA, 1-10. DOI:https://doi. org/10.1145/3450741.3465252
- Alex S. Taylor, Siân Lindley, Tim Regan, Da- vid Sweeney, Vasillis Vlachokyriakos, Lillie Grainger, and Jessica Lingel. 2015. Data-in-Place: Thinking through the Relations Between Data and Commu- nity. In Proceedings of the 33rd Annual ACM Con- ference on Human Factors in Computing Systems (CHI '15), Association for Computing Machinery, New York, NY, USA, 2863-2872. DOI:https://doi. org/10.1145/2702123.2702558
- Charles Taylor. 2003. Modern Social Imaginaries. Duke University Press Books.
- Jordan Wirfs-Brock, Maxene Graze, Laura De- vendorf, Audrey Desjardins, Visda Goudarzi, Mikhaila Friske, and Brian C Keegan. 2022. Sketching Across the Senses: Exploring Sensory Translation as a Generative Practice for Designing Data Representations. In Extend- ed Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (CHI EA '22), Associa- tion for Computing Machinery, New York, NY, USA, 1-7. DOI:https://doi.org/10.1145/3491101.3503712
- Richmond Y. Wong, Ellen Van Wyk, and James Pierce. 2017. Real-Fictional Entanglements: Using Sci- ence Fiction and Design Fiction to Interrogate Sensing Technologies. In Proceedings of the 2017 Conference on Designing Interactive Systems (DIS '17), Association for Computing Machinery, New York, NY, USA, 567- 579. DOI:https://doi.org/10.1145/3064663.3064682
- Paulina Yurman. 2021. Fluid Speculations: Draw- ing Artefacts in Watercolour as Experimentation in Research Through Design. In Creativity and Cognition (C&C '21), Association for Computing Machin- ery, New York, NY, USA, 1-13. DOI:https://doi. org/10.1145/3450741.3466777
- IoT connected devices worldwide 2019-2030.
- Statista. Retrieved February 13, 2023 from https:// www.statista.com/statistics/1183457/iot-connected- devices-worldwide/