publications

2026

  2. A Framework to Characterize Reporting on Generative AI Use
    Balayn, Agathe, Nagaraj Rao, Varun, Blodgett, Su Lin, Caliskan, Aylin, Barocas, Solon
    CHI 2026
  3. How Could AI Supply Chain Research Shape HCI Inquiries And Vice-Versa?
    Cha, Inha, Gray Widder, David, Attard-Frost, Blair, Singh, Jat, Balayn, Agathe
    CHI meet-up 2026

    4. 2025

    2. Unpacking Trust Dynamics in the LLM Supply Chain: An Empirical Exploration to Foster Trustworthy LLM Production And Use
      (supplementary material)
      Balayn, Agathe, Yurrita, Mireia, Rancourt, Fanny, Casati, Fabio, Gadiraju, Ujwal
      The Conference on Human Factors in Computing Systems (CHI) 2025 (honourable mention)
    3. AI Robustness: a Human-Centered Perspective on Technological Challenges and Opportunities
      Tocchetti, Andrea*, Corti, Lorenzo*, Balayn, Agathe*, Yurrita, Mireia, Lippmann, Philip, Brambilla, Marco, Yang, Jie,
      ACM Computing Surveys (CSUR) 2025
    4. Towards Effective Human Intervention in Algorithmic Decision-Making: Understanding the Effect of Decision-Makers' Configuration on Decision-Subjects' Fairness Perceptions
      Yurrita, Mireia, Verma, Himanshu, Balayn, Agathe, Gadiraju, Ujwal, Pont, Sylvia, Bozzon, Alessandro
      The Conference on Human Factors in Computing Systems (CHI) 2025
    5. Identifying Algorithmic Decision Subjects' Needs for Meaningful Contestability
      Yurrita, Mireia, Verma, Himanshu, Balayn, Agathe, Alfrink, Kars, Gadiraju, Ujwal, Bozzon, Alessandro
      Computer-Supported Collaborative Work (CSCW) 2025
    7. Systematizing During Measurement Enables Broader Stakeholder Participation
      Wallach, Hanna, Desai, Meera, Cooper, A. Feder, Wang, Angelina, Atalla, Chad, Balayn, Agathe, Barocas, Solon, Blodgett, Su Lin, Chouldechova, Alexandra, Corvi, Emily, Dow, Alex, Garcia-Gathright, Jean, Olteanu, Alexandra, Pangakis, Nicholas, Reed, Stefanie, Sheng, Emily, Vann, Dan, Wortman Vaughan, Jennifer, Vogel, Matthew, Washington, Hannah, Z Jacobs, Abigail
      HEAL workshop (CHI) 2025

      8. 2024

      2. Misguided: AI regulation needs a shift in focus
        Balayn, Agathe, Guerses, Seda
        Internet Policy Review 2024
      3. From Stem to Stern: Contestability Along AI Value Chains
        Balayn, Agathe, Pi, Yulu, Gray Widder, David, Alfrink, Kars, Yurrita, Mireai, Upadhyay, Sohini, Karusala, Naveena, Lyons, Henrietta, Turkay, Cagatay, Tessono, Christelle, Attard-Frost, Blair, Gadiraju, Ujwal
        Computer-Supported Collaborative Work (CSCW) 2024
      4. Opening the Analogical Portal to Explainability: Can Analogies Help Laypeople in AI-assisted Decision Making?
        He, Gaole, Balayn, Agathe, Buijsman, Stefan, Yang, Jie, Gadiraju, Ujwal
        Journal of Artificial Intelligence Research 2024
      5. An Empirical Exploration of Trust Dynamics in LLM Supply Chains
        Balayn, Agathe, Yurrita, Mireia, Rancourt, Fanny, Casati, Fabio, Gadiraju, Ujwal
        TRAIT workshop at CHI'24 2024
      6. Understanding Stakeholders' Perceptions and Needs Across the LLM Supply Chain
        Balayn, Agathe, Corti, Lorenzo, Rancourt, Fanny, Casati, Fabio, Gadiraju, Ujwal
        HCXAI workshop at CHI'24 2024
      7. "It Is a Moving Process": Understanding the Evolution of Explainability Needs of Clinicians in Pulmonary Medicine
        Corti, Lorenzo, Oltmans, Rembrandt, Jung, Jiwon, Balayn, Agathe, Wijsenbeek, Marlies, Yang, Jie
        The Conference on Human Factors in Computing Systems (CHI) 2024

        8. 2023

        2. "Fairness Toolkits, A Checkbox Culture?" On the Factors that Fragment Developer Practices in Handling Algorithmic Harms
          (supplementary material)
          Balayn, Agathe, Yurrita, Mireia, Yang, Jie, Gadiraju, Ujwal
          AI, Ethics, and Society conference(AIES) (best student paper award) 2023
        3. Faulty or Ready? Handling Failures in Deep-Learning Computer Vision Models until Deployment: A Study of Practices, Challenges, and Needs
          Balayn, Agathe, Rikalo, Natasa, Yang, Jie, and Bozzon, Alessandro
          The Conference on Human Factors in Computing Systems (CHI) 2023
        4. Disentangling Fairness Perceptions in Algorithmic Decision-Making: the Effects of Explanations, Human Oversight, and Contestability
          Yurrita, Mireia, Draws, Tim, Balayn, Agathe, Murray-Rust, Dave, Tintarev, Nava, and Bozzon, Alessandro
          The Conference on Human Factors in Computing Systems (CHI) (Best paper award) 2023
        5. Explainability in AI Policies: A Critical Review of Communications, Reports, Regulations, and Standards in the EU, US, and UK
          Nannini, Luca, Balayn, Agathe, and Smith, Adam
          The Conference on Fairness, Accountability, Transparency (FaccT) 2023
        6. Hear Me Out: A Study on the Use of the Voice Modality for Crowdsourced Relevance Assessments
          Roy, Nirmal, Balayn, Agathe, Maxwell, David, and Hauff, Claudia
          The Conference on Research and Development in Information Retrieval (SIGIR) 2023
        7. Perspective: Leveraging Human Understanding for Identifying and Characterizing Image Atypicality
          Shahin Sharifi Noorian, Sihang Qiu, Burcu Sayin, Balayn, Agathe, Ujwal Gadiraju, Jie Yang, Alessandro Bozzon
          The International Conference on Intelligent User Interfaces (IUI) 2023

          9. 2022

          1. How can Explainability Methods be Used to Support Bug Identification in Computer Vision Models?
            Balayn, Agathe, Rikalo, Natasa, Lofi, Christoph, Yang, Jie, and Bozzon, Alessandro
            The Conference on Human Factors in Computing Systems (CHI) 2022
          2. Towards a multi-stakeholder value-based assessment framework for algorithmic systems
            Yurrita, Mireia, Murray-Rust, Dave, Balayn, Agathe, and Bozzon Alessandro
            The Conference on Fairness, Accountability, Transparency (FAccT) 2022
          3. Ready Player One! Eliciting Diverse Knowledge Using A Configurable Game
            He, Gaole, Balayn, Agathe, Hu, Andrea, Yang, Jie, and Gadiraju, Ujwal
            (Nominated for best paper award) The Web Conference (WWW) 2022
          4. It Is like Finding a Polar Bear in the Savannah! Concept-Level AI Explanations with Analogical Inference from Commonsense Knowledge
            He, Gaole, Balayn, Agathe, Buijsman, Stefan, Yang, Jie, and Gadiraju, Ujwal
            The Conference on Human Computation (HCOMP) (Best paper award) 2022

            5. 2021

            1. FindItOut: A Multiplayer GWAP for Collecting Plural Knowledge
              Balayn, Agathe, He, Gaole, Hu, Andrea, Yang, Jie, and Gadiraju, Ujwal
              HCOMP demo --best demo award 2021
            2. Beyond debiasing: regulating AI and its inequalities
              Balayn, Agathe, and Guerses, Seda
              Report for EDRi (European Digital Rights organisation) 2021
            3. Exploring Data Pipelines through the Process Lens: a Reference Model for Computer Vision
              Balayn, Agathe, Kulynych, Bogdan, and Guerses, Seda
              Beyond Fair Computer Vision Workshop (CVPR) 2021
            4. Automatic Identification of Harmful, Aggressive, Abusive, and Offensive Language on the Web: A Survey of Technical Biases Informed by Psychology Literature
              Balayn, Agathe, Yang, Jie, Szlavik, Zoltan, and Bozzon, Alessandro
              Transactions on Social Computing (TSC) 2021
            5. What do You Mean? Interpreting Image Classification with Crowdsourced Concept Extraction and Analysis
              Balayn, Agathe, Soilis, Panagiotis, Lofi, Christoph, Yang, Jie, and Bozzon, Alessandro
              The Web Conference (WWW) 2021

            2019

            2. Unfairness towards subjective opinions in Machine Learning
              Balayn, Agathe, Bozzon, Alessandro, and Szlavik, Zoltan
              CHI workshop 2019

            2018

            1. Data-driven development of virtual sign language communication agents
              Balayn, Agathe, Brock, Heike, and Nakadai, Kazuhiro
              IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) 2018
            2. Characterising and mitigating aggregation-bias in crowdsourced toxicity annotations
              Balayn, Agathe, Mavridis, Panagiotis, Bozzon, Alessandro, Timmermans, Benjamin, and Szlávik, Zoltán
              HCOMP workshop 2018

            2016

            1. Adaptive handling assistance for industrial lightweight robots in simulation
              Balayn, Agathe, Queißer, Jeffrey Frederic, Wojtynek, Michael, and Wrede, Sebastian
              IEEE International Conference on Simulation, Modeling, and Programming for Autonomous Robots (SIMPAR) 2016