publications

2025

  2. Unpacking Trust Dynamics in the LLM Supply Chain: An Empirical Exploration to Foster Trustworthy LLM Production And Use
    (supplementary material)
    Balayn, Agathe, Yurrita, Mireia, Rancourt, Fanny, Casati, Fabio, Gadiraju, Ujwal
    The Conference on Human Factors in Computing Systems (CHI) 2025 (honourable mention)
  3. AI Robustness: a Human-Centered Perspective on Technological Challenges and Opportunities
    Tocchetti, Andrea*, Corti, Lorenzo*, Balayn, Agathe*, Yurrita, Mireia, Lippmann, Philip, Brambilla, Marco, Yang, Jie,
    ACM Computing Surveys (CSUR) 2025
  4. Towards Effective Human Intervention in Algorithmic Decision-Making: Understanding the Effect of Decision-Makers' Configuration on Decision-Subjects' Fairness Perceptions
    Yurrita, Mireia, Verma, Himanshu, Balayn, Agathe, Gadiraju, Ujwal, Pont, Sylvia, Bozzon, Alessandro
    The Conference on Human Factors in Computing Systems (CHI) 2025
  5. Identifying Algorithmic Decision Subjects' Needs for Meaningful Contestability
    Yurrita, Mireia, Verma, Himanshu, Balayn, Agathe, Alfrink, Kars, Gadiraju, Ujwal, Bozzon, Alessandro
    Computer-Supported Collaborative Work (CSCW) 2025
  7. Systematizing During Measurement Enables Broader Stakeholder Participation
    Wallach, Hanna, Desai, Meera, Cooper, A. Feder, Wang, Angelina, Atalla, Chad, Balayn, Agathe, Barocas, Solon, Blodgett, Su Lin, Chouldechova, Alexandra, Corvi, Emily, Dow, Alex, Garcia-Gathright, Jean, Olteanu, Alexandra, Pangakis, Nicholas, Reed, Stefanie, Sheng, Emily, Vann, Dan, Wortman Vaughan, Jennifer, Vogel, Matthew, Washington, Hannah, Z Jacobs, Abigail
    HEAL workshop (CHI) 2025

    8. 2024

    2. Misguided: AI regulation needs a shift in focus
      Balayn, Agathe, Guerses, Seda
      Internet Policy Review 2024
    3. From Stem to Stern: Contestability Along AI Value Chains
      Balayn, Agathe, Pi, Yulu, Gray Widder, David, Alfrink, Kars, Yurrita, Mireai, Upadhyay, Sohini, Karusala, Naveena, Lyons, Henrietta, Turkay, Cagatay, Tessono, Christelle, Attard-Frost, Blair, Gadiraju, Ujwal
      Computer-Supported Collaborative Work (CSCW) 2024
    4. Opening the Analogical Portal to Explainability: Can Analogies Help Laypeople in AI-assisted Decision Making?
      He, Gaole, Balayn, Agathe, Buijsman, Stefan, Yang, Jie, Gadiraju, Ujwal
      Journal of Artificial Intelligence Research 2024
    5. An Empirical Exploration of Trust Dynamics in LLM Supply Chains
      Balayn, Agathe, Yurrita, Mireia, Rancourt, Fanny, Casati, Fabio, Gadiraju, Ujwal
      TRAIT workshop at CHI'24 2024
    6. Understanding Stakeholders' Perceptions and Needs Across the LLM Supply Chain
      Balayn, Agathe, Corti, Lorenzo, Rancourt, Fanny, Casati, Fabio, Gadiraju, Ujwal
      HCXAI workshop at CHI'24 2024
    7. "It Is a Moving Process": Understanding the Evolution of Explainability Needs of Clinicians in Pulmonary Medicine
      Corti, Lorenzo, Oltmans, Rembrandt, Jung, Jiwon, Balayn, Agathe, Wijsenbeek, Marlies, Yang, Jie
      The Conference on Human Factors in Computing Systems (CHI) 2024

      8. 2023

      2. "Fairness Toolkits, A Checkbox Culture?" On the Factors that Fragment Developer Practices in Handling Algorithmic Harms
        (supplementary material)
        Balayn, Agathe, Yurrita, Mireia, Yang, Jie, Gadiraju, Ujwal
        AI, Ethics, and Society conference(AIES) (best student paper award) 2023
      3. Faulty or Ready? Handling Failures in Deep-Learning Computer Vision Models until Deployment: A Study of Practices, Challenges, and Needs
        Balayn, Agathe, Rikalo, Natasa, Yang, Jie, and Bozzon, Alessandro
        The Conference on Human Factors in Computing Systems (CHI) 2023
      4. Disentangling Fairness Perceptions in Algorithmic Decision-Making: the Effects of Explanations, Human Oversight, and Contestability
        Yurrita, Mireia, Draws, Tim, Balayn, Agathe, Murray-Rust, Dave, Tintarev, Nava, and Bozzon, Alessandro
        The Conference on Human Factors in Computing Systems (CHI) (Best paper award) 2023
      5. Explainability in AI Policies: A Critical Review of Communications, Reports, Regulations, and Standards in the EU, US, and UK
        Nannini, Luca, Balayn, Agathe, and Smith, Adam
        The Conference on Fairness, Accountability, Transparency (FaccT) 2023
      6. Hear Me Out: A Study on the Use of the Voice Modality for Crowdsourced Relevance Assessments
        Roy, Nirmal, Balayn, Agathe, Maxwell, David, and Hauff, Claudia
        The Conference on Research and Development in Information Retrieval (SIGIR) 2023
      7. Perspective: Leveraging Human Understanding for Identifying and Characterizing Image Atypicality
        Shahin Sharifi Noorian, Sihang Qiu, Burcu Sayin, Balayn, Agathe, Ujwal Gadiraju, Jie Yang, Alessandro Bozzon
        The International Conference on Intelligent User Interfaces (IUI) 2023

        9. 2022

        1. How can Explainability Methods be Used to Support Bug Identification in Computer Vision Models?
          Balayn, Agathe, Rikalo, Natasa, Lofi, Christoph, Yang, Jie, and Bozzon, Alessandro
          The Conference on Human Factors in Computing Systems (CHI) 2022
        2. Towards a multi-stakeholder value-based assessment framework for algorithmic systems
          Yurrita, Mireia, Murray-Rust, Dave, Balayn, Agathe, and Bozzon Alessandro
          The Conference on Fairness, Accountability, Transparency (FAccT) 2022
        3. Ready Player One! Eliciting Diverse Knowledge Using A Configurable Game
          He, Gaole, Balayn, Agathe, Hu, Andrea, Yang, Jie, and Gadiraju, Ujwal
          (Nominated for best paper award) The Web Conference (WWW) 2022
        4. It Is like Finding a Polar Bear in the Savannah! Concept-Level AI Explanations with Analogical Inference from Commonsense Knowledge
          He, Gaole, Balayn, Agathe, Buijsman, Stefan, Yang, Jie, and Gadiraju, Ujwal
          The Conference on Human Computation (HCOMP) (Best paper award) 2022

          5. 2021

          1. FindItOut: A Multiplayer GWAP for Collecting Plural Knowledge
            Balayn, Agathe, He, Gaole, Hu, Andrea, Yang, Jie, and Gadiraju, Ujwal
            HCOMP demo --best demo award 2021
          2. Beyond debiasing: regulating AI and its inequalities
            Balayn, Agathe, and Guerses, Seda
            Report for EDRi (European Digital Rights organisation) 2021
          3. Exploring Data Pipelines through the Process Lens: a Reference Model for Computer Vision
            Balayn, Agathe, Kulynych, Bogdan, and Guerses, Seda
            Beyond Fair Computer Vision Workshop (CVPR) 2021
          4. Automatic Identification of Harmful, Aggressive, Abusive, and Offensive Language on the Web: A Survey of Technical Biases Informed by Psychology Literature
            Balayn, Agathe, Yang, Jie, Szlavik, Zoltan, and Bozzon, Alessandro
            Transactions on Social Computing (TSC) 2021
          5. What do You Mean? Interpreting Image Classification with Crowdsourced Concept Extraction and Analysis
            Balayn, Agathe, Soilis, Panagiotis, Lofi, Christoph, Yang, Jie, and Bozzon, Alessandro
            The Web Conference (WWW) 2021

          2019

          2. Unfairness towards subjective opinions in Machine Learning
            Balayn, Agathe, Bozzon, Alessandro, and Szlavik, Zoltan
            CHI workshop 2019

          2018

          1. Data-driven development of virtual sign language communication agents
            Balayn, Agathe, Brock, Heike, and Nakadai, Kazuhiro
            IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) 2018
          2. Characterising and mitigating aggregation-bias in crowdsourced toxicity annotations
            Balayn, Agathe, Mavridis, Panagiotis, Bozzon, Alessandro, Timmermans, Benjamin, and Szlávik, Zoltán
            HCOMP workshop 2018

          2016

          1. Adaptive handling assistance for industrial lightweight robots in simulation
            Balayn, Agathe, Queißer, Jeffrey Frederic, Wojtynek, Michael, and Wrede, Sebastian
            IEEE International Conference on Simulation, Modeling, and Programming for Autonomous Robots (SIMPAR) 2016