CHI’23 Preprint Collection HCI + AI

Looking for current research on HCI + AI? Here’s a list.

Daniel Buschek
9 min readMar 7, 2023

Here’s a collection of CHI’23 preprints on topics related to computational HCI, data, algorithms, AI and related methodology, inclusively interpreted. It’s not a comprehensive list and in no particular order. Found via Mastodon, Twitter and arXiv. Suggestions welcome!

Daniel Buschek (mastodon, twitter)

XAI: Explainability, Transparency, Trust, Bias, …

“Help Me Help the AI”: Understanding How Explainability Can Support Human-AI Interaction

Out of Context: Investigating the Bias and Fairness Concerns of “Artificial Intelligence as a Service”

Contestable Camera Cars: A Speculative Design Exploration of Public AI That Is Open and Responsive to Dispute

Toward Human-Centered Responsible Artificial Intelligence: A Review of CHI Research and Industry Toolkits

Designerly Understanding: Information Needs for Model Transparency to Support Design Ideation for AI-Powered User Experience

Knowing About Knowing: An Illusion of Human Competence Can Hinder Appropriate Reliance on AI Systems

“Finding the Magic Sauce”: Exploring Perspectives of Recruiters and Job Seekers on Recruitment Bias and Automated Tools

Aspirations and Practice of Model Documentation: Moving the Needle with Nudging and Traceability

Ignore, Trust, or Negotiate: Understanding Clinician Acceptance of AI-Based Treatment Recommendations in Health Care

Measuring and Understanding Trust Calibrations for Automated Systems: A Survey of the State-Of-The-Art and Future Directions

GAM Coach: Towards Interactive and User-centered Algorithmic Recourse

Fairness Evaluation in Text Classification: Machine Learning Practitioner Perspectives of Individual and Group Fairness

“If I Had All the Time in the World”: Ophthalmologists’ Perceptions of Anchoring Bias Mitigation in Clinical AI Support

Disentangling Fairness Perceptions in Algorithmic
Decision-Making: the Efects of Explanations, Human Oversight,
and Contestability

“It is currently hodgepodge”: Examining AI/ML Practitioners’ Challenges during Co-production of Responsible AI Values

Who Should I Trust: AI or Myself? Leveraging Human and AI Correctness Likelihood to Promote Appropriate Trust in AI-Assisted Decision-Making

The Placebo Effect of Artificial Intelligence in Human–Computer Interaction

Designing Responsible AI: Adaptations of UX Practice to Meet Responsible AI Challenges

Interaction with Text and Code, and Natural Language Processing

Choice Over Control: How Users Write with Large Language Models using Diegetic and Non-Diegetic Prompting

Co-Writing with Opinionated Language Models Affects Users’ Views

On the Design of AI-powered Code Assistants for Notebooks

CatAlyst: Domain-Extensible Intervention for Preventing Task Procrastination Using Large Generative Models

Studying the effect of AI Code Generators on Supporting Novice Learners in Introductory Programming

RePrompt: Automatic Prompt Editing to Refine AI-Generative Art Towards Precise Expressions

The Walking Talking Stick: Understanding Automated Note-Taking in Walking Meetings

A Study of Editor Features in a Creative Coding Classroom

Inform the uninformed: Improving Online Informed Consent Reading with an AI-Powered Chatbot

KnowledgeShovel: An AI-in-the-Loop Document Annotation System for Scientific Knowledge Base Construction

Bridging the Abstraction Gap Between End-User Programmers and Code-Generating Large Language Models

Synthetic Lies: Understanding AI-Generated Misinformation and Evaluating Applicability of Algorithmic and Human Solutions

Rethinking ‘Risk’ in Algorithmic Systems Through A Computational Narrative Analysis of Casenotes in Child-Welfare

StoryChat: Designing a Narrative-Based Viewer Participation Tool for Live Streaming Chatrooms

Why Johnny Can’t Prompt: How Non-AI Experts Try (and Fail) to Design LLM Prompts

Designing and Evaluating Interfaces that Highlight News Coverage Diversity Using Discord Questions

Adding Domain-Specific Features to a Text-Editor to Support Diverse, Real-World Approaches to Time Management Planning

Enabling Conversational Interaction with Mobile UI using Large Language Models

DeepLens: Interactive Out-of-distribution Data Detection in NLP Models

Investigating the Role of Context in the Delivery of Text Messages for Supporting Psychological Wellbeing

Understanding the Benefits and Challenges of Deploying Conversational AI Leveraging Large Language Models for Public Health Intervention

Evaluating Large Language Models in Generating Synthetic HCI Research Data: a Case Study

Who’s Thinking? A Push for Human-Centered Evaluation of LLMs using the XAI Playbook

Parachute: Evaluating Interactive Human-LM Co-writing Systems

Interaction with Agents, Bots & Robots

Legal Obligation and Ethical Best Practice: Towards Meaningful Verbal Consent for Voice Assistants

Situated Participatory Design: A Method for In Situ Design of Robotic Interaction with Older Adults

Explainable Human-Robot Training and Cooperation with Augmented Reality

A Mixed-Methods Approach to Understanding User Trust after Voice Assistant Failures

Can Voice Assistants Be Microaggressors? Cross-Race Psychological Responses to Failures of Automatic Speech Recognition

How to Communicate Robot Motion Intent: A Scoping Review

Exploring the Use of Personalized AI for Identifying Misinformation on Social Media

Do You Mind? User Perceptions of Machine Consciousness

Assertiveness-based Agent Communication for a Personalized Medicine on Medical Imaging Diagnosis

I Know Your Feelings Before You Do: Predicting Future Affective Reactions in Human-Computer Dialogue

Stargazer: An Interactive Camera Robot for Capturing How-To Videos Based on Subtle Instructor Cues

Collaboration with Conversational AI Assistants for UX Evaluation: Questions and How to Ask them (Voice vs. Text)

VR, Computer Vision, Images

Faulty or Ready? Handling Failures in Deep-Learning Computer Vision Models until Deployment: A Study of Practices, Challenges, and Needs

The Entoptic Field Camera as Metaphor-Driven Research-through-Design with AI Technologies

LipLearner: Customizable Silent Speech Interactions on Mobile Devices

ThingShare: Ad-Hoc Digital Copies of Physical Objects for Sharing Things in Video Meetings

VRGit: A Version Control System for Collaborative Content Creation in Virtual Reality

fAIlureNotes: Supporting Designers in Understanding the Limits of AI Models for Computer Vision Tasks

The Elements of Visual Art Recommendation: Learning Latent Semantic Representations of Paintings

HOOV: Hand Out-Of-View Tracking for Proprioceptive Interaction using Inertial Sensing

WebUI: A Dataset for Enhancing Visual UI Understanding with Web Semantics

Deep Learning Super-Resolution Network Facilitating Fiducial Tangibles on Capacitive Touchscreens

When XR and AI Meet — A Scoping Review on Extended Reality and Artificial Intelligence

Collaborating Across Realities: Analytical Lenses for Understanding Dyadic Collaboration in Transitional Interfaces

ReBound: An Open-Source 3D Bounding Box Annotation Tool for Active Learning

Designing Ocean Vision AI: An Investigation of Community Needs for Imaging-based Ocean Conservation

HandyCast: Phone-based Bimanual Input for Virtual Reality in Mobile and Space-Constrained Setings via Pose-and-Touch Transfer

Infovis

Who Do We Mean When We Talk About Visualization Novices?

VizProg: Identifying Misunderstandings By Visualizing Students’ Coding Progress

MetaExplorer: Facilitating Reasoning with Epistemic Uncertainty in Meta-analysis

Interactive Context-Preserving Color Highlighting for Multiclass Scatterplots

When do data visualizations persuade? The impact of prior attitudes on learning about correlations from scatterplot visualizations

Deimos: A Grammar of Dynamic Embodied Immersive Visualisation Morphs and Transitions

Causalvis: Visualizations for Causal Inference

ProxSituated Visualization: An Extended Model of Situated Visualisation using Proxies for Physical Referents

DataPilot: Utilizing Quality and Usage Information for Subset Selection during Visual Data Preparation

DeepSeer: Interactive RNN Explanation and Debugging via State Abstraction

DataParticles: Block-based and Language-oriented Authoring of Animated Unit Visualizations

Perceptual Pat: A Virtual Human System for Iterative Visualization Design

GeoCamera: Telling Stories in Geographic Visualizations with Camera Movements

NetworkNarratives: Data Tours for Visual Network Exploration and Analysis

Notable: On-the-fly Assistant for Data Storytelling in Computational Notebooks

Accessibility

Accessible Data Representation with Natural Sound

ImageAssist: Tools for Enhancing Touchscreen-Based Image Exploration Systems for Blind and Low Vision Users

From User Perceptions to Technical Improvement: Enabling People Who Stutter to Better Use Speech Recognition

AVscript: Accessible Video Editing with Audio-Visual Scripts

CoPracTter: Toward Integrating Personalized Practice Scenarios, Timely Feedback and Social Support into An Online Support Tool for Coping with Stuttering in China

Bridging the Generational Gap: Exploring How Virtual Reality Supports Remote Communication Between Grandparents and Grandchildren

Understanding Discussions Around Culture Within Courses Covering Topics on Accessibility and Disability at U.S. Universities

WESPER: Zero-shot and Realtime Whisper to Normal Voice Conversion for Whisper-based Speech Interactions

Contributing to Accessibility Datasets: Reflections on Sharing Study Data by Blind People

Data, Data, Everywhere: Uncovering Everyday Data Experiences for People with Intellectual and Developmental Disabilities

Enhancing Older Adults’ Gesture Typing Experience Using the T9 Keyboard on Small Touchscreen Devices

AI & Data in Science, Practice, Life and Media

How does HCI Understand Human Autonomy and Agency?

Investigating How Practitioners Use Human-AI Guidelines: A Case Study on the People + AI Guidebook

Online Dating as Context to Design Sexual Consent Technology with Women and LGBTQ+ Stakeholders

Augmenting Pathologists with NaviPath: Design and Evaluation of a Human-AI Collaborative Navigation System

Competent but Rigid: Identifying the Gap in Empowering AI to Participate Equally in Group Decision-Making

Complex Daily Activities, Country-Level Diversity, and Smartphone Sensing: A Study in Denmark, Italy, Mongolia, Paraguay, and UK

Teachable Reality: Prototyping Tangible Augmented Reality with Everyday Objects by Leveraging Interactive Machine Teaching

A hunt for the Snark: Annotator Diversity in Data Practices

Co-designing Community-based Sharing of Smarthome Devices for the Purpose of Co-monitoring In-home Emergencies

Algorithmic Power or Punishment: Information Worker Perspectives on Passive Sensing Enabled AI Phenotyping of Performance and Wellbeing

This Watchface Fits with my Tattoos: Investigating Customisation Needs and Preferences in Personal Tracking

SwitchTube: A Proof-of-Concept System Introducing “Adaptable
Commitment Interfaces” as a Tool for Digital Wellbeing

Message Ritual: A Posthuman Account of Living with Lamp

Exploring Challenges and Opportunities to Support Designers in Learning to Co-create with AI-based Manufacturing Design Tools

It Made Me Feel So Much More at Home Here: Patient Perspectives on Smart Home Technology Deployed at Scale in a Rehabilitation Hospital

“We Cried on Each Other’s Shoulders”: How LGBTQ+ Individuals Experience Social Support in Social Virtual Reality

Towards Leveraging AI-based Moderation to Address Emergent Harassment in Social Virtual Reality

Decolonizing Content Moderation: Does Uniform Global Community Standard Resemble Utopian Equality or Western Power Hegemony?

Short-Form Videos Degrade Our Capacity to Retain Intentions: Effect of Context Switching On Prospective Memory

Understanding Human Intervention in the Platform Economy: A case study of an indie food delivery service

Rethinking the Role of AI with Physicians in Oncology: Revealing Perspectives from Clinical and Research Workflows

Understanding Practices, Challenges, and Opportunities for User-Engaged Algorithm Auditing in Industry Practice

Understanding Frontline Workers’ and Unhoused Individuals’ Perspectives on AI Used in Homeless Services

Meta, Methodology, Metrics, Models, Tools

Breaking Out of the Ivory Tower: A Large-scale Analysis of Patent Citations to HCI Research

Interface Design for Crowdsourcing Hierarchical Multi-Label Text Annotations

AI Shall Have No Dominion: on How to Measure Technology Dominance in AI-supported Human Decision Making

Rapsai: Rapid Application Prototyping System for AI

Thought Bubbles: A Proxy into Players’ Mental Model Development

AutoVis: Enabling Mixed-Immersive Analysis of Automotive User Interface Interaction Studies

Towards a Deep(er) Understanding of Interaction through Modeling, Simulation, and Optimization

Troubling Collaboration: Maters of Care for Visualization Design Study

Visual Belief Elicitation Reduces the Incidence of False Discovery

Stakeholder-Centered AI Design: Co-Designing Worker Tools with Gig Workers through Data Probes

Understanding and Supporting Debugging Workflows in Multiverse Analysis

PaTAT: Human-AI Collaborative Qalitative Coding with Explainable Interactive Rule Synthesis

SparseIMU: Computational Design of Sparse IMU Layouts for Sensing Fine-Grained Finger Microgestures

Data and (Usable) Privacy, Security, Safety

Stuck in the Permissions With You: Developer & End-User Perspectives on App Permissions & Their Privacy Ramifications

Work with AI and Work for AI: Autonomous Vehicle Safety Drivers’ Lived Experiences

Education, Human Learning and Instructions

Understanding Personal Data Tracking and Sensemaking Practices for Self-Directed Learning in Non-classroom and Non-computer-based Contexts

ChameleonControl: Teleoperating Real Human Surrogates through Mixed Reality Gestural Guidance for Remote Hands-on Classrooms

“What else can I do?” Examining the Impact of Community Data on Adaptation and Quality of Reflection in an Educational Game

MR.Brick: Designing A Remote Mixed-reality Educational Game System for Promoting Children’s Social & Collaborative Skills

DAPIE: Interactive Step-by-Step Explanatory Dialogues to Answer Children’s Why and How Qestions

--

--

Daniel Buschek

Professor at University of Bayreuth, Germany. Human-computer interaction, intelligent user interfaces, interactive AI.