CHI’21 Preprint Collection HCI + AI

Looking for current research on HCI + AI? Here’s a list.

Daniel Buschek
6 min readMar 9, 2021

Here’s a collection of CHI’21 preprints on topics related to computational HCI, data, algorithms and AI. It’s not a comprehensive list and in no particular order. Found via Twitter and arXiv. Suggestions welcome!

Daniel Buschek (@DBuschek)

XAI: Explainability, Transparency, Trust, Bias, …

Expanding Explainability: Towards Social Transparency in AI systems

To Live in Their Utopia: Why Algorithmic Systems Create Absurd Outcomes

Effect of Information Presentation on Fairness Perceptions of Machine Learning Predictors

Manipulating and Measuring Model Interpretability

Modeling Assumptions Clash with the Real World: Transparency, Equity, and Community Challenges for Student Assignment Algorithms

Trust in Collaborative Automation in High Stakes Software Engineering Work: A Case Study at NASA

Effects of Semantic Segmentation Visualization on Trust, Situation Awareness, and Cognitive Load in Highly Automated Vehicles

Beyond Expertise and Roles: A Framework to Characterize the Stakeholders of Interpretable Machine Learning and their Needs

Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance

Evaluating the Interpretability of Generative Models by Interactive Reconstruction

Understanding User Attitudes Towards Negative Side Effects of AI Systems (LBW)

Exploring a Makeup Support System for Transgender Passing based on Automatic Gender Recognition

Towards Explainable AI: Assessing the Usefulness and Impact of Added Explainability Features in Legal Document Summarization (LBW)

The Effects of Warmth and Competence Perceptions on Users’ Choice of an AI System

Data-driven UI Design, Adaptation & Accessibility

GestureMap: Supporting Visual Analytics and Quantitative Analysis of Motion Elicitation Data by Learning 2D Embeddings

Adapting User Interfaces with Model-based Reinforcement Learning

Screen2Vec: Semantic Embedding of GUI Screens and GUI Components

Screen Recognition: Creating Accessibility Metadata for Mobile Applications from Pixels

“I Choose Assistive Devices That Save My Face” A Study on Perceptions of Accessibility and Assistive Technology Use Conducted in China

Machine Learning Uncertainty as a Design Material: A Post-Phenomenological Inquiry

“It’s Complicated”: Negotiating Accessibility and (Mis)Representation in Image Descriptions of Race, Gender, and Disability

VINS: Visual Search for Mobile User Interface Design

Revamp: Enhancing Accessible Information Seeking Experience of Online Shopping for Blind or Low Vision Users

Interaction with Agents, Bots & Robots

Eliciting and Analysing Users’ Envisioned Dialogues with Perfect Voice Assistants

A Meta-Analysis of Human Personality and Robot Acceptance in Human-Robot Interaction

People May Punish, But Not Blame Robots

Towards Mutual Theory of Mind in Human-AI Interaction: How Language Reflects What Students Perceive About a Virtual Teaching Assistant

What Do We See in Them? Identifying Dimensions of Partner Models for Speech Interfaces Using a Psycholexical Approach

Designing Conversational Agents: A Self-Determination Theory Approach

Conversational Futures: Emancipating Conversational Interactions for Futures Worth Wanting

Disagree? You Must be a Bot! How Beliefs Shape Twitter Profile Perceptions

Effects of Communication Directionality and AI Agent Differences in Human-AI Interaction

Firefox Voice: An Open and Extensible Voice Assistant Built Upon the Web

“Grip-that-there”: An Investigation of Explicit and Implicit Task Allocation Techniques for Human-Robot Collaboration

When the Social Becomes Non-Human: Young People’s Perception of Social Support in Chatbots

Text Interaction and Natural Language Processing

The Impact of Multiple Parallel Phrase Suggestions on Email Input and Composition Behaviour of Native and Non-Native English Writers

Planning for Natural Language Failures with the AI Playbook

“I Can’t Reply with That”: Characterizing Problematic Email Reply Suggestions

PhraseFlow: Designs and Empirical Studies of Phrase-Level Input

Typing Efficiency and Suggestion Accuracy Influence the Benefits and Adoption of Word Suggestions

Data & AI in Science, Practice & Media

Whither AutoML? Understanding the Role of Automation in Machine Learning Workflows

“Everyone wants to do the model work, not the data work”: Data Cascades in High-Stakes AI

NBSearch: Semantic Search and Visual Exploration of Computational Notebooks

Tea, Earl Grey, Hot: Designing Speech Interactions from the Imagined Ideal of Star Trek

Player-AI Interaction: What Neural Network Games Reveal About AI as Play

Human Perceptions on Moral Responsibility of AI: A Case Study in AI-Assisted Bail Decision-Making

Designing Ground Truth and the Social Life of Labels

Chasing Luck: Data-driven Prediction, Faith, Hunch, and Cultural Norms in Rural Betting Practices

AdverTiming Matters: Examining User Ad Consumption for Effective Ad Allocations on Social Media

Computation-supported Input & Interaction

Data@Hand: Fostering Visual Exploration of Personal Data on Smartphones Leveraging Speech and Touch Interaction

CASSIE: Curve and Surface Sketching in Immersive Environments

Color by Numbers: Interactive Structuring and Vectorization of Sketch Imagery

KTabulator: Interactive Ad hoc Table Creation using Knowledge Graphs

RubySlippers: Supporting Content-based Voice Navigation for How-to Videos

Mindless Attractor: A False-Positive Resistant Intervention for Drawing Attention Using Auditory Perturbation

A Probabilistic Interpretation of Motion Correlation Selection Techniques

AtaTouch: Robust Finger Pinch Detection for a VR Controller Using RF Return Loss

Integrated Visualization Editing via Parameterized Declarative Templates

Spatial Labeling: Leveraging Spatial Layout for Improving Label Quality in Non-Expert Image Annotation

Falx: Synthesis-Powered Visualization Authoring

Data and (Usable) Privacy & Security

Understanding User Identification in Virtual Reality Through Behavioral Biometrics and the Effect of Body Normalization

Exploring Design and Governance Challenges in the Development of Privacy-Preserving Computation

“You Gotta Watch What You Say”: Surveillance of Communication with Incarcerated People

Bolder is Better: Raising User Awareness through Salient and Concise Privacy Notices

AI, Data and Health

AI in Global Health: The View from the Front Lines

Personalised Recommendations in Mental Health Apps: The Impact of Autonomy and Data Sharing

Sharing Heartbeats: Motivations of Citizen Scientists in Times of Crises

Apps Against the Spread: Privacy Implications and User Acceptance of COVID-19-Related Smartphone Apps on Three Continents

Viral Visualizations: How Coronavirus Skeptics Use Orthodox Data Practices to Promote Unorthodox Science Online

Auditing E-Commerce Platforms for Algorithmically Curated Vaccine Misinformation

Designing AI for Trust and Collaboration in Time-Constrained Medical Decisions: A Sociotechnical Lens

“Brilliant AI Doctor” in Rural China: Tensions and Challenges in AI-Powered CDSS Deployment

Machine Learning in Mental Health: A Systematic Review of the HCI Literature to Support the Development of Effective and Implementable ML Systems (TOCHI)

‘It cannot do all of my work’: Community Health Worker Perceptions of AI-Enabled Mobile Health Applications in Rural India

Methodology, Metrics, Models

The Disagreement Deconvolution: Bringing Machine Learning Performance Metrics In Line With Reality

A Simulation Model of Intermittently Controlled Point-and-Click Behavior

Touchscreen Typing As Optimal Supervisory Control

Computational Workflows for Designing Input Devices

The Challenges in Modeling Human Performance in 3D Space with Fitts’ Law

Remote and Collaborative Virtual Reality Experiments via Social VR Platforms

The Image of the Interface: How People Use Landmarks to Develop Spatial Memory of Commands in Graphical Interfaces

Modeling and Leveraging Analytic Focus During Exploratory Visual Analysis

XRgonomics: Facilitating the Creation of Ergonomic 3D Interfaces

Creepy Technology: What Is It and How Do You Measure It?

RCEA-360VR: Real-time, Continuous Emotion Annotation in 360◦ VR Videos for Collecting Precise Viewport-dependent Ground Truth Labels

Crowdsourcing More Effective Initializations for Single-Target Trackers Through Automatic Re-querying

Human Learning and Instructions

Soloist: Generating Mixed-Initiative Tutorials from Existing Guitar Instructional Videos Through Audio Processing

Automatic Generation of Two-Level Hierarchical Tutorials from Instructional Makeup Videos

One more thing…

Origami CHI Helmet

--

--

Daniel Buschek

Professor at University of Bayreuth, Germany. Human-computer interaction, intelligent user interfaces, interactive AI.