Skip to content
Preprint

Characterizing Visual Accessibility Issues in AI Developer Tools: An Empirical Study

Aug 2026 · 0 citations · 48 references
Computer Science

TL;DR

Analysis of issues and forum discussions from five AI developer tool ecosystems shows that the accessibility record of AI developer tools is shaped by both their interaction design and the reporting and maintenance practices of their surrounding ecosystems.

Abstract

AI-assisted developer tools increasingly mediate programming through chat panels, terminal agents, generated diffs, and streaming status output. These interaction surfaces may create visual accessibility barriers for blind, low-vision, and color-vision-deficient developers, yet little is known about how such barriers are reported in public tool ecosystems. We analyze issues and forum discussions from five AI developer tool ecosystems: GitHub Copilot in VS Code, Cursor, Claude Code, OpenAI Codex, and OpenCode. From 2,652 keyword-retrieved candidates, a three-model ensemble identified 600 unanimously positive visual accessibility reports. A stratified manual sanity check supported this conservative selection. Topic modeling and qualitative analysis identified three recurring categories: screen-reader and assistive-technology barriers; visual presentation, contrast, and differentiation problems; and readability, scaling, and control limitations in AI-specific interfaces. The relative prominence of these concerns varied across ecosystems and reflected differences in editor, terminal, chat, diff, and agent interaction surfaces. An exploratory metadata analysis further identified differences in reporter activity and, across the GitHub-based ecosystems, maintainer participation and closure processes. These findings show that the accessibility record of AI developer tools is shaped by both their interaction design and the reporting and maintenance practices of their surrounding ecosystems.

View source

Similar papers

#software testing Review Sep 2026

How Developers Discuss Generative AI: A Longitudinal Study of the Visual Studio Code Community

A longitudinal analysis of generative-AI-related discussions in the Visual Studio Code (VS Code) GitHub repository, using 43,806 candidate issues created between January 2021 and June 2026, suggests that GitHub Issues provide a practical, workflow-oriented perspective on generative AI that complements survey-based stud...

Panida Rumriankit, Akito Monden, Hiroki Inayoshi et al. · 0 citations
Review Aug 2026

Rating Like Blind Users: Automated App Evaluation by Detecting Critical Accessibility Issues

MAASdroid, an automated Mobile Application Accessibility Scoring tool, grounded in cognitive map theory to model their app exploration, achieves strong correlation with actual ratings from blind users, offering a scoring system that closely aligns with their experience.

Jian-Ling Yu, Jin-Yan Yu, Yu-Han Liu et al. · 0 citations
Review Aug 2025

SWIRL: Interactive Sensemaking of Tool-Generated Warnings through Customized Summaries

Evaluated SWIRL, which supports interpreting tool-generated warnings through interactive, customized summarization, suggests that SWIRL's active learning-based summarization can enhance the sensemaking process of tool-generated warnings.

Burak Yetistiren, Hong-Jin Kang, Miryung Kim · 0 citations

Targeted Interaction Agents for Web Accessibility Evaluation

This work proposes interactive tools and atomic rubrics for LLM agents to reliably assess accessibility and preliminary results on a subset of ACT test cases show substantially higher recall and precision than the strongest evaluated LLM-driven baseline.

Ming Zhong, Meng-Qi Shi, Davin Win Kyi et al. · 0 citations

A11yLTLNav: Automatic Detection of Accessibility Navigation Failures

This work organizes accessibility navigation failures into a failure taxonomy and formalizes a browser-observable subset as executable Linear Temporal Logic properties over action-state traces and transforms accessibility knowledge into reusable checks of interface behavior over time.

Chen-Ming Ge, Ke-Wen Peng, Cheng-Yang Shi et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.