Skip to content
Book Open access

"Should I use this or my mind?": Designing a Wearable Multimodal Tech Assistant for Older Adults Navigating Patient Portals

Oct 2026 · Proceedings of the 2026 28th International ACM SIGACCESS Conference on Computers and Accessibility · pp. 1-18 · 0 citations · 78 references

TL;DR

This study presents a wearable system combining multi-modal AI, visual overlays, and conversational smart glasses to provide guidance on a mock patient portal for pragmatic care coordination and makes the argument that interdisciplinary co-design approaches are essential to equity-centered care innovation.

Abstract

As the healthcare system increasingly relies on digital patient portals to coordinate care, equitable access depends on the ability of patients to navigate these platforms. This challenge disproportionately affects older adults, and access varies across racial groups and levels of digital health literacy. Yet assistive technologies for portal navigation have largely been designed from computer science perspectives, with limited input from clinical disciplines that understand patients’ lived health experiences. This study presents a wearable system combining multi-modal AI, visual overlays, and conversational smart glasses to provide guidance on a mock patient portal for pragmatic care coordination. In a single-group study with 10 Black older adults (mean age = 69.9 years, SD = 5.4), we measured participants’ digital health literacy (eHEALS) to provide context on task performance, and measured system interactions using the NASA Task Load Index (NASA-TLX), and System Usability Scale (SUS). Task performance, specifically completion rates, times, and errors, was assessed across six portal tasks. Task performance fared well (88% completion across all tasks), with less errors and time spent on simpler tasks (e.g., locating apps), as opposed to multi-step tasks (e.g., scheduling appointments). Post-task interviews uncovered themes related to system interactions, recovery mechanisms, communication breakdowns, device unfamiliarity, and ergonomics. Our work poses design implications for wearable, multi-modal AI assistants serving older adult populations and makes the argument that interdisciplinary co-design approaches are essential to equity-centered care innovation.

Read PDF

Similar papers

Open access Oct 2026

Designing Wearables for Older Adults

It is argued that, particularly in contexts involving care dependence, the relationships between older adults and those involved in their care should be treated as a central consideration in the design of wearable care technologies.

Bahar Şener-Pedgley, Ayhan Ozan Yılmaz, Ceren Usta et al. · 0 citations
Open access Oct 2026

DESIGNING AI-ASSISTED HEALTH EDUCATION FOR OLDER ADULTS: A HUMAN-CENTERED FRAMEWORK BASED ON GERIATRIC ASSESSMENT

This study addresses the gap in health literacy among geriatric populations, which is influenced by cognitive decline, visual impairment, and limited digital independence. Using a mixed-methods approach based on Comprehensive Geriatric Assessment (CGA) data, this research identifies key challenges faced by elderly user...

E. Pratomo, Hutomo Setia Budi, Yosephien Reynalda Prananda Wibowo · 0 citations
Book Open access Oct 2026

Used By, Not Used On: An Adaptive Systems Framework to Design Technology for and with People with Dementia

Technology-mediated support for people living with mild cognitive impairment (MCI) or dementia often aims to assist with everyday activities, yet such systems can also reproduce deficit-oriented framings or introduce tensions around privacy, autonomy, and control. These tensions become salient as dementia progresses an...

Susmitha Gurram, M. Belal, Shivansh Dutta et al. · 0 citations
Review Open access Oct 2026

Client Usability and Student Perspectives of a Novel Mobile Health App to Facilitate 3D-Printed Assistive Device Learning and Application

Introduction: Locating, selecting, and printing appropriate 3D-printed assistive devices (AD) to meet specific health needs can be overwhelming. To address these challenges, the 3DAdapt app was developed. This study aimed to explore the app’s usability through an occupational therapy (OT) student project that involved...

S. Benham, Sarah Argumedo, Samantha Pifer et al. · 0 citations
Open access Oct 2026

Feasibility of a Co-Designed Personalized Cognitive Reablement Program Delivered via Digital Voice Assistants for Older Adults Living With Early-Stage Dementia or Mild Cognitive Impairment: Pilot Randomized Controlled Trial

Abstract Background Home-based reablement programs have improved everyday functioning for people living with early-stage dementia or mild cognitive impairment (MCI), but the substantial time commitment required for delivery by health professionals has created a barrier to widespread implementation. Digital technology c...

Tracy Yiannis, Helen Macpherson, David Scott et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.