2026· International Journal of Mathematical and Computer Sciences· 0 citations· 10 references
TL;DR
A vision-enabled virtual robotic head which is entirely running inside a web browser and includes modules like Speech-to-Text, Large Language Models, Text-to-Speech, and vision processing using FastAPI and WebSocket architecture is developed.
Abstract
AI-enabled intelligent virtual humanoids are critical to ensure natural and socially aware human-machine interactions in areas such as education, customer services, and companionship. In this paper, we develop a vision-enabled virtual robotic head which is entirely running inside a web browser and includes modules like Speech-to-Text, Large Language Models, Text-to-Speech, and vision processing using FastAPI and WebSocket architecture. The proposed approach generates a dynamic robot-like face capable of realistic talking and facial expressions along with a vision module for face detection and visitor recognition and personalized interaction based on their memory. The proposed architecture ensures low-latency (less than one second) despite the active use of vision processing capabilities. User evaluation on 50 people resulted in 92% face recognition accuracy and high satisfaction scores.
The development of an intelligent visual aid incorporating object detection, face recognition, distance estimation, distance estimation, and text-to-speech audio feedback is outlined.
Findings indicate the practical feasibility of the proposed system for real-time assistive navigation, demonstrating low-cost implementation, contextual interaction capabilities, and the potential to address several limitations of existing wearable navigation systems.
Ashish Sharma, Dhiraj Rajput, Sushant Kumar et al.· Cureus Journal of Computer S...· 0 citations
Although Large Language Models (LLMs) and multimodal AI are quickly expanding the capabilities of embodied agents, real world robotic systems continue to face major challenges: the high cost of hardware, inflexible interaction models, and excessive dependence on cloud computing. We will address these challenges by prop...
Amruth Krishna K, Mohammed Sabil C, Mohammed Shamnas K et al.· International Conference Inn...· 0 citations
Visually impaired individuals encounter considerable difficulties while navigating indoor and outdoor environments due to their inability to perceive obstacles, objects, and surrounding conditions. Conventional assistive aids, such as white canes and guide dogs, offer only limited support because they primarily detect...
Ninin K. S., J. Binu, Joyal Christy Jose et al.· International Conference Inn...· 0 citations
Living alone in today's world is essential for every human being, but it becomes a challenge for those who have vision impairments. A person with a visual impairment is unable to detect or feel the outside environment. These people need certain resources in order to operate autonomously. With advancements in technology...
Purvis Paul, B. Kumar, K. Prasad· Journal of Science & Technol...· 0 citations
Aiming at the problems of insufficient spatial context modeling and limited understanding of temporal dynamics in monocular vision-based human-arm-robot interaction, this study proposes a monocular vision-based human-arm-robot interaction system based on attention feature fusion and temporal graph convolution. The...
