Jul 2026· JOIV: International Journal on Informatics Visualization· 0 citations
TL;DR
The findings indicate that integrating semantic retrieval with AI-based fallback mechanisms can improve response quality, scalability, and contextual relevance in academic library services.
Abstract
Academic libraries increasingly require intelligent digital services to improve information accessibility, responsiveness, and service efficiency. However, conventional FAQ-based chatbots often suffer from limited semantic understanding, while fully AI-based systems may introduce higher latency and inconsistent institutional responses. This study aims to design and evaluate a hybrid web-based library chatbot integrating a local MySQL FAQ database with OpenAI API services to support digital library services at Universitas Negeri Padang (UNP). The system was developed using a hybrid architecture combining semantic FAQ retrieval and AI-based fallback generation. The implementation utilized HTML, CSS, JavaScript, Node.js, and MySQL, while Bahasa Indonesia Natural Language Processing (NLP) techniques, including normalization, tokenization, stopword removal, and stemming, were applied to improve semantic query matching. Evaluation was conducted using 100 library-related queries, validated by three experts: senior librarians and an information systems lecturer. Experimental results demonstrated that the proposed hybrid chatbot achieved 92% response correctness accuracy with a 95% confidence interval ranging from 86.7% to 97.3%. Routing evaluation also confirmed effective query classification between local FAQ retrieval and AI fallback mechanisms, while benchmarking experiments showed that the proposed architecture outperformed keyword-based FAQ systems, semantic retrieval-only models, and pure LLM-based chatbots in terms of response accuracy and balanced response latency. The findings indicate that integrating semantic retrieval with AI-based fallback mechanisms can improve response quality, scalability, and contextual relevance in academic library services. Future research may focus on adaptive threshold optimization, multilingual support, and domain-specific prompt engineering to further enhance routing precision and the generation of contextual responses.
It is concluded that an NLP- and RAG-based chatbot is feasible to be implemented as a digital campus information service and improves answer accuracy from 58.5% to 89.25%, with an average response time below three seconds.
Zuhri Yanda, Yeni Yanti, Maulinda et al.· IC-ITECHS· 0 citations
The AI chatbot successfully addressed traditional academic information service issues by providing 24/7 service, reducing the workload of campus staff, and ensuring information consistency through RAG technology.
Muhammad Saiful, L. Samsu, Imam Fathurrahman et al.· Infotek : Jurnal Informatika...· 0 citations
This paper presents the design and implementation of intelligent chatbots using Retrieval-Augmented Generation architecture to derive accurate, context-based responses from domain-specific knowledge sources such as PDFs and CSV files. The proposed system integrates information retrieval mechanisms with large language m...
Varsha Spoorthi Shree Narravula, V. K, Yashaswini B. Suresh et al.· 2026 7th International Confe...· 0 citations
This paper explores the practical implementation of a Chatbot designed to connect natural language communication with database interactions by generating Structured Query Language (SQL) queries through the utilization of OpenAPI, with potential implications for improving human-computer interactions within database syst...
R. Santosa, Hartantya Ainiyatuts Tsaniyah, Yoga Ari Tofan et al.· IPTEK: The Journal for Techn...· 0 citations
A Retrieval-Augmented Generation (RAG)-based chatbot for academic regulation information services using a locally deployed Large Language Model (LLM) and promising feasibility for supporting document-based academic regulation information services is indicated.
Universities now use Large Language Models (LLMs) to transform their processes for managing student information. The paper introduces an upgraded chatbot system for Narasaraopeta Engineering College (NEC) which extends previous on-premise LLM chatbot research by providing four new functions. The system uses (1) Retriev...
M. Yaswanth, Kopparapu Sai Amar Durgesh, Mogili Harsha Vardhan et al.· 2026 7th International Confe...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.