2025· Proceedings of the 3rd International Conference on Data Science, Advanced Algorithms, and Intelligent Computing· 2 citations· 36 references
TL;DR
This review aims to systematically sort out the technical framework of automatic question answering system, analyze its performance bottlenecks, and explore innovative solutions based on large language model and multimodal fusion.
Abstract
: With the rapid development of artificial intelligence technology, automatic question answering system is becoming more and more important in the field of natural language processing. However, the existing systems are confronted with challenges such as semantic gap, insufficient knowledge dynamics and multimodal fusion bottleneck. This review aims to systematically sort out the technical framework of automatic question answering system, analyze its performance bottlenecks, and explore innovative solutions based on large language model and multimodal fusion. This paper analyzes in detail the status quo, advantages, limitations and applicable scenarios of four types of methods, such as retrieval question answering, knowledge base question answering, deep learning driven framework and multimodal question answering, and combs typical previous experimental data. The performance bottleneck is analyzed. Aiming at the illusion problem of large language model and the problem of cross-modal semantic alignment, the future research directions and technical routes are proposed, including designing hybrid architecture to integrate retrieval and generation, developing lightweight cross-modal alignment algorithms, and constructing dynamic knowledge update systems. It is hoped that the Question Answering (QA) system will develop in a more intelligent and practical direction and provide reference for subsequent research.
The proposed WILO-BiLSTM model can perform superior to the conventional approaches and its performance results in terms of METEOR, BLEU, ROUGE, and SPICE score at training data 90% is 0.28, 0.50, 0.56, and 26.93 for the SquAD dataset, respectively.
Pallavi Yevale, Nilesh Uke· Journal of Intelligent Decis...· 0 citations
Large language models (LLMs) are built on the classic Transformer architecture and have become a core driving force for the rapid development of modern artificial intelligence. This paper presents a systematic review of LLMs, elaborating on their fundamental working principles, mainstream open-source models, effective lightweight optimization methods, retrieval-augmented generation frameworks and key human-value-aligned technologies. Nowadays, LLMs have been widely applied in practice. Typical scenarios include intelligent text generation, professional knowledge-based question answering and automated code generation, delivering remarkable value to both industries and academia. However, their large-scale industrial application is still restricted by multiple challenges. The major issues involve content hallucination, poor model interpretability, excessive computing resource consumption, potential ethical risks and unsatisfactory multimodal integration capability. This paper also forecasts the future development directions of LLMs, such as lightweight deployment on edge devices, safety-focused human value alignment, in-depth cross-modal fusion and customized large models for vertical industries. Additionally, it collects a number of representative cases, which can offer solid references and practical guidance for relevant researchers and engineering practitioners to carry out further studies.
This work hypothesizes that using models trained only on generic question answering data (e.g. SQuAD) is a good starting point for domain specific entity extraction, and explores whether the addition of small amounts of training data can help lift model performance.
Corey A. Harper, R. Daniel, Paul Groth· 0 citations
Large Language Models (LLMs) have demonstrated strong capabilities in knowledge-based Visual Question Answering (VQA). However, existing prompt construction methods are often rigid and fail to fully exploit the reasoning potential of LLMs. To address this limitation, we propose the Intelligent Prompt Construction Framework (IPCF), which equips an autonomous agent with the ability to dynamically generate task-specific prompts. IPCF consists of a planner and a toolbox: the planner, powered by an LLM, enables autonomous decision-making, while the toolbox provides three tools—the vanilla VQA model for inspiration, the LLM for knowledge injection, and a knowledge base for information retrieval. This architecture allows the agent to flexibly determine when and how to invoke each tool and to construct adaptive prompts accordingly. Experimental results show that IPCF achieves performance gains of 2.6 and 1.9 points over existing baselines on the OK-VQA and A-OKVQA datasets, respectively.
Zhongjian Hu, Peng Yang, Dongmei Yang et al.· ACM Transactions on Multimed...· 0 citations
AutoDavis is introduced, a first-of-its-kind automatic and dynamic evaluation protocol that enables on-demand benchmarking of LVLMs across specific capability dimensions and shows effectiveness and reliability, offering a new paradigm for dynamic benchmarking of multimodal intelligence.
Han Bao, Yue Huang, Yanbo Wang et al.· Proceedings of the 32nd ACM...· 0 citations