Skip to content

Design and Validation of a Multimodal AI Conversational System for Automated Travel Itinerary Generation and Promotional Video Synthesis

Sep 2026 · Applied Sciences · Vol 16, pp. 8890
Multimodal Machine Learning Applications

Abstract

The manual creation of personalized travel itineraries remains a labor-intensive process that requires travel agents to consolidate heterogeneous information from multiple sources, including natural language interactions, booking confirmations, screenshots, and reservation documents. Although recent advances in multimodal artificial intelligence have significantly improved language understanding and content generation, existing solutions typically address isolated tasks rather than providing an integrated workflow capable of automating the complete travel planning process. This paper presents the development and validation of an AI-powered conversational agent designed to automate itinerary generation and generative video synthesis through natural language processing (NLP) and multimodal data extraction. The system, evaluated at Technology Readiness Level 4 (TRL4), employs a Multi-Agent System (MAS) architecture, integrating specialized large language models (Gemini 2.5/2.0 Flash, GPT-4o-mini) with optical character recognition (OCR) and Latent Diffusion Models to interpret user requests, extract structured data from images and PDFs, and produce comprehensive travel packages formatted as professional PDF deliverables alongside AI-synthesized promotional videos. Validation in a controlled laboratory environment demonstrated over 90% intent recognition accuracy, successful data extraction from non-standard formats, and the automated production of both client-ready documents and coherent visual narratives from static itinerary data. The system achieved an average video generation latency of 4.2±0.8 minutes, while maintaining structural consistency in the generated PDF itineraries. The system represents a viable proof-of-concept for intelligent travel planning automation, with implications for enhancing operational efficiency in the tourism industry and reducing cognitive load on human agents. Future work will advance the prototype to TRL5 through integration with external booking APIs and real-user testing scenarios.

View source

Similar papers

#artificial intelligence Conference Open access Jun 2018

Gibson Env: Real-World Perception for Embodied Agents

This paper investigates developing real-world perception for active agents, proposes Gibson Environment for this purpose, and showcases a set of perceptual tasks learned therein.

F. Xia, Amir Zamir, Zhi-Yang He et al. · 1,069 citations · ⚡112
#artificial intelligence Open access May 2023

Evaluating the Performance of Large Language Models on GAOKAO Benchmark

GAOKAO-Bench is introduced, an intuitive benchmark that employs questions from the Chinese GAOKAO examination as test samples, including both subjective and objective questions that contribute a robust evaluation benchmark for future large language models and offers valuable insights into the advantages and limitations...

Xiaotian Zhang, Chun-yan Li, Yi Zong et al. · 216 citations · ⚡17

KTO: Model Alignment as Prospect Theoretic Optimization

This work proposes a HALO that directly maximizes the utility of generations instead of maximizing the log-likelihood of preferences, and suggests that the best loss depends on the inductive biases most appropriate for a given setting, an oft-overlooked consideration.

Kawin Ethayarajh, Winnie Xu, Niklas Muennighoff et al. · 195 citations · ⚡28
#computer vision Open access Jun 2016

Software Development in Startup Companies: The Greenfield Startup Model

The results are packaged in the Greenfield Startup Model (GSM), which explains the priority of startups to release the product as quickly as possible, and the need to shorten time-to-market, by speeding up the development through low-precision engineering activities.

Carmine Giardino, Nicolò Paternoster, M. Unterkalmsteiner et al. · 178 citations · ⚡14
#computer vision Open access Oct 2016

Software Startups - A Research Agenda

Software startup companies develop innovative, software-intensive products within limited timeframes and with few resources, searching for sustainable and scalable business models.

M. Unterkalmsteiner, P. Abrahamsson, Xiaofeng Wang et al. · 157 citations · ⚡17

Related blog posts

MIT News · Artificial Intelligence Oct 23, 2026

Q&A: How AI came to model the “messy” human mind

Assistant Professor Benjamin Lindquist studies how engineers deliberately injected randomness into early AI, giving rise to deep-learning models that sometimes hallucinate.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.