Skip to content

Design and Validation of a Multimodal AI Conversational System for Automated Travel Itinerary Generation and Promotional Video Synthesis

Sep 2026 · Applied Sciences
Multimodal Machine Learning Applications

Abstract

The manual creation of personalized travel itineraries remains a labor-intensive process that requires travel agents to consolidate heterogeneous information from multiple sources, including natural language interactions, booking confirmations, screenshots, and reservation documents. Although recent advances in multimodal artificial intelligence have significantly improved language understanding and content generation, existing solutions typically address isolated tasks rather than providing an integrated workflow capable of automating the complete travel planning process. This paper presents the development and validation of an AI-powered conversational agent designed to automate itinerary generation and generative video synthesis through natural language processing (NLP) and multimodal data extraction. The system, evaluated at Technology Readiness Level 4 (TRL4), employs a Multi-Agent System (MAS) architecture, integrating specialized large language models (Gemini 2.5/2.0 Flash, GPT-4o-mini) with optical character recognition (OCR) and Latent Diffusion Models to interpret user requests, extract structured data from images and PDFs, and produce comprehensive travel packages formatted as professional PDF deliverables alongside AI-synthesized promotional videos. Validation in a controlled laboratory environment demonstrated over 90% intent recognition accuracy, successful data extraction from non-standard formats, and the automated production of both client-ready documents and coherent visual narratives from static itinerary data. The system achieved an average video generation latency of 4.2±0.8 minutes, while maintaining structural consistency in the generated PDF itineraries. The system represents a viable proof-of-concept for intelligent travel planning automation, with implications for enhancing operational efficiency in the tourism industry and reducing cognitive load on human agents. Future work will advance the prototype to TRL5 through integration with external booking APIs and real-user testing scenarios.

View source

Similar papers

#artificial intelligence Open access May 2023

Evaluating the Performance of Large Language Models on GAOKAO Benchmark

GAOKAO-Bench is introduced, an intuitive benchmark that employs questions from the Chinese GAOKAO examination as test samples, including both subjective and objective questions that contribute a robust evaluation benchmark for future large language models and offers valuable insights into the advantages and limitations of such models.

Xiaotian Zhang, Chun-yan Li, Yi Zong et al. · 216 citations · ⚡17
#computer vision Open access Jun 2016

Software Development in Startup Companies: The Greenfield Startup Model

The results are packaged in the Greenfield Startup Model (GSM), which explains the priority of startups to release the product as quickly as possible, and the need to shorten time-to-market, by speeding up the development through low-precision engineering activities.

Carmine Giardino, Nicolò Paternoster, M. Unterkalmsteiner et al. · 178 citations · ⚡14
#computer vision Open access Oct 2016

Software Startups - A Research Agenda

Software startup companies develop innovative, software-intensive products within limited timeframes and with few resources, searching for sustainable and scalable business models.

M. Unterkalmsteiner, P. Abrahamsson, Xiaofeng Wang et al. · 157 citations · ⚡17
#machine learning Review Open access Oct 2016

“Failures” to be celebrated: an analysis of major pivots of software startups

This study conducts a case survey study based on the secondary data of the major pivots happened in 49 software startups, and demonstrates that customer need pivot is the most common among all pivot types.

Sohaib Shahid Bajwa, Xiaofeng Wang, Anh Nguyen-Duc et al. · 127 citations · ⚡15
#computer vision Review Open access May 2015

A survey study on major technical barriers affecting the decision to adopt cloud services

The comparison of adopter and non-adopter sample reveals three potential adoption inhibitor, security, data privacy, and portability, which underlines the importance of the technical and security perspectives for research investigating the adoption of technology.

Nattakarn Phaphoom, Xiaofeng Wang, S. Samuel et al. · 111 citations · ⚡8
#computer vision Conference Open access Dec 2013

Affordable and Energy-Efficient Cloud Computing Clusters: The Bolzano Raspberry Pi Cloud Cluster Experiment

The ongoing work building a Raspberry Pi cluster consisting of 300 nodes is presented, with potential use cases being an inexpensive and green test bed for cloud computing research and a robust and mobile data center for operating in adverse environments.

P. Abrahamsson, S. Helmer, Nattakarn Phaphoom et al. · 110 citations · ⚡7

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.