Skip to content
Open access

MythoBiLLM: BiLSTM-Guided Parameter-Efficient Fine-Tuning of Large Language Models for Coherent Summarization and Generation of Indian Mythological Texts

Jul 2026 · Information · Vol 17, pp. 726 · 0 citations · 22 references

TL;DR

Findings support the complete framework on the evaluated corpus, while the controlled comparisons indicate a modest complementary contribution from the BiLSTM and do not identify it as the sole source of the performance gains.

Abstract

Indian mythological narratives contain long event chains, recurring characters, moral conflicts, interactions between human and divine agents, and source-specific narrative styles. General-purpose large language models can generate fluent text while losing character continuity, thematic relations, or source-supported events. This study presents MythoBiLLM, a parameter-efficient framework for summarization and continuation generation from Indian mythological texts. The framework combines a frozen Llama 3.2 3B-Instruct backbone, LoRA-based adaptation, and a gated BiLSTM narrative-memory adapter. A corpus of public-domain English translations from the Ramayana, Mahabharata, Bhagavad-Gita, Vishnupuranam, Harivamsha, Hindu Tales, and Indian Myth and Legend contains 3,684,838 word-level tokens and 6057 segmented passages. Evaluation covers language modeling, summarization, continuation generation, entity consistency, theme retention, component ablation, robustness, human assessment, and statistical testing. Relative to LLM+LoRA, the complete framework reduces average perplexity from 23.4 to 19.8. In controlled comparisons, the BiLSTM adapter achieves an MCS of 0.713 on both tasks, compared with 0.699 for the parameter-matched MLP adapter, 0.704 for independently trained long-context LoRA, and 0.708 for retrieval augmentation. Full MythoBiLLM reaches MCS values of 0.762 for summarization and 0.744 for continuation generation. After entity consistency and style alignment are excluded from MCS, the complete configuration retains the highest scores of 0.751 and 0.731. These findings support the complete framework on the evaluated corpus, while the controlled comparisons indicate a modest complementary contribution from the BiLSTM and do not identify it as the sole source of the performance gains.

Read PDF

Similar papers

Preprint Aug 2026

VoxSumm: A Multilingual Corpus of Long-Form Spoken News for Joint Summarization and Translation

This work formalizes joint speech summarization and translation (JSumT), the generation of a succinct, faithful target-language summary directly from a long spoken document in a source language, and establishes a foundation for developing and evaluating multilingual systems capable of jointly interpreting, compressing, and translating long-form speech.

Yejin Jeon, Marie Maltais, Virginia Ceccatelli et al. · 0 citations
Open access Jul 2026

Enhancing Readability of Telugu Text Summarization Using Multi-scale Attention and Bio-inspired Optimization

The proposed MLOA-MA-ASeqNet architecture, a Multi-scale Attention and Adaptive Sequence-to-Sequence Network whose hierarchical encoder operates simultaneously at word, phrase and sentence level granularity, achieves the highest average score across fluency, adequacy, coherence and readability.

V. M, Kunal Chakma, Anupam Jamatia et al. · 0 citations
Conference Jul 2026

Synergistic Summarization: An Ensemble of Fine-Tuned and Large-Scale Language Models for Factual and Coherent Scientific Abstracts

The exponential growth of scientific literature has intensified the demand for automated summarization systems capable of producing abstracts that are both linguistically fluent and factually reliable. Existing approaches face a fundamental trade-off: encoder-decoder models such as BART and T5 maintain strong factual grounding but produce rigid, extractive outputs, while decoder-only large language models (LLMs) such as Llama and Gemma generate highly fluent text yet remain susceptible to hallucination. This paper proposes a two-stage Synergistic Hybrid Ensemble framework designed to resolve this dichotomy. In Stage 1, a fine-tuned BART-Large model generates a factually grounded scaffold draft from a structured input representation comprising the document title, key sentences, method highlights, and results summary. In Stage 2, a QLoRA-adapted Llama-3.2-1B model performs coherent rewriting and stylistic polishing by conditioning on both the scaffold draft and the original source document. Experiments conducted on the arXiv Scientific Research Papers Dataset using BERTScore and entailment-based Factual Consistency metrics demonstrate that the proposed ensemble achieves a Factual Consistency metrics demonstrate that the proposed ensemble achieves a Factual Consistency score of 0.9140, substantially outperforming BART-Large (0.2890) and Llama-3.2-1B (0.6630) individually. Although the ensemble incurs a marginal reduction in BERTScore (0.8980) relative to Llama-3.2-1B (0.9555), this trade-off is justified given the critical importance of factual reliability in high-stakes scientific discourse. These findings confirm that anchoring the generative capacity of decoder-only LLMs to verified factual scaffolds effectively mitigates hallucination risk, offering a scalable and reproducible solution for high-fidelity scientific abstract generation.

Geoffrey Antonio Arifin, Andrew Widyanata, Henry Lucky et al. · 0 citations
Preprint Aug 2026

MameLoshnLM: Yiddish Language Model and Evaluation Benchmark

MameLoshnLM, the first open-source 8B-parameter language model built specifically for Yiddish, is presented, providing both a foundation for Yiddish NLP and a practical template for language model development in historically rich but digitally underrepresented languages.

Uri Katz, Omer Goldman, Tomasz Limisiewicz et al. · 0 citations
Book Jul 2026

NERBench-Chhattisgarh: A Multi-Family NER Dataset for Low-Resource Indic Languages

A morphological barrier is shown: while pivot-based adaptation facilitates transfer for distant languages through script alignment, it induces negative transfer in morphologically complex agglutinative languages like Gondi.

R. Mundotiya · 0 citations