Skip to content
Review Open access

A Hybrid VADER–IndoBERT Framework for Robust Sentiment Analysis of Long and Ambiguous Indonesian Texts

Jul 2026 · Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi) · 0 citations

TL;DR

A Hybrid VADER–IndoBERT framework designed to improve sentiment classification robustness on complex Indonesian texts is introduced, demonstrating the superiority of Transformer-based architectures in capturing long-range dependencies and handling ambiguous sentiment cues.

Abstract

The rapid expansion of digital learning platforms has increased the reliance on user-generated reviews for service evaluation and quality monitoring. However, sentiment analysis of Indonesian reviews remains challenging due to the prevalence of long sentences, mixed sentiments, and ambiguous linguistic expressions. This study introduces a Hybrid VADER–IndoBERT framework designed to improve sentiment classification robustness on complex Indonesian texts. A dataset of 4,904 Ruangguru application reviews was collected through web scraping and processed using a hybrid pipeline consisting of preprocessing, translation-based silver-standard sentiment labeling with VADER, and class balancing via Random Oversampling (ROS). The IndoBERT classifier was evaluated against a Bidirectional Long Short-Term Memory (BiLSTM) baseline. Experimental results show that IndoBERT achieved 90.9% accuracy, outperforming BiLSTM at 86.4%, demonstrating the superiority of Transformer-based architectures in capturing long-range dependencies and handling ambiguous sentiment cues. These findings highlight the effectiveness of integrating lexicon-based and Transformer-based approaches to achieve more robust sentiment analysis on linguistically complex Indonesian texts.

Read PDF

Similar papers

Review Open access Jul 2026

Improving Neutral Sentiment Classification in Indonesian E-Wallet Reviews Using Word2Vec and Easy Data Augmentation (EDA)

The rapid expansion of digital payments has produced massive volumes of user-generated reviews, making manual analysis impractical. This study focuses on the challenge of neutral sentiment classification in Indonesian e-wallet reviews, where neutral comments often contain ambiguous language and are underrepresented relative to positive and negative classes. A total of 26,537 preprocessed DANA application reviews were used to evaluate whether Word2Vec embeddings and Easy Data Augmentation (EDA) can improve neutral sentiment detection when combined with Long Short-Term Memory (LSTM) and Bidirectional Long Short-Term Memory (BiLSTM) architectures. Experiments comparing eight model configurations showed that the combination of Word2Vec, EDA, and LSTM achieved the best performance, with 0.861 accuracy, 0.841 macro-F1, and 0.749 F1-score for the neutral class. These findings demonstrate that semantic representations and controlled lexical variation can jointly enhance minority-class recognition in short informal Indonesian text and highlight the importance of aligning embedding strategies with sequence architectures.

Muhammad Fattah Edric Camilo, Fatma Indriani, M. Faisal et al. · 0 citations
Open access Jul 2026

IndoBERT-Based Sentiment Analysis of Indonesian Social Media Discourse on AI-Generated Images

The rapid emergence of generative artificial intelligence has disrupted creative ecosystems, prompting widespread discourse across Indonesian social media. However, the exact sentiment structure of this public reaction remains empirically unmapped due to the contextual complexities of informal language. The objective of this research is to evaluate the efficacy of contextual language models by fine-tuning IndoBERT and benchmarking it against classical machine learning classifiers—including Complement Naive Bayes, Logistic Regression, and Support Vector Machine—for classifying social media sentiment. A multi-platform dataset comprising 2,981 Indonesian-language posts from X, Reddit, and YouTube was collected and manually annotated into positive, neutral, and negative classes. To address inherent class imbalance, Synthetic Minority Oversampling Technique was applied to classical models, while class-weighted loss and Masked Language Modeling augmentation were utilized for IndoBERT. Performance was evaluated using macro-averaged F1-score across five repeated stratified random splits. IndoBERT achieved a mean macro-F1 of 0.7131 ± 0.0180, outperforming the best classical baseline by approximately 0.12, demonstrating a pronounced advantage in resolving ambiguous neutral discourse. Negative sentiment heavily dominated the corpus at 61.8%, reflecting a prevailing critical stance toward AI-generated imagery concerning ethical and copyright issues. Furthermore, evaluation variance across random seeds exceeded variance from augmentation strategies, indicating test set composition is a major performance determinant. In conclusion, this study establishes a robust empirical baseline for Indonesian sentiment analysis, proving transformer architectures superior for nuanced public opinion mining.

Halvino Iqbal Nataprawira, I. Nurhaida · 0 citations
Open access Aug 2026

Linguistically Informed Machine Learning for Gujarati–English Code-Mixed Sentiment Classification: A Comparative Study of Feature Fusion Strategies

Overall, this work demonstrates that incorporating explicit linguistic information, including language identity, sentiment polarity, and intensifier information, improves sentiment classification of Gujarati–English code-mixed text.

Chirag D. Shah, Shailesh A. Chaudhari · 0 citations
Review Open access Jul 2026

The Technological Evolution of Sentiment Analysis—A ComparativeStudy from SVM to Large Language Models

As the ecosystem encompassing social media and product reviews grows ever more intricate, emotional expression presents prominent traits including subtlety, sarcasm, fragmentation and multimodal fusion. Traditional machine learning models (e.g., SVM), which rely on manual feature engineering, encounter bottlenecks in recognition accuracy when dealing with irony, metaphor, and long-distance sentiment dependencies. Sentiment analysis of reviews is thus trapped in the dual predicament of "semantic noise" and "shallow understanding." This paper focuses on the advantages and accuracy verification of Large Language Models (LLMs) in tackling high-difficulty sentiment analysis of reviews. This study abandons the mere enumeration of single accuracy values and instead delves into the cognitive breakthroughs of LLMs across three key dimensions: context-aware ambiguous meaning resolution, which deeply interprets ironic and euphemistic connotations; fine-grained sentiment element extraction, accurately identifying the polarity of praise or criticism toward specific product attributes; and closed-loop verification through sentiment generation and explanation, providing traceable justifications via chain-of-thought mechanisms.

Yaxuan Wang · 0 citations
Open access Jul 2026

Beyond Classification: A Multilingual mBERT Framework for Sentiment Analysis, Zero-Shot Categorization, and Severity Assessment on social media

Considering the growth of multilingual user made content within social-media platforms, there is an urgent need for developing scalable, language-agnostic approaches for their analysis. Within this paper, we analyze mBERT's performance in sentiment classification in a binary setting as well as the possibility of performing transfer learning between languages. Specifically, the fine-tuned model is applied for sentiment analysis of tweets from the preprocessed TweetEval dataset, obtaining 79.2% of accuracy and 74.7% of the F1 score. It is shown that cross-language transfer learning without any preliminary training on multilingual sentiment datasets provides quite satisfactory performance. However, a more complex approach can be used, which consists of applying filtering of negative sentiments, categorization of subcategories through a sentence transformer with zero-shot settings, and grouping the resulting data in several major categories to obtain severity scores according to frequency thresholds. The application of the sentiment classification with transformers in combination with issue prioritization makes it possible to develop an end-to-end approach to structuring multilingual social media content.

S. Nahar, P. P. Agnihotri · 0 citations
Review Open access Jul 2026

Enhanced Sentiment Analysis Using RoBERTa and BiLSTM: A Context-Aware Hybrid Deep Learning Approach

With the widespread growth of digital platforms, online interaction has become an essential part of everyday life. Users frequently express their opinions, feedback, and emotions through reviews and comments on various platforms. Analyzing such textual data plays a crucial role in understanding user sentiment and supporting effective decision-making. However, sentiment analysis faces several challenges, including long-range dependencies within text and the presence of unknown words and symbols. Traditional sentiment analysis approaches mainly rely on sequential models, which process text step by step and often require higher computational time. In contrast, Transformer-based models offer improved efficiency through parallel processing. To address these challenges, this paper presents a context-aware hybrid deep learning approach by integrating the Robustly Optimized BERT Pretraining Approach (RoBERTa) with Bidirectional Long Short-Term Memory (BiLSTM) networks. RoBERTa is employed to generate rich contextual word embeddings, while BiLSTM captures long-term semantic dependencies by processing text in both forward and backward directions. The proposed model is trained and evaluated on the Twitter US Airline Sentiment dataset comprising 14,299 samples across three sentiment classes. Experimental analysis demonstrates that the hybrid approach achieves an accuracy of 85.14% and an F1-score of 0.8487, highlighting its effectiveness for sentiment analysis tasks compared to baseline models

Dr. Veguru Gayatri, Dr. Rajani Rajalingam · 0 citations