Implementation of Transfer Learning for Automatic Summarization in Research Article Synthesis

Abstract

The increasing number of scientific publications has made literature screening more time-consuming, particularly for researchers who need to identify the main contribution of an article before reading the full text. This study develops an extractive summarization model for Indonesian scientific articles using a BERT-based transfer learning approach. The proposed method represents each sentence with contextual embeddings and selects relevant sentences based on their similarity to the document representation, while applying a redundancy threshold to reduce redundancy. A curated corpus of Indonesian research articles was used for model development and evaluation. The generated summaries were evaluated using ROUGE-1, ROUGE-2, ROUGE-L, and ROUGE-Lsum, with the article abstract used as the reference summary. The experimental results show that the proposed model achieved a ROUGE-1 score of approximately 33%, indicating it retained important keywords and central information from the source documents. However, the lower ROUGE-2 score suggests that the model still has limitations in preserving phrase-level continuity and sentence coherence. Qualitative analysis also shows that the model can capture the main ideas of scientific articles, although some methodological details and contextual information are occasionally omitted. These findings indicate that BERT-based extractive summarization can support preliminary literature screening, but further improvement is needed through stronger baseline comparison, human evaluation, and redundancy-aware optimization.