Skip to content

Author

Herman Santoni

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Open access Sep 2026

EVALUASI KEAMANAN PROMPT DALAM INTERAKSI MANUSIA DAN AI: STUDI KASUS PADA MODEL GPT-4

ABSTRACT The rapid development of generative artificial intelligence, particularly language models such as GPT-4, has transformed human–machine interaction through the use of prompts across various contexts. However, the adaptive capabilities of these models introduce security challenges, particularly those involving prompt injection, output manipulation, behavioral constraint bypassing, and potential data breaches. This study aims to analyze the security dimensions of prompt-based interaction with GPT-4 and to identify its vulnerabilities and the effectiveness of the implemented mitigation mechanisms. A case study method was employed through several stages, including the design and testing of various types of manipulative prompts, observation of model responses, identification of deviations from security constraints, and evaluation of the available security filters and behavioral restrictions. The findings indicate that security filters and behavioral constraints implemented in GPT-4 can reduce certain risks associated with harmful interactions, but they do not completely prevent more sophisticated prompt-engineering strategies. These vulnerabilities demonstrate that the security of language-model-based systems cannot rely solely on built-in protection mechanisms but requires layered risk mitigation strategies, continuous security evaluation, and improved user awareness. The study concludes that strengthening security frameworks, conducting systematic testing against manipulative scenarios, and promoting safe and ethical AI usage practices are necessary to improve the resilience of prompt-based AI systems. ABSTRAK Perkembangan kecerdasan buatan generatif, khususnya model bahasa seperti GPT-4, telah mengubah pola interaksi manusia dan mesin melalui penggunaan perintah (prompt) dalam berbagai konteks. Namun, kemampuan model dalam memahami dan menghasilkan respons secara adaptif menimbulkan tantangan keamanan, terutama terkait injeksi perintah, manipulasi keluaran, pengabaian batasan perilaku, dan potensi pelanggaran data. Penelitian ini bertujuan menganalisis dimensi keamanan interaksi berbasis perintah pada GPT-4 serta mengidentifikasi kerentanan dan efektivitas mekanisme mitigasi yang diterapkan. Penelitian menggunakan metode studi kasus dengan tahapan berupa perancangan dan pengujian berbagai jenis perintah manipulatif, pengamatan terhadap respons model, identifikasi bentuk penyimpangan dari batasan keamanan, serta evaluasi terhadap filter dan mekanisme pembatasan perilaku yang tersedia. Hasil penelitian menunjukkan bahwa penerapan filter keamanan dan pembatasan perilaku pada GPT-4 mampu mengurangi sebagian risiko interaksi berbahaya, tetapi belum sepenuhnya mencegah strategi rekayasa perintah yang lebih kompleks. Kerentanan tersebut menunjukkan bahwa keamanan sistem berbasis model bahasa tidak hanya bergantung pada mekanisme perlindungan bawaan, tetapi juga memerlukan strategi mitigasi berlapis, evaluasi keamanan secara berkelanjutan, dan peningkatan kesadaran pengguna. Penelitian ini menyimpulkan bahwa penguatan kerangka kerja keamanan, pengujian terhadap skenario manipulatif, dan penerapan praktik penggunaan AI yang aman dan etis diperlukan untuk meningkatkan ketahanan sistem AI berbasis perintah.

Herman Santoni · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.