AI Social Interaction, Experience, and AI Literacy in Identifying AI Content among Jabodetabek Users
DOI:
https://doi.org/10.47709/brilliance.v6i3.9033Keywords:
AI Literacy, AI Experience, AI Social Interaction, AI Content Identification, Generative AIAbstract
Background: Generative AI has intensified the circulation of synthetic visual content and increased the need for users to identify AI-generated content. Prior studies have examined deepfake detection, AI literacy, AI experience, and social interaction separately, but empirical evidence on how these factors jointly shape identification ability remains limited. Objective: This study investigates the effects of AI Social Interaction and AI Experience on AI Content Identification Ability, with AI Literacy positioned as a mediating mechanism. Methods: A quantitative survey was conducted with 270 social media users in Jabodetabek. AI Social Interaction, AI Experience, and AI Literacy were measured using a five-point Likert questionnaire, while identification ability was measured through a 30-item objective performance test consisting of AI-generated and authentic images and videos. Data were analyzed using partial least squares structural equation modeling with SmartPLS 4.0. Results: AI Experience had a positive effect on AI Literacy. AI Literacy and AI Social Interaction had significant direct effects on AI Content Identification Ability. AI Experience did not directly affect identification ability, but its indirect effect through AI Literacy was significant, indicating full mediation. Conclusion: AI use experience does not automatically improve the ability to identify synthetic content. Experience must be converted into evaluative and ethical AI Literacy, while social interaction may support direct pattern recognition through digital exposure.
References
Allen, L. K., & Kendeou, P. (2024). ED-AI Lit: An interdisciplinary framework for AI literacy in education. Policy Insights from the Behavioral and Brain Sciences, 11(1), 3-10. https://doi.org/10.1177/23727322231220339
Asosiasi Penyelenggara Jasa Internet Indonesia. (2024, February 7). APJII jumlah pengguna internet Indonesia tembus 221 juta orang. https://apjii.or.id/berita/d/apjii-jumlah-pengguna-internet-indonesia-tembus-221-juta-orang
Bray, S. D., Johnson, S. D., & Kleinberg, B. (2023). Testing human ability to detect deepfake images of human faces. Journal of Cybersecurity, 9(1). https://doi.org/10.1093/cybsec/tyad011
Bussey, K. (2023). The contribution of social cognitive theory to school bullying research and practice. Theory Into Practice, 62(3), 293-305. https://doi.org/10.1080/00405841.2023.2226549
Casu, M., Guarnera, L., Zangara, I., Caponnetto, P., & Battiato, S. (2025). A (Mid)journey through reality: Assessing accuracy, impostor bias, and automation bias in human detection of AI-generated images. Human Behavior and Emerging Technologies, 2025(1). https://doi.org/10.1155/hbe2/9977058
Christensen, J., Hansen, J. M., & Wilson, P. (2025). Understanding the role and impact of generative artificial intelligence hallucination within consumers' tourism decision-making processes. Current Issues in Tourism, 28(4), 545-560. https://doi.org/10.1080/13683500.2023.2300032
Diel, A., Lalgi, T., Schroter, I. C., MacDorman, K. F., Teufel, M., & Baeuerle, A. (2024). Human performance in detecting deepfakes: A systematic review and meta-analysis of 56 papers. Computers in Human Behavior Reports, 16. https://doi.org/10.1016/j.chbr.2024.100538
Farid, H. (2022). Creating, using, misusing, and detecting deep fakes. Journal of Online Trust and Safety, 1(4). https://doi.org/10.54501/jots.v1i4.56
Grassini, S. (2024). A psychometric validation of the PAILQ-6: Perceived Artificial Intelligence Literacy Questionnaire. ACM International Conference Proceeding Series. https://doi.org/10.1145/3679318.3685359
Hair, J. F., Hult, G. T. M., Ringle, C. M., Sarstedt, M., Danks, N. P., & Ray, S. (2022). Partial least squares structural equation modeling (PLS-SEM) using R: A workbook. Springer.
Jeong Ha, A. Y., Passananti, J., Bhaskar, R., Shan, S., Southen, R., Zheng, H., & Zhao, B. Y. (2024). Organic or diffused: Can we distinguish human art from AI-generated images? Proceedings of the 2024 ACM SIGSAC Conference on Computer and Communications Security, 4822-4836. https://doi.org/10.1145/3658644.3670306
Kementerian Komunikasi dan Digital Republik Indonesia. (2025, January 8). Komdigi identifikasi 1.923 konten hoaks sepanjang tahun 2024. https://www.komdigi.go.id/berita/siaran-pers/detail/komdigi-identifikasi-1923-konten-hoaks-sepanjang-tahun-2024
Kim, J. S., Kim, M., & Baek, T. H. (2025). Enhancing user experience with a generative AI chatbot. International Journal of Human-Computer Interaction, 41(1), 651-663. https://doi.org/10.1080/10447318.2024.2311971
Liao, Q. V., Gruen, D., & Miller, S. (2020). Questioning the AI: Informing design practices for explainable AI user experiences. Conference on Human Factors in Computing Systems - Proceedings. https://doi.org/10.1145/3313831.3376590
Long, D., & Magerko, B. (2020). What is AI literacy? Competencies and design considerations. Conference on Human Factors in Computing Systems - Proceedings. https://doi.org/10.1145/3313831.3376727
Maiano, L., Benova, A., Papa, L., Stockner, M., Marchetti, M., Convertino, G., Mazzoni, G., & Amerini, I. (2024). Human versus machine: A comparative analysis in detecting artificial intelligence-generated images. IEEE Security and Privacy, 22(3), 77-86. https://doi.org/10.1109/MSEC.2024.3390555
Ng, D. T. K., Leung, J. K. L., Chu, S. K. W., & Qiao, M. S. (2021). Conceptualizing AI literacy: An exploratory review. Computers and Education: Artificial Intelligence, 2. https://doi.org/10.1016/j.caeai.2021.100041
Nightingale, S. J., & Farid, H. (2022). AI-synthesized faces are indistinguishable from real faces and more trustworthy. Proceedings of the National Academy of Sciences of the United States of America, 119(8). https://doi.org/10.1073/pnas.2120481119
Otoritas Jasa Keuangan. (2025, November 15). Satgas PASTI imbau masyarakat waspadai penipuan menggunakan artificial intelligence. https://ojk.go.id/id/berita-dan-kegiatan/info-terkini/Pages/Satgas-PASTI-Imbau-Masyarakat-Waspadai-Penipuan-Menggunakan-AI.aspx
Pennycook, G., & Rand, D. G. (2021). The psychology of fake news. Trends in Cognitive Sciences, 25(5), 388-402. https://doi.org/10.1016/j.tics.2021.02.007
Sarstedt, M., Ringle, C. M., & Hair, J. F. (2021). Partial least squares structural equation modeling. In Handbook of market research (pp. 1-47). Springer International Publishing. https://doi.org/10.1007/978-3-319-05542-8_15-2
Vaccari, C., & Chadwick, A. (2020). Deepfakes and disinformation: Exploring the impact of synthetic political video on deception, uncertainty, and trust in news. Social Media and Society, 6(1). https://doi.org/10.1177/2056305120903408
Wang, B., Rau, P. L. P., & Yuan, T. (2023). Measuring user competence in using artificial intelligence: Validity and reliability of artificial intelligence literacy scale. Behaviour and Information Technology, 42(9), 1324-1337. https://doi.org/10.1080/0144929X.2022.2072768
Wang, C., Wang, H., Li, Y., Dai, J., Gu, X., & Yu, T. (2025). Factors influencing university students' behavioral intention to use generative artificial intelligence: Integrating the Theory of Planned Behavior and AI Literacy. International Journal of Human-Computer Interaction, 41(11), 6649-6671. https://doi.org/10.1080/10447318.2024.2383033
Zhang, H., Lee, I., Ali, S., DiPaola, D., Cheng, Y., & Breazeal, C. (2023). Integrating ethics and career futures with technical learning to promote AI literacy for middle school students: An exploratory study. International Journal of Artificial Intelligence in Education, 33(2), 290-324. https://doi.org/10.1007/s40593-022-00293-3
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Dani Surya Wijaya, So Yohanes Jimmy, Trihadi Pudiawan Erhan
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
info@itscience.org, web: 
