CONCEPTUALIZING AND VALIDATING SOCIO-ALGORITHMIC AI LITERACY (SAILS) AMONG MALAYSIAN UNIVERSITY STUDENTS: A PROPOSED FRAMEWORK
DOI:
https://doi.org/10.35631/JISTM.1144037Keywords:
Socio-Algorithmic AI Literacy, Scale Development, CASA Paradigm, Higher Education, Information EvaluationAbstract
The current measures of AI literacy tools assess technical skills, mechanics of prompt engineering, and basic ethical considerations but do not account for socio-algorithmic vulnerability or increased susceptibility to cognitive persuasion, uncritical trust, and unintended privacy breaches due to conversational interface persuasion tactics. Drawing on theoretical constructs such as CASA (Computers Are Social Actors), Dual Process Theory, and Information Literacy. Socio-Algorithmic AI Literacy (SAIL) is defined as the psychological and behavioral ability of an individual to be aware of, assess, and reject mindless social scripts triggered through the interaction of humans with human-like AI. This study provides a theoretical framework for the development and validation of Socio-Algorithmic AI Literacy Scale (SAILS) for HEI students from Malaysia. By advancing AI literacy beyond mere operational knowledge towards identification and management of socio-algorithmic risks, SAILS is able to provide a reliable instrument for assessing the readiness of students in this regard at the Ministry of Higher Education Malaysia, university senates, and academic libraries.
Downloads
References
Almatrafi, O., Johri, A., & Lee, H. (2024). A systematic review of AI literacy conceptualization, constructs, and implementation and assessment efforts (2019–2023). Computers and Education Open, 6, 100177. https://doi.org/10.1016/j.caeo.2024.100177
Association of College and Research Libraries (ACRL). (2016). Framework for information literacy for higher education. Association of College and Research Libraries.
Association of College and Research Libraries. (2016). Framework for information literacy for higher education. Association of College and Research Libraries.
Bawden, D., & Robinson, L. (2022). Introduction to information science (2nd ed.). Facet Publishing.
Carolus, A., Schmidt, C., Schneider, F., Mayr, J., & Muench, R. (2018). Are people polite to smartphones?: How evaluations of smartphones depend on who is asking. In Lecture Notes in Computer Science (Vol. 10902, pp. 500–511). Springer. https://doi.org/10.1007/978-3-319-91244-8_39
Cochran, W. G. (1977). Sampling techniques (3rd ed.). John Wiley & Sons.
DeVellis, R. F., & Thorpe, C. T. (2021). Scale development: Theory and applications (5th ed.). SAGE Publications.
Do, H. V., Bui, T. T., Hoa Tran, D., & Dinh, L. D. (2026). Developing and validating an AI literacy scale for university students in Vietnam. IFLA Journal, 52(2), 222–233. https://doi.org/10.1177/03400352251310123
Doyle, M., Foster, B., & Yukhymenko-Lescroart, M. A. (2019). Development and testing of the Perception of Information Literacy Scale (PILS). The Journal of Academic Librarianship, 45(6), Article 102064. https://doi.org/10.1016/j.acalib.2019.102064
Field, A. (2018). Discovering statistics using IBM SPSS statistics (5th ed.). SAGE Publications.
Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.1177/002224378101800104
Gambino, A., Fox, J., & Ratan, R. A. (2020). Building a stronger CASA: Extending the Computers Are Social Actors paradigm. Human-Machine Communication, 1(1), 71–85. https://doi.org/10.30658/hmc.1.5
Ghosh, C., & Eastin, M. S. (2020). Understanding users’ relationship with voice assistants and how it affects privacy concerns and information disclosure behavior. Lecture Notes in Computer Science, 12210, 381–392. https://doi.org/10.1007/978-3-030-50309-3_25
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2019). Multivariate data analysis (8th ed.). Cengage Learning.
Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2022). A primer on partial least squares structural equation modeling (PLS-SEM) (3rd ed.). SAGE Publications.
Henseler, J., Ringle, C. M., & Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the Academy of Marketing Science, 43(1), 115–135. https://doi.org/10.1007/s11747-014-0403-8
Henseler, J., Ringle, C. M., & Sarstedt, M. (2016). Testing measurement invariance of composites using PLS. International Marketing Review, 33(3), 405–431. https://doi.org/10.1108/IMR-09-2014-0304
Heyselaar, E. (2023). The CASA theory no longer applies to desktop computers. Scientific Reports, 13(1), Article 19693. https://doi.org/10.1038/s41598-023-46527-9
Howard, M. C. (2016). A review of exploratory factor analysis decisions and overview of current practices: What we are doing and how can we improve? International Journal of Human–Computer Interaction, 32(1), 51–62. https://doi.org/10.1080/10447318.2015.1087664
Jöreskog, K. G. (1971). Statistical analysis of sets of congeneric tests. Psychometrika, 36(2), 109–133. https://doi.org/10.1007/BF02291393
Kahneman, D. (2011). Thinking, fast and slow. Farrar, Straus and Giroux.
Kaiser, H. F. (1974). An index of factorial simplicity. Psychometrika, 39(1), 31–36. https://doi.org/10.1007/BF02291575
Keleher, M., Baig, K., & Chiasson, S. (2026). The privacy triad: Understanding the influence of perceived social agency on privacy attitudes. International Journal of Human Computer Studies, 210. https://doi.org/10.1016/j.ijhcs.2026.103752
Koch, M. J., Carolus, A., Wienrich, C., & Latoschik, M. E. (2023). MAILS-Meta AI literacy scale: Development and testing of an AI literacy questionnaire based on well-founded competency models and psychological change-and meta-competencies. Computers in Human Behavior: Artificial Humans, 1(2). https://doi.org/10.1016/j.chbah.2023.100014
Lee, E.-J. (2024). Minding the source: Toward an integrative theory of human–machine communication. Human Communication Research, 50(2), 184–193. https://doi.org/10.1093/hcr/hqad034
Liu, X., Zhang, W., & Zhang, Y. (2025). Generative Artificial Intelligence Literacy: Scale development and its effect on job performance. Digital Government: Research and Practice, 6(1), 1–21. https://doi.org/10.1145/3708123
Long, D., & Magerko, B. (2020). What is AI literacy? Competencies and design considerations. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (pp. 1–16). Association for Computing Machinery. https://doi.org/10.1145/3313831.3376727
Lynn, M. R. (1986). Determination and quantification of content validity. Nursing Research, 35(6), 382–386. https://doi.org/10.1097/00006199-198611000-00017
MacKenzie, S. B., Podsakoff, P. M., & Podsakoff, N. P. (2011). Construct measurement and validation procedures in theory testing and development for leadership research. The Leadership Quarterly, 22(2), 293–334. https://doi.org/10.1016/j.leaqua.2011.02.006
Masrek, M. N., Mohamad Rosman, M. R., Mohamed Shuhidan, S., Baharuddin, M. F., Mutia, F., Soesantari, T., Yuwinanto, H. P., & Atmi, R. T. (2025). Artificial intelligence readiness in Malaysian libraries: An assessment framework. Journal of Applied Science, Engineering, Technology, and Education, 7(2), 181–194. https://doi.org/10.35877/454RI.asci3875
Memon, M. A., Ting, H., Cheah, J.-H., Thurasamy, R., Chuah, F., & Cham, T. H. (2020). Sample size for survey research: Review and recommendations. Journal of Applied Structural Equation Modeling, 4(2), i–xx. https://doi.org/10.47263/JASEM.4(2)01
Ministry of Science, Technology and Innovation. (2024). National guidelines on artificial intelligence governance and ethics (AIGE). Government of Malaysia. https://www.malaysia.gov.my/en/my-initiative/perkhidmatan-digital-keseluruhan-kerajaan/tadbir-urus/national-guidelines-on-artificial-intelligence-governance-and-ethics-aige
Nass, C., & Moon, Y. (2000). Machines and mindlessness: Social responses to computers. Journal of Social Issues, 56(1), 81–103. https://doi.org/10.1111/0022-4537.00153
Nass, C., Steuer, J., & Tauber, E. R. (1994). Computers are social actors. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 72–78). Association for Computing Machinery. https://doi.org/10.1145/259963.260288
Ngo, V. (2026). Humanizing AI for trust: The critical role of social presence in adoption. AI and Society, 41(3), 1803–1819. https://doi.org/10.1007/s00146-025-02506-4
Ngo, V. (2026). Humanizing AI for trust: The critical role of social presence in adoption. AI & SOCIETY, 41(3), 1803–1819. https://doi.org/10.1007/s00146-025-02506-4
Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). McGraw-Hill.
OECD/European Union. (2026). Empowering learners for the age of AI: An AI literacy framework for primary and secondary education. OECD Publishing. https://doi.org/10.1787/65cd27d4-en
Organisation for Economic Co-operation and Development. (2026). PISA 2029 Media and Artificial Intelligence Literacy (MAIL) Assessment Framework (First Draft). OECD Publishing.
Petronio, S. (2002). Boundaries of privacy: Dialectics of disclosure. State University of New York Press.
Polit, D. F., & Beck, C. T. (2006). The content validity index: Are you sure you know what's being reported? Critique and recommendations. Research in Nursing & Health, 29(5), 489–497. https://doi.org/10.1002/nur.20147
Polit, D. F., Beck, C. T., & Owen, S. V. (2007). Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in Nursing & Health, 30(4), 459–467. https://doi.org/10.1002/nur.20199
Reeves, B., & Nass, C. (1996). The media equation: How people treat computers, television, and new media like real people and places. Cambridge University Press.
Ringle, C. M., Wende, S., & Becker, J.-M. (2024). SmartPLS 4 [Computer software]. SmartPLS. https://www.smartpls.com
Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36. https://doi.org/10.18637/jss.v048.i02
Sekaran, U., & Bougie, R. (2016). Research methods for business: A skill-building approach (7th ed.). Wiley.
Shin, D., Rasul, A., & Fotiadis, A. (2022). Why am I seeing this? Deconstructing algorithm literacy through the lens of users. Internet Research, 32(4), 1214–1234. https://doi.org/10.1108/INTR-02-2021-0087
Shmueli, G., Sarstedt, M., Hair, J. F., Cheah, J.-H., Ting, H., Vaithilingam, S., & Ringle, C. M. (2019). Predictive model assessment in PLS-SEM: Guidelines for using PLSpredict. European Journal of Marketing, 53(11), 2322–2347. https://doi.org/10.1108/EJM-02-2019-0189
Sotero, J. M., Vicente, P. N., & Granado, A. (2026). Development and validation of a scale to assess algorithmic literacy in the context of recommender systems (ALRS). Technology in Society, 85, Article 103237. https://doi.org/10.1016/j.techsoc.2026.103237
Sundar, S. S. (2008). The MAIN model: A heuristic approach to understanding technology effects on credibility. In M. Metzger & A. Flanagin (Eds.), Digital media, youth, and credibility (pp. 73–100). The MIT Press.
Tabachnick, B. G., & Fidell, L. S. (2019). Using multivariate statistics (7th ed.). Pearson.
Xu, K., Chen, X., & Huang, L. (2022). Deep mind in social responses to technologies: A new approach to explaining the Computers are Social Actors phenomena. Computers in Human Behavior, 134, 107321. https://doi.org/10.1016/j.chb.2022.107321
Yusnilzahri, N. A. S., Rosman, M. R. M., & Bahry, F. D. S. (2025). AI literacy among undergraduates: Determinants and productivity outcomes in a Malaysian comprehensive university. Malaysian Journal of Library and Information Science, 30(1), 45–68. https://doi.org/10.22452/mjlis.vol30no1.3
Zhou, X., Lee, H., & Huang, Y. (2025). Defining, enhancing, and assessing artificial intelligence literacy and competency in K-12 and higher education: A systematic review. Interactive Learning Environments, 33(4), 1102–1125. https://doi.org/10.1080/10494820.2025.2487538
