MEASURING EDUCATIONAL IMPACT BEYOND THE CLASSROOM: A DUAL STUDENT–COMMUNITY EVALUATION FRAMEWORK FOR ACCOUNTING EDUCATION PROGRAMMES
DOI:
https://doi.org/10.35631/IJMOE.831120Keywords:
Accounting Education Programmes, Dual Student-Community Evaluation Framework, Evaluation Framework, Kirkpatrick Evaluation Model, Knowledge Transfer Programme, Logic Model, Service-Learning Malaysia–University for Society, University Social ResponsibilityAbstract
Accounting schools increasingly conduct University Social Responsibility (USR), Knowledge Transfer Programme (KTP), and Service-Learning Malaysia–University for Society (SULAM) initiatives to extend learning beyond the traditional classroom. Evaluation of these initiatives, however, often emphasises participation, completed activities, satisfaction, institutional indicators, and awards. Such measures establish implementation and reach but do not, by themselves, demonstrate learning, behavioural transfer, community capacity development, or longer-term results. Three related evaluation gaps therefore remain: an emphasis on outputs rather than outcomes, the tendency to privilege student evidence over community-partner outcomes, and the lack of an integrated approach that connects programme implementation with multi-level evaluation of change. This theoretical conceptual paper proposes a dual student–community evaluation framework for accounting education programmes by integrating the Kirkpatrick Evaluation Model (reaction, learning, behaviour, and results) with a programme logic model linking needs, inputs, activities, outputs, and outcomes. The conceptual contribution lies in assigning complementary functions to the two models: the logic model explains how a programme is expected to generate change, while Kirkpatrick structures the level at which change is assessed. These functions are applied through two related but non-substitutable evaluation pathways for students and community partners. Three Faculty of Accountancy programmes; i-Asnaf ACT and Financial Literacy, SULAM with small and medium-sized enterprises (SMEs), and the Secondary School Accounting USR Programme, are used as illustrative, rather than representative, cases because they reflect different forms of accounting-related community engagement, beneficiary groups, and intended outcomes. The framework proposes beneficiary-specific indicators, evidence sources, evaluation periods, community participation in defining success, clear distinctions between outputs and outcomes, and assessment of contribution rather than claims of causality unless sufficient evidence supports attribution. The framework provides accounting educators, faculty administrators, and community partners with a structured basis for defining programme success, selecting appropriate evidence, planning follow-up evaluation, distinguishing programme outputs from educational and community outcomes, and reporting programme contributions without unsupported causal claims.
Downloads
References
Alsalamah, A., & Callinan, C. (2021). Adaptation of Kirkpatrick’s Four-Level Model of Training Criteria to Evaluate Training Programmes for Head Teachers. Education Sciences, 1-25. doi:https://doi.org/10.3390/educsci11030116
Anwar Ibrahim. (2022). Membangun Negara MADANI: Visi dan Kerangka Dasar Reformasi. IDE Research Centre Sdn Bhd. Retrieved from https://malaysiamadani.gov.my/pengenalan/
Cahapay, M. B. (2021). Kirkpatrick Model: Its Limitations as Used in Higher Education Evaluation. International Journal of Assessment Tools in Education, 135-144. doi:https://doi.org/10.21449/ijate.856143
Carnegie, G., Parker, L., & Tsahuridu, E. (2021a). It’s 2020: what is accounting today? Australian Accounting Review, 65-73. doi:https://doi.org/10.1111/auar.12325
Carnegie, G., Parker, L., & Tsahuridu, E. (2021b). Redefining Accounting for Tomorrow. IS Chartered Accountant Journal, 42-45.
Chika-James, T. A., Salem, T., & Oyet, M. C. (2022). Our Gains, Pains and Hopes: Community Partners’ Perspectives of Service-Learning in an Undergraduate Business Education. SAGE Open, 1-20. doi:https://doi.org/10.1177/21582440211069390
Financial Education Network. (2025). Malaysia National Strategy for Financial Literacy 2026-2030: Shaping a Resilient Financial Future. Bank Negara Malaysia.
Jamil, N., Laipan, R. A., Jeffrey Nasah, C., & Abd Rahim, F. (2026). Transformative role of SULAM in advancing sustainability and Madani values in Malaysian higher education. Discover Education, 1-19. doi:https://doi.org/10.1007/s44217-026-01491-0
Kirkpatrick, D. L., & Kirkpatrick, J. D. (2006). Evaluating Training Programs: The Four Levels (Third Edition). Berrett-Koehler Publishers.
Lau, K. H., & Snell, R. S. (2023). The Development of the Community Impact Feedback Questionnaire for Service-Learning: A Delphi Study. Metropolitan Universities, 1-27. doi:https://doi.org/10.18060/26112
Lau, K. H., Lam, L., Snell, R. S., & Ma, C. (2024). Validation of Service-Learning Outcomes Measurement Scale-Short Version (S-LOMS-SV) With New Samples and Cross-Cultural Comparisons. Journal of Experiential Education, 1-27. doi:https://doi.org/10.1177/10538259241291779
Lawson, R., Blocher, E., Brewer, P., Cokins, G., Sorensen, J., Stout, D., . . . Wouters, M. (2014). Focusing Accounting Curricula on Students’ Long-Run Careers: Recommendations for an Integrated Competency-Based Framework for Accounting Education. American Accounting Association, 295-317. doi:https://doi.org/10.2308/iace-50673
Lee, W., & Perdana, A. (2023). Reprint of: Effects of experiential service learning in improving community engagement perception, sustainability awareness, and data analytics competency. Journal of Accounting Education. doi:https://doi.org/10.1016/j.jaccedu.2023.100846
Lin, S., Ngai, G., Kwan, K. P., Chan, S. C., & Lo, K. W. (2025). Mandatory Academic service learning and Continual Civic Engagement: Which Learning Outcomes Matter? The Asia-Pacific Education Researcher, 965-974. doi:https://doi.org/10.1007/s40299-024-00911-9
Lumillo, I., Escofet, A., Sola, M., & Morin-Fraile, V. (2025). What is the Social Impact of University Service-Learning Projects on Citizens and Community Organizations? A Scoping Review. International Journal of Research on Service-Learning & Community Engagement, 1-38. doi:https://doi.org/10.37333/001c.146138
Marco-Gardoqui, M., Eizaguirre, A., & Garcia-Feijoo, M. (2020). The impact of service-learning methodology on business schools' students worldwide: A systematic literature review. PLOS ONE, 1-21. doi:https://doi.org/10.1371/journal.pone.0244389
Ministry of Education Malaysia. (2015). Malaysia Education Blueprint 2015-2025 (Higher Education). Retrieved from https://www.mohe.gov.my/en/download/publications-journals-and-reports/pppm-2015-2025-pt/102-malaysia-education-blueprint-2015-2025-higher-education/file
Ministry of Entrepreneur Development and Cooperatives. (2019). National Entrepreneurship Policy (NEP) 2030. Ministry of Entrepreneur Development and Cooperatives. Retrieved from https://www.kuskop.gov.my/admin/files/med/image/portal/NEP2030-Final.pdf
Ministry of Higher Education. (2025). Malaysia Higher Education Blueprint 2026-2035. MInistry of Higher Education. Retrieved from https://www.mohe.gov.my/en/download/publications-journals-and-reports/malaysia-higher-education-blueprint/1820-executivesummary-malaysiahighereducationblueprint-pdf/file
Ministry of Housing and Local Government. (2017). National Rural Physical Policy (NRRP) 2030. Ministry of Housing and Local Government;. Retrieved from https://myplan.planmalaysia.gov.my/admin/uploads_publication/pdf_20240209105521_2.pdf
Ministry of Housing and Local Government Malaysia. (2018). National Community Policy. Ministry of Housing and Local Government Malaysia;. Retrieved from https://www.kpkt.gov.my/kpkt/resources/user_1/MENGENAI%20KPKT/DASAR/National_Community_Policy_Book.pdf
Mohd Naufal, W., Syed Aris, S., Wahi, R., Mohamed, A., Zulkipli, Z., Awang Hashim, R., . . . Mohd Yusof, M. (2024). Key Success Factors for Implementation of Service-Learning Malaysia University for Society (SULAM) Projects at Higher Education Level: Community Perspectives. Asian Journal of University Education, 152-172. doi:https://doi.org/10.24191/ajue.v20i1.25824
Rama, D. (1998). Learning By Doing: Concepts and Models for Service-Learning in Accounting (First Edition). Routledge.
Snell, R. S., & Lau, K. H. (2022). Assessing Community Impact After Service-Learning: A Conceptual Framework. Springer Singapore. Retrieved from 10.1007/978-981-19-2437-8_16
UiTM Fakulti Perakaunan. (2025). Laporan Anugerah Kualiti Naib Canselor (AKNC) Fakulti Perakaunan: Jaringan Alumni, Komuniti dan Kesukarelawan. Universiti Teknologi MARA (UiTM).
W.K. Kellog Foundation. (2004). Logic Model Development Guide: Using Logic Models to Bring Together Planning, Evaluation, and Action. Michigan: W.K. Kellog Foundation.
Wahab, M. H. (2024). Evaluating the Impact of Service-Learning Malaysia-University for Society (SULAM) on Student Learning and Community Engagement. International Journal of Academic Research in Progressive Education & Development, 2080-2096. doi:https://doi.org/10.6007/IJARPED/v13-i3/22077
Yu, D. D. (2011). Achieving Service-Learning Goals in a Financial Accounting Class Project. New Horizons in Education, 95-105.
