DEVELOPMENT AND PRELIMINARY PSYCHOMETRIC EVALUATION OF A CIPP-ALIGNED INSTRUMENT FOR ALTERNATIVE ASSESSMENT IN SPECIAL EDUCATION
DOI:
https://doi.org/10.35631/IJEPC.1164115Keywords:
Alternative Assessment, CIPP Model, Instrument Development, Pilot Study, Psychometric Validation, SEN PupilsAbstract
Alternative assessment programmes for special educational needs (SEN) pupils have expanded through policy mandates in Malaysia, yet no validated instrument exists for evaluating implementation fidelity across the Context, Input, Process, and Product (CIPP) dimensions. In this study, implementation fidelity refers to the extent to which the Primary Education Alternative Assessment (Pentaksiran Alternatif Pendidikan Rendah, PAPR) is enacted according to its intended CIPP components. This study developed and conducted preliminary psychometric evaluation of a CIPP-aligned instrument for assessing PAPR implementation in Special Education Integration Programmes (Program Pendidikan Khas Integrasi, PPKI). Item generation drew on literature and policy documents, guided by adult learning theory (informing Input items on teacher readiness and CPD), reflective practice (Process items on daily routines), and competency-based education frameworks (Product items on learning outcomes). Content validity was established through review by six education specialists with 10 to 34 years of experience, yielding item-level Content Validity Index (I-CVI) values of 0.98 to 0.99 and a scale-level S-CVI/Ave of 0.99, exceeding recommended thresholds. A pilot study with 70 special education teachers in Sabah was conducted. Exploratory factor analysis produced a preliminary structure for the instrument with Kaiser-Meyer-Olkin values 0.677 to 0.875, Bartlett's tests were significant (p < .001), and the total variance explained ranged from 48.43% to 79.67%. Six items were removed for weak associations with their constructs, leaving 114 items from 120 items that preserved CIPP dimensions coverage. Internal consistency was good to excellent, with Cronbach's alpha values between 0.821 and 0.941. The findings provide initial evidence of content validity and construct structure for a CIPP-aligned PAPR implementation instrument, while confirmatory factor analysis with a larger, stratified sample is recommended before wider deployment.
Downloads
References
Abdul Manap, M. H., Haron, Z., & Othman, N. (2020). Penilaian pelaksanaan program pentaksiran alternatif sekolah rendah (PASR) di sekolah rendah pendidikan khas integrasi. Jurnal Pendidikan Malaysia, 45(Special Issue), 9–16. https://doi.org/10.17576/JPEN-2020-45.01SI-02
Agus, A., Juliadharma, M., & Djamaluddin, M. (2023). Application of the CIPP model in evaluation of the inclusive education curriculum in Madrasah Aliyah. Nidhomul Haq: Jurnal Manajemen Pendidikan Islam, 8(1). https://doi.org/10.31538/ndh.v8i1.2705
Ahmad, N., & Ismail, R. (2020). Challenges in operationalising Alternative Assessment for Primary School as a school-based alternative assessment. Journal of Education Assessment Research, 28(1), 33–47.
Ahmad, N., Ismail, R., & Manap, R. (2021). Validation of teaching, learning, and assessment quality instrument in Malaysian early-childhood context. International Journal of Education Measurement, 39(3), 112–129.
Ang, L. L., & Phoon, H. S. (2025). Behavioural management challenges and support needs in inclusive classrooms in Malaysia. Asia Pacific Journal of Educators and Education, 40(1), 269–292. https://doi.org/10.21315/apjee2025.40.1.14
Black, P., & Wiliam, D. (2018). Classroom assessment and pedagogy. Assessment in Education: Principles, Policy & Practice, 25(6), 551–575. https://doi.org/10.1080/0969594X.2018.1441807
Black, P., & Wiliam, D. (2022). Classroom assessment and the improvement of learning. Assessment in Education: Principles, Policy & Practice, 27(1), 1–12. https://doi.org/10.1080/0969594X.2022.2048134
Bujang, M. A., Omar, E. D., Foo, D. H. P., & Hon, Y. K. (2024). Sample size determination for conducting a pilot study to assess reliability of a questionnaire. Restorative Dentistry & Endodontics, 49(1), e3. https://doi.org/10.5395/rde.2024.49.e3
Cheung, G. W. (2024). Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations. Asia Pacific Journal of Management, 41(2), 507–548. https://doi.org/10.1007/s10490-023-09871-y
Cohen, L., Manion, L., & Morrison, K. (2018). Research methods in education (8th ed.). Routledge. https://doi.org/10.4324/9781315456539
Creswell, J. W., & Creswell, J. D. (2023). Research design: Qualitative, quantitative, and mixed methods approaches (6th ed.). Sage Publications.
de Winter, J. C. F., & Dodou, D. (2010). Five-point Likert items: tt test versus Mann-Whitney-Wilcoxon. Practical Assessment, Research & Evaluation, 15(11), 1–12. https://www.researchgate.net/publication/266212127_FivePoint_Likert_Items_t_Test_Versus_Mann-Whitney-Wilcoxon
Dewi, N. K. (2024). A program evaluation study using CIPP model. International Journal of Learning, Teaching and Educational Research, 23(3), 1–15. https://ijlter.org/index.php/ijlter/article/view/12859/0
Examinations Board, Ministry of Education Malaysia. (2016). Surat Pekeliling Ikhtisas KPM Bil. 3 Tahun 2016: Pelaksanaan Pentaksiran Alternatif Sekolah Rendah (PASR) Murid Berkeperluan Khas mulai tahun 2016. Lembaga Peperiksaan, Kementerian Pendidikan Malaysia. https://lp.moe.gov.my/index.php/pekeliling-siaran/surat-pekeliling-lembaga-peperiksaan
Examinations Board, Ministry of Education Malaysia. (2026). Garis Panduan pengurusan Pentaksiran Alternatif Pendidikan Rendah (PAPR) edisi 4 tahun 2026. Lembaga Peperiksaan, Kementerian Pendidikan Malaysia. https://lp.moe.gov.my/files/papr/2026/Garis%20Panduan%20Pentadbiran%20PAPR%20Edisi%20Keempat.pdf
Ghazali, N. H. C. M., Hamzah, M., Abdullah, N., & Zaini, S. H. (2019). Validation of an instrument to measure the feedback conceptions scale. International Journal of Academic Research in Business and Social Sciences, 9(7). https://doi.org/10.6007/IJARBSS/v9-i7/6091
Gray, D. E. (2021). Doing research in the real world (5th ed.). Sage.
Gültürk, O. (2024). Minimum sample size requirements for SEM: A methodological review. Journal of Quantitative Social Research, 6(2), 45–59.
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2019). Multivariate data analysis (8th ed.). Cengage Learning.
Hatem, G., Zeidan, J., Goossens, M., & Moreira, C. (2022). Normality testing methods and the importance of skewness and kurtosis in statistical analysis. BAU Journal – Science and Technology, 3(2), Article 7. https://doi.org/10.54729/KTPE9512
Howard, M. C. (2023). A systematic literature review of exploratory factor analyses in premier journals. Journal of Business Research, 163, 113959. https://doi.org/10.1016/j.jbusres.2023.113959
Kalkbrenner, M. T. (2021). A practical guide to instrument development and score validation in the social sciences: The MEASURE approach. Practical Assessment, Research, and Evaluation, 26(1), 1–15. https://doi.org/10.7275/svg4-e671
Kasdiah, M. A. H., Amdan, M. A., & Janius, N. (2024). The impact of school infrastructure on learning among rural areas in Sabah, Malaysia. UNITAR International University – Education and Humanities Proceedings, 3, 224–230.
Khamidah, S., & Sanoto, H. (2025). Evaluating inclusive education implementation using the CIPP model. Journal of Innovation and Research in Primary Education, 4(4). https://doi.org/10.56916/jirpe.v4i4.1874
Kline, R. B. (2023). Principles and practice of structural equation modeling (5th ed.). Guilford Press.
Knowles, M. S., Holton, E. F., Swanson, R. A., & Robinson, P. A. (2020). The adult learner (9th ed.). Routledge.
Koo, M., & Yang, S.-W. (2025). Likert-type scale. Encyclopedia, 5(1), 18. https://doi.org/10.3390/encyclopedia5010018
Levy-Feldman, I. (2025). The role of assessment in improving education and promoting educational equity. Education Sciences, 15(2), 224. https://doi.org/10.3390/educsci15020224
Liu, M., Vu, T., van Atteveldt, N., & Meeter, M. (2023). Testing the reciprocal effect between value of education, time investment, and academic achievement in a large non-Western sample. Journal of Intelligence, 11(7), 133. https://doi.org/10.3390/jintelligence11070133
MCRCR. (2021). Malaysian Code of Responsible Conduct in Research. Ministry of Higher Education Malaysia.
Memon, M. A., Ting, H., Cheah, J.-H., Thurasamy, R., Chuah, F., & Cham, T. H. (2020). Sample size for survey research: Review and recommendations. Journal of Applied Structural Equation Modeling, 4(2), 1–19. https://doi.org/10.47263/JASEM.4(2)01
Ministry of Economy Malaysia. (2023). Malaysia Madani: Ekonomi MADANI–Memperkasa rakyat. Ministry of Economy Malaysia.
Ministry of Education Malaysia. (2023). Pelan Pembangunan Pendidikan Malaysia 2013–2025 (PPPM 2013–2025). Kementerian Pendidikan Malaysia. https://www.moe.gov.my
Ministry of Education Malaysia. (2026). Malaysia Education Blueprint 2026–2035. Ministry of Education Malaysia. https://www.moe.gov.my
Ministry of Finance Malaysia. (2023). Budget 2023: Belanjawan Madani. Ministry of Finance Malaysia.
Mulder, M. (2019). Foundations of competence-based vocational education and training. In S. McGrath, M., J. Papier, & R. Suart (Eds.), Handbook of vocational education and training (pp. 1–18). Springer. https://doi.org/10.1007/978-3-319-49789-1_65-1
OECD. (2020). PISA 2018 results: Where all students can succeed. OECD Publishing. https://doi.org/10.1787/e8d27ed2-en
Ofem, U. J., & Usoro, A. A. (2024). Alternative assessment practices in inclusive classrooms: A review. International Journal of Educational Research, 125, 102341.
Patrick, J., Nordin, M. N., & Amat, S. (2026). The perspective of special education teachers on evidence management in the implementation of the Primary School Alternative Assessment (PAPR). International Journal of Research and Innovation in Social Science, 10(26), 59–68. https://doi.org/10.47772/IJRISS.2026.1026EDU0004
Penang Institute. (2025). Bridging the digital divide in Malaysian education: Policy briefs on infrastructure, access and equity. Penang Institute.
Polit, D. F., & Beck, C. T. (2021). Nursing research: Generating and assessing evidence for nursing practice (11th ed.). Wolters Kluwer.
Quinney, S. (2021). Inclusive assessment for special educational needs. Support for Learning, 36(4), 562–580. https://doi.org/10.1111/1467-9604.12369
Razali, N. F. Y. M., Mahmud, R., & Aziz, A. (2021). E-portfolio implementation in Malaysian schools: A need analysis. International Journal of Academic Research in Progressive Education and Development (Vol.10, Issue 4, pp. 60-70) https://doi.org/10.6007/IJARPED/v10-i4/11842
Sanusi, N., Zulkifli, H., & Hamzah, M. I. (2025). Challenges, opportunities, and effects of alternative assessment approaches in teaching practices: A systematic review. International Journal of Educational Research & Evaluation, 14(2), 1105–1113. https://doi.org/10.11591/ijere.v14i2.32283
Saunders, M., Lewis, P., & Thornhill, A. (2019). Research methods for business students (8th ed.). Pearson Education Limited.
Stufflebeam, D. L., & Zhang, G. (2022). The CIPP evaluation model: How to evaluate for improvement and accountability. Guilford Press.
Sulaiman, L. H., & Tahar, M. M. (2024). Implementation of universal learning design principles by mainstream teacher in inclusive education programs. Special Education, 2(1). https://doi.org/10.59055/se.v2i1.15
UNESCO. (2020). Global education monitoring report 2020: Inclusion and education. https://unesdoc.unesco.org/ark:/48223/pf0000373718
Ying, X., Freedland, K. E., Powell, L. H., Stuart, E. A., Ehrhardt, S., & Mayo-Wilson, E. (2025). Determining sample size for pilot trials: A tutorial. BMJ 2025; 390, . https://doi.org/10.1136/bmj-2024-083405
Zhao, T., Yu, L., Jiang, X., Yang, S., Zhang, M., Zhang, Y., … Xu, F. (2025). Construction of a public health practice teaching quality evaluation system based on the CIPP model. BMC Medical Education, 25. https://doi.org/10.1186/s12909-025-06943-z
