CONTENT VALIDITY AND RELIABILITY OF THE FUNCTIONAL ABILITIES ASSESSMENT INSTRUMENT FOR PUPILS WITH SPECIAL EDUCATIONAL NEEDS
DOI:
https://doi.org/10.35631/IJEPC.1162044Keywords:
Assessment, Content Validation, Functional Abilities, ICF-CY, Instrument, Pupils with Special Educational Needs, Rasch AnalysisAbstract
Functional abilities encompass adaptive skills essential for developing independence in daily tasks, with rapid acquisition occurring during early childhood. Assessing these abilities is crucial in education programs to ensure timely interventions for learners with additional support needs. Even though international functional assessment tools are available, there are few validated instruments for Malaysian primary school pupils with special educational needs. Therefore, this study evaluates the content validity and reliability of a newly developed functional abilities assessment instrument for Malaysian primary school pupils with special educational needs. A multidisciplinary panel of experts reviewed the instrument for fairness, relevance, clarity, and ease of understanding. The Scale-Level Content Validity Index (S-CVI) results demonstrated strong agreement among experts. Some items were removed or revised based on the Item-Level Content Validity Index (I-CVI) and modified kappa coefficients (k*). The Rasch Measurement Model was applied across three domains to examine internal construct validity and reliability, revealing strong psychometric properties, particularly for the Body Functions and Activity and Participation sections. However, the Environmental Factors section showed slightly lower reliability indices, suggesting reduced measurement precision, though still within an acceptable range. The findings support the instrument’s potential in inclusive educational settings, while highlighting the need for additional large-scale validation before broader implementation.
Downloads
References
Abu Kassim, N. L. (2024). The RASCH model for psychometric testing rater-mediated assessment and standard setting. IIUM Press.
Aghekyan, R. (2020). Validation of the SIEVEA instrument using the Rasch analysis. International Journal of Educational Research, 103, 101619. https://doi.org/10.1016/j.ijer.2020.101619
Ahmed, I., & Ishtiaq, S. (2021). Reliability and validity: Importance in Medical Research. PubMed, 71(10), 2401–2406. https://doi.org/10.47391/jpma.06-861
Almanasreh, E., Moles, R., & Chen, T. F. (2018). Evaluation of methods used for estimating content validity. Research in Social and Administrative Pharmacy, 15(2), 214–221. https://doi.org/10.1016/j.sapharm.2018.03.066
Amini, M., Mehraban, A. H., Pashmdarfard, M., & Cheraghifard, M. (2019). Reliability and validity of the Children Participation Assessment Scale in Activities Outside of School–Parent version for children with physical disabilities. Australian Occupational Therapy Journal, 66(4), 482–489. https://doi.org/10.1111/1440-1630.12569
Azizan, N. H., Mahmud, Z., & Rambli, A. (2020). Rasch Rating Scale Item Estimates using Maximum Likelihood Approach: Effects of Sample Size on the Accuracy and Bias of the Estimates. International Journal of Advanced Science and Technology, 29(4s), 2526–2531.
Bölte, S., Alehagen, L., Black, M. H., Hasslinger, J., Wessman, E., Remnélius, K. L., Marschik, P. B., D’Arcy, E., Crowson, S., Freeth, M., Seidel, A., Girdler, S., & Zander, E. (2024). The Gestalt of functioning in autism revisited: First revision of the International Classification of Functioning, Disability and Health Core Sets. Autism, 28(9), 2394–2411. https://doi.org/10.1177/13623613241228896
Bond, T. G., & Fox, C. M. (2015). Applying the Rasch model: Fundamental measurement in the human sciences (3rd ed.). Routledge/Taylor & Francis Group.
Boone, W. J. (2016). Rasch Analysis for Instrument Development: Why, when, and how? CBE—Life Sciences Education, 15(4), rm4. https://doi.org/10.1187/cbe.16-04-0148
Brosnan, K., Grün, B., & Dolnicar, S. (2021). Cognitive load reduction strategies in questionnaire design. International Journal of Market Research, 63(2), 125–133. https://doi.org/10.1177/1470785320986797
Chiu, W., Yen, C., Teng, S., Liao, H., Chang, K., Chi, W., Wang, Y., & Liou, T. (2013). Implementing disability evaluation and welfare services based on the framework of the international classification of functioning, disability and health: experiences in Taiwan. BMC Health Services Research, 13(1). https://doi.org/10.1186/1472-6963-13-416
Damyanov, K. (2024). International Classification of Functioning, Disability, and Health for Children and Youth (ICF-CY) as a Framework for Early Intervention Planning in Inclusive Education. Open Journal of Social Sciences, 12(11), 85–98. https://doi.org/10.4236/jss.2024.1211006
Davis, L. L. (1992). Instrument review: Getting the most from a panel of experts. Applied Nursing Research, 5(4), 194–197. https://doi.org/10.1016/s0897-1897(05)80008-4
DeVellis, R. F., & Thorpe, C. T. (2022). Scale Development: theory and applications (5th ed.). SAGE.
Đoković, S., Kovačević, T., & Ostojić-Zeljković, S. (2022). Functional abilities of children as factors of school achievement. Zbornik Radova Filozofskog Fakulteta U Pristini, 52(3), 277–297. https://doi.org/10.5937/zrffp52-35020
Ellingsen, K. M., & Simeonsson, R. J. (2024). Defining childhood disability: ICF-CY developmental code sets. Disability and Rehabilitation, 1–9. https://doi.org/10.1080/09638288.2024.2303385
Fisher Jr., W. P. (2007). Rating Scale Instrument Quality Criteria. Rasch Measurement Transaction, 21, 1095.
http://www.rasch.org/rmt/rmt211a.htm
Frey, J. R. (2019). Assessment for special education: diagnosis and placement. The Annals of the American Academy of Political and Social Science, 683(1), 149–161. https://doi.org/10.1177/0002716219841352
Gottfredson, L. S. (1997). Mainstream science on intelligence: An editorial with 52 signatories, history, and bibliography. Intelligence, 24(1), 13–23. https://doi.org/10.1016/s0160-2896(97)90011-8
Hambleton, R. K., & Li, S. (2005). Translation and adaptation issues and methods for educational and psychological tests. In Comprehensive Handbook of Multicultural School Psychology (pp. 881–903). John Wiley & Sons, Inc.
Haynes, S. N., Richard, D. C. S., & Kubany, E. S. (1995). Content validity in psychological assessment: A functional approach to concepts and methods. Psychological Assessment, 7(3), 238–247. https://doi.org/10.1037/1040-3590.7.3.238
Hollenweger, J. (2011). Development of an ICF-based eligibility procedure for education in Switzerland. BMC Public Health, 11(S4). https://doi.org/10.1186/1471-2458-11-s4-s7
Horridge, K. A., Mcgarry, K., Williams, J., & Whitlingum, G. (2016). Prospective pilots of routine data capture by paediatricians in clinics and validation of the Disabilities Complexity Scale. Developmental Medicine & Child Neurology, 58(6), 581–588. https://doi.org/10.1111/dmcn.13101
Ikart, E. M. (2019). Survey questionnaire Survey pretesting method: an evaluation of survey questionnaire via expert reviews technique. Asian Journal of Social Science Studies, 4(2), 1. https://doi.org/10.20849/ajsss.v4i2.565
Johanson, G. and Brooks, G. (2010) Initial Scale Development: Sample Size for Pilot Studies. Educational and Psychological Measurement, 70, 394-400.
http://dx.doi.org/10.1177/0013164409355692
Kang, L., Naude, A., Rocha, A., Bornman, J., Alves, I., Maxwell, G. R., Moretti, M., Proyer, M., Shi, L., & Zahnd, R. (2025). An international systematic review of the ICF in education: cross-language comparisons from Chinese, German, Italian, and Portuguese publications. Frontiers in Education, 10. https://doi.org/10.3389/feduc.2025.1526194
Klein, B., & De Camargo, O. K. (2018). A proposed functional abilities classification tool for developmental disorders affecting learning and behaviour. Frontiers in Education, 3. https://doi.org/10.3389/feduc.2018.00002
Lac, A. (2016). Content analysis. In R. J. R. Levesque (Ed.), Encyclopedia of Adolesence (2nd ed., pp. 1-5). Switzerland: Springer International.
Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159. https://doi.org/10.2307/2529310
Leavy, P. (2017). Research design: Quantitative, qualitative, mixed methods, Arts-Based, and Community-Based participatory research approache. The Guilford Press.
Linacre, J. M. (1994). Sample size and item calibration or person measure stability. Rasch. https://www.rasch.org/rmt/rmt74m.htm
Luoto, J., Klette, K., & Blikstad-Balas, M. (2022). Possible biases in observation systems when applied across contexts: conceptualizing, operationalizing, and sequencing instructional quality. Educational Assessment Evaluation and Accountability, 35(1), 105–128. https://doi.org/10.1007/s11092-022-09394-y
Lynn, M. R. (1986). Determination and quantification of content validity. Nursing Research, 35(6), 382???386. https://doi.org/10.1097/00006199-198611000-00017
Malaysian Ministry of Education. (2015). Buku Panduan Pengoperasian PPKI. Bahagian Pendidikan Khas.
Malaysian Ministry of Education. (2022). Malaysian Education Blueprint 2013-2025: Annual Report 2022. In Ministry of Education. https://www.moe.gov.my/storage/files/shares/Dasar/PPPM/MEB%20Annual%20Report%202022.pdf
McQuaid, G. A., Pelphrey, K. A., Bookheimer, S. Y., Dapretto, M., Webb, S. J., Bernier, R. A., McPartland, J. C., Van Horn, J. D., & Wallace, G. L. (2021). The gap between IQ and adaptive functioning in autism spectrum disorder: Disentangling diagnostic and sex differences. Autism, 25(6), https://doi.org/10.1177/1362361321995620
Menold, J., Jablokow, K., Purzer, S., Ferguson, D., & Ohland, M. (2015). Using an instrument blueprint to support the rigorous development of new surveys and assessments in engineering education. 122nd ASEE Annual Conference & Exposition, 11853. https://doi.org/10.18260/p.24993
Menold, N. (2020). Double Barreled Questions: An analysis of the similarity of elements and effects on measurement quality. Journal of Official Statistics, 36(4), 855–886. https://doi.org/10.2478/jos-2020-0041
Moretti, M., Alves, I., & Maxwell, G. (2012). A Systematic Literature review of the situation of the International Classification of Functioning, Disability, and Health And the International Classification of Functioning, Disability, and Health–Children and Youth Version in Education. American Journal of Physical Medicine & Rehabilitation, 91(13), S103–S117. https://doi.org/10.1097/phm.0b013e31823d53b2
Musa, S. H., Md Zain, E., Ismail, M. Z., Mat Hussin, H., & Nordin, M. N. (2021). Something important for special education in Malaysia. Turkish Journal of Computer and Mathematics Education (TURCOMAT), 12(11), 5211–5216. https://doi.org/10.17762/turcomat.v12i11.6733
Norwich, B. (2016). Conceptualizing Special Educational Needs using a Biopsychosocial Model in England: The Prospects and Challenges of using the International Classification of Functioning Framework. Frontiers in Education, 1. https://doi.org/10.3389/feduc.2016.00005
Othman, N., & Mohd Matore, M. E. E. (2020). The Zero-Reject Policy in Special Education: A critique review. Journal of Critical Reviews, 7(11), 2507–2515.
Pellicano, E., & Houting, J. D. (2021). Annual Research Review: Shifting from ‘normal science’ to neurodiversity in autism science. Journal of Child Psychology and Psychiatry, 63(4), 381–396. https://doi.org/10.1111/jcpp.13534
Polit, D. F., & Beck, C. T. (2006). The content validity index: Are you sure you know what’s being reported? critique and recommendations. Research in Nursing & Health, 29(5), 489–497. https://doi.org/10.1002/nur.20147
Polit, D. F., Beck, C. T., & Owen, S. V. (2007). Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in Nursing & Health, 30(4), 459–467. https://doi.org/10.1002/nur.20199
Prokopiak, A., & Kirenko, J. (2020). ABAS-3 – an instrument for assessing adaptive skills in people with an intellectual disability. Hrvatska Revija Za Rehabilitacijska Istraživanja, 56(2), 154–168. https://doi.org/10.31299/hrri.56.2.9
Rosa, E. M., & Tudge, J. (2013). Urie Bronfenbrenner’s Theory of Human Development: Its Evolution From Ecology to Bioecology. Journal of Family Theory & Review, 5(4), 243–258. https://doi.org/10.1111/jftr.12022
Sanches-Ferreira, M., Lopes-Dos-Santos, P., Alves, S., Santos, M., & Silveira-Maia, M. (2013). How individualised are the Individualised Education Programmes (IEPs): an analysis of the contents and quality of the IEPs goals. European Journal of Special Needs Education, 28(4), 507–520. https://doi.org/10.1080/08856257.2013.830435
Sargent, L. (2025). Functional ability [E-Book]. In Concepts for Nursing Practice (4th ed., pp. 14–22). Elsevier.
Shrout, P. E. (1998). Measurement reliability and agreement in psychiatry. Statistical Methods in Medical Research, 7(3), 301–317. https://doi.org/10.1177/096228029800700306
Silveira-Maia, M., Lopes-Dos-Santos, P., Sanches-Ferreira, M., Alves, S., & Silveira-Maia, C. (2019). The use of the international classification of functioning, disability and health in an interactive perspective: the assessment and intervention of students’ additional support needs in Portugal. Disability and Rehabilitation, 41(25), 3016–3024. https://doi.org/10.1080/09638288.2018.1483433
Sireci, S., & Faulkner-Bond, M. (2014). Validity evidence based on test content. Psicothema, 1(26), 100–107. https://doi.org/10.7334/psicothema2013.256
Sumintono, B., & Widhiarso, W. (2015). Aplikasi pemodelan Rasch pada assessment pendidikan. http://eprints.um.edu.my/14228/
Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53–55. https://doi.org/10.5116/ijme.4dfb.8dfd
Tesio, L. (2003). Measuring Behaviours And Perceptions: Rasch Analysis As a Tool For Rehabilitation Research. Journal of Rehabilitation Medicine, 35(3), 105–115. https://doi.org/10.1080/16501970310010448
Werkhoven, S., Anderson, J. H., & Robeyns, I. a. M. (2022). Who benefits from diagnostic labels for developmental disorders? Developmental Medicine & Child Neurology, 64(8), 944–949. https://doi.org/10.1111/dmcn.15177
World Health Organization. (2001). International Classification of Functioning, Disability and Health [E-Book]. https://iris.who.int/server/api/core/bitstreams/83e1c3e0-cf9e-4063-a424-71ccc9a84ded/content
World Health Organization. (2007). International Classification of Functioning, Disability, and Health: Children & Youth Version : ICF-CY [E-Book]. https://www.who.int/standards/classifications/international-classification-of-functioning-disability-and-health
Xavier, S. (2021). Falling through the Cracks: Identifying children with learning difficulties in Malaysian schools. In IDEAS(Brief Ideas No. 32). Institute for Democracy and Economic Affaris. https://www.ideas.org.my/publications-item/brief-ideas-no-32-falling-through-the-cracks-identifying-children-with-learning-difficulties-in-malaysian-schools/
Yusoff, M. S. B. (2019). ABC of Content Validation and Content Validity Index Calculation. Education in Medicine Journal, 11(2), 49–54. https://doi.org/10.21315/eimj2019.11.2.
