Development and validation of technological pedagogical content knowledge (TPACK) test instruments for prospective chemistry teachers

Abstract

This study aimed to develop a digital-based test instrument to assess the technological, pedagogical, and content knowledge of pre-service chemistry teachers. The instrument was designed based on the TPACK framework, which consists of seven interrelated components: Content Knowledge (CK), Pedagogical Knowledge (PK), Technological Knowledge (TK), Pedagogical Content Knowledge (PCK), Technological Content Knowledge (TCK), Technological Pedagogical Knowledge (TPK), and the integrated TPACK domain. A total of 20 indicators were constructed, and corresponding items were developed in digital format. Content validation involved three chemistry education experts who evaluated each item based on three aspects: alignment with the indicator, clarity of the correct answer, and appropriateness of the scoring rubric. Using a binary scale (“Yes” = relevant, “No” = not relevant), data were analyzed through the Content Validity Index (CVI). The findings show that 18 out of 20 items achieved acceptable I-CVI values (≥ 0.78), and the overall S-CVI/Ave score was 0.95, indicating excellent content validity. This suggests that the developed instrument is valid for assessing TPACK and can support future efforts in preparing technology-integrated chemistry teaching.
Keywords
  • TPACK
  • Chemistry education
  • Pre-service teacher assessment
  • Professional competence
  • Content validity
References
  1. Abouelenein, Y., & Selim, S. A. S. (2024). Impact of digital interventions on the development of TPACK: Interviews, reports, and video simulation among pre-service teachers. Educ. Inf. Technol., 29, 1–40. https://doi.org/10.1007/s10639-023-12422-z
  2. Adams, W. K., & Wieman, C. E. (2010). Development and validation of instruments to measure learning of expert‐like thinking. International Journal of Science Education, 33(9), 1289–1312.
  3. Akbarini, N. R., & Anggrawal, A. (2024). Validity And Reliability of Test Questions to Measure The Information Literacy Skills of Prospective Teacher Students. JURNAL EDUSCIENCE. https://doi.org/10.36987/jes.v11i1.5640
  4. Aqib, M. A., Ekawati, R., & Khabibah, S. (2025). Development of TPACK-LK (Technological Pedagogical and Content Knowledge with Learner Knowledge) Instrument for Mathematic Preservice Teacher. TEM Journal. https://doi.org/10.18421/tem141-39
  5. Bernardes, T. S., & de Andrade Neto, A. S. (2020). Technological pedagogical Content Knowledge (TPACK) in pre-service and in-service chemistry teacher training: a systematic literature review. Revista Novas Tecnologias Na Educação, 18(2), 611–620.
  6. Can, H. B., & Boz, Y. (2022). Development of pre-service teachers’ pedagogical content knowledge and the factors affecting that development: a longitudinal study. Chemistry Education Research and Practice. https://doi.org/10.1039/d2rp00106c
  7. Deng, F., Lan, W., Sun, D., & Zheng, Z. (2023). Examining Pre-Service Chemistry Teachers’ Technological Pedagogical Content Knowledge (TPACK) of Using Data-Logging in the Chemistry Classroom. Sustainability. https://doi.org/10.3390/su152115441
  8. Dewi, C., Bendriyanti, R., Rachmadany, D., Handika, K., & Illahi, R. (2024). WORKSHOP MANAJEMEN PEMBELAJARAN ABAD 21 BAGI GURU SMAN 15 BENGKULU UTARA. JURNAL ABDIMAS SERAWAI. https://doi.org/10.36085/jams.v4i2.6608
  9. Foulger, T., Wetzel, K., & Buss, R. (2019). Moving Toward a Technology Infusion Approach: Considerations for Teacher Preparation Programs. Journal of Digital Learning in Teacher Education, 35, 79–91. https://doi.org/10.1080/21532974.2019.1568325
  10. Hairida, H., Erlina, E., Rasmawan, R., Sartika, R., Ifriany, A., Arifiyanti, F., Natasya, Q., & Warohmah, M. (2023). Development and Validation of a Self-Assessment Instrument for Measuring TPACK Ability of Scientific-Based Chemistry Teachers. Tadris: Jurnal Keguruan Dan Ilmu Tarbiyah. https://doi.org/10.24042/tadris.v8i1.14825
  11. Jammeh, A. L. J., Karegeya, C., & Ladage, S. (2024). Application of technological pedagogical content knowledge in smart classrooms: views and its effect on students’ performance in chemistry. Education and Information Technologies, 29(8), 9189–9219. https://doi.org/10.1007/s10639-023-12158-w
  12. Koehler, M. J., Mishra, P., & Cain, W. (2013). What is technological pedagogical content knowledge (TPACK)? Journal of Education, 193(3), 13–19.
  13. Kulanthaivel., G., & Ulagamuthalvi. (2020). Role of Technical Teacher Training Institution in a Knowledge based economy. Procedia Computer Science, 172, 1096–1102. https://doi.org/10.1016/j.procs.2020.05.159
  14. Kumari, S., & Anjana, A. (2021). Distance Teacher Education and the Challenges of 21st Century. MIER Journal of Educational Studies, Trends and Practices, 8, 83–101. https://doi.org/10.52634/MIER/2018/V8/I1/1428
  15. Lestari, W. T., Saputro, S., Masykuri, M., Hastuti, B., Ulfa, M., Mulyani, S., & Yamtinah, S. (2020). Item analysis of teachnological pedagogical content knowledge (TPACK) in pre-service chemistry teachers using the Rasch Model application. Journal of Physics: Conference Series, 1511(1), 012043.
  16. Luo, W.-H., Berson, I., Berson, M., & Park, S. (2022). An Exploration of Early Childhood Teachers’ Technology, Pedagogy, and Content Knowledge (TPACK) in Mainland China. Early Education and Development, 34, 963–978. https://doi.org/10.1080/10409289.2022.2079887
  17. Maba, W., Mantra, I. B. N., & Widiastuti, I. A. M. S. (2023). TEACHERS OF 21ST CENTURY: TEACHERS’ ROLES, STRATEGIES INNOVATION AND CHALLENGES. International Journal of Social Science. https://doi.org/10.53625/ijss.v2i6.5473
  18. Maddukelleng, M., Jihan, J., Gunawan, H., Murcahyanto, H., & Pasaribu, W. (2023). Hybrid Learning Innovation: Challenges for Developing Teachers Skills in Indonesia. Al Qalam: Jurnal Ilmiah Keagamaan Dan Kemasyarakatan. https://doi.org/10.35931/aq.v17i2.1959
  19. Mashuri, M., Sutoyo, S., & Azizah, U. (2025). Quality Education: Practicality of the 3CEL Learning Model to Improve the Tpack of Preservice Chemistry Teachers For SDGs. Journal of Lifestyle and SDGs Review. https://doi.org/10.47172/2965-730x.sdgsreview.v5.n02.pe04189
  20. Mirzakhmedov, A., & Mirzakhmedov, K. (2021). The Role Of The Teacher In The Education Of Young People. 03, 385–395. https://doi.org/10.37547/TAJSSEI/VOLUME03ISSUE01-72
  21. Mönch, C., & Markic, S. (2023). Elements constituting and influencing in-service secondary chemistry teachers’ pedagogical scientific language knowledge. Chemistry Education Research and Practice. https://doi.org/10.1039/d3rp00140g
  22. Paristiowati, M., Yusmaniar, Nurhadi, F., & Imansari, A. (2020). Analysis of Technological Pedagogical and Content Knowledge (TPACK) of Prospective Chemistry Teachers through Lesson Study. Journal of Physics: Conference Series, 1521. https://doi.org/10.1088/1742-6596/1521/4/042069
  23. Peng, Z. (2023). The role of the teacher in modern education. International Journal of Education and Humanities, 8(2), 117–118.
  24. Pikoli, M. (2020). Using guided inquiry learning with multiple representations to reduce misconceptions of chemistry teacher candidates on acid-base concept. International Journal of Active Learning, 5(1), 1–10.
  25. Polit, D. F., & Beck, C. T. (2006). The content validity index: are you sure you know what’s being reported? Critique and recommendations. Research in Nursing & Health, 29(5), 489–497.
  26. Purba, F. J., Sinaga, K., Sitinjak, D., & Tahya, C. (2023). 21st Century chemistry teacher: Analysis of TPACK of pre-service chemistry teachers in teachers college. Jurnal Pendidikan Kimia. https://doi.org/10.24114/jpkim.v15i2.43788
  27. Rodríguez-Becerra, J., Cáceres-Jensen, L., Díaz, T., Druker, S., Padilla, V. B., Pernaa, J., & Aksela, M. (2020). Developing technological pedagogical science knowledge through educational computational chemistry: a case study of pre-service chemistry teachers’ perceptions. Chemistry Education Research and Practice, 21, 638–654. https://doi.org/10.1039/c9rp00273a
  28. Schmidt, D. A., Baran, E., Thompson, A. D., Mishra, P., Koehler, M. J., & Shin, T. S. (2009). Technological pedagogical content knowledge (TPACK) the development and validation of an assessment instrument for preservice teachers. Journal of Research on Technology in Education, 42(2), 123–149.
  29. Setiawan, N. C. E., Putri, D. E. K., Marfu’ah, S., Pramesti, I. N., & Rosli, M. S. (2023). 21st Century Skills: The Perspective of Chemistry Teachers in Indonesia. Hydrogen: Jurnal Kependidikan Kimia, 11(4), 354–364.
  30. Sofyan, S., Habibi, A., Sofwan, M., Yaakob, M., Alqahtani, T. M., Jamila, A., & Wijaya, T. (2023). TPACK–UotI: the validation of an assessment instrument for elementary school teachers. Humanities and Social Sciences Communications, 10, 1–7. https://doi.org/10.1057/s41599-023-01533-0
  31. Sole, F. B., & Anggraeni, D. M. (2018). Inovasi Pembelajaran Elektronik dan Tantangan Guru Abad 21. Jurnal Penelitian Dan Pengkajian Ilmu Pendidikan: E-Saintika. https://doi.org/10.36312/e-saintika.v2i1.79
  32. Solikhin, F., & Rohiat, S. (2023). The TPACK Profile of Chemistry Prospective Teachers in Microteaching Class, University of Bengkulu. Jurnal Pendidikan Kimia Indonesia. https://doi.org/10.23887/jpki.v7i1.49009
  33. Tiken20, N., Erita, Y., Putri, R. S., & Salmiyanti. (2023). Application of Electronic Learning and Educators’ Challenges In The 21st Century. JOURNAL OF DIGITAL LEARNING AND DISTANCE EDUCATION. https://doi.org/10.56778/jdlde.v1i11.63
  34. Tkachov, S., Tkachova, N., Mordovtseva, N., Pochynkova, M., & Parfyonova, O. (2021). Study of the preparation of future teachers for the technologization of the educational process. LAPLAGE EM REVISTA. https://doi.org/10.24115/s2446-6220202173b1495p.90-96