Pelatihan Analisis Instrumen Menggunakan Quest untuk Meningkatkan Kompetensi Guru dalam Evaluasi Pembelajaran
DOI:
https://doi.org/10.65255/jipmas.v3i1.299Keywords:
instrument analysis, Quest, Rasch Model, teacher competency, learning evaluationAbstract
This community service activity aimed to improve teachers' competency in analyzing learning evaluation instruments through training on Quest software based on the Rasch Model. The participants were 25 high school teachers in Tondano, conducted online via Zoom over two days using a participatory training approach. The method included preparation, execution (conceptual reinforcement, demonstration, hands-on practice, and reflective discussion), and evaluation stages. Data were collected through pretests-posttests, questionnaires, and observations, then analyzed descriptively. Results showed a significant increase in competency, with the average pretest score of 46.80 increasing to 81.20 on the posttest (a 73.50% increase). The N-Gain value of 0.65 falls into the medium category, indicating meaningful training effectiveness. A total of 92% of participants showed substantial improvement and were able to operate Quest and interpret outputs such as item difficulty (logit), item fit statistics (INFIT/OUTFIT MNSQ), and reliability. Participant responses were very positive, with 88% stating the material was relevant and 84% committing to apply the training results in their schools. This activity contributes to strengthening teachers' pedagogical competence in evidence-based learning evaluation.
References
Bond, T. G., Yan, Z., & Heene, M. (2021). Applying the Rasch Model, Fundamental Measurement in the Human Sciences. Routledge. https://doi.org/10.4324/9781410614575
Chambers, R. (2014). PRA, PLA and Pluralism: Practice and Theory. The SAGE Handbook of Action Research, 297–318. https://doi.org/10.4135/9781848607934.n28
Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of Item Response Theory Library. Sage Publication, Inc.
Knapke, J. M., Hildreth, L., Molano, J. R., Schuckman, S. M., Blackard, J. T., Johnstone, M., Kopras, E. J., Lamkin, M. K., Lee, R. C., Kues, J. R., & Mendell, A. (2024). Andragogy in Practice: Applying a Theoretical Framework to Team Science Training in Biomedical Research. British Journal of Biomedical Science, 81(March), 1–8. https://doi.org/10.3389/bjbs.2024.12651
Lembang, F. K., Djami, R. J., & Latuihamallo, C. S. (2021). Peningkatan Kompetensi Guru SD Kristen 1 Hunuth Melalui Pelatihan Teknik Analisis Data Statistik Penelitian Tindakan Kelas Menjadi Karya Ilmiah. BAKTI (Jurnal Pengabdian Kepada Masyarakat), 1(1), 12–16. https://doi.org/10.51135/baktivol1iss1pp12-16
Lumembang, M. M., Arundaa, R., & Tumanggor, A. M. R. (2025). Optimalisasi Pembelajaran Konsep Kemagnetan melalui Pelatihan Sensor Magnetik IoT di SMPN 3 Kawangkoan. JURNAL ABDIMAS MADUMA, 4(3), 188–195. https://doi.org/10.52622/jam.v4i3.554
Mandinach, E. B., & Gummer, E. S. (2016). What does it mean for teachers to be data literate: Laying out the skills, knowledge, and dispositions. Teaching and Teacher Education, 60, 366–376. https://doi.org/10.1016/j.tate.2016.07.011
Marlina, M., Rahim, A., Aziz, F., & Arsalaan, A. T. (2024). Pelatihan analisis kualitas instrumen penilaian hasil belajar dengan pendekatan Clasical Theory dan Item Response Theory di sekolah dasar. KACANEGARA Jurnal Pengabdian Pada Masyarakat, 7(2), 209. https://doi.org/10.28989/kacanegara.v7i2.1888
Nirmala, M. F. T., Tumanggor, A. M. R., & Supahar. (2021). Analysis of Validity and Reliability of Diagnostic Test of Picture Representation Ability in High School Physics Learning. Proceedings of the 7th International Conference on Research, Implementation, and Education of Mathematics and Sciences (ICRIEMS 2020), 528(Icriems 2020), 538–546. https://doi.org/10.2991/assehr.k.210305.079
Nitko, A. J., & Brookhart, S. M. (2014). Educational Assessment of Students Sixth Edition. In Pearson New International Edition.
Peraturan Menteri Pendidikan Dan Kebudayaan Nomor 21 Tahun 2016 Tentang Standar Isi Pendidikan Dasar Dan Menengah (2016).
Permendikbud No. 23 Tahun 2016 Tentang Standar Penilaian Pendidikan (2016). https://doi.org/10.31227/osf.io/munp2
Sumintono, B., & Widhiarso, W. (2015). Aplikasi Pemodelan Rasch pada Assessment Pendidikan. Trim Komunikata Publishing House.
Tarigan, Y., Tumanggor, A. M. R., Paembonan, T. L., Varisky Abraham Dumanaw, & Jein Jeilen Tampi. (2025). Sosialisasi Penggunaan SPSS dalam Meningkatkan Kompetensi Analisis Data Statistik Mahasiswa FMIPAK UNIMA. Journal Inovasi Pengabdian Masyarakat, 2(2), 132–141. https://doi.org/10.65255/jipmas.v2i2.198
Tumanggor, A. M. R., & Supahar. (2021). Dissemination of Online Diagnostic Test Instrument to Diagnose High School Students’ Mathematical Representation Ability: The Case of Work and Energy. Proceedings of the 6th International Seminar on Science Education (ISSE 2020), 541, 528–537. https://doi.org/10.2991/assehr.k.210326.076
Tumanggor, A. M. R., Supahar, & Nirmala, M. F. T. (2021). The Development of Diagnostic Test Instrument for Verbal Representation Ability in High School Physics Learning. Proceedings of the 7th International Conference on Research, Implementation, and Education of Mathematics and Sciences (ICRIEMS 2020), 528, 471–476. https://doi.org/10.2991/assehr.k.210305.069
Wright, B. D., & Stone, M. H. (1979). Best Test Design: Rasch Measurement. In Mesa Press. Routledge.
