Polyglot: Jurnal Ilmiah
Email this article 
Hide
Show all
COMPREHENSION PROCESSES AND CRITICAL THINKING SKILLS IN TWO UNIVERSITY ENTRANCE EXAMS IN INDONESIA: A CONTENT ANALYSIS OF THE SBMPTN AND THE SIMAK UI 2008-2019
Abstract
Language testing development intervened with cognitive processes and higher-order thinking skills (HOTS) has impacted the English tests, included Indonesian university entrance exams within a decade. State universities in Indonesia which are in demand to the high quality of their candidates have conducted a highly reputable entrance exams to select their best candidates. However, less research was conducted to investigate the trend of English questions in the scope of university entrance tests. This study aimed to investigate trends of English questions tested in both the SBMPTN (national university entrance exams) and the SIMAK UI (Universitas Indonesia’s entrance exams) in a decade (from 2009 to 2018). The study design was a mixed-method employing content analysis to English questions (quantitatively and qualitatively). The findings revealed; 1) types of questions tested, 2) comprehension processes, 3) and higher-order thinking questions, and 4) construction MCQs to promote critical thinking skills in both entrance exams. Finally, implications of the findings were elaborated.
Bahasa Indonesia Abstrak: Ujian Saringan Masuk (USM), khususnya soal bahasa Inggris, dipercaya dapat mengambarkan pemahamanan dan kemampuan berpikir kritis para kandidat. Oleh karena itu, penelitian terhadap USM menjadi sangat signifikan. Nyatanya, penelitian tentang USM sangat jarang dan tren terhadap soal-soal bahasa Inggris terbatas. Penelitian ini bertujuan untuk menyelidiki tren dalam proses pemahaman dan kemampuan berpikir tingkat tinggi yang termanifestasi dalam Ujian Seleksi Masuk UI (SIMAK UI) dalam satu dekade belakangan (2009-2018). Dengan menggunakan metode campuran content analysis, pertanyaan-pertanyaan dianalisa secara kualitatif dan kuantitatif dan menghasil beberapa temuan seperti 1) jenis pertanyaan yang diuji, 2) proses pemahaman, 3) pertanyaan untuk kemampuan berpikir tingkat tinggi, dan 4)konstruksi pembuatan pertanyaan pilihan ganda yang bertujuan meningkatkan kemampuan berpikir kritis. Implikasi dari temuan ini juga dijelaskan.
Keywords
DOI: http://dx.doi.org/10.19166/pji.v18i1.4908
Full Text:
PDFReferences
Airasian, P. (1994). Classroom assessment. New York: McGraw-Hill.
Alderson, J. C. (2000). Assessing reading. Cambridge UK: Cambridge University Press. https://doi.org/doi:10.1017/CBO9780511732935
Anderson, L. W., & Krathwohl, D. R. (2001). A taxonomy for learning, teaching and assessing: A revision of Bloom’s Taxonomy of Educational Objectives. New York: Longman.
Baghaei, S., Bagheri, M. S., & Yamini, M. (2020). Analysis of IELTS and TOEFL reading and listening tests in terms of Revised Bloom’s Taxonomy. Cogent Education, 7(1). https://doi.org/10.1080/2331186X.2020.1720939
Bloom, B. S. (1956). Taxonomy of educational objectives. New York: McKay.
Bryman, A. (2004). Social research methods (2nd ed.). New York: Oxford University Press.
Burns, E. (2010). “Anatomizing” reversed: Use of examination questions that foster use of higher order learning skills by students. Anatomical Science Education, 3(6), 330–334. https://https://doi.org/10.1002/ase.187
Campbell, J. R. (2005). Single Instrument, Multiple Measures: Considering the Use of Multiple Item formats to Assess Reading Comprehension. In S. G. Paris & S. A. Stahl (Eds.), Children’s Reading Comprehension and Assessment (pp. 347–368). Mahwah, NJ: Lawrence Erlbaum.
Coe, K., & Scacco, J. M. (2017). Content Analysis, Quantitative. In J. Matthes (Ed.), The International Encyclopedia of Communication Research Methods (pp. 346–356). New York: Wiley-Blackwel.
Dancy, M., & Beichner, R. (2006). Impact of animation on assessment of conceptual understanding in physics. Physical Review Special Topics – Physics Education Research, 2(1), 1–7. https://doi.org/10.1103/physrevstper.2.010104
Deygers, B., Van den Branden, K., & Van Gorp, K. (2018). University entrance language tests: A matter of justice. Language Testing, 35(4), 449–476. https://doi.org/10.1177/0265532217706196
Dickinson, M. (2011). Writing multiple-choice questions for higher-level thinking. Learning Solutions Magazine. Retrieved from
https://learningsolutionsmag.com/articles/804/writing-multiplechoice-
questions-for-higher-level-thinking
Hemati, S. J., & Baghaei, P. (2020). A Cognitive Diagnostic Modeling Analysis of the English Reading Comprehension Section of the Iranian National University Entrance Examination. International Journal of Language Testing, 10(1). Retrieved from https://www.ijlt.ir/article_114278_022ab6b64d4bc8acba9c561846828270.pdf
IEA. (2015). PIRLS 2016 Assessment framework. In I. V. S. Mullis, M. O. Martin, & M. Sainsbury (Eds.), PIRLS 2016 Assessment Framework. Boston College. Retrieved from https://timssandpirls.bc.edu/pirls2016/downloads/P16_Framewor
k_2ndEd.pdf
Khalifa, H., & Weir, C. J. (2009). Examining Reading: Research and Practice in Assessing Second Language Reading. Cambridge UK: Cambridge University Press.
Krathwohl, D. R. (2008). A revision of Bloom’s taxonomy: An overview. Theory Into Practice, 41(4), 212–218. https://doi.org/10.1207/s15430421tip4104
Krippendorff, K. (2004). Content Analysis: An Introduction to Its methodology (2nd ed.). Thousand Oaks, CA: Sage Publications.
LTMPT. (2021). Lembaga Tes Masuk Perguruan Tinggi. Retrieved from https://ltmpt.ac.id/?mid=7
Morrison, S., & Free, K. W. (2001). Writing multiple-choice test items that promote and measure critical thinking. Journal of Nursing Education, 40(1), 17–24. https://doi.org/10.3928/0148-4834-20010101-06
Moss, P. A., & Koziol, S. M. (1991). Investigating the validity of a locally developed critical thinking test. Educational Measurement: Issues and Practice, 10(3), 17–22. https://doi.org/10.1111/j.1745-3992.1991.tb00199.x
NACE. (2019). The four career competencies employers value most. Retrieved from https://www.naceweb.org/career-readiness/competencies/thefour-career-competencies-employers-value-most/
P21CS. (2008). 21st Century Skills, Education & Competitiveness. Retrieved from https://files.eric.ed.gov/fulltext/ED519337.pdf
Paribakht, T. S., & Webb, S. (2016). The relationship between academic vocabulary coverage and scores on a standardized English proficiency test. Journal of English for Academic Purposes, 21, 121–
132. https://doi.org/10.1016/j.jeap.2015.05.009
PPRC. (2010). 21st century skills for students and teachers. Kamehameha Schools Research & Evaluation, 1–25. Retrieved from https//www.21stcenturyskills.com
Rethinasamy, S., & Chuah, K. M. (2011). The Malaysian university English test (MUET) and its use for placement purposes: A predictive validity study. Electronic Journal of Foreign Language Teaching, 8(2), 234–245. https://doi.org/10.2139/ssrn.2146007
Rowe, M., Ozuru, Y., & McNamara, D. S. (2006). An analysis of a standardized reading ability test: what do questions actually measure? In S. A. Barab, K. E. Hay, & D. T. Hickey (Eds.), Proceedings of the seventh international conference of the learning sciences (pp. 627–633).
Samad, A. A. (2008). Refining English Language Tests for University Admission: A Malaysian Example. Asian Journal of University Education, 4(1), 57–68. Retrieved from http://psasir.upm.edu.my/id/eprint/16468/1/Refining%20English%20Language%20tests%20for%20university%20admission.pdf
Scott, C. L. (2015). Education Research and Foresight Working Papers. Retrieved from https://en.unesco.org/futuresofeducation/education-research-and-foresight-working-papers
Scully, D. (2017). Constructing multiple-choice items to measure higherorder thinking. Practical Assessment, Research and Evaluation, 22(4), 1–13. https://doi.org/10.7275/swgt-rj52
Tengberg, M. (2015). National reading tests in Denmark, Norway, and Sweden: A comparison of construct definitions, cognitive targets, and response formats. Language Testing, 34(1), 83–100.
https://doi.org/10.1177/0265532215609392
Refbacks
- There are currently no refbacks.
Copyright (c) 2022 Bernard Richard Nainggolan, Pupung Purnawarman, Didi Sukyadi
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Faculty of Education | Universitas Pelita Harapan | Lippo Karawaci, Tangerang, Indonesia, 15811 | Tel +62 21 5460901 | Fax +62 21 5460910