ISSN 2415-3060 (print), ISSN 2522-4972 (online)
  • 27 of 39
Up
JMBS 2021, 6(2): 196–203
https://doi.org/10.26693/jmbs06.02.196
Physical Therapy and Ergotherapy

Instruments for Monitoring the Quality of Higher Education: Structural Validation of the Ukrainian Version of the ETLQ Questionnaire

Pavlova Iu. O., Tymruk-Skoropad K. A., Tsizh L. M.
Abstract

The problem of ensuring the quality of higher education and the formation of a culture of quality causes a significant interest. That determines the practice of collecting, analyzing, and taking into account information about the academic environment, requires identifying and constantly monitoring of factors that affect the effectiveness of curricula, and determines student success. To better monitor the effectiveness of the proposed approaches, keep up with emerging challenges, and adjust decisions, it is necessary to develop special tools to study participants’ opinions of the educational process. Such tools should have sufficient validity and meet current trends and approaches. The purpose of the study was to check the internal structure and validate the Ukrainian version of the content part “Experiences of teaching and learning” of the ETLQ tool. Materials and methods. The study involved students (n = 632, 59.81 % were women; age (M±SE) – 21.5±0.2 years old) of Ivan Boberskyj Lviv State University of Physical Culture, who studied in the specialty 227 “Physical therapy, occupational therapy”. Data collection was conducted during the 2019/2020 and 2020/2021 academic years upon completing mandatory special subjects. The convergent, discriminant, and criterion validity of the “Experiences of teaching and learning” part of the ETLQ tool were evaluated. Exploratory and confirmatory factor analyses were used in the research; α-Cronbach values, composite reliability coefficient, and average extracted variance were calculated. Results and discussion. Based on the results of the work, a modified version of the questionnaire was proposed, which contained 29 questions and had a sufficient level of validity. The final model consisted of four factors, which explained 51.353% of the total variance (the first factor – 39.339 %, the second – 5.224 %, the third – 4.281 %, the fourth – 2.509 %). The model was characterized by satisfactory indices: χ² / df (920/344) = 2.67, CFI = 0.923, TLI = 0.935, RMSEA = 0.055, SRMR = 0.058. Based on the validation results, a modified Ukrainian version of the questionnaire “Experiences of teaching and learning” was proposed, which is one of the content parts of the ETLQ tool. It consists of separate scales “Organization and structure,” “Teaching, learning, assessments and other set work”, “Teachers’ enthusiasm and responsiveness to students”, “Climate and support from peers”. The proposed questionnaire has sufficient validity to assess the quality of the academic environment, the effectiveness of specialists’ educational process in physical therapy, occupational therapy, and physical culture and sports

Keywords: quality of education, ETLQ, teaching, learning, training course

Full text: PDF (Ukr) 295K

References
  1. Diseth Å. Approaches to learning, course experience and examination grade among undergraduate psychology students: Testing of mediator effects and construct validity. Stud High Educ. 2007; 32(3): 373-88. https://doi.org/10.1080/03075070701346949
  2. Gijbels D, Segers M, Struyf E. Constructivist learning environments and the (im)possibility to change students' perceptions of assessment demands and approaches to learning. Instr Sci. 2008; 36: 431-43. https://doi.org/10.1007/s11251-008-9064-7
  3. Utriainen J, Tynjälä P, Kallio E, Marttunen M. Validation of a modified version of the Experiences of Teaching and Learning Questionnaire. Stud Educ Eval. 2018 Mar 1; 56: 133-43. https://doi.org/10.1016/j.stueduc.2017.12.007
  4. Entwistle N. Teaching for Understanding at University. Basingstoke, Hampshire, UK: Palgrave Macmillan; 2009.
  5. Entwistle N. Concepts and conceptual frameworks underpinning the ETL project. Psychology. 2003 [Internet]. Available from: www.ed.ac.uk/etl/publications.html
  6. Karagiannopoulou E, Milienos FS. Testing two path models to explore relationships between students' experiences of the teaching-learning environment, approaches to learning and academic achievement. Educ Psychol. 2015 Jan 2; 35(1): 26-52. https://doi.org/10.1080/01443410.2014.895800
  7. Bath D, Smith C, Stein S, Swann R. Beyond mapping and embedding graduate attributes: Bringing together quality assurance and action learning to create a validated and living curriculum. High Educ Res Dev. 2004; 23(3): 313-28. https://doi.org/10.1080/0729436042000235427
  8. Rytkönen H, Parpala A, Lindblom-Ylänne S, Virtanen V, Postareff L. Factors affecting bioscience students' academic achievement. Instr Sci. 2012 Mar 2; 40(2): 241-56. https://doi.org/10.1007/s11251-011-9176-3
  9. Entwistle N, McCune V, Hounsell J. Investigating ways of enhancing university teaching-learning environments: Measuring students' approaches to studying and perceptions of teaching. Elsevier Science Limited; 2003. p. 89-108.
  10. De Corte E. Marrying theory building and the improvement of school practice: A permanent challenge for instructional psychology. Learn Instr. 2000; 10(3): 249-66. https://doi.org/10.1016/S0959-4752(99)00029-8
  11. McCune V, Entwistle N. Cultivating the disposition to understand in 21st century university education. Learn Individ Differ. 2011 Jun; 21(3): 303-10. https://doi.org/10.1016/j.lindif.2010.11.017
  12. Kline RB. Principles and Practice of Structural Equation Modeling. NY-London: The Guilford Press; 2011. 534 p.
  13. Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Model. 1999; 6(1): 1-55. https://doi.org/10.1080/10705519909540118
  14. Brown T. Confirmatory Factor Analysis for Applied Research. Second Edition. NY: The Guilford Press; 2006. 462 p.
  15. He J, Van De Vijver F. Methodological issues in psychological research on culture. Journal of Cross-Cultural Psychology. 2000; 31(1): 33-51. https://doi.org/10.1177/0022022100031001004
  16. Entwistle N, McCune V, Hounsell J. Approaches to Studying and Perceptions of University Teaching-Learning Environments: Concepts, Measures and Preliminary Findings. Edinburgh; 2002.
  17. Stes A, De Maeyer S, Gijbels D, Van Petegem P. Instructional development for teachers in higher education: Effects on students' perceptions of the teaching-learning environment. Br J Educ Psychol. 2012 Sep 1; 82(3): 398-419. PMid: 22881046. https://doi.org/10.1111/j.2044-8279.2011.02032.x
  18. Asikainen H, Parpala A, Lindblom-Ylänne S, Vanthournout G, Coertjens L. The Development of Approaches to Learning and Perceptions of the Teaching-Learning Environment During Bachelor Level Studies and Their Relation to Study Success. High Educ Stud. 2014 Jul 30; 4(4). https://doi.org/10.5539/hes.v4n4p24