Developing and validating a rubric-based approach to quality assurance in Turkish higher education

MakaleYalnız künyeScopus SJRQ2
  • SDG 4 · Nitelikli Eğitim

Özet

This study, initiated by the Turkish Higher Education Quality Council (THEQC), develops and validates a rubric-based approach for evaluating institutional quality assurance (QA) processes within the Turkish higher education ecosystem. Effective quality assurance (QA) in higher education requires evaluation tools that are methodologically robust, responsive to institutional needs, and aligned with international benchmarks. A rubric-based approach offers a structured and transparent framework for consistent assessments. The rubric was created through an iterative, evidence-based process incorporating expert feedback, international benchmarks, site visits, and prior research. It consists of 22 main criteria across four key domains—Leadership, Governance and Quality; Learning and Teaching; Research and Development; and Service to Society—subdivided into 46 sub-criteria, each assessed on a five-point maturity scale. The validity and reliability of the rubric were rigorously examined. Content validity was established through evaluations by 10 QA professionals, addressing four key dimensions: relevance, alignment with the intended domain, appropriateness for the target audience, and clarity of language. Construct and criterion validity were assessed through consistency checks and usability analyses, with data collected from 252 external evaluators across 57 higher education institutions. Additionally, 360-degree feedback was gathered from both external evaluation teams and the institutions involved in the evaluation process. Results: demonstrate strong content validity (Lawshe coefficient = 1.00, p < .05), high interrater consistency, and strong usability across various evaluator groups. Further evaluation confirmed the rubric's applicability and robustness across diverse institutional contexts. This study concludes that the developed rubric is a reliable and valid tool for enhancing and evaluating quality assurance practices in higher education.

Anahtar Kelimeler

RDL Kalıcı Bağlantı (PID)
https://rdlopen.rawdatalibrary.net/r/kostu/10723Resmi atıflarda kullanılan kalıcı adres
İndeks kayıtları
Kaydın indeks veri tabanlarındaki sayfası (aktarımda alınan kayıt numarasıyla). Erişim, indeksin kendi koşullarına bağlıdır.
Atıflar
Scopus
1
WoS
0
OpenAlex
2
Her kaynağın kendi saydığı toplam atıf; aktarım ve zenginleştirme sırasında alındı.
Tam Kayıt
AlanDeğerDil
dc.contributor.authorAkkoyunlu, Buket
dc.contributor.authorBardakcı, Salih
dc.contributor.authorYıldırım, Sibel Aksu
dc.contributor.authorAvşaroğlu, M. Dilek
dc.contributor.authorUludağ, Gonca
dc.contributor.authorKoçer, Ayhan
dc.contributor.authorElmas, Muzaffer
dc.date.accessioned2026-10-27T23:47:45.931199370Z
dc.date.available2026-10-27T23:47:45.931199370Z
dc.date.issued2025
dc.description.abstractThis study, initiated by the Turkish Higher Education Quality Council (THEQC), develops and validates a rubric-based approach for evaluating institutional quality assurance (QA) processes within the Turkish higher education ecosystem. Effective quality assurance (QA) in higher education requires evaluation tools that are methodologically robust, responsive to institutional needs, and aligned with international benchmarks. A rubric-based approach offers a structured and transparent framework for consistent assessments. The rubric was created through an iterative, evidence-based process incorporating expert feedback, international benchmarks, site visits, and prior research. It consists of 22 main criteria across four key domains—Leadership, Governance and Quality; Learning and Teaching; Research and Development; and Service to Society—subdivided into 46 sub-criteria, each assessed on a five-point maturity scale. The validity and reliability of the rubric were rigorously examined. Content validity was established through evaluations by 10 QA professionals, addressing four key dimensions: relevance, alignment with the intended domain, appropriateness for the target audience, and clarity of language. Construct and criterion validity were assessed through consistency checks and usability analyses, with data collected from 252 external evaluators across 57 higher education institutions. Additionally, 360-degree feedback was gathered from both external evaluation teams and the institutions involved in the evaluation process. Results: demonstrate strong content validity (Lawshe coefficient = 1.00, p < .05), high interrater consistency, and strong usability across various evaluator groups. Further evaluation confirmed the rubric's applicability and robustness across diverse institutional contexts. This study concludes that the developed rubric is a reliable and valid tool for enhancing and evaluating quality assurance practices in higher education.
dc.identifier.articlenumber102673
dc.identifier.doi10.1016/j.evalprogplan.2025.102673
dc.identifier.eissn1873-7870
dc.identifier.issn0149-7189
dc.identifier.pmid40803122
dc.identifier.scopus2-s2.0-105012936529
dc.identifier.urihttps://rdlopen.rawdatalibrary.net/r/kostu/10723
dc.identifier.volume113
dc.identifier.wosWOS:001550798100001
dc.language.isoen
dc.publisherElsevier Ltd
dc.relation.ispartofEvaluation and Program Planning
dc.rightsinfo:eu-repo/semantics/closedAccess
dc.subjectDevelopment
dc.subjectHigher education
dc.subjectQuality assurance
dc.subjectReliability
dc.subjectRubric-based evaluation
dc.subjectValidity
dc.subject.classificationSocial Sciences, Interdisciplinary
dc.subject.classificationSocial Sciences - Other Topics
dc.subject.otherBenchmarking
dc.subject.otherHumans
dc.subject.otherLeadership
dc.subject.otherProgram Evaluation
dc.subject.otherReproducibility of Results
dc.subject.otherTurkey
dc.subject.otherUniversities
dc.subject.otherhigher education
dc.subject.otherlearning
dc.subject.otherreliability analysis
dc.subject.otherteaching
dc.subject.otherarticle
dc.subject.othercontent validity
dc.subject.othercriterion related validity
dc.subject.otherevidence based practice
dc.subject.otherhuman
dc.subject.otherquality control
dc.subject.otherreliability
dc.subject.othertertiary education
dc.subject.othervalidity
dc.subject.otherorganization and management
dc.subject.otherprocedures
dc.subject.otherreproducibility
dc.subject.otherturkey (bird)
dc.subject.otheruniversity
dc.subject.othervalidation study
dc.titleDeveloping and validating a rubric-based approach to quality assurance in Turkish higher education
dc.typeArticle
rdl.citation.openalex2
rdl.citation.scopus1
rdl.citation.wos0
rdl.departmentÇankaya University, Türkiye
rdl.departmentHacettepe University, Türkiye
rdl.departmentAnkara University, Türkiye
rdl.departmentGiresun University, Türkiye
rdl.departmentHigher Education Council (CoHE), Türkiye
rdl.departmentKocaeli Health and Technology University, Türkiye
rdl.oa.statusclosed
rdl.scopus.quartileQ2
rdl.sdgSDG04
rdl.source.indexSCOPUS
rdl.source.indexWOS
rdl.source.indexPUBMED
rdl.wos.indexSocial Science Citation Index (SSCI)