Validity evidence using expert judgment: a study of using item congruence involving expert judgements for evidence for validity of a reading test
This study demonstrates the use of the Item Objective Congruence Method (IOC) for a content validation procedure to evaluate the congruence between reading test items constructed and the reading sub-skills they were intended to measure. The IOC allows for quantification of the content validity evide...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English English |
| Published: |
The International Institute of Islamic Thought and Civilization (ISTAC)- IIUM
2018
|
| Subjects: | |
| Online Access: | http://irep.iium.edu.my/69103/ http://irep.iium.edu.my/69103/ http://irep.iium.edu.my/69103/1/69103_Validity%20evidence%20using%20expert%20judgment.pdf http://irep.iium.edu.my/69103/2/69103_Validity%20evidence%20using%20expert%20judgment_SCOPUS.pdf |
| id |
iium-69103 |
|---|---|
| recordtype |
eprints |
| spelling |
iium-691032019-02-01T03:25:04Z http://irep.iium.edu.my/69103/ Validity evidence using expert judgment: a study of using item congruence involving expert judgements for evidence for validity of a reading test Jusoh, Zailani Zubairi, Ainol Madziah Badrasawi, Kamal J I L Education (General) This study demonstrates the use of the Item Objective Congruence Method (IOC) for a content validation procedure to evaluate the congruence between reading test items constructed and the reading sub-skills they were intended to measure. The IOC allows for quantification of the content validity evidence of a test or an instrument. In this study, experts were asked to rate 96 reading comprehension test items against the sub-skills that the items were intended to measure. In line with the concept of justice in Islam, it is important that the evidence of justice is demonstrated. Using ten English language experts who were also experienced test writers, the study found different degrees of agreement between the experts in terms of what some of the items were supposed to measure. Items that showed considerable incongruence are those that test multiple subskills. Whereas, items that had high degree of congruence are those that clearly test a single subskill. The International Institute of Islamic Thought and Civilization (ISTAC)- IIUM 2018-12-31 Article PeerReviewed application/pdf en http://irep.iium.edu.my/69103/1/69103_Validity%20evidence%20using%20expert%20judgment.pdf application/pdf en http://irep.iium.edu.my/69103/2/69103_Validity%20evidence%20using%20expert%20judgment_SCOPUS.pdf Jusoh, Zailani and Zubairi, Ainol Madziah and Badrasawi, Kamal J I (2018) Validity evidence using expert judgment: a study of using item congruence involving expert judgements for evidence for validity of a reading test. Al-Shajarah, Special Issue: Education. pp. 307-320. ISSN 1394-6870 http://journals.iium.edu.my/shajarah/index.php/shaj/article/view/766 |
| repository_type |
Digital Repository |
| institution_category |
Local University |
| institution |
International Islamic University Malaysia |
| building |
IIUM Repository |
| collection |
Online Access |
| language |
English English |
| topic |
L Education (General) |
| spellingShingle |
L Education (General) Jusoh, Zailani Zubairi, Ainol Madziah Badrasawi, Kamal J I Validity evidence using expert judgment: a study of using item congruence involving expert judgements for evidence for validity of a reading test |
| description |
This study demonstrates the use of the Item Objective Congruence Method (IOC) for a content validation procedure to evaluate the congruence between reading test items constructed and the reading sub-skills they were intended to measure. The IOC allows for quantification of the content validity evidence of a test or an
instrument. In this study, experts were asked to rate 96 reading comprehension test items against the sub-skills that the items were intended to measure. In line with the concept of justice in Islam, it is important that the evidence of justice is demonstrated. Using ten
English language experts who were also experienced test writers, the study found different degrees of agreement between the experts in terms of what some of the items were supposed to measure. Items that
showed considerable incongruence are those that test multiple subskills. Whereas, items that had high degree of congruence are those that clearly test a single subskill. |
| format |
Article |
| author |
Jusoh, Zailani Zubairi, Ainol Madziah Badrasawi, Kamal J I |
| author_facet |
Jusoh, Zailani Zubairi, Ainol Madziah Badrasawi, Kamal J I |
| author_sort |
Jusoh, Zailani |
| title |
Validity evidence using expert judgment: a study of using item congruence involving expert judgements for evidence for validity of a reading test |
| title_short |
Validity evidence using expert judgment: a study of using item congruence involving expert judgements for evidence for validity of a reading test |
| title_full |
Validity evidence using expert judgment: a study of using item congruence involving expert judgements for evidence for validity of a reading test |
| title_fullStr |
Validity evidence using expert judgment: a study of using item congruence involving expert judgements for evidence for validity of a reading test |
| title_full_unstemmed |
Validity evidence using expert judgment: a study of using item congruence involving expert judgements for evidence for validity of a reading test |
| title_sort |
validity evidence using expert judgment: a study of using item congruence involving expert judgements for evidence for validity of a reading test |
| publisher |
The International Institute of Islamic Thought and Civilization (ISTAC)- IIUM |
| publishDate |
2018 |
| url |
http://irep.iium.edu.my/69103/ http://irep.iium.edu.my/69103/ http://irep.iium.edu.my/69103/1/69103_Validity%20evidence%20using%20expert%20judgment.pdf http://irep.iium.edu.my/69103/2/69103_Validity%20evidence%20using%20expert%20judgment_SCOPUS.pdf |
| first_indexed |
2023-09-18T21:38:04Z |
| last_indexed |
2023-09-18T21:38:04Z |
| _version_ |
1777412955027013632 |