The effects of test characteristics on the hierarchical order of reading skills
Purpose – The study sought to determine the hierarchical nature of reading skills. Whether reading is a ‘unitary’ or ‘multi-divisible’ skill is still a contentious issue. So is the hierarchical order of reading skills. Determining the hierarchy of reading skills is challenging as item difficulty...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English English |
| Published: |
Universiti Utara Malaysia Press
2017
|
| Subjects: | |
| Online Access: | http://irep.iium.edu.my/57342/ http://irep.iium.edu.my/57342/ http://irep.iium.edu.my/57342/1/THE%20EFFECTS%20OF%20TEST%20CHARACTERISTICS%20ON%20THE%20HIERARCHICAL%20ORDER%20OF%20READING%20SKILLS.pdf http://irep.iium.edu.my/57342/7/57342_The%20effects%20of%20test%20characteristics_SCOPUS.pdf |
| id |
iium-57342 |
|---|---|
| recordtype |
eprints |
| spelling |
iium-573422017-07-12T01:30:13Z http://irep.iium.edu.my/57342/ The effects of test characteristics on the hierarchical order of reading skills Badrasawi, Kamal J I Abu Kassim, Noor Lide Mat Daud, Nuraihan H Social Sciences (General) PE English Purpose – The study sought to determine the hierarchical nature of reading skills. Whether reading is a ‘unitary’ or ‘multi-divisible’ skill is still a contentious issue. So is the hierarchical order of reading skills. Determining the hierarchy of reading skills is challenging as item difficulty is greatly influenced by factors related to test characteristics. To examine the interaction between these factors and item difficulty, and determine the possibility of such a hierarchy, this study used the multifaceted Rasch approach. Methodology – In this descriptive study, a 42-MCQ reading test was administered to 944 ESL lower secondary students, randomly selected from eleven Malaysian national-type schools in the Federal Territory of Kuala Lumpur and the state of Selangor. These student populations were selected as the development of reading ability was considered critical at this stage of schooling. The reading test items were identified according to the following aspects: Reading Skill Areas (Interpreting information, making Inference, Understanding figurative language, Drawing conclusions, Scanning for details and Finding word meanings), Context Type (Linear and Non-Linear), and Text Type (Ads, Notice, Chart, Story extract, Short message, Poem, Short news report, Brochure, Formal letter, Conversation, Long passage and weather forecast). Applying the Many-Facet Rasch model of measurement, the study analyzed student responses to the test items with the help of FACETS, version 3.7.1.4. Findings – The findings showed that context types, skill areas, and text types differed in difficulty (p<.01), with those items that required understanding and interpretation being more demanding. Test items based on linear contexts were more difficult than those based on non-linear contexts. Understanding figurative language was found to be the most difficult skill followed by Making inference and Interpreting information. The easiest reading skill was Scanning for details, followed by Finding word meanings. The reading skill, Drawing conclusions, was close to the average difficulty level. The findings also indicated that texts that were longer and had more information tended to be more difficult. Significance – This study has also shed new light on the theory and practice of reading. The findings support the hierarchical nature of reading skills. Different reading skills were found to exert differential cognitive demands, and those which required higher cognitive ability were more difficult for learners to acquire and perform. Understanding the hierarchy of reading skills will help language teachers to target their teaching more effectively; course designers to produce more appropriate teaching and learning materials; and test writers to develop test items that better meet students’ reading competencies. Keywords: Reading hierarchy; reading skills; many-facet Rasch analysis; FACETS. Universiti Utara Malaysia Press 2017-06 Article PeerReviewed application/pdf en http://irep.iium.edu.my/57342/1/THE%20EFFECTS%20OF%20TEST%20CHARACTERISTICS%20ON%20THE%20HIERARCHICAL%20ORDER%20OF%20READING%20SKILLS.pdf application/pdf en http://irep.iium.edu.my/57342/7/57342_The%20effects%20of%20test%20characteristics_SCOPUS.pdf Badrasawi, Kamal J I and Abu Kassim, Noor Lide and Mat Daud, Nuraihan (2017) The effects of test characteristics on the hierarchical order of reading skills. Malaysian Journal of Learning and Instruction, 14 (1). pp. 63-82. ISSN 1675-8110 E-ISSN 2180-2483 http://mjli.uum.edu.my/index.php |
| repository_type |
Digital Repository |
| institution_category |
Local University |
| institution |
International Islamic University Malaysia |
| building |
IIUM Repository |
| collection |
Online Access |
| language |
English English |
| topic |
H Social Sciences (General) PE English |
| spellingShingle |
H Social Sciences (General) PE English Badrasawi, Kamal J I Abu Kassim, Noor Lide Mat Daud, Nuraihan The effects of test characteristics on the hierarchical order of reading skills |
| description |
Purpose – The study sought to determine the hierarchical nature
of reading skills. Whether reading is a ‘unitary’ or ‘multi-divisible’
skill is still a contentious issue. So is the hierarchical order of reading
skills. Determining the hierarchy of reading skills is challenging
as item difficulty is greatly influenced by factors related to test
characteristics. To examine the interaction between these factors
and item difficulty, and determine the possibility of such a hierarchy,
this study used the multifaceted Rasch approach.
Methodology – In this descriptive study, a 42-MCQ reading test
was administered to 944 ESL lower secondary students, randomly
selected from eleven Malaysian national-type schools in the Federal
Territory of Kuala Lumpur and the state of Selangor. These student
populations were selected as the development of reading ability was
considered critical at this stage of schooling. The reading test items
were identified according to the following aspects: Reading Skill
Areas (Interpreting information, making Inference, Understanding
figurative language, Drawing conclusions, Scanning for details and Finding word meanings), Context Type (Linear and Non-Linear),
and Text Type (Ads, Notice, Chart, Story extract, Short message,
Poem, Short news report, Brochure, Formal letter, Conversation,
Long passage and weather forecast). Applying the Many-Facet
Rasch model of measurement, the study analyzed student responses
to the test items with the help of FACETS, version 3.7.1.4.
Findings – The findings showed that context types, skill areas, and
text types differed in difficulty (p<.01), with those items that required
understanding and interpretation being more demanding. Test items
based on linear contexts were more difficult than those based on
non-linear contexts. Understanding figurative language was found
to be the most difficult skill followed by Making inference and
Interpreting information. The easiest reading skill was Scanning
for details, followed by Finding word meanings. The reading skill,
Drawing conclusions, was close to the average difficulty level. The
findings also indicated that texts that were longer and had more
information tended to be more difficult.
Significance – This study has also shed new light on the theory and
practice of reading. The findings support the hierarchical nature of
reading skills. Different reading skills were found to exert differential
cognitive demands, and those which required higher cognitive
ability were more difficult for learners to acquire and perform.
Understanding the hierarchy of reading skills will help language
teachers to target their teaching more effectively; course designers
to produce more appropriate teaching and learning materials; and
test writers to develop test items that better meet students’ reading
competencies.
Keywords: Reading hierarchy; reading skills; many-facet Rasch analysis; FACETS. |
| format |
Article |
| author |
Badrasawi, Kamal J I Abu Kassim, Noor Lide Mat Daud, Nuraihan |
| author_facet |
Badrasawi, Kamal J I Abu Kassim, Noor Lide Mat Daud, Nuraihan |
| author_sort |
Badrasawi, Kamal J I |
| title |
The effects of test characteristics on the hierarchical order of reading skills |
| title_short |
The effects of test characteristics on the hierarchical order of reading skills |
| title_full |
The effects of test characteristics on the hierarchical order of reading skills |
| title_fullStr |
The effects of test characteristics on the hierarchical order of reading skills |
| title_full_unstemmed |
The effects of test characteristics on the hierarchical order of reading skills |
| title_sort |
effects of test characteristics on the hierarchical order of reading skills |
| publisher |
Universiti Utara Malaysia Press |
| publishDate |
2017 |
| url |
http://irep.iium.edu.my/57342/ http://irep.iium.edu.my/57342/ http://irep.iium.edu.my/57342/1/THE%20EFFECTS%20OF%20TEST%20CHARACTERISTICS%20ON%20THE%20HIERARCHICAL%20ORDER%20OF%20READING%20SKILLS.pdf http://irep.iium.edu.my/57342/7/57342_The%20effects%20of%20test%20characteristics_SCOPUS.pdf |
| first_indexed |
2023-09-18T21:21:03Z |
| last_indexed |
2023-09-18T21:21:03Z |
| _version_ |
1777411883626659840 |