Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios

Although writing electronic portfolios (ePortfolios) help learners communicate digitally and provide a platform for works to be better collected and presented, challenges are present in their assessment. This paper reports the development and validation of a writing ePortfolio scoring rubric for an...

Full description

Bibliographic Details
Main Authors:	Lallmamode, Sheila Parveen, Mat Daud, Nuraihan, Abu Kassim, Noor Lide
Format:	Article
Language:	English
Published:	Elsevier 2016
Subjects:	L Education (General) PE English
Online Access:	http://irep.iium.edu.my/52378/ http://irep.iium.edu.my/52378/ http://irep.iium.edu.my/52378/ http://irep.iium.edu.my/52378/1/Development%20%26%20Initial%20Argument-Based%20Validation.pdf

id	iium-52378
recordtype	eprints
spelling	iium-523782016-12-07T02:18:41Z http://irep.iium.edu.my/52378/ Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios Lallmamode, Sheila Parveen Mat Daud, Nuraihan Abu Kassim, Noor Lide L Education (General) PE English Although writing electronic portfolios (ePortfolios) help learners communicate digitally and provide a platform for works to be better collected and presented, challenges are present in their assessment. This paper reports the development and validation of a writing ePortfolio scoring rubric for an action research course for L2 learners. Using Bachman's (2005) 'Assessment Use Argument' as a basis, two main claims to support the validity of the rubric were examined: (1) the rubric is a reliable tool; and, (2) the rubric is relevant to the construct being measured. A mixed-method approach was used in the development and validation of the eight-criteria analytic and holistic evaluation scoring rubric. Thirteen raters evaluated thirty-eight ePortfolios in the study. The analyses of raters' rating using many-facet Rasch measurement approach and raters' individual standardised open-ended interviews indicated that overall the rubric's analytic categories functioned appropriately to assess the intended construct. However, the criterion 'Ease of Navigation' was found to be misfitting due to a differences in raters' evaluation of the same ePortfolios. Overall, the argument-based validation indicated that the scoring rubric is a reliable and valid instrument for the purpose of assessing L2 writing ePortfolios in the context for which it was developed. Elsevier 2016-10-01 Article PeerReviewed application/pdf en http://irep.iium.edu.my/52378/1/Development%20%26%20Initial%20Argument-Based%20Validation.pdf Lallmamode, Sheila Parveen and Mat Daud, Nuraihan and Abu Kassim, Noor Lide (2016) Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios. Assessing Writing, 30. pp. 44-62. ISSN 1075-2935 http://www.journals.elsevier.com/assessing-writing DOI: 10.1016/j.asw.2016.06.001
repository_type	Digital Repository
institution_category	Local University
institution	International Islamic University Malaysia
building	IIUM Repository
collection	Online Access
language	English
topic	L Education (General) PE English
spellingShingle	L Education (General) PE English Lallmamode, Sheila Parveen Mat Daud, Nuraihan Abu Kassim, Noor Lide Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios
description	Although writing electronic portfolios (ePortfolios) help learners communicate digitally and provide a platform for works to be better collected and presented, challenges are present in their assessment. This paper reports the development and validation of a writing ePortfolio scoring rubric for an action research course for L2 learners. Using Bachman's (2005) 'Assessment Use Argument' as a basis, two main claims to support the validity of the rubric were examined: (1) the rubric is a reliable tool; and, (2) the rubric is relevant to the construct being measured. A mixed-method approach was used in the development and validation of the eight-criteria analytic and holistic evaluation scoring rubric. Thirteen raters evaluated thirty-eight ePortfolios in the study. The analyses of raters' rating using many-facet Rasch measurement approach and raters' individual standardised open-ended interviews indicated that overall the rubric's analytic categories functioned appropriately to assess the intended construct. However, the criterion 'Ease of Navigation' was found to be misfitting due to a differences in raters' evaluation of the same ePortfolios. Overall, the argument-based validation indicated that the scoring rubric is a reliable and valid instrument for the purpose of assessing L2 writing ePortfolios in the context for which it was developed.
format	Article
author	Lallmamode, Sheila Parveen Mat Daud, Nuraihan Abu Kassim, Noor Lide
author_facet	Lallmamode, Sheila Parveen Mat Daud, Nuraihan Abu Kassim, Noor Lide
author_sort	Lallmamode, Sheila Parveen
title	Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios
title_short	Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios
title_full	Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios
title_fullStr	Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios
title_full_unstemmed	Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios
title_sort	development and initial argument-based validation of a scoring used in the assessment of l2 writing electronic portfolios
publisher	Elsevier
publishDate	2016
url	http://irep.iium.edu.my/52378/ http://irep.iium.edu.my/52378/ http://irep.iium.edu.my/52378/ http://irep.iium.edu.my/52378/1/Development%20%26%20Initial%20Argument-Based%20Validation.pdf
first_indexed	2023-09-18T21:14:13Z
last_indexed	2023-09-18T21:14:13Z
_version_	1777411454080647168

Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios

Similar Items