Collaborative test development: the role of item moderation in ensuring test quality WORKSHOP8/3/2022
by Dr Olena Rossi. Wednesday 23rd February 1:00-2:30pm (UK time). Care taken during test development directly impacts on the test’s validity because poorly-constructed tests weaken inferences based on test scores. An important but often overlooked stage in the test development process is item moderation. Moderation is “the scrutiny of proposed items by (ideally) at least two colleagues, neither of whom is the author of the items being examined” (Hughes & Hughes, 2020, p.68). Careful item moderation makes item trialling more efficient. This is because moderation allows the identification and subsequent rejection (or revision) of problematic items early into the test development process so that trialling efforts are not wasted on poorly-constructed items. In this workshop, I suggest ways of setting up an efficient item moderation system at your institution. In particular, I provide guidance on establishing item-writer working groups, producing item moderation checklists, and giving effective feedback on items. Below, you can view the recording, moderation checklist, link to item writing for language testing website, and slides used during the workshop. Dr Olena Rossi & TAFSIG committee About Olena Rossi Olena Rossi has an MA and a PhD in Language Testing from Lancaster University, UK. Her main research interests are in test development, item writing, and assessment literacy for test stakeholders. Olena’s doctoral thesis looked into the nature of item-writing skills and their development. Olena also has a lot of practical language testing experience as an item writer, item reviewer, and consultant for language testing organisations. She has facilitated assessment-related workshops in different countries and has taught item-writing courses.
Comments are closed.
|
Archives
January 2023
Categories |