Norming is a practice of determining how to address grey areas on a rubric and consistently assign scores that hold students to the same standards, no matter who is doing the scoring. In schools and at conferences, teachers and assessment scorers meet to become familiar with rubric language, score sample student work, discuss discrepancies, and decide how to consistently apply the rubric moving forward.
We can't realistically gather Graiders around a table to have discussions like this, but will sometimes ask you to participate in norming activities on certain assignments to help ensure accurate scoring across different classes that complete the same assignment. Graiders who complete these activities also report that they feel more confident and more efficient in their grading moving forward.
- Norming activities: For some large-scale assessments, you'll be asked to complete a module in Google forms that introduces you to some combination of information about the assignment/rubric, grading expectations, and scored samples. Then you'll be asked to complete a quiz or performance task to demonstrate understanding of scoring or special cases. In most cases, you will receive feedback on your performance so you know what to do once scoring for real students begins.
- Norming with other Graiders: There may be opportunities to compare scores or participate in short conversations with other Graiders to ensure you are applying the rubric consistently. We'll give you more information if you receive an assignment where this is true!
- Norming against scored samples: If you have scored student work samples, always work with these in mind so that you are scoring consistently with the teacher's expectations or (in case of AP work), the College Board's standards.
See also: Best practices for accurate scoring