Two Markers Per Student (Parallel Marking)

What is Two markers per Student (Parallel Marking)?

Blackboard assignments have a 'Two markers per student' option, this allows staff to be assigned as a marker or reconciler. The system automatically assigns two markers to each submission, these markers mark in parallel and provide provisional marks. The reconciler reviews the provisional marks and determines the final mark for the student.

Screenshot 2024-10-30 at 22.58.19.png

 

Use the marking option 'Two markers per student' when you need marking and feedback from more than one marker and want to distribute the marking workload evenly.

Characteristics of 'Two markers per student' marking option

  • Each marker will mark a student’s submission in parallel, they won’t see other markers' marks, feedback, annotations on student files.

  • Once staff are assigned as markers the system randomly assigns them students. The marking workload is distributed evenly among the markers. Markers can only open the submissions for the students assigned to them.

  • You can have more than one reconciler but a marker cannot be a reconciler on the same assignment

  • Reconcilers can view the markers' marks and feedback, but not their annotations in student files.

  • Reconcilers determine, override and post final marks.

Setting up Two markers per student


1. Open your Blackboard assessment dropbox, click on the Assignment Settings cog

Screenshot 2024-10-30 at 22.20.20.png

In the Assessment settings panel, scroll down to in the Marking and Submissions section.

  1. Select the check box for 'Two markers per student', then click the Assign markers link that appears.

NB if you want the marking to be anonymous then select the checkbox beside ‘Hide students names’

On the Assign Markers screen, Unassigned staff appear at the top.

  1. You can either assign all staff as markers by clicking on Assign All Markers link at the top of the page

 

Or you can assign staff individually by clicking on the ellipsis beside each name, and using the drop-down options to assign that person as a marker or a reconciler.

You can use the ellipsis to Unassign a marker or reconciler.

 

A marker cannot be a reconciler and vice versa, you need to set at least one reconciler before you can save your settings.

  1. Select Save when you're finished assigning markers and reconcilers.

 

  1. Then save the Assignment settings

 

The marking workload is then distributed evenly among the markers.

Marking assessments

Markers can only access the submissions in Gradebook that are assigned to them.

Markers don't receive notifications in the activity stream when they submissions to mark.

 

  • Each marker marks the student’s submission as normal* independently of the other marker, they won’t see the other markers' marks, annotations or feedback.

  • The system randomly assigns markers so that the marking workload is distributed evenly among the markers.

 

Marker’s annotations aren't available to students or reconcilers. Reconcilers can't edit markers' marks and feedback.

After markers provide marks and feedback for their sets of submissions the students' marking status is set to complete, they don’t post their marks.

 

When both markers have marked the submission, the reconciler receives an activity stream notification.

Reconciling marks

When the reconciler is notified that a submission is ready reconcile, they click on the submission link to view both marker’s marks and feedback. They can only view the markers' entries, not edit them. For instance, they can open the feedback icon on the right (B) and review the markers feedback and then enter the final feedback at the top (C). The reconciler can then enter the final mark (A). The student will only see the reconciler’s mark and feedback when it is posted.

Only the reconciler can post the marks. The student and markers can only view the Reconciler’s marks and feedback. Markers can't edit their evaluations after final marks are posted.

 

Reconcile All marks automatically

As a reconciler, you can use Reconcile All to "batch" reconcile if you have confidence in your markers and want to assign the average of their marks to each attempt.

You can use this functionality before all students have finished submitting their assignments and before all the the markers have finished. You can automatically reconcile the marks for the attempts that exist. This action is irreversible. Reconciliation doesn't override manually reconciled or previously reconciled marks.

On the Submissions page, select the Reconcile All link.

Select the mark to use:

  • Average marks

  • Highest mark

  • Lowest mark

 

If you choose to reconcile all marks and you've associated a rubric with the assessment, an Override label appears on the Submissions list page only.

If the final grade is calculated based on the highest graded attempt, the final grade appears immediately after at least one attempt is reconciled. But, the grade may change as students submit more attempts.

Student view of reconciled marks and feedback

After reconciliation, you can post the final grades for students. Once posted, the Students can view their mark and feedback as normal. Students only see the mark and feedback from the reconciler not the individual markers.

Related Articles

Centre for Digital Learning Enhancement
ulster.ac.uk/learningengancement/cdle