Moderation using Blackboard Ultra

Moderation using Blackboard Ultra

Moderation ensures fair, consistent marking through internal review, sampling, and oversight by External Examiners before exam board validation. This page gives a brief overview of how Blackboard can be used for moderation processes in Ulster University. The methods and tools outlined will help staff remain compliant with the moderation practices detailed in the Assessment Code of Practice (as defined below).

The Gradebook in Blackboard Ultra provides a centralised location to view and manage all grades, including any overridden marks. Where work is not electronically submitted, grades and feedback should still be recorded and can be made available to students via a manually-created Gradebook item or an offline submission assignment in Gradebook.

The Assessment Code of Practice covers many forms of moderation, once you are clear on the methods you need to use, you will find some suggested workflows for these in Blackboard Ultra.

You are welcome to contact CDLE, or book a one to one, to discuss what would work best for your particular needs.

Moderation practices

Suggested workflows

Moderation practices

Suggested workflows

Dual marking:

Where two markers are assigned to assess different aspects of an assessment, e.g. in student projects, one marker assesses for process and the other for content.

Access Gradebook > Markable items, click on name of assignment, view submissions, mark in usual way:

  • Blackboard assignments

Marking and feedback in Blackboard assignments
In Blackboard both markers can use single overall comments and rubric (if used). In Blackboard there is also an opportunity for each marker to use the comment on each specific rubric criteria.

See Mark using rubric in Blackboard

 

  • Turnitin assignments

Marking and feedback of Turnitin assignments

In Turnitin both markers can use single overall comments and rubric (if used).

See Mark using a rubric in Turnitin

Sampling:

In this instance, a moderator will receive a sample of marked work with grades and feedback attached. The moderator will review this sample to validate the marks and to check the overall standards and consistency of marking, and the quality of feedback

Access Gradebook > Markable items, click on name of assignment, view submissions and view as instructed.

When sampling the moderator will just view and has no need to amend or add comments.

To facilitate this process, you can set up a ‘Sampling groups’ in Groups, for each coursework component. The moderator can then use the filter functionality in the Gradebook > Marks view to see only the assignments belonging to the sample group which need moderated.

Double marking:

Each script is marked by two markers (same as 100% monitoring). The second marker has sight of the first marker’s marks. The final mark is determined by agreement between the two markers. For example, final year projects/ dissertations.

Students should never see two sets of grades and feedback. Provide feedback to students through the designated feedback area, this could include written comments, rubric feedback, and/or attached files.

  1. Access Gradebook > Markable items, click on name, view submissions, mark in usual way.

  1. Second marker sees first marker marks and comments and agrees (and leaves comment in overall comment referencing their agreement).

Parallel marking/ 2 markers per student setting in Blackboard assignments only. This could also be used to filter views of students to mark/second mark (be aware of limitations -can’t be used with groups or Turnitin functionality)

Alternative workflow (contact CDLE for advice)

Set up two dropboxes for the course submission (a main assignment dropbox – can be BB Assignment or Turnitin) for students to submit into and a hidden ‘Offline submission’ dropbox .

Ask all Assessor 1 staff to mark and add feedback in the main dropbox, Assessor 2 markers should go into the hidden dropbox to add their marks and feedback. The Assessors meet and agree a mark and they (or the Module Coordinator) incorporate both and incorporate all feedback and grades to release to students in the main assignment dropbox.

Double blind marking:

Similar to double marking except that the second marker does not have sight of the marks awarded by the first marker.

Alternative workflows (contact CDLE for advice)

  • One submission drop boxes with rubric attached, one local copy of submission for 2nd marker and offline assignment with rubric attached for second marker to add overall comment and use rubric.

  • Set up two drop boxes with rubrics attached, mark independently, get students to upload twice and then have a final mark award column (create item in Gradebook) agreed between two markers.

  • Double marking assignments (Two Markers Per Student) could be used, but be aware of limitations, in that student does not see rubric and reconciler can only see final marks, not the rubric. Rubric is only released once student marks have been posted.

Arbitration:  

Individual cases where the marker and moderator are unable to agree a mark, the Course Director will identify an arbiter who will determine the mark and feedback recorded. In this case, the feedback sheet will include the arbiter’s name.

 

To add notes or feedback to a student’s submission (that students cannot see):

  1. Access Gradebook > Marks tab.

  2. Click on the mark awarded for the student and select Feedback & Notes.

  3. Use marker notes to attach feedback sheet (These can only be seen by instructors/ markers in the module)

  4. To access these notes, instructors may also select the Notes tab on the Student Overview page.

 

Related articles

 

Useful links

Centre for Digital Learning Enhancement
ulster.ac.uk/learningengancement/cdle