Setting up Marking

Marking settings

When the assessment and schedule are finished, all the candidate answers are collected and ready to be marked.  

  1. Go to Marking and select, on the tab Coordinator, the assessment that needs to assessed.
  2. Settings: on this page you can set the marking conditions. See the next chapter 'Which settings do I need to use' for the steps.
  3. Assessors: on this page you can assign assessors and moderators. See chapter 'How can I assign assessors and moderators' for the steps.
  4. Allocation: in case you have chosen for multiple assessors, it is necessary to allocate the candidates results to assessors. On the Settings page you can allocate assessors to candidates or to items (questions). Depending on that setting, you can follow the chapter 'How can I allocate candidates to assessors' or 'How can I allocate items to assessors' for the steps.

Which settings do I need to use?

  1. Select Assessing type:
    • One assessor: each candidate (or item) will be marked by one assessor. This is the most chosen option.
    • Two assessorseach candidate (or item) will be marked by two assessors (4-eye method). Each assessor has the same weight in deciding the score for the marked candidate (or item). An average will be calculated.
  2. Select in Allocation by one of the following options:
    • Candidate: candidates are divided over the assessors. Also known as vertical marking.
    • Items: items are divided over the assessors. Also known as horizontal marking.
  3. Decide if you want to do the allocation by item or candidate, manually or let the assessor decide.
  4. Select Share assessments between assessors, when assessors may see annotations and scores given to a candidate/item by the other assessor. If you select this option you get two more settings:
    • Only if assessing same: the annotations and scores are only shared if the same item/candidate is being marked (depending on the setting).
    • All candidates/items: the annotations and scores are always shared.
  5. Select Anonymous Candidate to hide the names of the candidates during marking.
  6. If assessing type is set to Two assessors it is possible to select the option Anonymous Assessor. With that setting the assessors are unknown for each other.
  7. Select Manually score auto-scored questions if you want to be able to score items that are automatically scored by the system (i.e. multiple choice). 
  8. Press Add Moderation round to add the settings for assessing by a moderator (maximum of 3 rounds).
  9. In case you do not use Moderation, click on Save and next step to assign assessors to candidates/items.
    In case you do use Moderation, press 'Add moderation round' and follow the steps explained below:
  1. Select Show assessor annotations to allow the moderator to see the annotations of the first assessor(s).
  2. Enter the calculated % in which the marking differs between multiple assessors, to go to moderation (this is only applicable when you have selected Two assessors in Assessing type.
  3. Enter the % a candidate may deviate from the pass-mark to go to moderation.
  4. Enter the marking range % for candidates to go to moderation
  5. Enter the % for how many candidates (sample out of the population) to go to moderation.
  6. Add another moderation round if needed. The moderator can moderate the moderator.
  7. Click on Save and next step to assign assessors and moderators

All items need to be moderated. If you only moderate a few items and submit the scores, the original scores from the not-moderated items will not be submitted. As a moderator you start by loading first all given scores by the assessors and then moderated the desired items. When finished, submit the results. 

How can I assign assessors and moderators?

After completing the Settings you can start assigning assessors and moderators. This is a mandatory step in the marking process.

  1. You are now guided to the tab Assessors.
  2. Search by name to add the assessor. Click on the name when it is shown. The assessor will be selected.
  1. Select one of the following roles:
    • Assessor
    • Moderator: assessor during moderation. 
    • Assessor and Moderator: you can assess and moderate
    • Other: with this role the person has no assessing abilities, but still is able to publish results of the assessment. This type of role is often assigned to you Faculty coordinator Digital Assessment.
  2. Select if the assessor needs to be able to Publish Results after marking.
  3. Select if the assessor needs to be able to Edit marking scheme (only applicable to Essay questions) during the marking.
  4. Select if the assessor needs to be able to Rescore items
  5. Select if the assessor may see the results in the Audit page.
    You have now added an assessor with a role. Repeat all steps to add more assessors.
  6. Click on Save and next step.

Did you assign an incorrect assessor? Mark the checkbox in front of the name and click Remove. This is possible as long as the marking has not started yet. Else all marking will be lost, done by that assessor.

How can I allocate candidates to assessors?

This step is only applicable when chosen Allocate by candidate in the settings. 

After assigning the assessors you can allocate the assessors to candidates. You can do that manually or automatically.

Automatic allocation assessors:

  • Click on Automatic allocation
  1. Select Assign to all candidates if an assessor will mark all candidates. Select the assessor in the dropdown.
  2. Select Set assessors randomly to allocate assessor randomly to candidates.
  3. Click on Save and Close.

Manually allocate assessors

  1. Click on tab Allocation.
  2. Click on Select assessor and choose an assessor for each candidate.
  3. Click on Save.

How can I allocate items to assessors?

After assigning the assessors you can allocate the assessors to items. You can do that manually or automatically.

Automatic allocation assessors

  • Click on Automatic allocation.
  1. Select Assign to all items if an assessor will mark all items. Select the assessor in the dropdown.
  2. Select Set assessors randomly to allocate assessors randomly to items.
  3. Click on Save and Close.

Manually allocate assessors

  1. Click on tab Allocation.
  2. Click on Select assessor and choose an assessor for each item.
  3. Click on Save.