Contributing Judges (AKA - getting students to submit and judge their own work)

One of the most common use cases we have right now, especially in the HE sector, is Peer Assessment. A key driver here is the need to provide students with rich feedback as part of the learning process. However, with increasing student numbers and over-stretched staff this is quite a challenge. Using Students as Contributing Judges unlocks some significant benefits.

What is a contributing judge?

At the most basic level, we need 2 things to make an Adaptive Comparative Judgement session work - Judges and Items. Judges are invited by the session admin (there are a number of ways of doing this), who in most cases also adds in all the items to be judged.

There is however the option of asking the Judges to directly submit their own items - in other words we ask them to be Contributing Judges.

If you are a Session Administrator, you can read more HERE. If you are a Contributing Judge yourself there is more information in the Judge Corner.

What's the point?

The Contributing Judges approach is most commonly used in a Peer Learning scenario. Aside from the obvious time saving element of getting students to add their own items, it also encourages more ownership of the entire process helping them to better understand the underlying benefits.

However, the most significant benefits take place in the reporting where Students can get instant feedback about their Item in the form of an anonymized rank order and comments.

Setting up a Contributing Judge Session

Session administrators have a number of options to consider when setting up a new session. You will find many of these in the Session Overview area. Here you will find Feedback and Judging tabs that give you a selection of powerful options for sessions involving Contributing Judges.

The judging tab is where you can allow Judges to upload items - in other words you are facilitating Contributing Judges.

The Feedback area allows you to describe what type of feedback you want your Judges to contribute.

What reporting is available to Contributing Judges?

Whereas Session Administrators are able to see all of the results from the session, Contributing Judges can only see information that pertains to their own Item.

The Rank Order is presented in a way where the Contributing Judge can see where their own item is placed, however all other Items are anonymised.

Contributors can also review the feedback received about their Item from other Judges.