Setting up a new ACJ session

This article will focus on the first steps of planning. We will taking you through the process of creating a new session and all the available settings.

1. Creating a new session

An RM Compare session involves planning your assessment, to doing the judgements and reviewing your results.

RM Compare UI - Create session button highlighted in the top-right corner of the session's dashboard

Find the Create new session button in your session’s dashboard right top corner, create a unique title for it and provide a short description.

Defining your holistic statement

RM Compare UI - Basic settings

The importance of a good Holistic Statement cannot be over-estimated. When judges are deciding the relative merit of 2 items, the Holistic Statement will be their only term of reference.

2. Session Settings

Session settings are available in the Feedback and Judging tabs under the Overview section of your session dashboard. 

Feedback Settings

Enabling feedback in your sessions is a good way to encourage judges to reflect on their decisions as they progress. In doing so this can encourage deeper learning. The information can also be used to stimulate collaborative discussion amongst participants, for example as part of continued professional development.

RM Compare UI - Feedback settings

Enable comments on judgements

Ask judges to justify their decisions (I.e., why they chose one option over the other).

When enabled, by default comments will be set as optional. You can make them mandatory for all pairs or only for a specific number of pairs at the start of the session (i.e., if you set 5 mandatory comments, only the first 5 judgements will require comments).

Enable feedback on items

Allow judges to leave feedback on individual pieces of work. This can be a useful tool for teachers to flag a particular piece of work that they find interesting to their team or to students in the class, or to gather feedback from students about their peers’ work when used for Peer learning.

By default, feedback will be optional, but you can also make it compulsory for all items.

Judging Settings

Customise what your judges cand do and see during the session.

RM Compare UI - Judging settings

Allow judges to submit their own items

This can be useful If you’re planning a session in which judges will be assessing their own work (i.e., when using RM Compare for peer assessment).

You can also restrict the file types (e.g., image, video or word documents) and set-up a specific time window for submissions.

Allow judges to view results

Make final reports of the session available for all participating judges. Results will be automatically anonymised; every judge will only be able to see their own name.

Set custom number of rounds

The number of rounds in a session is automatically calculated by RM Compare, but you can also manually setup a specific number of rounds if you wish to.

To learn more about how the number of rounds and judgements can impact the confidence rate of your rank read our advice on How-to use the Judgement calculator. 

Can’t find what you’re looking for?

Get in touch, we are here to help.

Related Articles