Understanding and achieving a stable rank

The stability of a rank is expressed at the top of the rank report in the Reliability score.

In the example below we can see how an Item's position on the rank becomes more stable as the session progresses. This is mirrored in the improved stability / confidence achieved in each round.

In this case a high degree of stability is achieved between 12 and 14 rounds - this is a typical outcome for most sessions. Note however that stability may be harder to achieve where Item quality is harder to discriminate. This may be because of the Items themselves, the ambiguity of the holistic statement or the proficiency of the Judges.

RM Compare produces live, 'in-session' reporting to allow administrators to monitor stability in real time.