Resources : Inter rater agreement

Inter Rater Agreement

Computing Inter-Rater Reliability for Observational Data: An Overview and Tutorial

Measures of Inter Rater Agreement

What is Cohen,s Kappa

How to calculate inter and Intra rater reliability