Is ICC the correct test?


New Member
I would like to study junior versus senior interviewers when they score job applicants. Each applicant has five interviews, one by a junior faculty and then four by senior members, and gets assigned a score 1-10 from each interviewer. Interviewers are not always the same and have not interviewed the same number of candidates. I want to look at whether the junior interviewers score applicants similar to the senior interviewers.

A one way ICC seems to make sense to look at the reliability across all interviewers, but if I want to specifically compare the junior interviewers to their senior counterparts, is there a more appropriate test to use?

Down the line I want to look at how candidate variables effect junior vs senior interviewer scores- would ANOVA be the best test to address this?

Thanks for the help!