icc

  1. N

    Measuring equivalence/reliability (ICC and consorts)

    For a reliability study I’m administering patient reported outcomes (questionnaires) with 2 modes of administration (on paper and via an electronic device). I’d like to measure equivalence/reliability of the 2 modes of administration. In other words: does the electronic version of the...
  2. S

    Inter/Intra-class correlation between graders, large dataset

    I have a set of 100 images obtained from a machine called an OCT, its similar to an ultra-sound and I use it to take pictures of various skin cancers. The main goal is to give a diagnosis by looking at the OCT image. To do so, I pulled 8 ‘features’ that I can observe by OCT. Each feature or...
  3. J

    CI to percentage change in ICC

    I'm running fixed effects models to estimate changes in intra class correlations. I first run an unconditional model and then a second model including only level-2 factors. I'm interested in the reduction of the icc when adding only level-2 factors. I'm interested in expressing the...
  4. N

    Interrater reliability test on 3 raters (2 experts and 1 non-expert) on ordinal data

    I need to find the interrater reliability between 3 raters. A nurse (non-expert) performed 60 ultrasound scans and categorised patients into 3 ordinal and also categorical variables (hypovolemic, euvolemic, hypervolemic) according to the scans. The recorded scans were then subsequently...
  5. U

    Weighted Kappa vs. ICC for rater agreement

    I am helping a friend with a research study. Two raters are ranking publications based on 31 yes or no questions. For each question they assign a value of 1 for yes and 0 for no. For each publication, the number of 1's (yeses) is determined. For example for the same publication one rater might...
  6. D

    Reliability between sets - is the intraclass correlation coefficient appropriate?

    Hi, I am having trouble applying the ICC to data I have collected for my Masters thesis. I have collected 8 sets (of 30 samples) from 40+ participants. Data was collected with constant parameters for all participants in order to find the reliability of the instrument in question. (To clarify...
  7. T

    Negative ICC values in SPSS

    Hi there, I have run an ICC to assess if scores for 5 dimensions of a quality of life scale have been rated the same by child and their parent. Sample sizes are small (n=14) I ran a two way random model and wanted absolute agreement as I am keen to know about differences with the specific...
  8. N

    Intraclass Correlation Coefficient Types

    I have two datasets in which I probably need to use the intraclass correlation coefficient, and I want to make sure I choose the right type. Dataset 1: I had 20 randomly selected human subjects rate 50 faces based on their attractiveness on an ordinal scale from 1-5. Each subject rated the...
  9. S

    Complicated ICC question

    So, this might be the wrong forum for this If so, I can close it and repost it in the appropriate one. So, my data is attached. The variables are: Machine ID - machine that analyzes the sample (total of 15) Tech ID - the technician running the sample analysis (total of 31)...
  10. V

    Which Model of ICC to use: one way; two way mixed, or two way random?

    Hello All, I am using spss 21 My goal is to justify aggregating individual lower-level viability scores into a team higher-level viability score using a likert-type scale. I have 24 teams, each has 4-5 members. Each member of the team rated 6 items on the viability scale. I have...
  11. A

    Which ICC to choose if there are missing values?

    I want to say that I am really sorry if this question has already came up but after looking in different posts I could not find good answer. I have 1500 participants and their trust was measured so I have variables: - trust in EU - trust in giverment - trust in political party - trust in...
  12. E

    Intraclass Correlation Coefficients: Significant Difference when H0~=0?

    I'm trying to determine whether two intraclass correlation coefficients are statistically significantly different. The catch is that the two samples are between subjects, and the null hypothesis is that the difference between rho1-rho2 = .5. I've done a Fisher's Z' transform, but the confidence...
  13. S

    Help with justifying aggregation in SPSS?

    Hi there, I am running a multi-level model on data which is one row per individual survey return, each with Individual ID and Organisational ID. There are variables which can be aggregated in to group, but I first have to justify this aggregation, and have been told to do so via ICC(1)...
  14. G

    ICC and Factor scores

    Dear All, I am computing Inter-class correlations (ICC) for a multilevel comparison of geographical areas. I have a long list of indicators and for some I could reduce them in fewer factors. Is there any problem in computing the ICC on individual's factor scores? Thank you in advance
  15. U

    interrater reliability help?

    Dear all, I'm hoping for some direction in choosing between cohen's kappa and ICC for my interrater reliability. I have 2 coders rating the presence of expressions 1 or 0 (present or not). I'm leaning towards cohen's kappa, but I don't totally understand the relevant difference between the...