I have two raters who could have assigned any of 16 ratings to a subject. There are some categories that were not used, so the resulting table is not square and SAS will not give me the Kappa (Cohen's) for it.
I'm having trouble figuring out how to do this quickly and efficiently to get the Kappa statistic with some zero rows or columns. SAS notes some option about weighting with ZEROES but it seems I would need to basically reformat the data into the summarized counts of each possible outcome.
Anyone able to offer advice to tackle the problem? If I do need to summarize the counts for each category, what is the quickest way to do this for a 16x16 table?
I'm having trouble figuring out how to do this quickly and efficiently to get the Kappa statistic with some zero rows or columns. SAS notes some option about weighting with ZEROES but it seems I would need to basically reformat the data into the summarized counts of each possible outcome.
Anyone able to offer advice to tackle the problem? If I do need to summarize the counts for each category, what is the quickest way to do this for a 16x16 table?