I have tried to analyze the groups responses using chi-square, but every chi-square value calculated for the responses to each item is coming back as significant, even when the PROPORTION of each group that has said 'yes' is almost identical for all groups (ex: group 1: 96% responded yes, group 2: 94% responded yes, group 3: 95% responded yes, etc). After some reading, I discovered this is a common problem associated with chi-square for extremely large samples size (that is, everything begins to 'appear' significant due to the increased chi-square value). Here is a document that describes this 'phenomenon' on page 7, if anyone is interested http://courses.ncssm.edu/math/Stat_Inst/PDFS/Categorical Data Analysis.pdf . I have approximately 3000 responses from my groups for each item in question.

Does anyone have any other suggestions on how else I can compare these data to see if some groups responded differently to the use of a certain items? I know there is a "z-test for two proportions", but I'm afraid since I can only compare 2 group proportions at once using this method, and since I will have to repeat the comparison multiple times for all groups, there will be increased error.

I appreciate any suggestions.