I usually try to write answers up here, but this time I'm asking the question. Hopefully, you all can go easy on me.
I am working on a project where our team is trying to implement a county-level treatment and measure its effects. They have chosen to do a matched pair analysis where they control for different things like race, income, gender, etc. The treatment is an educational program to reduce a particular potentially deadly habit. Our response variable is proportion being measured objectively through a survey.
I have concerns about the sample size which is about 20 counties (10 pairs) as well as whether or not the counties can truly be paired when they will clearly have differences in their demographic makeups. How would I determine whether these counties are suitable to be matched and if there is enough power to draw sound conclusions? Lastly, what is the final test we would run to determine the answer? A paired t-test? Any other advice on potential designs are welcome.
I am working on a project where our team is trying to implement a county-level treatment and measure its effects. They have chosen to do a matched pair analysis where they control for different things like race, income, gender, etc. The treatment is an educational program to reduce a particular potentially deadly habit. Our response variable is proportion being measured objectively through a survey.
I have concerns about the sample size which is about 20 counties (10 pairs) as well as whether or not the counties can truly be paired when they will clearly have differences in their demographic makeups. How would I determine whether these counties are suitable to be matched and if there is enough power to draw sound conclusions? Lastly, what is the final test we would run to determine the answer? A paired t-test? Any other advice on potential designs are welcome.