I hope someone can take a look at the tests I ran and let me know if it seems appropriate, or if I'm off track. BTW - I'm using JASP for my analyses (just based on a google search for something I could use).

My research project is a group design. Participants complete a data entry task under four different conditions (plus a baseline). The dependent variable is the number of records completed. There are two groups with the conditions counterbalanced, for example:

ABCDE

ADEBC

I ran a repeated measures ANOVA on the conditions, regardless of the order in which they were introduced (ABCDE). I used the group assignment as a between-subjects factor. The results are below (sorry, they don't copy and paste very well). The within subjects had a p<.001, and the between subjects had a p=.162. The within subjects did not provide each comparison, so I ran a paired samples t-test to get a better look at how each condition performed against the others.

Does that sound reasonable? Would it also make sense to run a repeated measures ANOVA for trials 1, 2, 3, 4, 5 - even though the participants experienced the conditions in a different order?

Thank you so much for any assistance you can provide.

Within Subjects Effects

Cases Sum of Squares df Mean Square F p η²

RM Factor 1 12274.520 4 3068.630 66.287 < .001 0.343

RM Factor 1 ✻ V2 3468.806 4 867.201 18.733 < .001 0.097

Residuals 3518.280 76 46.293

Note. Type III Sum of Squares

Between Subjects Effects

Cases Sum of Squares df Mean Square F p η²

V2 1651.142 1 1651.142 2.113 0.162 0.046

Residuals 14848.820 19 781.517

Note. Type III Sum of Squares

Paired Samples T-Test

t df p Cohen's d

CoopS - CompS -4.784 20 < .001 -1.044

CoopF - CompF -6.783 20 < .001 -1.480

CoopS - CoopF -0.572 20 0.574 -0.125

CompS - CompF -1.692 20 0.106 -0.369

Note. Student's t-test.