I would imagine tests around those groups would have limited power. Logistic reg will give you a warning "quasi seperation " however linear will run but may be give you large standard errors. Also unadjusted r^2 may be higher just because of the numbers of predictors.
I am guessing it will let you do it, you just have to proceed with caution.