# scoring

1. ### How to decide on a cut-off score (groups) if the scale doesn't have one?

For my study, I'm using a scale (rating scale from 1-7) that doesn't have a predetermined cut-off score. However, in order to do the stats, I need to make 2 groups/categories with "high score" and "low score". How do I determine the point at which a participant is considered high vs. low...
2. ### Appropriate item aggregation for one construct

Hi all, I have just finished collecting my data and I have a question concerning how to deal with a construct that I measured. In the questionnaire participants were asked to name at least one and a maximum of three persons which they follow on social media. After that, they had to answer...
3. ### Computing relative score for % Values distribution ?

Hi , I have a survey % values in the following order (in the attachment) with Survey campaign no A1 to A19, and its percentage value i.e (number of surveys successful/total surveys)*!00 , ? Now I have to score the survey campaign such that the min and max values are in the band of 1 to 10 i.e...
4. ### Brier score calculation: 2 methods should yield same result

I have a set of 234 predictions of tennis match outcomes and 5 different prediction models. I use the two different methods for calculating the Brier score described, for instance, here. The first method is: BS=\frac{1}N\sum_{t=1}^N(f_{t}-o_{t})^2 Where N is the number of forecasting...
5. ### Scoring model/formula to rank based on accuracy of data sources

Let us say i have 5 different data sources. My aim is arrive a score to arrive the accuracy of this data sources. It is like below 1. Refer the section Data confidence calculation in http://ibmdatamag.com/2014/07/measuring-confidence-in-data/ 2...
6. ### Scoring a subset in SPSS?

Hi! I'm trying to apply an existing XML model to my SPSS dataset. However, I only want to apply the model to a subset of my data -- is it possible to create some kind of "filter" or "selection variable" ... so that the regression will only be applied to a subset of the data? For instance...
7. ### Judging bias in assessment system with multiple assessors & scoring criteria

I work for a grant giving charity and we use external assessors to help in our selection process. There are 30 applications for review. We have 6 assessors who will look at no more than 15 app forms each. They have to score each app out of 5 across several criteria. We total the scores and...
8. ### Dealing with variation in subjective qualitative data

I am helping conduct a review of scholarship applications. There were approximately 275 applicants that were reviewed by various individuals. There seems to be a lot of variation in scoring among the reviewers. Issue being not everyone reviewed each individual, so those who have high...
9. ### predictive model's scoring issue

Suppose I have built a model to predict default on loans. In my modeling data set I have three independent variables: income, home(own or rent) and job(manager, sales, self, other). They are all very strong predictors. For some reason, I won't be able to have the variable "job" in my scoring...