scoring

  1. A

    How to decide on a cut-off score (groups) if the scale doesn't have one?

    For my study, I'm using a scale (rating scale from 1-7) that doesn't have a predetermined cut-off score. However, in order to do the stats, I need to make 2 groups/categories with "high score" and "low score". How do I determine the point at which a participant is considered high vs. low...
  2. A

    Appropriate item aggregation for one construct

    Hi all, I have just finished collecting my data and I have a question concerning how to deal with a construct that I measured. In the questionnaire participants were asked to name at least one and a maximum of three persons which they follow on social media. After that, they had to answer...
  3. S

    Computing relative score for % Values distribution ?

    Hi , I have a survey % values in the following order (in the attachment) with Survey campaign no A1 to A19, and its percentage value i.e (number of surveys successful/total surveys)*!00 , ? Now I have to score the survey campaign such that the min and max values are in the band of 1 to 10 i.e...
  4. B

    Brier score calculation: 2 methods should yield same result

    I have a set of 234 predictions of tennis match outcomes and 5 different prediction models. I use the two different methods for calculating the Brier score described, for instance, here. The first method is: BS=\frac{1}N\sum_{t=1}^N(f_{t}-o_{t})^2 Where N is the number of forecasting...
  5. K

    Scoring model/formula to rank based on accuracy of data sources

    Let us say i have 5 different data sources. My aim is arrive a score to arrive the accuracy of this data sources. It is like below 1. Refer the section Data confidence calculation in http://ibmdatamag.com/2014/07/measuring-confidence-in-data/ 2...
  6. M

    Scoring a subset in SPSS?

    Hi! I'm trying to apply an existing XML model to my SPSS dataset. However, I only want to apply the model to a subset of my data -- is it possible to create some kind of "filter" or "selection variable" ... so that the regression will only be applied to a subset of the data? For instance...
  7. J

    Judging bias in assessment system with multiple assessors & scoring criteria

    I work for a grant giving charity and we use external assessors to help in our selection process. There are 30 applications for review. We have 6 assessors who will look at no more than 15 app forms each. They have to score each app out of 5 across several criteria. We total the scores and...
  8. S

    Dealing with variation in subjective qualitative data

    I am helping conduct a review of scholarship applications. There were approximately 275 applicants that were reviewed by various individuals. There seems to be a lot of variation in scoring among the reviewers. Issue being not everyone reviewed each individual, so those who have high...
  9. H

    predictive model's scoring issue

    Suppose I have built a model to predict default on loans. In my modeling data set I have three independent variables: income, home(own or rent) and job(manager, sales, self, other). They are all very strong predictors. For some reason, I won't be able to have the variable "job" in my scoring...