Proprietary grading / scoring algorithms were developed by using the “ model answers ” with consultation and interpretative guidance by specially trained nurse raters .
The next step included sending selected evaluations to an experienced lead nurse rater . The nurse rater evaluated 28 sets , which included 8 conversations per set , yielding a total of 224 conversations .
Participants
In order to evaluate the construct validity of using jane and Health- Stream ’ s proprietary scoring algorithm , nurses across three nationally recognized healthcare systems were recruited to take the critical thinking assessments . As a result , over 326 completions were obtained . Twenty-eight complete evaluations sets were selected across all score ranges for final comparison between jane and human ratings .
Findings
Once all assessment completions were obtained , all data was sent to Perception Health , an independent analytics firm , where an analysis was conducted to determine the relationship between the jane scores and human scoring via a trained RN using “ model answers ” established by PBDS .
The Pearson Correlation Coefficient was used to evaluate the relationship . The results of the statistical analysis found a strong , positive correlation between the jane scores and the human RN rating scores ,
14