Is the Casper Test a Predictor of Success in Professional School?

The CASPer test, or Computer-Based Assessment for Sampling Personal Characteristics, is an online situational judgment test used in the admissions process for many professional healthcare programs, including medicine, dentistry, optometry, nursing, physiotherapy, and physician assistant schools. The Casper test uses open-ended written and video-recorded responses to various scenarios to assess non-cognitive qualities such as professionalism, empathy, collaboration, and ethical decision-making.

The test itself spans about 2 hours and consists of 2 main sections – one for typed text responses and one for video-recorded responses. The exam does not have a “right” or “wrong” answer, so your performance depends on your ability to think critically. This involves being able to analyze the scenario, consider various perspectives, and propose well-reasoned actions. In this article we will explore what the research says about the Casper test’s ability to predict success in professional school, including what types of outcomes it can be linked to and what it means for applicants. 

What does the Casper test measure?

Unlike academic metrics like GPA scores that reflect your ability to retain and apply knowledge, the Casper test is designed to assess your soft skills – this involves how you might behave in response to ethical dilemmas, interpersonal conflict, or situations requiring empathy. These skills include: ethical reasoning, communication skills, professionalism, collaboration and teamwork, and empathy and compassion.
Even though these skills may not be evaluated by other written exams or academic testing, they are very important for real-world clinical practice and programs are increasingly looking for ways to assess them fairly and earlier on in the admissions process.

What does the research say?

1. Correlation to future clinical performance

Research indicates that Casper test scores have a moderate predictive correlation concerning future performance in medical training. A study examined the correlation between Casper test scores and results of the Canadian national licensure examination outcomes in 109 doctors who took the Casper test at the time of selection to medical school. Specifically, Casper test scores were correlated against performance on sections assessing personal and professional characteristics, with moderate correlations ranging from 0.3 to 0.5 (Dore et al., 2017). These correlations were not otherwise predicted by traditional screening measures, which suggests that the Casper test can predict aspects of professional behavior assessed years after admission. 

Furthermore, a systematic review highlighted that higher Casper test scores were associated with better academic performance during medical training, with small to medium positive correlations around 0.39 (History Tools, 2024) 

Therefore, the Casper test appears to better predict how students will perform in clinical environments, where communication and professionalism matter, instead of how they would perform in classroom-based exams.

2. Formation of Professional Identity  

Beyond academic performance, the Casper test has been linked to the development of professional identity. A study at the University of Illinois College of Medicine found that Casper test scores had statistically significant positive relationships with measures of professional identity and moral reasoning, even after controlling for MCAT scores, GPA, and interview ratings (Yingling, S. et al., 2018). This suggests that the Casper test may contribute to effectively identifying candidates that are likely to develop strong professional identities, which can lead to better patient-centred care in the professional setting.

Are there any limitations to the Casper test?

1. Considerations of Diversity and Bias 

While the Casper test aims to assess non-cognitive skills objectively, some studies have raised concerns about potential biases. For example, a study evaluating CASPer scores at a U.S. medical school found significant differences in scores across racial and ethnic groups, with underrepresented minorities scoring lower on average (Gustafson, C.E. et al., 2023). This highlights the need for ongoing evaluation to ensure fairness and equity in admissions processes, as there are other factors at play. 

2. Need for Further Research 

Despite promising findings, some critiques point out limitations in the current research on the Casper test. Concerns include potential conflicts of interest in studies conducted by creators of the Casper test and the need for more independent, large-scale research to validate its effectiveness (Macbeth, 2021). Critics also argue that the Casper test scores correlate with simulated scenarios and outcomes instead of realistic medical school admission outcomes, and that there is a lack of transparency in terms of how the exam scores are weighted in admissions decisions. Additionally, while the Casper test may predict certain aspects of professional behavior, it is not a comprehensive measure of all qualities necessary for success in professional schools.​

3. Other Factors 

While the Casper test offers a promising way to evaluate applicants holistically, there are still limitations to consider. One concern is subjectivity – despite the use of multiple evaluators, the open-ended nature of responses can still lead to variability in scoring. Additionally, cultural bias may influence how scenarios are interpreted. Some prompts may reflect values or norms that are not universal, which could potentially disadvantage applicants from underrepresented or international backgrounds. Lastly, test conditions can also affect outcomes. Factors including internet connectivity issues, test anxiety, or lack of familiarity with virtual assessments can impact performance more than a candidate’s actual readiness for professional school. Therefore, it would be a good idea to do practice questions in a simulated, timed environment to help reduce stress on the actual test day.

Conclusion

The CASPer test is a challenging exam that evaluates non-cognitive skills like empathy, ethics and communication. Although the Casper test will not determine your academic performance, it can provide valuable insight into your performance in clinically-relevant situations, especially involving skills like communication, professionalism, and ethical decision-making. Despite its limitations, the exam still serves as a valuable tool to evaluate applicants holistically and determine one’s potential as a future healthcare professional. Even more, these are skills that you can improve on with practice. By adopting a structured approach to analyzing scenarios, refining your communication, and strengthening your critical thinking, you will be better equipped not just for the test, but for real-life patient care.

For more information on the Casper test, check out our other articles on: Developing Critical Thinking Skills on the Casper Test, Mistakes to Avoid on the Casper Test, Which Schools Require the Casper Test, How to Prepare for the Casper Test, How Long Does It Take to Prepare for the Casper, What to Expect on Casper Test Day, How Much to Write in a Casper Response, and other Free Casper Test Resources. If you have already taken the test and did not do as well as you had hoped, it is okay if you need to retake it. We have articles on What Does a Bad Casper Score Mean and How to Improve your Casper Test Score – make sure to check them out as well!

References
Dore, K. L., Reiter, H. I., Kreuger, S., & Norman, G. R. (2017). CASPer, an online pre-interview screen for personal/professional characteristics: Prediction of national licensure scores. Advances in Health Sciences Education, 22(2), 327–336. doi: 10.1007/s10459-017-9798-6.

Gustafson, C. E., Johnson, C. J., Beck Dallaghan, G. L., Knight, O. J., Malloy, K. M., Nichols, K. R., & Rahangdale, L. (2023). Evaluating situational judgment test use and diversity in admissions at a southern US medical school. PLOS ONE, 18(2), e0280205. doi: 10.1371/journal.pone.0280205.

History Tools. (2024, July 29). The CASPer test: A complete guide for aspiring doctors. History Tools. https://www.historytools.org/school/the-casper-test-a-complete-guide-for-aspiring-doctors

Macbeth, B. (2021, January 29). Ad-conned: A critical look at CASPer. Science-Based Medicine. https://sciencebasedmedicine.org/ad-conned-a-critical-look-at-casper/

Yingling, S., Park, Y. S., Curry, R. H., Monson, V., & Girotti, J. (2018). Beyond cognitive measures: Empirical evidence supporting holistic medical school admissions practices and professional identity formation. MedEdPublish, 7, 274. doi: 10.15694/mep.2018.0000274.1.