Global Security and Intelligence Studies Volume 5, Number 1, Spring / Summer 2020 | Page 119

The Challenge of Evaluating and Testing Critical Thinking in Potential Intelligence Analysts
Appendix: Critical Thinking Test Assessments
Test A: Taken February 2019
This test measures the ability to recognize arguments, including assumptions. It
purports to measure confirmation biases and emotional thinking. It also measures
the ability to draw conclusions. Time frame: 30 minutes.
Strengths:
• Test questions had simple scenarios
• Cost $28.00 per person & $37 per profile development (20 tests = $1,300)
• Easy to follow instructions
• Detail-rich report that included:
o
o
o
o
o
Evaluation based on norm group: candidate is measured against
candidates in their level (managers are measured against managers)
Provides a general overview of the candidate: moderate, strong, or
weak skill base overall
Provides subscale interpretation for recognizing assumptions,
evaluating arguments and drawing conclusions (about 3-4 lines of
quantitative results)
Provides a number of answers that the candidate got correct
Gives a percentile for each subscale (skill area) to see where the
employee needs further training
• For an additional charge of $37.00, company provides more qualitative
data assessment, an appraisal of where the candidate can develop skills
in target areas, and a reflective component that allows the candidate to
provide their own assessment and feedback
• Quick score results
• Test time: 30-45 minutes, depending on the test-taker
Weaknesses:
• Test questions were sometimes poorly worded.
• Test scenarios vague and general
105