This document pertains more
to high school teaching than primary school. Read this summary outline
to get an idea of what the document is about. Then you can read
the relevant parts in detail, if you want to.
The document provides a scoring rubric which can
be used to assess critical thinking. It is based on how a person:
- interprets evidence, questions statements
etc.
- identifies relevant arguments
- deals with points of view different from their
own
- draws conclusions
- justifies results and explains reasons
- reacts to evidence and reasons
The document goes on to discuss how the rubric
can be fairly used to assess essays, assignments etc. that are designed
to test critical thinking.
Here is the document:
This assessment device can be used in conjunction
with objective tests to provide multiple measures of critical thinking
performance.
Holistic critical thinking scoring rubric
by Facione & Facione
- Consistently does all or almost all of the
following:
Accurately interprets evidence, statements, graphics, questions,
etc. Identifies the salient arguments (reasons and claims) pro
and con. Thoughtfully analyzes and evaluates major alternative
points of view. Draws warranted, judicious, non-fallacious conclusions.
Justifies key results and procedures, explains assumptions and
reasons. Fair-mindedly follows where evidence and reasons lead.
- Does most or many of the following:
Accurately interprets evidence, statements, graphics, questions,
etc. Identifies relevant arguments (reasons and claims) pro and
con. Offers analyses and evaluations of obvious alternative points
of view. Draws warranted, non-fallacious conclusions. Justifies
some results or procedures, explains reasons. Fair-mindedly follows
where evidence and reasons lead.
- Does most or many of the following:
Misinterprets evidence, statements, graphics, questions, etc.
Fails to identify strong, relevant counter-arguments. Ignores
or superficially evaluates obvious alternative points of view.
Draws unwarranted or fallacious conclusions. Justifies few results
or procedures, seldom explains reasons. Regardless of the evidence
or reasons, maintains or defends views based on self-interest
or preconceptions.
- Consistently does all or almost all of the
following:
Offers biased interpretations of evidence, statements, graphics,
questions, information, or the points of view of others. Fails
to identify or hastily dismisses strong, relevant counter-arguments.
Ignores or superficially evaluates obvious alternative points
of view. Argues using fallacious or irrelevant reasons, and unwarranted
claims. Does not justify results or procedures, nor explain reasons.
Regardless of the evidence or reasons, maintains or defends views
based on self-interest or preconceptions. Exhibits closed-mindedness
or hostility to reason.
Instructions for using the holistic critical
thinking scoring rubric
1. Understand the construct.
2. Differentiate and focus
- Ideally, in a training session with other raters
one will examine sample essays (videotaped presentations, etc.)
which are paradigmatic of each of the four levels. Without prior
knowledge of their level, raters will be asked to evaluate and
assign ratings to these samples. After comparing these preliminary
ratings, collaborative analysis with the other raters and the
trainer is used to achieve consistency of expectations among those
who will be involved in rating the actual cases. Training, practice,
and inter-rater reliability are the keys to a high quality assessment.
- Usually, two raters will evaluate each essay/assignment/project/performance.
If they disagree there are three possible ways that resolution
can be achieved: (a) by mutual conversation between the two raters,
(b) by using an independent third rater, or (c) by taking the
average of the two initial ratings. The averaging strategy is
strongly discouraged. Discrepancies between raters of more than
one level suggest that detailed conversations about the CT construct
and about project expectations are in order. This rubric is a
four level scale, half point scoring is inconsistent with its
intent and conceptual structure. Further, at this point in its
history, the art and science of holistic critical thinking evaluation
cannot justify asserting half-level differentiations.
- If working alone, or without paradigm samples,
one can achieve a greater level of internal consistency by not
assigning final ratings until a number of essays/projects/performances/assignments
have been viewed and given preliminary ratings. Frequently natural
clusters or groupings of similar quality soon come to be discernible.
At that point one can be more confident in assigning a firmer
critical thinking score using this four level rubric. After assigning
preliminary ratings, a review of the entire set assures greater
internal consistency and fairness in the final ratings.
California Academic Press, 217 La Cruz Avenue,
Millbrae, CA 94030, (650) 697-5628, e-mail info@calpress.com.
from
http://www.calpress.com/rubric.html
© Copyright 1996, CAP, Inc. All rights reserved.
|