Blank Item Analysis Form

KSI 2006 Session D, Strand 6: Assessment

Overview of Project 2061 Tools & Resources

Item Analysis Data Entry Form

(Condensed Version of the Item Analysis Form in the Database)

Item Number:

Targeted Learning Goal:

I. Exploration

B. Exploring the Assessment Task

1. Knowledge needed to evaluate each answer choice?

2. Relevant misconceptions?

II.Content Alignment

A. Necessity

Evaluation of every answer choice requires the knowledge targeted in

the learning goal. State the part of the learning goal that is required for

each answer choice.

Evaluation of some of the answer choices requires the knowledge

targeted in the learning goal. State the part of the learning goal that is

required for each of those answer choices.

3. Evaluation of none of the answer choices requires the knowledge

targeted in the learning goal.

Evaluation of the answer choices may come from having learned a

specific instance of the general principle (SIGP) being tested.

Score for Necessity:

Scoring Notes:

B. Sufficiency

Evaluation of each of the answer choices DOES NOT require additional knowledge.

2a. Evaluation of some or all of the answer choices DOES require more

knowledge or skill than is in the learning goal.

2b. Evaluation of some or all of the answer choices DOES require

familiarity with science or math terminologythat is not in the learning goal.

2c. Evaluation of some or all of the answer choices requires knowledge of specific

instances of a general principle that all students are not expected to have.

2d. Evaluation of some or all of the answer choices DOES require familiarity with

specific representations or models that all students are not expected to be

familiar with.

2e. Other

Score for Sufficiency:

Scoring Notes:

III. confounding factors

A. comprehensibility

1. Unclear question

2. Unfamiliar vocabulary

3. Unnecessarily complex language

4. Inaccurate information

5. Comprehensibility issues with diagrams, graphs, data tables

6. More than one correct answer

7. Other

Score for Comprehensibility:

Scoring Notes:

B. Appropriateness of Task Context

Employs a context:YESor NO

1. Unfamiliar context

2. Context favors one group over another

3. Context is too complicated

4. Context is unreasonable or unbelievable

5. Context is scientifically/mathematically inaccurate

6. Other

Score for Context:

Scoring Notes:

C. Resistance to Test-Wiseness

1. Distractors are implausible

2. Answer choices are different in length or detail from each other

3. Answer choices are qualified differently or include “giveaway” words

4. Answer choices include logical opposites that narrow answer choice options

5. Answer choices use different vocabulary level

6. Language of answer choice mirrors stem language

7. Other

Score for Test-Wiseness:

Scoring Notes:

IV. Evaluation

Score for Necessity:

Score for Sufficiency:

Score for Comprehensibility:

Score for Appropriateness of Task Context:

Score for Resistance to Test-Wiseness:

Comments on Scoring:

V. Revisions

The task is effective and does not need to be revised.

The task should be revised. Suggestions:

The task should be eliminated. Explain why:

Page 1 of 4