Formative Evaluation of ICW (revise-as-you-go) (continued)
"New" Methods"
(cont.)
Expert Review
How it Works
Methods
The designers prepare a set of evaluation
Self Evaluation
questions and criteria to evaluate the instruction,
and then arrange a time to conduct the "self
evaluation." Evaluation is conducted alone or
with another team member acting as evaluator.
A panel review is a directed and structured group
Panel Reviews
interview conducted by two or more experts.
Methodology is similar to the discussion method
used in the two-on-one learner evaluation.
Experts and evaluator move through the
instruction together. The panel discusses
instruction and answers the evaluator's prepared
questions.
Small Group Field Test
How it Works
Methods
Learner groups discuss instruction without an
Evaluation Meetings
evaluator. Then, a learner representative meets
with the evaluator to discuss problems and
possible changes. Based on meeting outcomes,
the instruction is immediately revised and tried
out on the same learner group.
Individual users of networked software use the
Computer Journals and
computer journal to gather evaluation data by
Networks
solicitation and then store comments. Students
write in their individual, on-line journals about
their reactions to the software. The instructor
assesses this information, and the evaluator may
use the network for follow-up questions.
Students (or the evaluator) can post their
comments for general discussion. (e.g. Apple
Open Collaboration Environment or Powertalk)
A working portion of the final product is
Rapid Prototyping
developed and immediately implemented with a
group of learners or experts. Their input is used
to revise the prototype.
49