If the
participants were homogeneous on many important background
factors, for example, if they were all African-American
students from inner city elementary schools in a large metropolitan
area, the findings can’t be assumed to apply to all
other contexts.
- Are
the data analysis methods appropriate.
There
are many statistical methods for extracting answers to research
questions from data. For any particular design, though,
only a few methods of analysis are likely to be appropriate.
-
Instrumentation and measurement.
Outcomes,
such as achievement test scores, should be objectively measured,
and of high reliability and validity.
Replication
Are the
major findings replicated across a number of studies? No one
study ever settles an issue definitively. A research finding,
in order to be of practical value, should be repeated in a
variety of demographic settings, with different student and
teacher populations. Every replication helps to lower the
likelihood of the findings arising by chance, and to raise
the credibility of instructional decisions based on the finding.
Additional
considerations
-
Can judgments about the meaningfulness, validity, and reliability
of the study be made easily from the information presented?
- Are
the similarities and differences between the study findings
and findings from similar studies discussed?
- Are
the limitations and alternative explanations for the findings
discussed?
This description
of criteria for quality research is not meant to be definitive
or exhaustive. However, we hope that it provides some meaningful
guidance as you undertake the formidable task of identifying
and using quality, validated, evidence-based educational practices
and products.
The American
Federation of Teachers described some criteria they used when
identifying educational programs that show promise for raising
student achievement significantly. These Program Selection
Methods may provide further guidance and they can be found
on the last page of AFT publications in the series, Building
on the Best: Learning From What Works. One such document can
be found here: 
For additional
information, contact Dr. Wendy McColskey, at 800-755-3277.
<<Prev
Top
of Page
|
