(P.S.: Review this and all STEPPE/Hedbring reference lists often;
they are in constant flux as new literature is uncovered, recommended, or
encountered. We are all in this together, so please be quick and eager to
point out errors or additional literature you find compelling. Thank you.)
Definition:
Validity is a set of measurement procedures concerned with ensuring
that the instrument (survey,test,exam,interview,SAT,GRE) in fact
accurately and correctly measures what it purports or intends to measure.
In the measurement literature, several types of validity have
been studied, including: (1) Content validity -- the degree to which the
content of an instrument (e.g., test) reflects or represents the
knowledge base it purports or intends to measure.
(2) Construct validity -- the degree to which an instrument
(test, exam, term paper) accurately and correctly measures the
variable (construct) -- stress,success,achievement,motivation,racism,
full inclusion,integration,IQ/intelligence,criminality -- it
purports or intends to measure. (3) Predictive validity --
the degree to which an instrument (e.g., SAT, GRE) correctly and accurately
predicts the future occurrence of or performance on a specific
variable (computer competence of 6th graders, as predicted by
the measured computer competence of 5th grader, using the same
test measure). (4) Ecological validity -- the degree to which
an instrument (e.g., profiles) correctly and accurately generalizes
to circumstances beyond but similar to the original experimental
setting.
Altschuld, J.W., & Hines, C.V. (1982). Factors affecting the validity of field
tests in education. Educational Evaluation and Policy Analysis, 4, 331-339.
Baer, D.M., & Schwartz, I.S. (1991). If reliance on epidemiology were to become
epidemic, we would need to assess its social validity. Journal of Applied Behavior
Analysis, 24, 231-234.
Bracht, G.H., & Glass, G.V. (1968). The external validity of experiments.
American Education Research Journal, 5, 437-474.
Brinberg, D., & McGrath, J.E. (1985). Validity and the research process. Newbury
Park, CA: Sage.
Brooks, P.H., & Baumeister, A.A. (1977). A plea for consideration of ecological
validity in the experimental psychology of mental retardation: A guest editorial.
American Journal of Mental Deficiency, 81, 407-416.
Campbell, D.T. (1957). Factors relevant to the validity of experiments in social
settings. Psychological Bulletin, 54, 297-312.
Cronbach, L.J. (1988). Five perspectives on the validity argument. In H. Waner
& H.I. Braun (Eds.), Test validity (pp. 3-17). Hillsdale, NJ: Erlbaum.
Cronbach, L.J., & Meehl, P.E. (1955). Construct validity in psychological tests.
Psychological Bulletin, 52, 281-302.
Cronbach, L.J., & Shapiro, K. (1982). The limited research of internal validity.
In L.J. Cronbach & K. Shapiro (Eds.), Designing evaluations of educational and
social programs (pp. 112-157). San Francisco: Jossey-Bass.
Dahlloff, U. (1971). Ability grouping, content validity, and curriculum process
analysis. New York: Teachers College Press.
Eisenhart, M., & Howe, K. (1992). Validity in educational research. In M.D.
LeCompte, W.L. Millroy, & J. Preissle (Eds.), The handbook of qualitative
research in education (pp. 643-680). New York: Academic Press.
Evans, I. (1987). Moving to educational validity: A reply to Test, Spooner,
and Cooke. Journal of The Association for Persons with Severe Handicaps, 12,
103-106.
Fawcett, S.B. (1991). Social validity: A note on methodology. Journal of Applied
Behavior Analysis, 24, 235-239.
Fawcett, S.B., & Miller, L.K. (1975). Training public speaking behavior: An
experimental analysis and social validation. Journal of Applied Behavior
Analysis, 8, 125-136.
Fee, V.E., Matson, J.L., Moore, L.A., & Benavidez, D.A. (1993). The differential
validity of hyperactivity/attention deficits and conduct problems among mentally
retarded children. Journal of Abnormal Child Psychology, 21, 1-11.
Finney, J.W. (1991). On further development of the concept of social validity.
Journal of Applied Behavior Analysis, 24, 245-249.
Forehand, R., Wells, K., & Griest, D. (1980). An examination of the social
validity of a parent training program. Behavior Therapy, 11, 488-502.
Gaylord-Ross, R. (1979). Mental retardation research, ecological validity, and
the delivery of longitudinal educational programs. Journal of Special Education,
13, 69-80.
Geller, E.S. (1991). Where's the validity in social validity? Journal of Applied
Behavior Analysis, 24, 179-184.
Green, B.F. (1987). Construct validity of computer-based tests. In H. Wainer
& H.I. Braun (Eds.), Test validity (pp. 77-86). Hillsdale, NJ: Lawrence
Erlbaum.
Haertel, E. (1985). Construct validity and criterion-referenced testing. Review
of Educational Research, 55, 23-46.
Hall, G.C., Proctor, W.C., & Nelson, G.M. (1988). Validity of physiological
measures of pedophilic sexual arousal in a sexual offender population. Journal
of Consulting and Clinical Psychology, 56, 118-122.
Hawkins, R.P. (1991). Is social validity what we are interested in? Argument
for a functional approach. Journal of Applied Behavior Analysis, 24,
205-213.
Hoge, R.D. (1985). The validity of direct observation measure of pupil classroom
behavior. Review of Educational Research, 55, 469-483.
Holmes, M.R., Hansen, D.J., & St. Lawrence, J.S. (1984). Conversational skills
training with aftercare patients in the community: Social validation and
generalization. Behavior Therapy, 15, 84-100.
Hudson, A. (1992). Assessing the validity of facilitated communication. Australian
Educational and Developmental Psychologist, 9, 24-29.
Hudson, A., Melita, B., & Arnold, N. (1993). Brief report: A case study assessment
of the validity of facilitated communication. Journal of Autism and
Developmental Disorders, 23, 165-173.
Jenkins, J.R., Pious, C.G., & Peterson, D.L. (1988). Categorical programs for
remedial and handicapped students: Issues of validity. Exceptional Children, 55,
147-158.
Jones, R.T., Kazdin, A.E., & Haney, J.I. (1981). Social validation and training
of emergency fire safety skills for potential injury prevention and life saving.
Journal of Applied Behavior Analysis, 14, 249-260.
Kamphaus, R.W. (1992). Authentic assessment and content validity. School
Psychology Quarterly, 6, 300-304.
Kazdin, A.E. (1977). Assessing the clinical or applied importance of behavior
change through social validation. Behavior Modification, 1, 427-452.
Kazdin, A.E., & Matson, J.L. (1981). Social validation in mental retardation.
Applied Research in Mental Retardation, 2, 39-53.
Kennedy, C.H. (1992). Trends in the measurement of social validity. The Behavior
Analyst, 15, 147-156.
Kirk, J., & Miller, M. (1986). Reliability and validity in qualitative research.
Newbury Park, CA: Sage.
Kohr, M.A., Parrish, J.M., Neef, N.A., Driessen, J.R., & Hallinan, P.C. (1988).
Communication skills training for parents: Experimental and social validation.
Journal of Applied Behavior Analysis, 21, 21-30.
Maxwell, J.A. (1992). Understanding and validity in qualitative research.
Harvard Educational Review, 62, 279-300.
McConaghy, M. (1989). Validity and ethics of penile circumference measures of
sexual arousal: A critical review. Archives of Sexual Behavior, 18, 357-369.
Messick, S. (1989). Validity. In R. Linn (Ed.), Educational measurement (3rd
ed., pp. 13-104). New York: Macmillan.
Minkin, N., Braukmann, C.J., Minkin, B.L., Timbers, G.D., Timbers, B.J., Fixsen,
L., Phillips, E.L., & Wolf, M.M. (1976). The social validation and training of
conversational skills. Journal of Applied Behavior Analysis, 9, 127-139.
Murphy, W.D., Krisak, J., Stalgaitis, S.J., & Anderson, K. (1984). The use of
penile tumescence measures with incarcerated rapists: Further validity issues.
Archives of Sexual Behavior, 13, 545-554.
Perry, A., Bebko, J., & Bryson, S. (1994). Letter to the editor: Validity of
facilitated communication: Failure to replicate Calculator and Singer (1992).
Topics in Language Disorders, 14, 79-82.
Quinn, J.M., Sherman, J.A., Sheldon, J.B., Quinn, L.M., & Harchik, A.E. (1992).
Social validation of component behaviors of following instructions, accepting
criticism, and negotiating. Journal of Applied Behavior Analysis, 25,
401-413.
Rice, M.E., & Harris, G.T. (1995). Violent recidivism: Assessing predictive
validity. Journal of Consulting and Clinical Psychology, 63, 737-748.
Schwartz, I.S., & Baer, D.M. (1991). Social validity assessments: Is current
practice state of the art? Journal of Applied Behavior Analysis, 24, 189-204.
Scotti, J.R., Evans, I.M., Meyer, L.H., & Walker, P. (1991). A meta-analysis of
intervention research with problem behavior: Treatment validity and standards
of practice. American Journal on Mental Retardation, 96, 233-256.
Snow, R.E. (1993). Construct validity and constructed-response tests. In R.E.
Bennett & W.C. Ward (Eds.), Construction versus choice in cognitive measurement
(pp. 45-60). Hillsdale, NJ: Erlbaum.
Teal, M.B., & Wiebe, M.J. (1986). A validity analysis of selected instruments
used to assess autism. Journal of Autism and Developmental Disorders, 16, 485-
494.
Test, D.W. (1994). Supported employment and social validity. Journal of The
Association for Persons with Severe Handicaps, 19, 116-129.
Test, D.W., Spooner, F., & Cooke, N.L. (1987). Educational validity revisited.
Journal of The Association for Persons with Severe Handicaps, 12, 96-102.
Thousand, J.S., Burchard, S.N., & Hasazi, J.E. (1986). Field-based generation
and social validation managers and staff competencies for small community
residences. Applied Research in Mental Retardation, 7, 263-283.
Van Houten, R. (1979). Social validation: The evolution of standards of competency
for target behaviors. Journal of Applied Behavior Analysis, 12, 581-592.
Voeltz, L.M., & Evans, I.M. (1983). Educational validity: Procedures to evaluate
outcomes in programs for severely handicapped learners. Journal of The Associa-
tion for Persons with Severe Handicaps, 8, 3-15.
Wacker, D.P., & Steege, M. (1993). Providing outpatient services: Evaluating
treatment and social validity. In S. Axelrod & R. Van Houten (Eds.), Behavior
analysis and treatment (pp. 297-319). New York: Plenum.
Wainer, H., & Braun, H.I. (Eds.). (1987). Test validity. Hillsdale, NJ:
Erlbaum.
Walkup, J.T., Rosenberg, L.A., Brown, J., & Singer, H.S. (1992). The validity
of instruments measuring tic severity in Tourette's syndrome. Journal of the
American Academy of Child and Adolescent Psychiatry, 30, 472-477.
White, D.M., & Rusch, F.R. (1983). Social validation in competitive employment:
Evaluating work performance. Applied Research in Mental Retardation, 4,
343-354.
Wildman, B.G., Wildman, H.E., & Kelly, W.J. (1986). Group conversational-skills
training and social validation with mentally retarded adults. Applied Research
in Mental Retardation, 7, 443-458.
Wolcott, H.F. (1990). On seeking--and rejecting--validity in qualitative
research. In E.W. Eisner & A. Peshkin (Eds.), Qualitative inquiry in education:
The continuing debate (pp. 121-152). New York: Teachers College Press.
Wolery, M., & Gast, D.L. (1990). Re-framing the debate: Finding middle ground
and defining the role of social validity. In A.C. Repp & N.N. Singh (Eds.),
Perspectives on the use of nonaversive and aversive interventions for persons
with developmental disabilities (pp. 129-143). Sycamore, IL: Sycamore.
Wolf, M.M. (1978). Social validity: The case for subjective measurement, or how
applied behavior analysis is finding its heart. Journal of Applied Behavior Analysis,
11, 203-214.