Charles Hedbring/Program STEPPE



Below is a set of references addressing Ecological Validity. All refs are taken from Biblio-Refs (click on "Download" above). Biblio-Refs contains dozens more references on subjects relevant to the many dimensions of validity. So download Win95 Biblio-Refs to get a firm grasp on validity issues in measurement.

  Validity   
 
 

(P.S.: Review this and all STEPPE/Hedbring reference lists often; they are in constant flux as new literature is uncovered, recommended, or encountered. We are all in this together, so please be quick and eager to point out errors or additional literature you find compelling. Thank you.)

Definition: Validity is a set of measurement procedures concerned with ensuring that the instrument (survey,test,exam,interview,SAT,GRE) in fact accurately and correctly measures what it purports or intends to measure.


In the measurement literature, several types of validity have been studied, including: (1) Content validity -- the degree to which the content of an instrument (e.g., test) reflects or represents the knowledge base it purports or intends to measure. (2) Construct validity -- the degree to which an instrument (test, exam, term paper) accurately and correctly measures the variable (construct) -- stress,success,achievement,motivation,racism, full inclusion,integration,IQ/intelligence,criminality -- it purports or intends to measure. (3) Predictive validity -- the degree to which an instrument (e.g., SAT, GRE) correctly and accurately predicts the future occurrence of or performance on a specific variable (computer competence of 6th graders, as predicted by the measured computer competence of 5th grader, using the same test measure). (4) Ecological validity -- the degree to which an instrument (e.g., profiles) correctly and accurately generalizes to circumstances beyond but similar to the original experimental setting.

Altschuld, J.W., & Hines, C.V. (1982). Factors affecting the validity of field tests in education. Educational Evaluation and Policy Analysis, 4, 331-339.

Baer, D.M., & Schwartz, I.S. (1991). If reliance on epidemiology were to become epidemic, we would need to assess its social validity. Journal of Applied Behavior Analysis, 24, 231-234.

Bracht, G.H., & Glass, G.V. (1968). The external validity of experiments. American Education Research Journal, 5, 437-474.

Brinberg, D., & McGrath, J.E. (1985). Validity and the research process. Newbury Park, CA: Sage.

Brooks, P.H., & Baumeister, A.A. (1977). A plea for consideration of ecological validity in the experimental psychology of mental retardation: A guest editorial. American Journal of Mental Deficiency, 81, 407-416.

Campbell, D.T. (1957). Factors relevant to the validity of experiments in social settings. Psychological Bulletin, 54, 297-312.

Cronbach, L.J. (1988). Five perspectives on the validity argument. In H. Waner & H.I. Braun (Eds.), Test validity (pp. 3-17). Hillsdale, NJ: Erlbaum.

Cronbach, L.J., & Meehl, P.E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281-302.

Cronbach, L.J., & Shapiro, K. (1982). The limited research of internal validity. In L.J. Cronbach & K. Shapiro (Eds.), Designing evaluations of educational and social programs (pp. 112-157). San Francisco: Jossey-Bass.

Dahlloff, U. (1971). Ability grouping, content validity, and curriculum process analysis. New York: Teachers College Press.

Eisenhart, M., & Howe, K. (1992). Validity in educational research. In M.D. LeCompte, W.L. Millroy, & J. Preissle (Eds.), The handbook of qualitative research in education (pp. 643-680). New York: Academic Press.

Evans, I. (1987). Moving to educational validity: A reply to Test, Spooner, and Cooke. Journal of The Association for Persons with Severe Handicaps, 12, 103-106.

Fawcett, S.B. (1991). Social validity: A note on methodology. Journal of Applied Behavior Analysis, 24, 235-239.

Fawcett, S.B., & Miller, L.K. (1975). Training public speaking behavior: An experimental analysis and social validation. Journal of Applied Behavior Analysis, 8, 125-136.

Fee, V.E., Matson, J.L., Moore, L.A., & Benavidez, D.A. (1993). The differential validity of hyperactivity/attention deficits and conduct problems among mentally retarded children. Journal of Abnormal Child Psychology, 21, 1-11.

Finney, J.W. (1991). On further development of the concept of social validity. Journal of Applied Behavior Analysis, 24, 245-249.

Forehand, R., Wells, K., & Griest, D. (1980). An examination of the social validity of a parent training program. Behavior Therapy, 11, 488-502.

Gaylord-Ross, R. (1979). Mental retardation research, ecological validity, and the delivery of longitudinal educational programs. Journal of Special Education, 13, 69-80.

Geller, E.S. (1991). Where's the validity in social validity? Journal of Applied Behavior Analysis, 24, 179-184.

Green, B.F. (1987). Construct validity of computer-based tests. In H. Wainer & H.I. Braun (Eds.), Test validity (pp. 77-86). Hillsdale, NJ: Lawrence Erlbaum.

Haertel, E. (1985). Construct validity and criterion-referenced testing. Review of Educational Research, 55, 23-46.

Hall, G.C., Proctor, W.C., & Nelson, G.M. (1988). Validity of physiological measures of pedophilic sexual arousal in a sexual offender population. Journal of Consulting and Clinical Psychology, 56, 118-122.

Hawkins, R.P. (1991). Is social validity what we are interested in? Argument for a functional approach. Journal of Applied Behavior Analysis, 24, 205-213.

Hoge, R.D. (1985). The validity of direct observation measure of pupil classroom behavior. Review of Educational Research, 55, 469-483.

Holmes, M.R., Hansen, D.J., & St. Lawrence, J.S. (1984). Conversational skills training with aftercare patients in the community: Social validation and generalization. Behavior Therapy, 15, 84-100.

Hudson, A. (1992). Assessing the validity of facilitated communication. Australian Educational and Developmental Psychologist, 9, 24-29.

Hudson, A., Melita, B., & Arnold, N. (1993). Brief report: A case study assessment of the validity of facilitated communication. Journal of Autism and Developmental Disorders, 23, 165-173.

Jenkins, J.R., Pious, C.G., & Peterson, D.L. (1988). Categorical programs for remedial and handicapped students: Issues of validity. Exceptional Children, 55, 147-158.

Jones, R.T., Kazdin, A.E., & Haney, J.I. (1981). Social validation and training of emergency fire safety skills for potential injury prevention and life saving. Journal of Applied Behavior Analysis, 14, 249-260.

Kamphaus, R.W. (1992). Authentic assessment and content validity. School Psychology Quarterly, 6, 300-304.

Kazdin, A.E. (1977). Assessing the clinical or applied importance of behavior change through social validation. Behavior Modification, 1, 427-452.

Kazdin, A.E., & Matson, J.L. (1981). Social validation in mental retardation. Applied Research in Mental Retardation, 2, 39-53.

Kennedy, C.H. (1992). Trends in the measurement of social validity. The Behavior Analyst, 15, 147-156.

Kirk, J., & Miller, M. (1986). Reliability and validity in qualitative research. Newbury Park, CA: Sage.

Kohr, M.A., Parrish, J.M., Neef, N.A., Driessen, J.R., & Hallinan, P.C. (1988). Communication skills training for parents: Experimental and social validation. Journal of Applied Behavior Analysis, 21, 21-30.

Maxwell, J.A. (1992). Understanding and validity in qualitative research. Harvard Educational Review, 62, 279-300.

McConaghy, M. (1989). Validity and ethics of penile circumference measures of sexual arousal: A critical review. Archives of Sexual Behavior, 18, 357-369.

Messick, S. (1989). Validity. In R. Linn (Ed.), Educational measurement (3rd ed., pp. 13-104). New York: Macmillan.

Minkin, N., Braukmann, C.J., Minkin, B.L., Timbers, G.D., Timbers, B.J., Fixsen, L., Phillips, E.L., & Wolf, M.M. (1976). The social validation and training of conversational skills. Journal of Applied Behavior Analysis, 9, 127-139.

Murphy, W.D., Krisak, J., Stalgaitis, S.J., & Anderson, K. (1984). The use of penile tumescence measures with incarcerated rapists: Further validity issues. Archives of Sexual Behavior, 13, 545-554.

Perry, A., Bebko, J., & Bryson, S. (1994). Letter to the editor: Validity of facilitated communication: Failure to replicate Calculator and Singer (1992). Topics in Language Disorders, 14, 79-82.

Quinn, J.M., Sherman, J.A., Sheldon, J.B., Quinn, L.M., & Harchik, A.E. (1992). Social validation of component behaviors of following instructions, accepting criticism, and negotiating. Journal of Applied Behavior Analysis, 25, 401-413.

Rice, M.E., & Harris, G.T. (1995). Violent recidivism: Assessing predictive validity. Journal of Consulting and Clinical Psychology, 63, 737-748.

Schwartz, I.S., & Baer, D.M. (1991). Social validity assessments: Is current practice state of the art? Journal of Applied Behavior Analysis, 24, 189-204.

Scotti, J.R., Evans, I.M., Meyer, L.H., & Walker, P. (1991). A meta-analysis of intervention research with problem behavior: Treatment validity and standards of practice. American Journal on Mental Retardation, 96, 233-256.

Snow, R.E. (1993). Construct validity and constructed-response tests. In R.E. Bennett & W.C. Ward (Eds.), Construction versus choice in cognitive measurement (pp. 45-60). Hillsdale, NJ: Erlbaum.

Teal, M.B., & Wiebe, M.J. (1986). A validity analysis of selected instruments used to assess autism. Journal of Autism and Developmental Disorders, 16, 485- 494.

Test, D.W. (1994). Supported employment and social validity. Journal of The Association for Persons with Severe Handicaps, 19, 116-129.

Test, D.W., Spooner, F., & Cooke, N.L. (1987). Educational validity revisited. Journal of The Association for Persons with Severe Handicaps, 12, 96-102.

Thousand, J.S., Burchard, S.N., & Hasazi, J.E. (1986). Field-based generation and social validation managers and staff competencies for small community residences. Applied Research in Mental Retardation, 7, 263-283.

Van Houten, R. (1979). Social validation: The evolution of standards of competency for target behaviors. Journal of Applied Behavior Analysis, 12, 581-592.

Voeltz, L.M., & Evans, I.M. (1983). Educational validity: Procedures to evaluate outcomes in programs for severely handicapped learners. Journal of The Associa- tion for Persons with Severe Handicaps, 8, 3-15.

Wacker, D.P., & Steege, M. (1993). Providing outpatient services: Evaluating treatment and social validity. In S. Axelrod & R. Van Houten (Eds.), Behavior analysis and treatment (pp. 297-319). New York: Plenum.

Wainer, H., & Braun, H.I. (Eds.). (1987). Test validity. Hillsdale, NJ: Erlbaum.

Walkup, J.T., Rosenberg, L.A., Brown, J., & Singer, H.S. (1992). The validity of instruments measuring tic severity in Tourette's syndrome. Journal of the American Academy of Child and Adolescent Psychiatry, 30, 472-477.

White, D.M., & Rusch, F.R. (1983). Social validation in competitive employment: Evaluating work performance. Applied Research in Mental Retardation, 4, 343-354.

Wildman, B.G., Wildman, H.E., & Kelly, W.J. (1986). Group conversational-skills training and social validation with mentally retarded adults. Applied Research in Mental Retardation, 7, 443-458.

Wolcott, H.F. (1990). On seeking--and rejecting--validity in qualitative research. In E.W. Eisner & A. Peshkin (Eds.), Qualitative inquiry in education: The continuing debate (pp. 121-152). New York: Teachers College Press.

Wolery, M., & Gast, D.L. (1990). Re-framing the debate: Finding middle ground and defining the role of social validity. In A.C. Repp & N.N. Singh (Eds.), Perspectives on the use of nonaversive and aversive interventions for persons with developmental disabilities (pp. 129-143). Sycamore, IL: Sycamore.

Wolf, M.M. (1978). Social validity: The case for subjective measurement, or how applied behavior analysis is finding its heart. Journal of Applied Behavior Analysis, 11, 203-214.

Reminder: Please consider downloading
Biblio-Refs -- THE practical Assistant.

Home | About | Products | Workshops | Pricing

For more information, please email: steppec@aol.com

Copyright © 1995-2001 Dr Charles Hedbring. All rights reserved worldwide.