|
Sign In to gain access to subscriptions and/or personal tools.
|
Median-Based Overlap Analysis for Single Case DataA Second Study
Richard I. Parker
Texas A&M University, College Station
Shanna Hagan-Burke
Texas A&M University, College Station
This article takes a further look at the percentage of data points exceeding the median (PEM) analysis method for single-case research data, first presented in this journal by Hsen-Hsing Ma. Ma examined the relationship between PEM and the established percentage of nonoverlapping data (PND) and then applied PEM in a meta-analysis of 61 data sets, correlating their authors' judgments of intervention effectiveness with PEM. The present article covers PEM's historical and statistical context and then applies the new measure in a field test with 165 contrasts between a baseline phase A and a treatment phase B. For comparison, Pearson r , Kruskal-Wallis W, PND, and IRD (improvement rate difference) indices also are calculated and correlated with PEM, and all distributions are examined. Expert visual analysis ratings of the 165 graphs are correlated with all indices. PEM surpassed PND in its validation by other established measures. However, PEM was weaker in distribution shape and visual judgment validation. More strongly validated than either PEM or PND was the new nonparametric measure, IRD.
Key Words: single case research methods effect sizes single case data analysis
References
- *Allen, S.J., & Kramer, J.J. (1990). Modification of personal hygiene and grooming behaviors with contingency contracting: A brief review and case study. Psychology in the Schools, 27, 44-56.
- Altman, D.G. (1999). Practical statistics for medical research. Bristol, UK: Chapman & Hall.
- American Psychological Association. (2001). Publication manual of the American Psychological Association (5th ed.). Washington, DC: Author.
- *Anhalt, K., McNeil, C.B., & Bahl, A.B. (1998). The ADHD classroom kit: A whole-classroom approach for managing disruptive behavior. Psychology in the Schools, 35(1), 67-79.[CrossRef][Web of Science]
- Barlow, D. H., & Hersen, M. (Eds.). (1984). Single case experimental designs: Strategies for studying behavior change (2nd ed.). Oxford, UK: Pergamon.
- *Bray, M.A., & Kehle, T.J. (1998). Self-modeling as an intervention for stuttering. School Psychology Review, 27(4), 587-598.[Web of Science]
- Brossart, D.F., Parker, R.I., Olson, E.A., & Mahadevan, L. (2006). The relationship between visual analysis and five statistical analyses in a simple AB single-case research design. Behavior Modification, 30, 531-563.[Abstract/Free Full Text]
- Brown, M.B., & Forsythe, A.B. (1974). Robust tests for the equality of variances. Journal of the American Statistical Association, 69, 364-387.[CrossRef][Web of Science]
- *Bujold, A., Ladouceur, R., Sylvain, C., & Boisvert, J. (1994). Treatment of pathological gamblers: An experimental study. Journal of Behavioral Therapy & Experimental Psychiatry, 25, 275-282.[CrossRef]
- *Burnette, M., Boehn, K., Kenyon-Jump, R., Hutton, K., & Stark, C. (1991). Control of genital herpes recurrences using progressive muscle relaxation. Behavior Therapy, 22, 237-247.[CrossRef][Web of Science]
- *Cassisi, J., & McGlynn, F. (1988). Effects of EMG activated alarms on nocturnal bruxism. Behavior Therapy, 19, 133-142.[CrossRef][Web of Science]
- *Chadwick, P.D. (1994). Examining specific cognitive change in cognitive therapy for depression: A controlled case experiment. Journal of Cognitive Psychotherapy: An International Quarterly, 8, 19-31.
- *Chadwick, P.D., & Lowe, C.F. (1990). Measurement and modification of delusional beliefs. Journal of Consulting and Clinical Psychology, 58, 225-232.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- *Chadwick, P., & Trower, P. (1996). Cognitive therapy for punishment paranoia: A single case experiment. Behavioral Research and Therapy, 4, 351-356.
- Chambers, J., Cleveland, W., Kleiner, B., & Tukey, P. (1983). Graphical Methods for Data Analysis. Belmont, CA: Wadsworth.
- Cleveland, W. (1985). Elements of Graphing Data. Belmont, CA: Wadsworth.
- Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
- Cohen, J., Cohen, P., West, S.G., & Aiken, L.S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Mahwah, NJ: Lawrence Erlbaum.
- Collett, D. (2002). Modelling binary data (2nd ed.). Bristol, UK: Chapman & Hall.
- Conover, W.J. (1999). Practical nonparametric statistics (3rd ed.). New York: John Wiley.
- Cumming, G. (2002). Exploratory software for confidence intervals [Computer software]. Retrieved August 7, 2005, from http://www.latrobe.edu.au/psy/esci
- DeProspero, A., & Cohen, S. (1979). Inconsistent visual analyses of intrasubject data. Journal of Applied Behavior Analysis, 12, 573-579.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- *DuPaul, G.J., & Henningson, P.N. (1993). Peer tutoring effects on the classroom performance of children with attention deficit hyperactivity disorder. School Psychology Review, 22(1), 134-143.[Web of Science]
- Edgington, E.S. (1984). Statistics and single-case designs. Progress in Behavior Modification, 16, 83-119.[Web of Science]
- Edgington, E.S. (1987). Randomization tests (2nd ed.). New York: Marcel Dekker.
- *Fantuzzo, J.W., Polite, K., & Grayson, N. (1990). An evaluation of reciprocal peer tutoring across elementary school settings. Journal of School Psychology, 28, 309-323.[CrossRef][Web of Science]
- Fidler, F. (2002). The fifth edition of the APA publication manual: Why its statistics recommendations are so controversial. Educational and Psychological Measurement, 62(5), 749-770.[Abstract/Free Full Text]
- Glass, G.V., Willson, V.L., & Gottman, J.M. (1975). Design and analysis of time-series experiments. Boulder: Colorado Associated University Press.
- *Greene, B.F., Norman, K.R., Searle, M.S., Daniels, M., & Lubeck, R.C. (1995). Child abuse and neglect by parents with disabilities: A tale of two families. Journal of Applied Behavior Analysis, 28, 417-434.[Medline]
[Order article via Infotrieve]
- Harbst, K.B., Ottenbacher, K.J., & Harris, S.R. (1991). Inter-rater reliability of therapists' judgments of graphed data. Physical Therapy, 71, 107-115.[Abstract/Free Full Text]
- *Hartley, E.T., Bray, M.A., & Kehle, T.J. (1998). Self-modeling as an intervention to increase student classroom participation. Psychology in the Schools, 35(4), 363-372.[CrossRef][Web of Science]
- Hintze, J. (2004). NCSS and PASS [Computer software]. Kaysville, UT: Number Cruncher Statistical Systems.
- *Houten, R.V., & Retting, R.A. (2001). Increasing motorist compliance and caution at stop signs. Journal of Applied Behavior Analysis, 34, 185-193.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- *Jensen, C. (1994). Psychosocial treatment of depression in women: Nine single subject evaluations. Research on Social Work Practice, 4, 267-282.[Abstract/Free Full Text]
- Kazdin, A.E. (1982). Single case research designs: Methods for clinical and applied settings. New York: Oxford University Press.
- *Kern, L., & Bambara, L. (2002). Class-wide curricular modification to improve the behavior of students with emotional or behavioral disorders. Behavior Disorders, 27, 317-326.
- Kirk, R.E. (1996). Practical significance: A concept whose time has come. Educational & Psychological Measurement, 56, 746-759.[CrossRef]
- *Ladouceur, R., Boisvert, J., & Dumont, J. (1994). Cognitive-behavioral treatment for adolescent pathological gamblers. Behavior Modification, 18, 230-242.[Abstract/Free Full Text]
- *Ladouceur, R., Freeston, M., Gagnon, F., Thibodeau, N., & Dumont, J. (1993). Idiographic considerations in the behavioral treatment of obsessional thoughts. Journal of Behavioral Therapy & Experimental Psychiatry, 24, 301-310.[CrossRef]
- *Lee, M.J., & Tingstrom, D.H. (1994). A group math intervention: The modification of cover, copy, and compare for group applications. Psychology in the Schools, 31, 133-145.[CrossRef][Web of Science]
- *Lee, R., McComas, J.J., & Jawor, J. (2002). The effects of differential and lag reinforcement schedules on varied verbal responding by individuals with autism. Journal of Applied Behavior Analysis, 35, 391-402.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- *Lemanek, K.L., & Gresham, F.M. (1984). Social skills training with a deaf adolescent: Implications for placement and programming. School Psychology Review, 13, 385-390.
- Linden Software. (1998). I-extractor [Graph digitizing software]. Barrow Upon Humber, UK: Author.
- Llorca, J. (2002). Computer programs for epidemiologists: PEPI version 4.0. Journal of Epidemiology Community Health, 56, 959-960.[Free Full Text]
- *Lopez, A., & Cole, C.L. (1999). Effects of a parent-implemented intervention on the academic readiness skills of five Puerto Rican Kindergarten students in an urban school. School Psychology Review, 28, 439-447.[Web of Science]
- *Lyon, M.A. (1984). Positive reinforcement and logical consequences in the treatment of classroom encopresis. School Psychology Review, 13, 238-243.
- Ma, H.H. (2006). An alternative method for quantitative synthesis of single-subject research: Percentage of data points exceeding the median. Behavior Modification, 30, 598-617.[Abstract/Free Full Text]
- *Magg, J.W., Rutheford, R.B., & Diganoni, S.A. (1992). Effects of self-monitoring and contingent reinforcement on on-task behavior and academic productivity of learning-disabled students: A social validation study. Psychology in the Schools, 29, 157-172.[CrossRef][Web of Science]
- *Martens, B.K., Hiralall, A.S., & Bradley, T.A. (1997). A note to teacher: Improving student behavior through goal setting and feedback. School Psychology Quarterly, 12(1), 33-41.[Web of Science]
- Matyas, T.A., & Greenwood, K.M. (1997). Serial dependency in single-case time series. In R. D. Franklin, D. B. Allison, & B. S. Gorman (Eds.), Design and analysis of single-case research (pp. 215-243). Mahwah, NJ: Lawrence Erlbaum.
- *O'Kearney, R. (1993). Additional considerations in the cognitive-behavioral treatment of obsessional ruminations. Journal of Behavioral Therapy & Experimental Psychiatry, 24, 357-365.[CrossRef]
- Ottenbacher, K.J. (1990). Visual inspection of single-subject data: An empirical analysis. Mental Retardation, 28, 283-290.[Web of Science][Medline]
[Order article via Infotrieve]
- Park, H., Marascuilo, L., & Gaylord-Ross, R. (1990). Visual inspection and statistical analysis of single-case designs. Journal of Experimental Education, 58, 311-320.[Web of Science]
- Parker, R.I. (2006). Increased reliability for single case research results: Is the bootstrap the answer? Behavior Therapy, 37(4), 326-338.[CrossRef][Medline]
[Order article via Infotrieve]
- Parker, R., & Brossart, D. (2003). Evaluating single case research data: A comparison of seven statistical methods. Behavior Therapy, 34, 189-211.[CrossRef][Web of Science]
- Parker, R.I., Brossart, D.F., Callicott, K.J., Long, J.R., Garcia de Alba, R., Baugh, F.G., et al. (2005). Effect sizes in single case research: How large is large? School Psychology Review, 34(1), 116-132.[Web of Science]
- Parker, R.I., Cryer, J., & Byrns, G. (2006). Controlling trend in single case research. School Psychology Quarterly, 21, 418-440.[CrossRef][Web of Science]
- *Pray, B., Kramer, J.J., & Lindskog, R. (1986). Assessment and treatment of tic behavior: A review and case study. School Psychology Review, 15, 418-429.[Web of Science]
- *Rankin, H. (1982). Control rather than abstinence as a goal in the treatment of excessive gambling. Behavior Research and Therapy, 20, 185-187.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Rosenthal, R., Rosnow, R., & Rubin, D. (2000). Contrasts and effect sizes in behavioral research: A correlational approach. New York: Cambridge University Press.
- *Rutherfort, R.B., & Digangi, S.A. (1992). Effects of self-monitoring and contingent reinforcement on on-task behavior and academic productivity of learning-disabled students: A social validation study. Psychology in the Schools, 29, 157-172.[CrossRef][Web of Science]
- Sackett, D. L., Richardson, W. S., Rosenberg, W., & Haynes, R. B. (Eds.). (1997). Evidence-based medicine: How to practice and teach EBM. London: Churchill Livingstone.
- *Salend, S.J., Whittaker, C.R., Raab, S., & Giek, K. (1991). Using a self-evaluation system as a group contingency. Journal of School Psychology, 29, 319-329.[CrossRef][Web of Science]
- Scruggs, T.E., Mastropieri, M.A., & Casto, G. (1987). The quantitative synthesis of single-subject research. Remedial and Special Education, 8(2), 24-33.[Abstract/Free Full Text]
- *Shapiro, E.S., Albright, T.S., & Ager, C.L. (1986). Group versus individual contingencies in modifying two disruptive adolescents' behavior. Professional School Psychology, 1(2), 105-116.
- Shapiro, S.S., & Wilk, M.B. (1965). An analysis of variance test for normality. Biometrika, 52, 591-611.[Free Full Text]
- *Sharpe, T., & Lounsbery, M. (1997). The effects of a sequential behavior analysis protocol on the teaching practices of undergraduate trainees. School Psychology Quarterly, 1, 105-116.
- Siegel, S., & Castellan, N.J., Jr. (1988). Nonparametric statistics for the behavioral sciences. New York: McGraw-Hill.
- Steiger, J.H. (2002). NDC (noncentral distribution calculator) [Statistical software]. Retrieved April 1, 2004, from http://www.statpower.net/page5.htm
- Steiger, J.H., & Fouladi, R.T. (1992). R2: A computer program for interval estimation, power calculation, and hypothesis testing for the squared multiple correlation. Behavior Research Methods, Instruments, and Computers, 4, 581-582.
- *Swanson, H.L., Kozleski, E., & Stegink, P. (1987). Disabled readers' processing of prose: Do any processes change because of intervention? Psychology in the Schools, 24, 378-384.[CrossRef][Web of Science]
- Thompson, B. (2006, April). Effect sizes, confidence intervals, and especially confidence intervals for effect sizes. Professional development course presented at the annual meeting of the American Educational Research Association, San Francisco.
- *Tollefson, N., Tracy, D.B., Johnsen, E.P., & Chatman, J. (1986). Teaching learning disabled students goal-implementation skills. Psychology in the Schools, 23, 194-204.[CrossRef][Web of Science]
- Walter, S.D. (2000). Choice of effect measure for epidemiological data. Journal of Clinical Epidemiology, 53, 931-939.[CrossRef]
- White, O.R. (1973). A manual for the calculation of the median slope: A technique of progress estimation and prediction in the single case (Working Paper 16). Eugene: University of Oregon, Regional Resource Center for Handicapped Children.
- White, O.R. (1974). The split middle: A quickie method of trend estimation (3rd ed.). Unpublished manuscript, University of Washington, Experimental Education Unit, Child Development and Mental Retardation Center, Seattle.
- White, O.R., & Haring, N.G. (1980). Exceptional teaching (2nd ed.). Columbus, OH: Merrill.
- Wilkinson, L., & Task Force on Statistical Inference. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594-604.[CrossRef]
- *Winborn, L., Wacker, D.P., Richman, D.M., Asmus, J., & Geier, D. (2002). Assessment of mand selection for functional communication training packages. Journal of Applied Behavior Analysis, 35, 295-298.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
Behavior Modification, Vol. 31, No. 6,
919-936 (2007)
DOI: 10.1177/0145445507303452

CiteULike Complore Connotea Del.icio.us Digg Reddit Technorati Twitter What's this?
This article has been cited by other articles:

|
 |

|
 |
 
H.-H. Ma
The Effectiveness of Intervention on the Behavior of Individuals With Autism: A Meta-Analysis Using Percentage of Data Points Exceeding the Median of Baseline Phase (PEM)
Behav Modif,
May 1, 2009;
33(3):
339 - 359.
[Abstract]
[PDF]
|
 |
|
|
|