Academia.eduAcademia.edu

Outline

How much do sample characteristics affect the effect size?

2004, Journal of Anxiety Disorders

https://doi.org/10.1016/S0887-6185(03)00040-9

Abstract

In spite of the success of cognitive behavioral therapy for social phobia in research studies, it remains unclear whether interventions will remain successful in the routine of clinical practice, where patients might differ from those in research samples. This study investigates the possibility that higher effect sizes are achieved under typical research conditions. Thirty studies testing treatment effects for social phobia are re-examined by categorizing them according to the quality and amount of applied sample restriction and laboratory study characteristics. The results indicate that even accumulation of sample restriction, such as excluding patients with comorbid disorders or being outside a certain age range, does not have any predictive value for treatment effect. However, there was a relevant tendency for studies applying a row of laboratory treatment conditions, such as recruiting patients by advertisements, applying treatment in university settings, and using specifically trained therapists, to achieve higher effect sizes.

References (51)

  1. Alden, L. (1989). Short-term structured treatment for avoidant personality disorder. Journal of Consulting and Clinical Psychology, 57, 756-764.
  2. Bryant, B., & Trower, P. E. (1974). Social difficulty in a student sample. British Journal of Educational Psychology, 44, 13-21.
  3. Butler, G., Cullington, A., Munby, M., Amies, P., & Gelder, M. (1984). Exposure and anxiety management in the treatment of social phobia. Journal of Consulting and Clinical Psychology, 52, 642-650.
  4. Chambless, D. L., & Hollon, S. D. (1998). Defining empirically supported therapies. Journal of Consulting and Clinical Psychology, 66, 7-18.
  5. Clark, D.B., & Agras, W. S. (1991). The assessment and treatment of performance anxiety in musicians. American Journal of Psychiatry, 148, 598-605.
  6. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
  7. Cox, B.J., Ross, L., Swinson, R. P., & Direnfeld, D. M. (1998). A comparison of social phobia outcome measures in cognitive behavioral group therapy. Behavior Modification, 22, 285-297.
  8. Fava, G.A., Grandi, S., & Canestrari, R. (1989). Treatment of social phobia by homework exposure. Psychotherapy and Psychosomatics, 52, 209-213.
  9. Fedoroff, I. C., & Taylor, S. (2001). Psychological and pharmacological treatments of social phobia: a meta-analysis. Journal of Clinical Psychopharmacology, 21, 311-324.
  10. Feske, U., & Chambless, D. L. (1995). Cognitive behavioral versus exposure only treatment for social phobia: a meta-analysis. Behavior Therapy, 26, 695-720.
  11. Gelernter, C.S., Uhde, T. W., Cimbolic, P., Arnkoff, D. B., Vittone, B. J., Tancer, M. E. et al. (1991). Cognitive-behavioral and pharmacological treatments of social phobia. A controlled study. Archives of General Psychiatry, 48, 938-945.
  12. Gould, R. A., Buckminster, S., Pollack, M. H., Otto, M. W., & Yap, L. (1997). Cognitive-behavioral and pharmacological treatment for social phobia: a meta-analysis. Clinical Psychology: Science and Practice, 4, 291-306.
  13. Gruber, K., Moran, P. J., Roth, W. T., & Taylor, C. B. (2001). Computer-assisted cognitive behavioral group therapy for social phobia. Behavior Therapy, 32, 155-165.
  14. Hallam, R. S., & Hafner, R. J. (1978). Fears of phobic patients: factor analyses of self-report data. Behaviour Research and Therapy, 16, 1-6.
  15. Heimberg, R.G., Becker, R. E., Goldfinger, K., & Vermilyea, J. A. (1985). Treatment of social phobia by exposure, cognitive restructuring and homework assignments. The Journal of Nervous and Mental Disease, 17, 236-245.
  16. 9 Heimberg, R.G., Dodge, C. S., Hope, D. A., Kennedy, C. R., Zollo, L. J., & Becker, R. E. (1990). Cognitive behavioral group treatment for social phobia: comparison with a credible placebo control. Cognitive Therapy and Research, 14, 1-23.
  17. Heimberg, R. G., Juster, H. R., Hope, D. A., & Mattia, J. I. (1995). Cognitive behavioral group treatment: description, case presentation, and empirical support. In: M. B. Stein (Ed.), Social phobia: clinical and research perspectives (pp. 293-321). Washington, DC: American Psychiatric Press.
  18. Heimberg, R.G., Liebowitz, M. R., Hope, D. A., Schneier, F. R., Holt, C. S., Welkowitz, L. A. et al. (1998). Cognitive behavioral group therapy vs. phenelzine therapy for social phobia. Archives of General Psychiatry, 55, 1133-1141.
  19. Hofmann, S.G., Newman, M. G., Becker, E., Taylor, C. B., & Roth, W. T. (1995). Social phobia with and without avoidant personality disorder: preliminary behavior therapy outcome findings. Journal of Anxiety Disorders, 9, 427-438.
  20. Hope, D.A., Heimberg, R. G., & Bruch, M. A. (1995). Dismantling cognitive-behavioral group therapy for social phobia. Behaviour Research and Therapy, 33, 637-650.
  21. Hope, D.A., Herbert, J. D., & White, C. (1995). Diagnostic subtype, avoidant personality disorder and efficacy of cognitive-behavioral group therapy for social phobia. Cognitive Therapy and Research, 19, 399-417.
  22. Hunter, J. E., & Schmidt, F. L. (1990). Methods of meta-analysis. Correcting error and bias in research findings. Newbury Park, CA: Sage.
  23. Jerremalm, A., Jansson, L., & O ¨st, L.-G. (1986). Cognitive and physiological reactivity and the effects of different behavioral methods in the treatment of social phobia. Behaviour Research and Therapy, 24, 171-180.
  24. Juster, H. R., Heimberg, R. G., & Engelberg, B. (1995). Self selection and sample selection in a treatment study of social phobia. Behaviour Research and Therapy, 33, 321-324.
  25. Kanter, N.J., & Goldfried, M. R. (1979). Relative effectiveness of rational restructuring and self- control desensitization in the reduction of interpersonal anxiety. Behavior Therapy, 10, 472-490.
  26. Lincoln, T. M., Rief, W., Hahlweg, K., Frank, M., von Witzleben, I., Schroeder, B., et al. (in press). Effectiveness of an empirically supported treatment for social phobia in the field. Behaviour Research and Therapy.
  27. Marks, I. M., & Mathews, A. M. (1979). Brief standard self-rating for phobic patients. Behaviour Research and Therapy, 17, 263-267.
  28. Mattick, R. P., & Clarke, J. C. (1998). Development and validation of measures of social phobia scrutiny fear and social interaction anxiety. Behaviour Research and Therapy, 36, 455-470.
  29. Mattick, R.P., & Peters, L. (1988). Treatment of severe social phobia: effects of guided exposure with and without cognitive restructuring. Journal of Consulting and Clinical Psychology, 56, 251-260.
  30. Mattick, R.P., Peters, L., & Clarke, J. C. (1989). Exposure and cognitive restructuring for social phobia: a controlled study. Behavior Therapy, 20, 3-23.
  31. Mersch, P.P.A. (1995). The treatment of social phobia: the differential effectiveness of exposure in vivo and an integration of exposure in vivo, rational emotive therapy and social skills training. Behaviour Research and Therapy, 33, 259-269.
  32. Newman, M.G., Hofmann, S. G., Trabert, W., Roth, W. T., & Taylor, C. B. (1994). Does behavioral treatment of social phobia lead to cognitive changes? Behavior Therapy, 25, 503-517.
  33. Otto, M.W., Pollack, M. H., Gould, R. A., Worthington, J. J., McArdle, E. T., & Rosenbaum, J. F. (2000). A comparison of the efficacy of clonazepam and cognitive behavioral group therapy for the treatment of social phobia. Journal of Anxiety Disorders, 14, 345-358.
  34. Paul, G. L. (1966). Insight vs. desensitization in psychotherapy. Stanford, CA: Stanford University Press.
  35. Ruhmland, M., & Margraf, J. (2001). Effektivita ¨t psychologischer Therapien von generalisierter Angststo ¨rung und sozialer Phobie: Meta-Analysen auf Sto ¨rungsebene [Efficacy of psychological treatments for generalized anxiety disorder and social phobia]. Verhaltenstherapie, 11, 27-40.
  36. Schelver, S.R., & Gutsch, K. U. (1983). The effects of self-administered cognitive therapy on social-evaluative anxiety. Journal of Clinical Psychology, 39, 658-666.
  37. Scholing, A., & Emmelkamp, P. M. G. (1993a). Cognitive and behavioral treatments of fear of blushing, sweating or trembling. Behaviour Research and Therapy, 31, 155-170.
  38. Scholing, A., & Emmelkamp, P. M. G. (1993b). Exposure with and without cognitive therapy for generalized social phobia: effects of individual and group treatment. Behaviour Research and Therapy, 31, 667-681.
  39. Shadish, W. R., Matt, G. E., Navarro, A. M., Siegle, G., Crits-Christoph, P., Hazelrigg, M. D. et al. (1997). Evidence that therapy works in clinically representative conditions. Journal of Consulting and Clinical Psychology, 65, 355-365.
  40. Stangier, U., Heidenreich, T., Peitz, M., Lauterbach, W., & Clark, D. M. (in press). Cognitive therapy for social phobia: individual versus group treatment. Behaviour Research and Therapy.
  41. Stravynski, A., Marks, I., & Yule, W. (1982). Social skills problems in neurotic outpatients. Social skills training with and without cognitive modification. Archives of General Psychiatry, 39, 1378-1385.
  42. Taylor, S. (1996). Meta-analysis of cognitive-behavioral treatments for social phobia. Journal of Behavior Therapy and Experimental Psychology, 27, 1-9.
  43. Taylor, S., Woody, S., Koch, W. J., McLean, P., Paterson, R. J., & Anderson, K. W. (1997). Cognitive restructuring in the treatment of social phobia. Behavior Modification, 21, 487-511.
  44. Turner, S.M., Beidel, D. C., Cooley, M. R., Woody, S. R., & Messer, S. C. (1994). A multicomponent behavioral treatment for social phobia: social effectiveness therapy. Behaviour Research and Therapy, 32, 381-390.
  45. Turner, S. M., Beidel, D. C., Dancu, C. V., & Stanley, M. A. (1989). An empirically derived inventory to measure social fears and anxiety: the social phobia and anxiety inventory. Psychological Assessment, 1, 35-40.
  46. Turner, S.M., Beidel, D. C., & Jacob, R. G. (1994). Social phobia: a comparison of behavior therapy and atenolol. Journal of Consulting and Clinical Psychology, 62, 350-358.
  47. Ullrich de Muynck, R., & Ullrich, R. (1979). Der Unsicherheitsfragebogen. Testmanual U [The uncertainty questionnaire. Testmanual U] (2nd ed.). Mu ¨nchen: J. Pfeiffer.
  48. Watson, D., & Friend, R. (1969). Measurement of social-evaluative anxiety. Journal of Consulting and Clinical Psychology, 33, 448-457.
  49. Weisz, J. R., Donenberg, G. R., Han, S. S., & Weiss, B. (1995). Bridging the gap between laboratory and clinic in child and adolescent psychotherapy. Journal of Consulting and Clinical Psychology, 63, 688-701.
  50. Weisz, J. R., Weiss, B., & Donenberg, G. R. (1992). The lab versus the clinic. Effects of child and adolescent psychotherapy. American Psychologist, 47, 1578-1585.
  51. Wlazlo, Z., Schroeder-Hartwig, K., Hand, I., Kaiser, G., & Mu ¨nchau, N. (1990). Exposure in vivo vs. social skills training for social phobia: long-term outcome and differential effects. Behaviour Research and Therapy, 28, 181-193.