PSY 611: Methods and Program Evaluation

PSY 611: Methods and Program Evaluation

PSY 611: Methods and Program Evaluation

Dr. Mike Aamodt

Summer I, 2004

Class Information Instructor InformationOffice Hours

Monday - Thursday RU 443M, T, W, TR, F

2:00 p.m. – 4:45 p.m. 831-551310:00 a.m. – 10:50 a.m.

RU 349

______

Course Objectives

  • Be able to determine if there is a need for a psychological intervention
  • Be able to implement a psychological intervention
  • Learn how to choose the best method to evaluate the success of psychological interventions
  • Understand the characteristics of properly developed assessment tools
  • Be able to understand the statistics used in journal articles and technical reports
  • Be able to select the appropriate statistic to analyze program evaluation data
  • Be able to professionally present the results of psychological research or program evaluation

Course Schedule

May17Introduction to the classand program evaluation

18Understanding statisticsAamodt et al. (1-5)

19Understanding the literature: meta-analysisAamodt et al. (6)

20Needs analysisRoyse (1, 2, 3)

May24Implementing a program – managing change

25Surveys and interviewingRoyse (4)

26Effectively communicating program evaluation results

27*** Mid-Term Exam ***

May31*** Memorial Day Holiday ***

June 1Research methodsRoyse (6-10)

2Research methods

3Creating psychometrically sound assessmentsRoyse (11, 13)

June 7General Program Evaluation Issues

June 8*** Presentations ***

June 9*** Presentations ***

June10*** Final Exam ***

Texts

Royse, D., Thyer, B. A., Padgett, D. K., & Logan, T. K. (2001). Program evaluation (3rd edition). Belmont, CA: Brooks/Cole. (ISBN 0-8304-1536-x)

Aamodt, M. G., Surrette, M. A., & Cohen, D. (2004). Statistics for Human Resource Professionals. Washington, D.C.: DCI Consulting. (you don’t need to buy this book, I will email you a copy).

Grades

Mid-term Exam100

Final Exam100

Student meta-analysis presentation100

Group project100

A = 360-400B = 320-359 C = 280-319 D = 240-279 F = 239 or lower

Attendance Policy

Due to the compressed nature of the course, each absence after the first will result in a reduction of one grade.

Group Project

Students will be divided into two groups. The school psychology students will conduct a program evaluation of the Counseling Program and the counseling psychology students will conduct a program evaluation of the School Psychology Program.

Meta-Analysis Project

Each student will read a meta-analysis and then present the meta-analysis results to the class using a PowerPoint presentation. The presentation should be 10-15 minutes long.

  • An example of the information to be included in your presentation can be foundon by web page at:
  • Examples of presentations from last year can be found on my web page at:
  • The criteria used to grade the presentation can be found on my web page at:

Meta-Analyses

Braithwaite, D., Emery, J., Walter, F., Prevost, A. T., & Sutton, S. (2004). Psychological impact of genetic counseling for familial cancer: A systematic review and meta-analysis. Journal of the National Cancer Institute, 96(2), 122-133.

*Burke, B. L., Arkowitz, H., & Menchola, M. (2003). The efficacy of motivational interviewing: A meta-analysis of controlled clinical trials. Journal of Consulting and Clinical Psychology, 71(5), 842-861.

*Connor, D. F., Boone, R. T., Steingard, R. J., Lopez, I.D., & Melloni, R. H. (2003). Psychopharmacology and aggression: II. A meta-analysis of nonstimulant medication effects on overt aggression-related behaviors in youth with SED. Journal of Emotional and Behavioral Disorders, 11(3), 157-168.

*Dowden, C., & Andrews, D. A. (2003). Does family intervention work for delinquents? Results of a meta-analysis. Canadian Journal of Criminology and Criminal Justice, 45(3), 327-343.

*Farrington, D. P., & Welsh, B. C. (2003). Family-based prevention of offending: A meta-analysis. Australian and New Zealand Journal of Criminology, 36(2), 127-151.

Greenberg, D. H., Michalopoulos, C., & Robins, P. K. (2003, October). A meta-analysis of government-sponsored training programs. Industrial and Labor Relations Review, 57(1), 31-53.

*Hosp, J. L., & Reschly, D. J. (2003). Referral rates for intervention or assessment: A meta-analysis of racial differences. Journal of Special Education, 37(2), 67-80.

*Leichsenring, F., & Leibing, E. (2003). The effectiveness of psychodynamic therapy and cognitive behavior therapy in the treatment of personality disorders: A meta-analysis. American Journal of Psychiatry, 160(7), 1223-1233.

Losel, F., & Beelmann, A. (2003). Effects of child skills training in preventing antisocial behavior: A systematic review of randomized evaluations. Annals of the AmericanAcademy of Political and Social Science. May, 84-109.

*Moyer, C. A., Rounds, J., & Hannum, J. W. (2004). A meta-analysis of massage therapy research. Psychological Bulletin, 130(1), 3-18.

*Ortiz, B. A., & Raine, A. (2004). Heart rate level and antisocial behavior in children and adolescents: A meta-analysis. Journal of the AmericanAcademy of Child and Adolescent Psychiatry, 43(2), 154-162.

Petrosino, A., Turpin-Petrosino, C., & Buehler, J. (2003). Scared straight and other juvenile awareness programs for preventing juvenile delinquency: A systematic review of the randomized experimental evidence. Annals of the AmericanAcademy of Political and Social Science, 58(9),September, 41-62.

Price, C., & Kunz, J, (2003). Rethinking the paradigm of juvenile delinquency as related to divorce. Journal of Divorce and Remarriage, 39(1-2), 109-133.

*Robbins, S. B., Lauver, K., Le, H., Davis, D., Langley, R., & Carslstrom, A. (2004). Do psychosocial and study kill factors predict college outcomes? A meta-analysis. Psychological Bulletin, 130(2), 261-288.

*Rosenfeld, B. (2004). Violence risk factors in stalking and obsessional harassment: A review and preliminary meta-analysis. Criminal Justice and Behavior, 31(1), 8-36.

*Smith, T. B., McCullough, M. E., & Poll, J. (2003). Religiousness and depression: Evidence for a main effect and the moderating influence of stressful life events. Psychological Bulletin, 129(4), 614-636.

*Stice, E., & Shaw, H. (2004). Eating disorder prevention programs: A meta-analytic review. Psychological Bulletin, 130(2), 206-227.

Twenge, J. M. Campbell, W. K., & Foster, C. A. (2003). Parenthood and marital satisfaction: A meta-analytic review. Journal of Marriage and the Family, 65(3), 573-583.

*Vitaliano, P. P., Zhang, J., & Scanlan, J. M. (2003). Is caregiving hazardous to one’s physical health? A meta-analysis. Psychological Bulletin, 129(6), 946-972.

Wilson, W. C., & Rosenthal, B. S. (2003). The relationship between exposure to community violence and psychological distress among adolescents: A meta analysis. Violence and Victims, 18(3), 335-352.