Skip To Content
	Home Grants Publications Statistics Newsroom Programs About Us Contact Us En Español

Appendix C: Actual and Planned Program Evaluations

Community Mental Health Services Block Grant (MHBG)

• Evaluability Assessment: SAMHSA conducted an evaluability assessment of the MHBG which was completed in August 2004. The study helped to pinpoint and clarify evaluation questions, methodology, costs, and uses prior to expending further evaluation resources.

• Evaluation of MHBG: The Community Mental Health Services Block Grant Program (MHBG) will be evaluated in FY 2005-2006.

• Study of the Cost Efficiency & Effectiveness of Evidence-Based Practices (EBP): This evaluation, to be completed in FY 2006, will conduct a pilot study to examine cost efficiency in relation to state mental health systems of care that implement evidence-based practices.

The MHBG underwent a PART review in 2003. It received a rating of “Adequate”. One of the recommendations was to conduct an evaluation to remedy the fact that the MHBG has not had an independent evaluation since its inception in 1981. OMB also asked CMHS to complete a pilot study to consider cost efficiency in relation to the implementation of EBPs within states. The EPB study directly addresses this recommendation.

Protection and Advocacy for Individuals with Mental Illness Program

The Protection and Advocacy for Individuals with Mental Illness (PAIMI) Program will be evaluated in FY 2005-2006. OMB will also conduct a PART review of the PAIMI program in FY 2005. Since its creation in 1986, the PAIMI Program has not had an independent evaluation.

Comprehensive Community Mental Health Services for Children and Their Families Program

This program is evaluated on an ongoing basis, and produces an annual report to Congress on evaluation results. The Children’s MH Program underwent a PART review in 2002. It received a rating of “Moderately Effective”. OMB recommended that the Children’s program:

(1) Provide a budget presentation that clearly ties the impact of funding decisions on expected performance or explains why the requested performance and resource mix is appropriate;
(2) Develop data for long term measures;
(3) Improve efficiency data.

The evaluation addresses recommendations (2) and (3) .

Projects for Assistance in Transition from Homelessness (PATH) Program

• The current PATH program evaluation began in FY 2004 and is scheduled to be completed in FY 2006. Section 528 of the Public Health Service (PHS) Act requires SAMHSA to evaluate the expenditures of PATH program grants at least once every three years. The PATH program underwent a PART review in 2002. It received a rating of “Moderately Effective”. OMB recommended that the PATH program:

(1) Provide a budget presentation that clearly ties the impact of funding decisions on expected performance or explains why the requested performance and resource mix is appropriate;
(2) Develop data for long term measures;
(3) Improve efficiency data.

This evaluation addresses the data recommendations.

• Pilot Testing of Outcome Measures in Programs Providing Services to Persons Who Are Homeless and Have Serious Mental Illnesses:

This study is expected to be completed in June 2005. The purpose of this evaluation is to test the feasibility of PATH-funded programs to obtain data on outcomes related to housing, continuing mental health treatment, substance use and employment provided and funded by sources other than PATH.

The PATH program underwent a PART review in 2002. It received a rating of “Moderately Effective”. Two of the recommendations were to develop data for long term measures and to
improve efficiency data. The evaluation project will address these recommendations by reporting results, identifying impediments and assessing the utility of continuing the voluntary data collection effort on a larger scale.

CMHS Programs of Regional and National Significance

• The National Child Traumatic Stress Initiative (NCTSI) will be evaluated in FY 2005. The evaluation will support continued ongoing cross-site data collection and analysis, collaboration and network analysis, and other outcome studies.

• The Safe Schools/Healthy Students National Evaluation begins in FY 2005. A previous evaluation of the program by the Department of Justice has now been completed.

• Youth Suicide Early Intervention and Prevention Evaluation:  This evaluation begins in FY 2005.  The evaluation will examine system-level outcomes such as access to referral resources, adherence to follow-up recommendations, and community/statewide treatment outcomes.

These three programs are part of the PRNS program, which will receive a PART review in FY 2005.

CSAP Programs of Regional and National Significance

Several programs within CSAP's Programs of Regional and National Significance are being evaluated in FY 2004-2006.  The programs are:

• Youth Mentoring:
• Family Strengthening:
• Methamphetamine/Ecstasy
• Ecstasy
• Substance Abuse Prevention/HIV Prevention
• State Incentive Grants
• Centers for the Application of Prevention Technologies (CAPTs)
• Strategic Prevention Framework State Incentive Grants:

CSAP's Programs of Regional and National Significance received an OMB PART review in FY 2004, and was rated “Moderately Effective”.

CSAT Programs of Regional and National Significance

Several programs within CSAT's Programs of Regional and National Significance are being evaluated in FY 2004-2006.  The programs are:

• Family Drug Treatment Courts Program (FTDC): The evaluation will examine the effectiveness of FTDCs in four sites which represent two distinct models: a stand-alone family treatment drug court that serves some substance-abusing families involved with the child welfare system; and a system-wide approach to serving these families.

• Drug Addiction Treatment Waiver Program: The study evaluates a new program that allows qualified physicians to obtain waivers from federal law to use certain new medications in the office-based treatment of opiate addiction.

• Opioid Treatment Program (OTP) Accreditation: This evaluation will gauge the impact of accreditation on Opioid Treatment Programs (OTPs) now that accreditation has become mandatory.

• Screening, Brief Intervention Evaluation (SBIRT): SBIRT will be evaluated in FY 2004-2008. This is a new CSAT PRNS activity that was not in existence at the time of the PART review.

• Addiction Technology Treatment Centers: The study will evaluate both the process and impact of the ATTCs, specifically the impact of the ATTCs on increasing and developing the substance use disorder treatment workforce.

• Rehabilitation and Restitution Initiative: The study is evaluating two sites in Ohio to determine what factors may contribute to the successful completion of all criminal supervision and the ability of first time non-violent felony offenders to remain in the community without committing additional crime or engaging in substance use/abuse.

CSAT Programs of Regional and National Significance underwent a PART review in 2002, and received a rating of “Adequate”. One of the recommendations was “Fund independent and comprehensive program evaluations of the national program.” These evaluations will specifically address this recommendation, as well as the recommendation to develop data for performance measures.

Substance Abuse Prevention and Treatment Block Grant

• An evaluability assessment of the SAPT Block Grant. Methodology is in progress which includes interviews with key stakeholders and analysis of existing information and data and development of a logic model, resulting in recommendations for formal analysis of the Block Grant. It is expected that a full evaluation will be conducted after the completion of the evaluability study.

The SAPT Block Grant underwent a PART review in 2003, and received a rating of “Ineffective.”

Home Contact Us Staff Directory Accessibility Privacy Disclaimer FOIA Site Map The White House• Department of Health & Human Services• FirstGov• Grants.gov Substance Abuse & Mental Health Services Administration • 1 Choke Cherry Road • Rockville, MD 20857 * PDF formatted files require that Adobe Acrobat Reader® program. Click here to download this FREE software now from Adobe.