Program Evaluation
Evaluation and Technical Assistance
The fast moving and often complex transformation of behavioral health services requires behavioral health care providers to establish a fundamentally sound evaluation platform to develop and implement an effective set of strategies ensuring they not only survive but thrive in this challenging environment.
SAE will ensure our clients have the required personnel, appropriate policies, established protocols and work processes, evaluation tools, and reporting infrastructure to support reporting on all required performance measures accurately and on time.
Evaluation
SAE Behavioral Health Evaluation Services, DBA, provides clients with a wide range of high-quality evaluation services and support. Some of these supports and services include:
- Ensuring client is equipped to meet grant requirements (on time); with
- Performance measures and necessary personnel
- Appropriate policies
- Established protocols and work processes, and
- Necessary evaluation tools and reporting infrastructure
- Utilizing appropriate data collection tools, data entry, database revision, and analysis plan;
- Process evaluation: How closely did the implementation match the plan? What changes were made to the originally proposed plan? What led to the changes and impact did changes have on planned intervention and performance assessment? Who provided (program staff) what services (modality, type, intensity, duration), to whom (individual characteristics), in what context (system, community), and at what cost (facilities, personnel, dollars)?
- Outcome evaluation: What impact did interventions and evidence-based practices have on participants knowledge, attitude and/or behavior? What individual factors were associated with outcomes, including race/ethnicity/sexual identity (sexual orientation/gender identity)? What program/contextual/cultural/linguistic factors were associated with outcomes? How durable were the effects?
- To track, monitor, and analyze the metrics related to program activities (i.e., services accessed, frequency of visitation, time spent in the program).
- To produce high quality, actionable information that promotes data-driven decision making and continuous quality improvement (CQI) and quality assurance (QA).
- As necessary, based on evaluation results and CQI Performance Improvement Plans.
- Regarding evaluation requirements to produce timely reports and facilitate communication between the funding agency and project staff.
SAE Behavioral Health Evaluation Services, DBA, offers the following analytic approaches to grant funded agencies:
- State-of-the-art statistical techniques to analyze data;
- Reliable and valid behavioral and medical health indicators to evaluate integrated health care for behavioral health care consumers of services;
- Verification of adherence to evidence-based interventions;
- Timely reporting of evaluation results to project stakeholders and funders.
Making Use of Technical Assistance Funds
SAMSHA grantees can look forward to accessing technical assistance (TA) funds tied to the award they receive. SAMSHA now allows grantees the option to secure their own TA experts. Securing knowledgeable and experienced subject matter experts are important criteria for choosing your TA. With a direct understanding of grant requirements, evaluation process and outcome, and operational process flow for service launch, grant management and service transitions, SAE offers a wide range of TA-focused capabilities.
SAE offers the following TA capabilities:
- Logic Modeling and Program Design
- Program Evaluation and Implementation
- Randomized Control Study
- Evaluation in Multiple Settings
- Client-Centered Orientation
- Data Visualization
- Program Sustainability for Post Grant Terms
- Organization Agility Assessment
- Performance Measures for Service Goals
- Outcome and Population Datasets
- Operational Performance and Financial Benchmarks
- Overcoming Technical Disruptions
- EHR and Operational Management Tools
- Quality Improvements and Corrective Improvements
For a summary of our SAMHSA Quantitative Program Evaluation Experience, click here.
Please note that SAE & Associates, LLC (now SAE Behavioral Health Consulting, DBA) has evolved into two separate companies, one of which is SAE Behavioral Health Evaluation Services, DBA, a step that SAE has voluntarily taken to address the requirements of HHS 45 CFR 74.43, thereby avoiding any issues relative to potential organizational conflicts of interest.
Schedule A Consultation
SAE Behavioral Health Consulting enhances provider service provision that is integrated, accessible, data-driven, and person-centered.
