Current Evaluation Projects
TOPIC SPECIFIC DATA CALLS
Perinatal Behavioral Health
The perinatal work group expressed an interest in collecting baseline data for the guidelines they created in order to measure changes to processes of care. In response, the Bree has designed a difference-in-differences evaluation plan to measure the change in processes and impact of implementation using a combination of process measures collected through a survey and metrics data collected through OB COAP.
Aims
- To measure impact of guidelines implementation
- To determine which activities had the most impact on the outcomes
- To understand if or how the use of equity data may have contributed to the outcome
- To understand which guideline areas provided the most support for implementation
- To understand which barriers and facilitators were most highly correlated with successful implementation.
Benefits of Participation
Any organizations that participates in the 2024 and 2027 process data collection efforts will be eligible for the Bree Collaborative’s Pathfinder Award and, subsequently, the Foundation for Health Care Quality’s Mountain Climber Award.
Who should be involved?
- Hospitals
- Hospital Systems that offer perinatal care
- Outpatient services that offer perinatal care
- Health Plans that cover Perinatal Care
- Pediatricians
- Other organizations that offer behavioral health services to pregnant and postpartum patients
What kind of support documentation should be included?
Supporting documentation may include links in the score card to webpages or documents, examples of policies, procedures, workflows, patient information, quality metrics data, or other items that demonstrate ways to operationalize guideline recommendations.
How is the data being used?
All data submitted to the Bree Collaborative will be used to populate dashboards and all participants will be de-identified.
2024
- Baseline data collection January 2024-December 2024
- Implementation Plan Survey Open December 1st, 2024
- OB COAP cross reference of participants
2025
- Implementation Plan Survey Close January 31st, 2025
- OB COAP impact metrics data collection, January 1st to January 31st 2025 for 2023-24 data.
2026
- Re-survey of process (baseline) data September 1st, 2026 to December 31st 2026.
- Guideline Usefulness Survey, September 1st, 2026 to December 31st, 2026.
- OB COAP impact metrics data collection, January 1st to January 31st 2026 for 2025 data.
2027
- OB COAP impact metrics data collection, January 1st to January 31st 2027 for 2026 data
- Bree Implementation Support Activities data collection, January/February 2027 for dates between January of 2025 and December of 2026.
- Final Data Analysis
Data Collection tools for baseline data can be found in the Bree Collaborative Implementation Guide under the Perinatal Behavioral Health section. The collection tools can be found in the Metrics and Evaluation Tools section and are listed by audience type.
Those submitting baseline data should fill out the data collection tab that is applicable to their role or “audience type” (i.e. pediatrician, outpatient, hospital, etc.) and the equity tab.
The completed score cards can be submitted using the form below, along with any supporting documentation. You may also email a zip file to: knicholas@qualityhealth.org Please put Perinatal Behavioral Health Baseline Data in the subject line.
ON-GOING DATA SUBMISSIONS
- Health System Surveys: Sent out through partners and contacts to be filled out by any health system stakeholder. The purpose of this survey is to collect data on stakeholder perceptions of the usefulness of the guidelines and to better understand barriers and facilitators for specific audiences. This data is used to inform changes to the Bree process, to identify topics to address during guidelines creation, and to identify organizations for further evaluation purposes. A copy of this survey can be found HERE
- Data Capacity Surveys: sent out through partners and contacts to be filled out by individuals responsible for implementing or managing IT services. The purpose of this survey is to collect data on IT roles perceptions of the usefulness of the guidelines and to better understand barriers and facilitators for specific audiences. This data is used to inform changes to the Bree process, to identify topics to address during guidelines creation, and to identify organizations for further evaluation purposes. A copy of this survey can be found HERE
Describe awards submssions and link to awards page
describe and link
Evaluation “score cards” are available for most Bree guidelines. The purpose of these score cards it to collect standardized data on the extent to which organizational policies, contracting, programs, and care processes are concordant with the guidelines. Score Cards can be found in our IMPLEMENTATION GUIDE.
These score cards are used for a variety of purposes including awards, populating dashboards, and reports. (more description)
Submit a survey question to the Evaluation Survey Question Bank!
This tool can be found on our website. It is modeled after the CDC Question Bank and allows multiple organizations to use the same questions when they perform PDSAs or evaluate programs or implementation projects. The aim of the question bank is to help organizations use validated questions or survey tools and reduce the burden of evaluation work and improve the validity of their findings.Our Question Bank can be found HERE
Submit a survey that you have used (expand)
Contact use about developing a Case study!
Each year the Bree chooses a topic area to develop new case studies that can illustrate impact and demonstrate the “how to” of implementation. Your project doesn’t need to be on one of our defined topics in order to submit a suggestion, we are always open to new and interesting ways that organizations have used our guidelines.
2024 – Opioid Prescribing and Treatment
2025 – TBD
Guideline Evaluation Planning Projects
The Bree Collaborative has developed a new evaluation design process for all new guidelines. An evaluation subcommittees will create an evaluation plan and tools, in parallel with the guidelines development, that the Bree staff will operationalize.
For guidelines developed before 2023, Bree staff (describe)
We are using both qualitative and quantitative methods for evaluation of our guidelines and are interested in evaluating five broad areas of our work:
- Guideline usefulness and clarity
- Uptake and Concordance of Care
- Barriers and facilitator
- Equity
- Metrics and impact of guideline
2024 Guideline Evaluation Planning
Thank you for your interest in joining the Bree Collaborative’s Behavioral Health: Early Intervention for Youth subcommittee for measurement and evaluation. This meeting is scheduled for the second Monday of the month from April through September of 2024.
Microsoft Teams Need help?
Meeting ID: 219 454 245 63
Passcode: ftMTxE
Dial-in by phone
+1 360-329-2914,,5601012# United States, Seattle
Phone conference ID: 560 101 2#
For organizers: Meeting options | Reset dial-in PIN
Thank you for your interest in joining the Bree Collaborative’s Heat Related Illness subcommittee for measurement and evaluation. This meeting is scheduled for the second Wednesday of the month from April through September of 2024.
Microsoft Teams meeting
Join on your computer, mobile app or room device
Meeting ID: 260 290 430 009
Passcode: 9CvmNK
Passcode: 9CvmNK
Or call in (audio only)
+1 360-329-2914,,548363852# United States, Seattle
Phone Conference ID: 548 363 852#
Thank you for your interest in joining the Bree Collaborative’s Opioid Use Disorder subcommittee for measurement and evaluation. This meeting is scheduled for the third Thursday of the month from April through September of 2024.
Microsoft Teams meeting
Join on your computer, mobile app or room device
Meeting ID: 278 832 055 216
Passcode: JTApAj
Passcode: JTApAj
Or call in (audio only)
+1 360-329-2914,,664586680# United States, Seattle
Phone Conference ID: 664 586 680#
2023 Guideline Evaluation Planning
Evaluation design, planning, and tool development is still in process for the 2023 Bree guidelines on Diabetes Care. If you are interested in participating in the evaluation design process, please contact Karie Nicholas, Evaluation and Measurement Manager, at knicholas@qualityhealth.org.
Evaluation design, planning, and tool development is still in process for the 2023 Bree guidelines on Complex Discharge. If you are interested in participating in the evaluation design process, please contact Karie Nicholas, Evaluation and Measurement Manager, at knicholas@qualityhealth.org.
© 2024 Foundation for Health Care Quality | Privacy Statement | Disclaimer