Foundation Program Sites

EVALUATION

Welcome to the Bree Collaborative Evaluation Home Page

On this page you will find introductory information about our evaluation activities and links our dashboards, evaluation reports,  and the Evaluation Survey Question Bank.

Introduction and Methods

The Bree Collaborative is using both qualitative and quantitative methods for evaluation of our guidelines. We are interested in evaluating five broad areas of our work:

  1. Guideline usefulness and clarity
  2. Uptake and Concordance of Care
  3. Barriers and facilitator
  4. Equity
  5. Metrics and impact of guideline

What tools did we use?

The Bree Collaborative has created multiple tools for data collection. These include:

  • Health System Survey Tool: Sent out through partners and contacts to be filled out by any health system stakeholder. The purpose of this survey is to collect data on stakeholder perceptions of the usefulness of the guidelines and to better understand barriers and facilitators for specific audiences. This data is used to inform changes to the Bree process, to identify topics to address during guidelines creation, and to identify organizations for further evaluation purposes. A copy of this survey can be found here (ADD LINK)
  • Data Capacity Survey Tool: sent out through partners and contacts to be filled out by individuals responsible for implementing or managing IT services. The purpose of this survey is to collect data on IT roles perceptions of the usefulness of the guidelines and to better understand barriers and facilitators for specific audiences. This data is used to inform changes to the Bree process, to identify topics to address during guidelines creation, and to identify organizations for further evaluation purposes. A copy of this survey can be found here (ADD LINK).
  • Evaluation “score card” Tools: Organizations were invited to participate and were selected by the Measurement and Data Advisory Committee. The purpose of this method is to collect data on which guidelines are being used, the extent to which care processes are concordant with the guidelines.
  • Self-report “score card” Tools: The purpose and tools are the same as the evaluation “score cards” but data is collected on a voluntary basis from organizations that are interested in implementation support or awards.
  • Evaluation Survey Question Bank Tool: This tool can be found on our website. It is modeled after the CDC Question Bank and allows multiple organizations to use the same questions when they perform PDSAs or evaluate programs or implementation projects. The aim of the question bank is to help organizations use validated questions or survey tools and reduce the burden of evaluation work and improve the validity of their findings.

HOW CAN I PARTICIPATE?

We have created multiple ways that organizations can opt into our evaluation work.

Take our Health System Survey on usefulness of Bree Collaborative Guidelines

Take our Data Capacity Survey on organizational data capacity and usefulness of Bree Guidelines to identify data collection and sharing goals

Self report your uptake of Bree Guidelines and assess your concordance of care with best practices

Bree Collaborative Dashboards

The Bree Collaborative is creating dashboards to measure the progress on implementation and impact of our guidelines

Bree Collaborative Evaluation Survey Question Bank – NOW AVAILABLE!

The Bree Collaborative has developed a collaborative question bank, where organizations can draw from and share evaluation questions with the goal of aligning evaluations of implementation projects. Modeled on the CDC’s Survey Question Bank, this resource can support organizations in demonstrating the value of their implementation work.

Bree Collaborative Case Studies – COMING SOON!

The Bree Collaborative is creating case studies, in partnership with other organizations, in order to illustrate different implementation projects. Case studies may be on broad topics and include multiple guideline reports, or they may be focused on a single report.

Case studies are developed through a standardized method, borrowed from the Guidelines International Network, to support validity and reliability of the information.

Bree Collaborative Evaluation Reports

2016 Evaluation Reports – in 2016 the Bree Collaborative conducted an evaluation of 14 reports and factors affecting the adoption of the guidelines included in them. The results were disseminated through a rep0ort and stratified by Hospitals, Medical Groups and Health Plans. The report can be found here: Bree-Implementation-Survey-Results-Final-17-04

2023 Evaluation Reports – COMING SOON! – in 2022.23 the Bree Collaborative developed methods and a program for continued evaluation of the adoption of its guidelines, measurement for concordance of care and impact on patient experience and health outcomes among those organizations adopting the guidelines.