Foundation Program Sites

Evaluation Survey Question Bank

Purpose and Rational

The purpose of the bank is to provide sample validated survey questions that organizations may utilize within their evaluation tools to produce results that can be compared with other entities. 

The CDC has also developed a survey question bank for standard surveys. You can find out more about their question bank here.

What is the Evaluation Survey Question Bank?

The Bree Collaborative is interested in finding new ways to support data collection and reporting for projects focused on the implementation our guidelines. To that end, we have developed this collaborative question bank, where organizations can draw from and share evaluation questions with the goal of aligning evaluations of implementation projects.

The Bree Collaborative publishes questions used, or proposed for use, for different purposes, including but not limited to: Bree work group participation, case study development, Bree Guidelines project evaluation surveys, and other similar purposes.

All questions developed by the Bree or submitted by other organizations include standardized methodological information such as which audiences they are intended for, question format, measurement scale, appropriate or recommended method(s) of analysis, and validation information as seen in the structure below:

Introduction:

If the question requires an introduction

Question:

The content of the question

Answer options:

What options audiences have for answering the questions (example: “happens routinely, never happens”)

Format:

Whether the question is constructed as a single select, item ranking, text, etc.

Scale:

How the question is being measured (example: count, qualitative word coding, likert scale, 1-10, etc.)

Measurement:

Recommended way to aggregate or measure responses.

Status:

Whether the question has been reviewed or validated and how it was done.

Audience:

Who the question was intended for

Notes:

May include name of a specific tool the question was taken from or modified from, specific groups the question has been deployed with or other supporting information

Links to full surveys that the Bree has leveraged for evaluation purposes can also be found within each section. This includes name of the topic, publishing institution, descriptions, scale, audiences, and notes.

Why use our question bank?

When multiple organizations ask the same questions in the same way it can support better data exchange and improve evaluation validity. As we collect more data from participating organizations, the Bree will publish information on question validity and the methods for validating the questions. Organizations participating in the collaborative question bank may make data requests or be considered for case study development and support.

How to use the question bank?

Any organization can use these questions to create their own survey. Question (domains) are found on the tabs to the left on this page. Clicking on the tabs will bring you to all questions in that (domain). If you are drawing questions from this bank to support your own evaluation efforts we ask that you let us know which questions you used and what you used them for. To report how you are using our questions, scroll down to the form at the bottom of this page.

Organizations can also add to the question bank by submitting any questions they are using for projects that aim to evaluate the implementation or use of the Bree guidelines. To add questions, simply submit your question in the standardized format (See the “what is the Evaluation Survey Question Bank?” tab above) via email to the Evaluation and Measurement Manager at knicholas@qualityhealth.org, or scroll down to the form at the bottom of this page.

What will happen if I report on or add to this question bank?

If you add to the question bank your questions will be uploaded so that other organizations can use them. This will include the name of the organization that has submitted the question and the specific guideline topic it was used for. If you submit a report that you have used a question from the question bank you may be contacted by the Foundation for Health Care Quality to provide more information about your uses. Basic information on questions may be reported out publicly, such as how many, what type, or general location of organizations that are using specific questions to evaluate guidelines implementation projects.

Organizations can also report that they have used surveys or questions from other question banks. The Bree will track other surveys or resources used and make information about them available to here.

Sharing Data

We highly encourage organizations to submit the results of their survey or evaluation, but it is not required in order to use the bank. Sharing de-identified data can help us generate a sample size large enough for validity and reliability testing. If you decide to share your data with the Bree we will not publish any identifying data without your permission, however we reserve the right to publish highly aggregated data on our dashboard. An example of highly aggregated data is: “X number of organizations in Washington State found that cost was a major barrier to implementing Y guideline”.

To submit your data please email the Evaluation and Measurement Manager at knicholas@qualityhealth.org

Other Resources for Creating Evaluation Surveys

Below you will find a list of resources to support and help align your evaluation with other Bree stakeholders.

Evaluation Checklist, Adapted from SAMHSA

Likert Scale Examples, Iowa State University

Harvard Survey Design Tips

University of Wisconsin, Questionnaire Design: Asking questions with a purpose

UT HealthHuston Institute for Implementation Science WHO Training

Sierra Health Foundation, We did it ourselves: an evaluation guide book

Share your knowledge: contribute to this question bank, or let us know how you are using the questions, through the form at the bottom of this page.

Question Bank Categories

Question QA1: Staff awareness of Bree Collaborative Guidelines

Answer Options:

1) …no awareness of Bree Collaborative Guidelines
2) …basic level of awareness; content not known
3) …general awareness; some specific content known
4) …advanced knowledge of awareness; content known and staff interest in implementation

Format: Scale for each answer option and total score 1-10

Scale or Measurement: Count of answers in each strata

a) 1
b) 2-4
c) 5-7
d) 8-10

Status: In review

Audience: General, Delivery site staff, other TBD

Notes: This survey tool called the “Bree Collaborative Behavioral Health Integration Assessment” was created by Bree staff in 2020 based on the MeHAF to capture general awareness of Bree Guidelines in conjunction with surveys of adoption of behavioral health integration measures. More information here.

Question QA2: Buy-in/Interest in Implementation of Bree Collaborative Guidelines

Answer Options:

1) …no interest in Guideline Implementation
2) …actively considering  Guideline Implementation
3) ..some steps taken toward Guideline Implementation; test cycles beginning
4) ..actively working toward Guideline Implementation; team formed and test cycles ongoing

Format: Scale for each answer option and total score 1-10

Scale or Measurement: Count of answers in each strata

a) 1
b) 2-4
c) 5-7
d) 8-10

Status: In review

Audience: General, Delivery site staff, Other TBD

Notes: This survey tool called the “Bree Collaborative Behavioral Health Integration Assessment” was created by Bree staff in 2020 based on the MeHAF to capture general interest in adopting Bree Guidelines in conjunction with surveys of adoption of behavioral health integration measures. More information here.

Question QA3: Has your organization taken any actions to implement X Bree Guideline?

Answer Options:

a) no action on Bree Guidelines
b) in the process of creating an implementation plan
c) executed an implementation
d) evaluated an implementation

Format: Single select

Scale or Measurement: Count

Status: In use, un-validated

Audience: General, CEO, COO, Bree work group members, Other TBD

Note: This question is part of the Transformation and Outreach managers survey of Bree work groups.

Question QB1: What was the project time frame for the implementation of X guidelines?

Answer Options:

  1. Less than 3 months
  2. 3-6 months
  3. 6-9 months
  4. 9 months to a year
  5. a year or longer

Format: Single select

Scale or Measurement: Count

Status: In review

Audience: TBD

Notes:

Question QB2a: Was the implementation project:

Answer Options:

  1. Completed
  2. Abandoned
  3. Postponed

Format: Single select

Scale or Measurement: Count

Status: In review

Audience: TBD

Notes:

Question QB2b: If completed, the amount of time to complete the project was:

Answer Options:

  1. Shorter than planned
  2. As planned
  3. Longer than planned

Format: Single select

Scale or Measurement: Count

Status: In review

Audience: TBD

Notes:

Question QB3: To what extent do you agree with the following statements?

Answer Options:

1) The project schedule was realistic.
2) Strategies to keep the project on schedule were effective.

Format: Item ranking (strongly disagree to strongly agree)

Scale or Measurement: Likert

Status: In review

Audience: TBD

Notes:

Introduction: From your perspective:

Question QB4a: What helped the project remain on schedule?

Answer Options: Open text

Question QB4b: What prevented the project from remaining on schedule?

Answer Options: Open text

Question QB4c: What strategies were used to help the project stay on schedule?

Answer Options: Open text

Question QB4d: What staff roles were required or used to design and execute the implementation?

Answer Options: Open text (also consider drop downs for selected roles)

Question QB4e: What staff roles were affected by the implementation?

Answer Options: Open text (also consider drop downs for selected roles)

Format: Multiple line response

Scale or Measurement: Qualitative word coding

Status: In review

Audience: TBD

Notes:

Question QC1: What were the total project costs for implementing X guideline, including staff time and any additional resources?

Answer Options: open text

Format: Single line response

Scale or Measurement: Post survey groupings to the nearest 10K

Status: In review

Audience: TBD

Notes:

Question QC2: Did the implementation project remain within the predicted budget?

Answer Options:

Yes
No
I don’t know

Format: Single select

Scale or Measurement: Count, percent, proportion

Status: In review

Audience: TBD

Notes:

Question QC3: How many FTEs were required to execute the project?

Answer Options: open text

Format: Single line response

Scale or Measurement: Post survey groupings to the nearest half full time equivalent

Status: In review

Audience: TBD

Notes:

QC4 Introduction: From your perspective:

Question QC4a: If the project came in under budget, how were savings made?

Answer Options: open text

Question QC4b: If the project ran over budget, why did this happen?

Answer Options: open text

Format: Multiple line response

Scale or Measurement: Qualitative word coding

Status: In review

Audience: TBD

Notes:

Question QC5: To what extent do you agree with the following statements:

Answer Options:

  1. The costs of the implementation project were worth the benefits.
  2. Any increases in workforce costs or workloads to implement guidelines was in proportion to the benefits
  3. The cost of implementing the guidelines was reasonable for our facility or organization.

Format: Item Rating (strongly disagree to strongly agree)

Scale or Measurement: likert

Status: In review

Audience: TBD

Notes:

Question QC6: What was the largest contributor to expenses?

Answer Options:

  1. Taking staff away from patient care
  2. Technology capacity
  3. Infrastructure capacity
  4. Project administrative staffing costs
  5. Staff training costs
  6. Other, please describe:

Format: Single select, select with multiple line text

Scale or Measurement: Count, percent, proportion, qualitative word coding

Status: In review

Audience: TBD

Notes:

Question QD1: To what extent do you agree with the following statements:

Answer Options:

  1. The major goals and objectives of the project were clearly identified and communicated by our team leaders.
  2. The project deliverables defined by the team leaders aligned with the goals and objectives.

Format: Item rating (Strongly disagree to strongly agree)

Scale or Measurement: Likert

Status: In review

Audience: TBD

Notes:

QD2 Introduction: From your perspective

  1. Question QD2a: What were the major goals & objectives of this implementation project?
    Answer Options: Open text
  2. Question QD2b: What were the implementation project deliverables?
    Answer Options: Open text
  3. Question QD2c: Did project outcomes help meet the goals and objectives?
    Answer Options: Open text
  4. Question QD2d: If not, why did the project vary from the objectives?
    Answer Options: Open text

Format: Multiple line response

Scale or Measurement: Qualitative word coding

Status: In review

Audience: TBD

Notes:

Question QD3: To what extent do you agree with the following statements:

Answer Options:

  1. I could easily identify appropriate goals from the Bree guidelines.
  2. I would easily identify the objectives needed to reach goals in the Bree guidelines.

Format: Item rating (Strongly disagree to strongly agree)

Scale or Measurement: Likert

Status: In review

Audience: TBD

Notes:

Question QE1: Use of screening tool(s) (for Social Needs)

Answer Options:

  1. …does not occur
  2.  …is an organizational goal, but not in use
  3.  …is done sporadically but no formal process exists or tracking system in place
  4.  …is part of standard practice; a formal process is in place and used by all care teams

Format: Scale for each answer option

Scale or Measurement: 

  • 1
  • 2-4
  • 5-7
  • 8-10

Status: Used as part of a Behavioral Health Integration Assessment Tool

Audience: Medical Directors, practitioners, nurses, MA’s, other clinical staff, Other TBD

Notes: this question is from the Bree Collaborative BH Integration Assessment tool 

Question QE2: Please provide examples of how your organization has changed or improved the way you plan and deliver programs/services in order to promote / reflect health equity?

Answer Options:

N/A

Format: open text

Scale or Measurement: qualitative word coding

Status: in use

Audience: Community health center staff

Notes: from the Building Capacity for Equity Informed Planning and Evaluation (BCEIPE) Project, (list owner) Full survey

Question QF1: To what extent do you agree with the following statements?

Answer Options:

  1. The use of the guidelines increased my understanding of the topic.
  2. The use of the guidelines guidelines increased my confidence in decision making.
  3. The patient recommendations provided patients with increased knowledge about the topic.

Format: Item rating (Strongly disagree to strongly agree)

Scale or Measurement: Likert

Status: In review

Audience: Item 1-2 general, Item 3 clinical staff, Other TBD

Notes:

Question QF2: On a scale of 1 to 5, 1 being lowest and 5 being highest, did the guidelines increase your knowledge about the following:

Answer Options:

  1. How to provide, support, or advocate for more equitable access and care for the topic specific condition.
  2. How to provide, support, or advocate for better coordinated care for the topic specific condition.
  3. How to incorporate, support, advocate for and/or use data from other sources to inform care.

Format: Item rating

Scale or Measurement: Scale of 1-5 for each answer item

Status: In review

Audience: TBD

Notes:

Question QG1: Thinking about your work group experience, please rate the following:

Answer Options:

  1. I had a positive experience as a Bree work group member
  2. My goals of participating in the Bree work group were met
  3. I would recommend being a part of a future work group to a colleague

Format: Item rating (Strongly disagree to strongly agree)

Scale or Measurement: Likert

Status: In review

Audience: Bree work group members

Notes:

Question QG2: How could Bree Collaborative staff further support convening and guideline development within the work group?

Answer Options: Open text

Format: Multiple line response

Scale or Measurement: Qualitative word coding

Status: In review

Audience: Bree work group members

Notes:

Question QG3: Would you or your organization be interested in partnering with the Bree Collaborative to co-create tools to support implementation of Bree guidelines into your sector of the healthcare ecosystem?

Answer Options:

  1. yes
  2. no
  3. I don’t know

Format: Single select

Scale or Measurement: Count, percent, proportion

Status: In review

Audience: Bree work group members, Other TBD

Notes:

Question QH1: With which sector do you most strongly identify?

Answer Options:

  1. Health Care Professional (MD, DO, PA, ARNP, RN, MA) at delivery site
  2. Delivery Site Staff, other
  3. Health Plan Staff
  4. Patient and/or Family
  5. Private Employer Purchaser Staff
  6. Public Purchaser Staff
  7. Public Health Staff
  8. Community Organization Staff
  9. Quality Improvement Organization Staff
  10. Other (Please list)

Format: Single select

Scale or Measurement: Count, percent, proportion, qualitative word coding

Status: In use

Audience: Bree work group members, other TBD

Notes:

Question QI1: What tools or resources would be useful for the Bree Collaborative to develop to support adoption of guidelines in your organization?

Answer Options:

  1. Checklist of action items
  2. Webinars
  3. Implementation guide
  4. Implementation collaboratives (e.g., peer to peer connection)
  5. Workflow tools
  6. Screening tools
  7. Patient education materials
  8. Info-graphics
  9. Other (please explain)

Format: multiple select, open text

Scale or Measurement: Count, percent, proportion, qualitative word coding

Status: In use

Audience: Bree work group members, Other TBD

Notes:

Question QJ1: How often does your organization analyze client data to understand inequalities (in terms of health access, quality and outcomes) within and between your client groups?

Answer Options:

Never, rarely, sometimes, often, always

Format: single select

Scale or Measurement: Likert

Status: In use

Audience: Community health center staff, can be use for other organizations

Notes: from the Building Capacity for Equity Informed Planning and Evaluation (BCEIPE) Project, (list owner) Full survey

SURVEY QUESTIONS IN DEVELOPMENT

SURVEY QUESTIONS IN DEVELOPMENT

Question QM1: Were there complimentary or similar initiatives that either helped to facilitate or that were barriers to guideline implementation?  

Answer Options: open text

Format: Multiple line response

Scale or Measurement: qualitative word coding

Status: In review

Audience: TBD

Notes:

Question QM2: To what extent do you agree with the following statements?

Answer Options:

  1. My site had adequate buy-in from non-clinical staff
  2. My site had adequate buy-in from health professional staff (MD, DO, PA, ARNP, RN, MA, other)
  3. My site had adequate buy-in and support from administrative leadership

Format: Item ranking (strongly disagree to strongly agree)

Scale or Measurement: Likert

Status: In review

Audience: TBD

Notes:

Question QM3: What barriers exist to implementing guidelines in your setting? (Please pick your top 3 barriers)

Answer Options:

A. Time
B. Cost
C. Lack of business case and/or evidence economic reward
D. Lack of personnel
E. Lack of availabile and credibile of data
F. Lack of Implementation metrics
G. Lack of infrastructure capacity (e.g., EHR system, broadband issues, lack of integration with behavioral health systems etc.)
H. Lack of staff or leadership buy-in
I. Lack of staff knowledge
J. Staff attitudes
K. Lack of alignment with other priorities
L. Lack of guidelines specific factors (e.g., evidence, plausibility, complexity, applicability.
M. Other priorities (Please explain)

Format: Multiple select, long text

Scale or Measurement: count, percent, proportion, qualitative word count

Status: In review

Audience: Bree work group members, Other TBD

Notes:

Question QM4: What facilitators exist to implementing guidelines in your setting? (Please pick your top 3 facilitators)

A. Time
B. Cost
C. Business case-evidence and/or economic reward
D. Sufficient personnel
E. Availability and credibility of data
F. Implementation metrics
G. Infrastructure capacity EHR system, broadband issues, lack of integration with behavioral health systems etc.)
H. Staff or leadership buy-in
I. Staff knowledge
J. Staff attitudes
K. Alignment with other priorities
L. Guidelines specific factors (e.g., evidence, plausibility, complexity, applicability)
M. Other priorities (Please explain)

 

Format: Multiple select, long text

Scale or Measurement: count, percent, proportion, qualitative word count

Status: In review

Audience: Bree work group members, general, other TBD

Notes:

Question QN1: Do you plan to use, or have you used the information in the Bree Collaborative Guidelines in your setting?

Answer Options:

  1. Yes
  2. No
  3. I don’t know

Question QN1a: If stated “yes”, please list which report topic(s) and what motivated you or your organization to utilize the guidelines?

Answer Options: Open text

Question QN1b: If stated “no”, why do you not plan to utilize or did not use the Bree Collaborative Guidelines?

Answer Options: Open text

Format: single select, multiple line response

Scale or Measurement: Count, percent, proportion, Qualitative word coding

Status: Validation in process, using a one-tailed z-test for proportions with a hypothesized proportion of 50% responding yes.

Audience: TBD

Notes:

Question QO1: Are there intangible benefits to your organization because of the implementation of these guidelines?

Answer Options: Open text

Format: Multiple line response

Scale or Measurement: Qualitative word coding

Status: In review

Audience: Bree work group members, Other TBD

Notes:

Question QO2: To what extent do you agree with the following statements?

Answer Options:

  1. The guidelines offered no clear benefits for my specific role in my organization
  2. The guidelines offered no clear benefits to our organization
  3. The guidelines offered no clear benefits to our patients

Format: Item rating (Strongly disagree to strongly agree)

If you answered strong disagree to disagree for X question above, how did projected benefits not match the actual benefits?

Scale or Measurement: Likert

Status: In review

Audience: Bree work group members, other TBD

Notes:

Question QP1: To what extent do you agree with the following statements?

Answer Options:

  1. The guidelines were consistent with our patients’ values.
  2. The guidelines were consistent with our patients health concerns.
  3. The guidelines were consistent with our communities values.
  4. The guidelines were consistent with our communities health concerns.

Format: Item ranking (strongly disagree to strongly agree)

Scale or Measurement: Likert

Status: In review

Audience: TBD

Notes:

Question QP2: To what extent do you agree with the following statements?

Answer Options:

1) The guidelines were complementary to indigenous and local cultural health practices.
2) The guidelines were antagonistic to indigenous and local cultural health practices.

Format: Item Ranking (strongly disagree to strongly agree)

Scale or Measurement: Likert

Audience: TBD

Status: In review

Notes:

Question QP3: Our organization provides patient satisfaction surveys on a regular basis.

Answer Options:

  1. Yes
  2. No
  3. I don’t know

Question QP5b: If yes, please provide the name of the survey you use.

Answer Options: open text

Format: Single select, multiple line response

Scale or Measurement: Count, percent, proportion qualitative word coding

Status: In review

Audience: TBD

Notes:

Question QP4: Do you have any comments on the ways in which the guidelines failed to offered benefits or were inconsistent values for your community or patients?

Answer Options: open text

Format: Multiple line response

Scale or Measurement: Qualitative word coding

Status: In review

Audience: TBD

Notes:

SURVEY QUESTIONS IN DEVELOPMENT

SURVEY QUESTIONS IN DEVELOPMENT

Question QS1: To what extent do the appropriate people have access to needed health data to meet patient need?

Answer Options:

  1. Often
  2. Nearly always
  3. only for specific conditions or populations
  4. never

Format: Single select

Scale or measurement: Count, percent, proportion

Status: In review

Audience: CIO, Other TBD

Notes: adapted from KLAS

Question QS2: To what extent are specific patient records locatable or are automatically presented to clinicians?

Answer Options:

  1. Often
  2. Nearly always
  3. Only for specific conditions or populations
  4. Never

Format: Single select

Scale or measurement: Count, percent, proportion

Status: In review

Audience: CIO, Other TBD

Notes: adapted from KLAS

Question QS3: How often do clinician have electronic access to the OUTSIDE data sources they need?

Answer Options:

  1. Often
  2. Nearly always
  3. Only for specific conditions or populations
  4. Never

Format: Single select

Scale or measurement: Count, percent, proportion

Status: In review

Audience: CIO, Other TBD

Notes: adapted from KLAS, https://healthmanagement.org/c/healthmanagement/issuearticle/deep-interoperability-in-healthcare

Question QS4: When accessing OUTSIDE data, how easy is it to locate specific patient records?

Answer Options:

  1. Often
  2. Nearly always
  3. Only for specific conditions or populations
  4. Never

Format: Single select

Scale or measurement: Count, percent, proportion

Status: In review

Audience: CIO, Other TBD

Notes: adapted from KLAS, https://healthmanagement.org/c/healthmanagement/issuearticle/deep-interoperability-in-healthcare

Question QS5: To what degree is OUTSIDE data integrated with clinicians’ EMR/EHR workflow?

Answer Options:

  1. Often
  2. Nearly always
  3. Only for specific conditions or populations
  4. Never

Format: Single select

Scale or measurement: Count, percent, proportion

Status: In review

Audience: CIO, Other TBD

Notes: adapted from KLAS, https://healthmanagement.org/c/healthmanagement/issuearticle/deep-interoperability-in-healthcare

Question QS6: Once retrieved and viewed, how impactful is OUTSIDE data for patient care?

Answer Options:

  1. Often
  2. Nearly always
  3. Only for specific conditions or populations
  4. Never

Format: Single select

Scale or measurement: Count, percent, proportion

Status: In review

Audience: CIO, Other TBD

Notes: adapted from KLAS, https://healthmanagement.org/c/healthmanagement/issuearticle/deep-interoperability-in-healthcare

Question QS7: Who is responsible in your organization to pull, analyze, and report on client data? (Check ALL that apply)

Answer Options:

  • DMC (or analytics staff)
  • Research and evaluation staff
  • Managers/directors

Format: Checkbox

Scale or Measurement: Count, percent, proportion,

Status: In use

Audience: Community health center staff, can be use for other organizations

Notes: from the Building Capacity for Equity Informed Planning and Evaluation (BCEIPE) Project, (list owner) Full survey

Question QS8: Our organization has clear policies on data collection, handling, and analysis (including ensuring privacy, accuracy, and quality)

Answer Options:

Strongly disagree, disagree, neutral, agree, strongly agree

Format: Single select

Scale or Measurement: Likert

Status: In use

Audience: Community health center staff, can be use for other organizations

Notes: from the Building Capacity for Equity Informed Planning and Evaluation (BCEIPE) Project, (list owner) Full survey

Question QS9: Continuity of care is much more complex than implementing information and technology in a single care setting. Multiple stakeholders must act in concert to provide an environment that facilitates the best care and value. Thinking about your organizations capabilities for data exchange and transperacy that support Continuity of Care across care types, settings and populations – which level of the HIMSS Continuity of Care model (CCMM) are you best aligned with? You can find the full description of each of these stages here: https://www.himss.org/what-we-do-solutions/digital-health-transformation/maturity-models/continuity-care-maturity-model-ccmm

Answer Options:

Stage 0 – Limited or no e-communication
Stage 1 – Basic peer-to-peer data exchange
Stage 2 – Patient centered clinical data using basic system-to-system exchange
Stage 3 – Normalised patient record using structural interoperability
Stage 4 – Care coordination based on actionable data using a semantic interoperable patient record
Stage 5 – Community-wide patient records using applied information with patient engagement focus
Stage 6 – Closed loop care coordination across care team members
Stage 7 – Knowledge driven engagement for dynamic, multi-vendor, multi-organisational interconnected healthcare delivery model

Format: Single select

Scale or Measurement: count, percent

Status: In use

Audience: CIOs, others TBD

Notes: This question has been adapted from the HIMSS HL7 models

Question QS10: Analytics serve to improve many facets of a healthcare business beyond clinical decision support, such as an organization’s operational and financial aspects. Thinking about your organizations data capbilities and use for Analytics Capabilities to support health care services and decisions – which level of the HIMSS Analytics Model or Analytics Maturity (AMAM) are you best aligned with? You can find the full description of each of these stages here: https://www.himss.org/what-we-do-solutions/digital-health-transformation/maturity-models/adoption-model-analytics-maturity-amam

Answer Options:

Stage 0 – Fragmented point solutions
Stage 1 – Foundation building: data aggregation and initial data governance
Stage 2 – Core data warehouse workout: centralised database with an analytics competency center
Stage 3 – Efficient, consistent internal and external report production and agility
Stage 4 – Measuring and managing evidence based care, care visibility, and waste reduction
Stage 5 – Enhancing quality of care, population health, and understanding the economics of care
Stage 6 – Clinical risk intervention & predictive analytics
Stage 7 – Personalized medicine & prescriptive analytics

Format: Single select

Scale or Measurement: Count, percentage

Status: In use

Audience: CIOs, other TBD

Notes: This question has been adapted from the HIMSS HL7 models

Question QS11: To what extent do you agree with the following statements?

Answer Options:

1) The use of the guidelines increased my/our understanding of what data should be captured and shared with others on my/our team.
2) From my perspective, the use of the guidelines guidelines increased our organizations ability to implement data sharing solutions with other partners.
3) The use of the guidelines increased our organizations ability to implement analytics capabilities.

Format: Item ranking (strongly disagree to strongly agree)

Scale or Measurement: Likert

Status: In use

Audience: CIOs, other TBD

Notes: This question is being used for Bree Collaborative Evaluation activities.

Question QS12: Introduction: The Rural Health Information Hub defines successful care coordination programs as ones that “focus on meeting the needs of each individual, beyond healthcare services, including transportation, home safety, nutrition, and literacy. Care coordination involves addressing more than just the medical needs of a patient and supporting the entire person.”
Referring to using data for continuity of care, to what extent do you agree with the following statements?

Answer Options:

1) The goals for referrals were were clear in all guidelines we used.
2) The goals for data transparency (such as sharing information with patients) were clear in all the guidelines we used.
3) The goals for data standardization were clear in all of the guidelines we used.

Format: Item ranking (strongly disagree to strongly agree)

Scale or Measurement: Likert

Status: In use

Audience: CIOs, other TBD

Notes: This question is being used for Bree Collaborative Evaluation activities.

Question QS13: Referring to using data for analytics capabilities, to what extent do you agree with the following statements?

Answer Options:

1) The goals for data aggregation capabilities were clear in all guidelines we used.
2) The goals for data collection were clear in all of the guidelines we used.
3) The goals for population health management (such as sharing information with patients) were clear in all the guidelines we used.

Format: Item ranking (strongly disagree to strongly agree)

Scale or Measurement: Likert

Status: In use

Audience: CIOs, other TBD

Notes: This question is being used for Bree Collaborative Evaluation activities.

Building Capacity for Equity Informed Planning and Evaluation (BCEIPE) Project

Publisher: Alliance for Healthier Communities  Alliance pour des communautés en santé

Description: The survey will establish a baseline that reflects your current state and allow a valuable comparison to a new state after the completion of capacity building activities have taken place and identified with post-test survey findings.

Scale or Measurement: scales and question formats included for each question.

Status: in use, no validation information

Audience: Community  Health Centers in Canada

Notes: This survey focuses on capacity and skills for address health equity issues. Some of the generic questions can also be found as stand alone questions in other sections of this question bank.

The Bree Collaborative use this survey to create a pre-assessment for participants in our Health Equity Action Collaborative.

Health Equity Skills for Public Health Professionals Survey

Publisher: National Association of Chronic Disease Directors (NACDD) Health Equity Council

Description: The following brief questionnaire will provide information that will be used to help you achieve success in moving toward health equity in your public health practice.

Scale or Measurement: Likert scales included for each question.

Status: Validated, in use

Audience: Public health, organization staff

Notes: This survey was originally developed for public health and is validated for the following positions: Manager, Program Coordinator, Epidemiologist or Research Investigator, Operational Support. These questions can be adapted for other types of organizations however, the Bree Collaborative recommends further validation.

Primary Care Experience Survey

Publisher: Health Quality Ontario

Description: This survey documents:
– A patient’s experience contacting the organization

– A patient’s experience arriving and waiting at the organization

– The performance of the health care provider they dealt with during their most recent visit

– A patient’s overall experience during their most recent visit

– A patient’s experiences visiting with the organization over the last year or so

– A patient’s context/ demographics

– A patient’s feedback with respect to successes and opportunities for improvement
.

Scale or Measurement: Likert scales included for each question.

Status: in use, no information on validity

Audience: Intake staff at AHACs and CHCs

Notes: 

Focus Group Questions

Publisher: AAMHCS

Description: These questions are used to obtain client feedback with respect to accessibility, efficiency, equity, patient centeredness and satisfaction within a focus group setting. It includes sample questions and probes to evoke conversation and feedback in situations where participants are offering limited feedback.

Scale or Measurement: N/A

Status: in use, no information on validity

Audience: Community health organization staff

Notes: 

HOW ARE YOU USING THESE QUESTIONS?

If you would like to tell us about how you are using the Bree Collaborative Evaluation Survey Question Bank, please fill out the form below.

 

SUMBIT YOUR QUESTIONS TO THE BANK

If you are interested in submitting your own questions to our Bree Guidelines Evaluation Question Bank, please use the form below and we will add your question to appropriate list.

 

CONTACT US

Contact us for questions about the Evaluation Survey Question Bank.