Foundation Program Sites

Question Bank

These questions can be used to create surveys for evaluation purposes. The benefit of using these question is that the results can be submitted to the Bree Collaborative to compare and validate your responses.

Question Bank Categories

Question QA1: Please describe your staffs awareness of Bree Collaborative Guidelines.

Answer Options:

1) …no awareness of Bree Collaborative Guidelines
2) …basic level of awareness; content not known
3) …general awareness; some specific content known
4) …advanced knowledge of awareness; content known and staff interest in implementation

Format: Scale for each answer option and total score 1-10

Scale or Measurement: Count of answers in each strata

a) 1
b) 2-4
c) 5-7
d) 8-10

Status: In review

Audience: General, Delivery site staff, other TBD

Notes: This survey tool called the “Bree Collaborative Behavioral Health Integration Assessment” was created by Bree staff in 2020 based on the MeHAF to capture general awareness of Bree Guidelines in conjunction with surveys of adoption of behavioral health integration measures. More information here.

Question QA2: Please describe your organizations buy-in/interest in the implementation of Bree Collaborative Guidelines.

Answer Options:

1) …no interest in Guideline Implementation
2) …actively considering  Guideline Implementation
3) ..some steps taken toward Guideline Implementation; test cycles beginning
4) ..actively working toward Guideline Implementation; team formed and test cycles ongoing

Format: Scale for each answer option and total score 1-10

Scale or Measurement: Count of answers in each strata

a) 1
b) 2-4
c) 5-7
d) 8-10

Status: In review

Audience: General, Delivery site staff, Other TBD

Notes: This survey tool called the “Bree Collaborative Behavioral Health Integration Assessment” was created by Bree staff in 2020 based on the MeHAF to capture general interest in adopting Bree Guidelines in conjunction with surveys of adoption of behavioral health integration measures. More information here.

Question QA3: Has your organization taken any actions to implement Bree Guidelines?

Answer Options:

a) no action on Bree Guidelines
b) in the process of creating an implementation plan
c) executed an implementation
d) evaluated an implementation

Format: Single select

Scale or Measurement: Count

Status: In use, un-validated

Audience: General, CEO, COO, Bree work group members, Other TBD

Note: This question is part of the Transformation and Outreach managers survey of Bree work groups.

Question QB1: What was the project time frame for the implementation of X guidelines?

Answer Options:

  1. Less than 3 months
  2. 3-6 months
  3. 6-9 months
  4. 9 months to a year
  5. a year or longer

Format: Single select

Scale or Measurement: Count

Status: In review

Audience: TBD

Notes:

Question QB2a: Was the implementation project:

Answer Options:

  1. Completed
  2. Abandoned
  3. Postponed

Format: Single select

Scale or Measurement: Count

Status: In review

Audience: TBD

Notes:

Question QB2b: If completed, the amount of time to complete the project was:

Answer Options:

  1. Shorter than planned
  2. As planned
  3. Longer than planned

Format: Single select

Scale or Measurement: Count

Status: In review

Audience: TBD

Notes:

Question QB3: To what extent do you agree with the following statements?

Answer Options:

1) The project schedule was realistic.
2) Strategies to keep the project on schedule were effective.

Format: Item ranking (strongly disagree to strongly agree)

Scale or Measurement: Likert

Status: In review

Audience: TBD

Notes:

Introduction: From your perspective:

Question QB4a: What helped the project remain on schedule?

Answer Options: Open text

Question QB4b: What prevented the project from remaining on schedule?

Answer Options: Open text

Question QB4c: What strategies were used to help the project stay on schedule?

Answer Options: Open text

Question QB4d: What staff roles were required or used to design and execute the implementation?

Answer Options: Open text (also consider drop downs for selected roles)

Question QB4e: What staff roles were affected by the implementation?

Answer Options: Open text (also consider drop downs for selected roles)

Format: Multiple line response

Scale or Measurement: Qualitative word coding

Status: In review

Audience: TBD

Notes:

Question QC1: What were the total project costs for implementing X guideline, including staff time and any additional resources?

Answer Options: open text

Format: Single line response

Scale or Measurement: Post survey groupings to the nearest 10K

Status: In review

Audience: TBD

Notes:

Question QC2: Did the implementation project remain within the predicted budget?

Answer Options:

Yes
No
I don’t know

Format: Single select

Scale or Measurement: Count, percent, proportion

Status: In review

Audience: TBD

Notes:

Question QC3: How many FTEs were required to execute the project?

Answer Options: open text

Format: Single line response

Scale or Measurement: Post survey groupings to the nearest half full time equivalent

Status: In review

Audience: TBD

Notes:

QC4 Introduction: From your perspective:

Question QC4a: If the project came in under budget, how were savings made?

Answer Options: open text

Question QC4b: If the project ran over budget, why did this happen?

Answer Options: open text

Format: Multiple line response

Scale or Measurement: Qualitative word coding

Status: In review

Audience: TBD

Notes:

Question QC5: To what extent do you agree with the following statements:

Answer Options:

  1. The costs of the implementation project were worth the benefits.
  2. Any increases in workforce costs or workloads to implement guidelines was in proportion to the benefits
  3. The cost of implementing the guidelines was reasonable for our facility or organization.

Format: Item Rating (strongly disagree to strongly agree)

Scale or Measurement: likert

Status: In review

Audience: TBD

Notes:

Question QC6: What was the largest contributor to expenses?

Answer Options:

  1. Taking staff away from patient care
  2. Technology capacity
  3. Infrastructure capacity
  4. Project administrative staffing costs
  5. Staff training costs
  6. Other, please describe:

Format: Single select, select with multiple line text

Scale or Measurement: Count, percent, proportion, qualitative word coding

Status: In review

Audience: TBD

Notes:

Question QD1: To what extent do you agree with the following statements:

Answer Options:

  1. The major goals and objectives of the project were clearly identified and communicated by our team leaders.
  2. The project deliverables defined by the team leaders aligned with the goals and objectives.

Format: Item rating (Strongly disagree to strongly agree)

Scale or Measurement: Likert

Status: In review

Audience: TBD

Notes:

QD2 Introduction: From your perspective

  1. Question QD2a: What were the major goals & objectives of this implementation project?
    Answer Options: Open text
  2. Question QD2b: What were the implementation project deliverables?
    Answer Options: Open text
  3. Question QD2c: Did project outcomes help meet the goals and objectives?
    Answer Options: Open text
  4. Question QD2d: If not, why did the project vary from the objectives?
    Answer Options: Open text

Format: Multiple line response

Scale or Measurement: Qualitative word coding

Status: In review

Audience: TBD

Notes:

Question QD3: To what extent do you agree with the following statements:

Answer Options:

  1. I could easily identify appropriate goals from the Bree guidelines.
  2. I would easily identify the objectives needed to reach goals in the Bree guidelines.

Format: Item rating (Strongly disagree to strongly agree)

Scale or Measurement: Likert

Status: In review

Audience: TBD

Notes:

Question QE1: Use of screening tool(s) (for Social Needs)

Answer Options:

  1. …does not occur
  2.  …is an organizational goal, but not in use
  3.  …is done sporadically but no formal process exists or tracking system in place
  4.  …is part of standard practice; a formal process is in place and used by all care teams

Format: Scale for each answer option

Scale or Measurement: 

  • 1
  • 2-4
  • 5-7
  • 8-10

Status: Used as part of a Behavioral Health Integration Assessment Tool

Audience: Medical Directors, practitioners, nurses, MA’s, other clinical staff, Other TBD

Notes: this question is from the Bree Collaborative BH Integration Assessment tool 

Question QE2: Please provide examples of how your organization has changed or improved the way you plan and deliver programs/services in order to promote / reflect health equity?

Answer Options:

N/A

Format: open text

Scale or Measurement: qualitative word coding

Status: in use

Audience: Community health center staff

Notes: from the Building Capacity for Equity Informed Planning and Evaluation (BCEIPE) Project, (list owner) Full survey

Question QF1: To what extent do you agree with the following statements?

Answer Options:

  1. The use of the guidelines increased my understanding of the topic.
  2. The use of the guidelines guidelines increased my confidence in decision making.
  3. The patient recommendations provided patients with increased knowledge about the topic.

Format: Item rating (Strongly disagree to strongly agree)

Scale or Measurement: Likert

Status: In review

Audience: Item 1-2 general, Item 3 clinical staff, Other TBD

Notes:

Question QF2: On a scale of 1 to 5, 1 being lowest and 5 being highest, did the guidelines increase your knowledge about the following:

Answer Options:

  1. How to provide, support, or advocate for more equitable access and care for the topic specific condition.
  2. How to provide, support, or advocate for better coordinated care for the topic specific condition.
  3. How to incorporate, support, advocate for and/or use data from other sources to inform care.

Format: Item rating

Scale or Measurement: Scale of 1-5 for each answer item

Status: In review

Audience: TBD

Notes:

Question QF3: Program Planning Tools – Please rate your current level of knowledge on the following items using a 1-5 scale.

Answer Options:

  1. Bree Collaborative reports
  2. Finding sources of evidence (e.g. evidence-based recommendations, promising practices, practice-based evidence) to inform your project design
  3. Completing a root-cause analysis (i.e. Fishbone diagram)
  4. Developing Strategic, Measurable, Ambitious, Realistic, Time-bound, Inclusive, and Equitable (SMARTIE) aims statements
  5. Developing a logic model
  6. Measures & Metrics use and development
  7. Developing Plan-Do-Study-Act Cycles

Format: Item rating

Scale or Measurement: Scale of 1-5 for each answer item, 1= novice, 2= advanced beginner, 3= Competent, 4= Proficient, 5= Expert

Status: In use

Audience: general

Notes:

Question QF3: Health Equity – Please rate your current level of knowledge on the following items using a 1-5 scale.

Answer Options:

  1. Disability
  2. Gender
  3. Poverty and economic disadvantages
  4. Sexual Orientation
  5. Race and ethnicity

Format: Item rating

Scale or Measurement: Scale of 1-5 for each answer item, 1= novice, 2= advanced beginner, 3= Competent, 4= Proficient, 5= Expert

Status: In use

Audience: general

Notes:

Question QG1: Thinking about your work group experience, please rate the following:

Answer Options:

  1. I had a positive experience as a Bree work group member
  2. My goals of participating in the Bree work group were met
  3. I would recommend being a part of a future work group to a colleague

Format: Item rating (Strongly disagree to strongly agree)

Scale or Measurement: Likert

Status: In review

Audience: Bree work group members

Notes:

Question QG2: How could Bree Collaborative staff further support convening and guideline development within the work group?

Answer Options: Open text

Format: Multiple line response

Scale or Measurement: Qualitative word coding

Status: In review

Audience: Bree work group members

Notes:

Question QG3: Would you or your organization be interested in partnering with the Bree Collaborative to co-create tools to support implementation of Bree guidelines into your sector of the healthcare ecosystem?

Answer Options:

  1. yes
  2. no
  3. I don’t know

Format: Single select

Scale or Measurement: Count, percent, proportion

Status: In review

Audience: Bree work group members, Other TBD

Notes:

Question QG4: How do you learn most effectively?

Answer Options:

  1. Presentation
  2. Large group discussion (whole group)
  3. Small group discussion (sub-group)
  4. Guest Speakers
  5. Zoom Polls
  6. Videos
  7. Podcasts
  8. Other (please describe)

Format: Top three select

Scale or Measurement: Count, percent, proportion

Status: In review

Audience: General

Notes:

Question QH1: What type of organization do you current work for?

Answer Options:

  1. Community-Based Organization (CBO)
  2. Employer/purchaser
  3. For-profit organization
  4. Government Agency
  5. Health Plan
  6. Health Clinic
  7. Hospital or Hospital System
  8. Pharmaceutical
  9. Professional Association
  10. QI organization
  11. Other (Please list)

Format: Single select

Scale or Measurement: Count, percent, proportion, qualitative word coding

Status: In use

Audience: Bree work group members, Health Equity Action Collaborative, others

Notes:

Question QH2: What is your role within your organization?

Answer Options:

  1. Administrative Staff
  2. Direct patient care (e.g. clinician, medical staff)
  3. Health equity staff
  4. Leadership staff (e.g. manager, officer)
  5. Quality Improvement Staff
  6. Other (Please list)

Format: Single select

Scale or Measurement: Count, percent, proportion, qualitative word coding

Status: In use

Audience: Bree work group members, Health Equity Action Collaborative, others

Notes:

Question QI1: What tools or resources would be useful for the Bree Collaborative to develop to support adoption of guidelines in your organization?

Answer Options:

  1. Checklist of action items
  2. Webinars
  3. Implementation guide
  4. Implementation collaboratives (e.g., peer to peer connection)
  5. Workflow tools
  6. Screening tools
  7. Patient education materials
  8. Info-graphics
  9. Other (please explain)

Format: multiple select, open text

Scale or Measurement: Count, percent, proportion, qualitative word coding

Status: In use

Audience: Bree work group members, Other TBD

Notes:

Question QJ1: How often does your organization analyze client data to understand inequalities (in terms of health access, quality and outcomes) within and between your client groups?

Answer Options:

Never, rarely, sometimes, often, always

Format: single select

Scale or Measurement: Likert

Status: In use

Audience: Community health center staff, can be use for other organizations

Notes: from the Building Capacity for Equity Informed Planning and Evaluation (BCEIPE) Project, (list owner) Full survey

Question QJ2: The stated objectives of X event were (list objectives).

Answer Options:

  1. After attending X event, I am able to identify how Bree/FHCQ guidelines can be implemented into practice.
  2. After attending x event, I am able to recognize how Social Drivers of Health can impact a person’s overall health status.
  3. After attending X event, I am able to plan or modify strategies to center health equity into quality improvement initiatives.
  4. During X event, I was able to peers (doing x) who were in attendance.
  5. The information covered during X event was relative to my work.

Format: rating for each answer option

Scale or Measurement: Likert, Scale 1= strongly disagree, 2= disagree, 3= neutral, 4= agree, 5= strongly agree

Status: In use

Audience: General

Notes:

SURVEY QUESTIONS IN DEVELOPMENT

SURVEY QUESTIONS IN DEVELOPMENT

Question QM1: Were there complimentary or similar initiatives that either helped to facilitate or that were barriers to guideline implementation?  

Answer Options: open text

Format: Multiple line response

Scale or Measurement: qualitative word coding

Status: In review

Audience: TBD

Notes:

Question QM2: To what extent do you agree with the following statements?

Answer Options:

  1. My site had adequate buy-in from non-clinical staff
  2. My site had adequate buy-in from health professional staff (MD, DO, PA, ARNP, RN, MA, other)
  3. My site had adequate buy-in and support from administrative leadership

Format: Item ranking (strongly disagree to strongly agree)

Scale or Measurement: Likert

Status: In review

Audience: TBD

Notes:

Question QM3: What barriers exist to implementing guidelines in your setting? (Please pick your top 3 barriers)

Answer Options:

A. Time
B. Cost
C. Lack of business case and/or evidence economic reward
D. Lack of personnel
E. Lack of availabile and credibile of data
F. Lack of Implementation metrics
G. Lack of infrastructure capacity (e.g., EHR system, broadband issues, lack of integration with behavioral health systems etc.)
H. Lack of staff or leadership buy-in
I. Lack of staff knowledge
J. Staff attitudes
K. Lack of alignment with other priorities
L. Lack of guidelines specific factors (e.g., evidence, plausibility, complexity, applicability.
M. Other priorities (Please explain)

Format: Multiple select, long text

Scale or Measurement: count, percent, proportion, qualitative word count

Status: In review

Audience: Bree work group members, Other TBD

Notes:

Question QM4: What facilitators exist to implementing guidelines in your setting? (Please pick your top 3 facilitators)

A. Time
B. Cost
C. Business case-evidence and/or economic reward
D. Sufficient personnel
E. Availability and credibility of data
F. Implementation metrics
G. Infrastructure capacity EHR system, broadband issues, lack of integration with behavioral health systems etc.)
H. Staff or leadership buy-in
I. Staff knowledge
J. Staff attitudes
K. Alignment with other priorities
L. Guidelines specific factors (e.g., evidence, plausibility, complexity, applicability)
M. Other priorities (Please explain)

 

Format: Multiple select, long text

Scale or Measurement: count, percent, proportion, qualitative word count

Status: In review

Audience: Bree work group members, general, other TBD

Notes:

Question QM5: Assessment of health landscape – Below are environmental factors identified as having the biggest impact on organizations ability to improve care. Please rate the current relevance for your role or organization.

Answer Options:

  1. Ongoing shortages and burn-out related to COVID/post-COVID (e.g. Shortages in staff, turnover of staff, constant travel nurses/providers).
  2. Patient’s workups and treatment delayed due to shortage of beds and/or staffing
  3. Patients presenting with more advanced pathology
  4. Health care on virtual platforms with less “true” engagement
  5. Move of low risk elective procedures to ambulatory surgery centers
  6. Not enough acceptance of QI roles in individual practice
  7. Focus on disease management
  8. Demands to “do more with less” in all aspects of clinical practice
  9. Lack of system support to coordinate ongoing care for patients
  10. Changes in health care delivery teams, utilizing more non-physicians
  11. Increased telehealth
  12. Transient fads in health care cycle with federal priorities, politicians and media. Providers are “whipsawed” with these priorities.
  13. Move from fee-for-service to population health management
  14. Increased bundle payments
  15. Competition among medical centers and the resulting vertical, exclusive systems of care that further erode care coordination
  16. Hospital budgets squeezed; considerable loss of operating budgets due to COVID-19 leading to de-prioritization of QI and reduced support for data collection
  17. Performance incentives/penalties; changes in physician/APC workforce dynamics due to RVU focus vs. performance metrics for salaries.
  18. Continued hospital consolidation
  19. Trends towards very large systems, with negative impacts to delivery of care and focus on profits
  20. Competing registries (national and organizational) looking at the same data sets.

Format: Grid, item ranking

Scale or Measurement: High relevance, Moderate Relevance, Low/no relevance

Status: In use

Audience: Clinicians and QI staff

Notes:

Question QN1: Do you plan to use, or have you used the information in the Bree Collaborative Guidelines in your setting?

Answer Options:

  1. Yes
  2. No
  3. I don’t know

Question QN1a: If stated “yes”, please list which report topic(s) and what motivated you or your organization to utilize the guidelines?

Answer Options: Open text

Question QN1b: If stated “no”, why do you not plan to utilize or did not use the Bree Collaborative Guidelines?

Answer Options: Open text

Format: single select, multiple line response

Scale or Measurement: Count, percent, proportion, Qualitative word coding

Status: Validation in process, using a one-tailed z-test for proportions with a hypothesized proportion of 50% responding yes.

Audience: TBD

Notes:

Question QO1: Are there intangible benefits to your organization because of the implementation of these guidelines?

Answer Options: Open text

Format: Multiple line response

Scale or Measurement: Qualitative word coding

Status: In review

Audience: Bree work group members, Other TBD

Notes:

Question QO2: To what extent do you agree with the following statements?

Answer Options:

  1. The guidelines offered no clear benefits for my specific role in my organization
  2. The guidelines offered no clear benefits to our organization
  3. The guidelines offered no clear benefits to our patients

Format: Item rating (Strongly disagree to strongly agree)

If you answered strong disagree to disagree for X question above, how did projected benefits not match the actual benefits?

Scale or Measurement: Likert

Status: In review

Audience: Bree work group members, other TBD

Notes:

Question QP1: To what extent do you agree with the following statements?

Answer Options:

  1. The guidelines were consistent with our patients’ values.
  2. The guidelines were consistent with our patients health concerns.
  3. The guidelines were consistent with our communities values.
  4. The guidelines were consistent with our communities health concerns.

Format: Item ranking (strongly disagree to strongly agree)

Scale or Measurement: Likert

Status: In review

Audience: TBD

Notes:

Question QP2: To what extent do you agree with the following statements?

Answer Options:

1) The guidelines were complementary to indigenous and local cultural health practices.
2) The guidelines were antagonistic to indigenous and local cultural health practices.

Format: Item Ranking (strongly disagree to strongly agree)

Scale or Measurement: Likert

Audience: TBD

Status: In review

Notes:

Question QP3: Our organization provides patient satisfaction surveys on a regular basis.

Answer Options:

  1. Yes
  2. No
  3. I don’t know

Question QP5b: If yes, please provide the name of the survey you use.

Answer Options: open text

Format: Single select, multiple line response

Scale or Measurement: Count, percent, proportion qualitative word coding

Status: In review

Audience: TBD

Notes:

Question QP4: Do you have any comments on the ways in which the guidelines failed to offered benefits or were inconsistent values for your community or patients?

Answer Options: open text

Format: Multiple line response

Scale or Measurement: Qualitative word coding

Status: In review

Audience: TBD

Notes:

SURVEY QUESTIONS IN DEVELOPMENT

SURVEY QUESTIONS IN DEVELOPMENT

Question QS1: To what extent do the appropriate people have access to needed health data to meet patient need?

Answer Options:

  1. Often
  2. Nearly always
  3. only for specific conditions or populations
  4. never

Format: Single select

Scale or measurement: Count, percent, proportion

Status: In review

Audience: CIO, Other TBD

Notes: adapted from KLAS

Question QS2: To what extent are specific patient records locatable or are automatically presented to clinicians?

Answer Options:

  1. Often
  2. Nearly always
  3. Only for specific conditions or populations
  4. Never

Format: Single select

Scale or measurement: Count, percent, proportion

Status: In review

Audience: CIO, Other TBD

Notes: adapted from KLAS

Question QS3: How often do clinician have electronic access to the OUTSIDE data sources they need?

Answer Options:

  1. Often
  2. Nearly always
  3. Only for specific conditions or populations
  4. Never

Format: Single select

Scale or measurement: Count, percent, proportion

Status: In review

Audience: CIO, Other TBD

Notes: adapted from KLAS, https://healthmanagement.org/c/healthmanagement/issuearticle/deep-interoperability-in-healthcare

Question QS4: When accessing OUTSIDE data, how easy is it to locate specific patient records?

Answer Options:

  1. Often
  2. Nearly always
  3. Only for specific conditions or populations
  4. Never

Format: Single select

Scale or measurement: Count, percent, proportion

Status: In review

Audience: CIO, Other TBD

Notes: adapted from KLAS, https://healthmanagement.org/c/healthmanagement/issuearticle/deep-interoperability-in-healthcare

Question QS5: To what degree is OUTSIDE data integrated with clinicians’ EMR/EHR workflow?

Answer Options:

  1. Often
  2. Nearly always
  3. Only for specific conditions or populations
  4. Never

Format: Single select

Scale or measurement: Count, percent, proportion

Status: In review

Audience: CIO, Other TBD

Notes: adapted from KLAS, https://healthmanagement.org/c/healthmanagement/issuearticle/deep-interoperability-in-healthcare

Question QS6: Once retrieved and viewed, how impactful is OUTSIDE data for patient care?

Answer Options:

  1. Often
  2. Nearly always
  3. Only for specific conditions or populations
  4. Never

Format: Single select

Scale or measurement: Count, percent, proportion

Status: In review

Audience: CIO, Other TBD

Notes: adapted from KLAS, https://healthmanagement.org/c/healthmanagement/issuearticle/deep-interoperability-in-healthcare

Question QS7: Who is responsible in your organization to pull, analyze, and report on client data? (Check ALL that apply)

Answer Options:

  • DMC (or analytics staff)
  • Research and evaluation staff
  • Managers/directors

Format: Checkbox

Scale or Measurement: Count, percent, proportion,

Status: In use

Audience: Community health center staff, can be use for other organizations

Notes: from the Building Capacity for Equity Informed Planning and Evaluation (BCEIPE) Project, (list owner) Full survey

Question QS8: Our organization has clear policies on data collection, handling, and analysis (including ensuring privacy, accuracy, and quality)

Answer Options:

Strongly disagree, disagree, neutral, agree, strongly agree

Format: Single select

Scale or Measurement: Likert

Status: In use

Audience: Community health center staff, can be use for other organizations

Notes: from the Building Capacity for Equity Informed Planning and Evaluation (BCEIPE) Project, (list owner) Full survey

Question QS9: Continuity of care is much more complex than implementing information and technology in a single care setting. Multiple stakeholders must act in concert to provide an environment that facilitates the best care and value. Thinking about your organizations capabilities for data exchange and transperacy that support Continuity of Care across care types, settings and populations – which level of the HIMSS Continuity of Care model (CCMM) are you best aligned with? You can find the full description of each of these stages here: https://www.himss.org/what-we-do-solutions/digital-health-transformation/maturity-models/continuity-care-maturity-model-ccmm

Answer Options:

Stage 0 – Limited or no e-communication
Stage 1 – Basic peer-to-peer data exchange
Stage 2 – Patient centered clinical data using basic system-to-system exchange
Stage 3 – Normalised patient record using structural interoperability
Stage 4 – Care coordination based on actionable data using a semantic interoperable patient record
Stage 5 – Community-wide patient records using applied information with patient engagement focus
Stage 6 – Closed loop care coordination across care team members
Stage 7 – Knowledge driven engagement for dynamic, multi-vendor, multi-organisational interconnected healthcare delivery model

Format: Single select

Scale or Measurement: count, percent

Status: In use

Audience: CIOs, others TBD

Notes: This question has been adapted from the HIMSS HL7 models

Question QS10: Analytics serve to improve many facets of a healthcare business beyond clinical decision support, such as an organization’s operational and financial aspects. Thinking about your organizations data capbilities and use for Analytics Capabilities to support health care services and decisions – which level of the HIMSS Analytics Model or Analytics Maturity (AMAM) are you best aligned with? You can find the full description of each of these stages here: https://www.himss.org/what-we-do-solutions/digital-health-transformation/maturity-models/adoption-model-analytics-maturity-amam

Answer Options:

Stage 0 – Fragmented point solutions
Stage 1 – Foundation building: data aggregation and initial data governance
Stage 2 – Core data warehouse workout: centralised database with an analytics competency center
Stage 3 – Efficient, consistent internal and external report production and agility
Stage 4 – Measuring and managing evidence based care, care visibility, and waste reduction
Stage 5 – Enhancing quality of care, population health, and understanding the economics of care
Stage 6 – Clinical risk intervention & predictive analytics
Stage 7 – Personalized medicine & prescriptive analytics

Format: Single select

Scale or Measurement: Count, percentage

Status: In use

Audience: CIOs, other TBD

Notes: This question has been adapted from the HIMSS HL7 models

Question QS11: To what extent do you agree with the following statements?

Answer Options:

1) The use of the guidelines increased my/our understanding of what data should be captured and shared with others on my/our team.
2) From my perspective, the use of the guidelines guidelines increased our organizations ability to implement data sharing solutions with other partners.
3) The use of the guidelines increased our organizations ability to implement analytics capabilities.

Format: Item ranking (strongly disagree to strongly agree)

Scale or Measurement: Likert

Status: In use

Audience: CIOs, other TBD

Notes: This question is being used for Bree Collaborative Evaluation activities.

Question QS12: Introduction: The Rural Health Information Hub defines successful care coordination programs as ones that “focus on meeting the needs of each individual, beyond healthcare services, including transportation, home safety, nutrition, and literacy. Care coordination involves addressing more than just the medical needs of a patient and supporting the entire person.”
Referring to using data for continuity of care, to what extent do you agree with the following statements?

Answer Options:

1) The goals for referrals were were clear in all guidelines we used.
2) The goals for data transparency (such as sharing information with patients) were clear in all the guidelines we used.
3) The goals for data standardization were clear in all of the guidelines we used.

Format: Item ranking (strongly disagree to strongly agree)

Scale or Measurement: Likert

Status: In use

Audience: CIOs, other TBD

Notes: This question is being used for Bree Collaborative Evaluation activities.

Question QS13: Referring to using data for analytics capabilities, to what extent do you agree with the following statements?

Answer Options:

1) The goals for data aggregation capabilities were clear in all guidelines we used.
2) The goals for data collection were clear in all of the guidelines we used.
3) The goals for population health management (such as sharing information with patients) were clear in all the guidelines we used.

Format: Item ranking (strongly disagree to strongly agree)

Scale or Measurement: Likert

Status: In use

Audience: CIOs, other TBD

Notes: This question is being used for Bree Collaborative Evaluation activities.

Question QT1: Does your organization have a standard list of social determinants of health (e.g. housing, income, transportation, etc.) by which your organization is able to assess population health measures (e.g. blood sugar levels for a diabetic cohort stratified by homelessness)?

Answer Options:

  1. Yes
  2. No
  3. Unsure

Format: Single Select

Scale or Measurement: Count or percent

Status: In use

Audience: general

Notes:

Question QU1: Please rate the following questions from 1-5 with 1=strongly AGREE to 5=Strongly DISAGREE.

Answer Options:

  1. I think I would like to use this website frequently.
  2. I found the website unnecessarily complex.
  3. I thought the website was easy to use.
  4. I think I would need some help sometimes to be able to use this website effectively.

Format: rating

Scale or Measurement: Likert scale; Strongly Agree, Agree, Neutral, Disagree, Strongly Disagree

Status: In review

Audience: General

Notes:

These questions were used by the NCHS to evaluate technology usability.

Citation: Maitland, A, 2010, Usability Testing of the NCHS Website, Hyattsville, MD: National Center for Health Statistics. https://wwwn.cdc.gov/QBank/Report.aspx?1077

 

Share your evaluation questions!

Use the form below to share the questions you have used in an evaluation of an implementation project.

Question Bank Submission Form
Use this form to submit questions you are using for your own evaluation projects.
List the options that respondents can choose from, if any.
Example: single select, open text, multiple select, star rating, ranking, etc.
Example: Likert scale, count, qualitative word coding, etc.
Example: in use, in review, retired, etc.
Example: Work group members, patients, providers, administrators, general, etc.
Please provide any other information here.