{"id":2539,"date":"2022-11-07T20:21:03","date_gmt":"2022-11-08T01:21:03","guid":{"rendered":"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/?page_id=2539"},"modified":"2022-11-07T20:21:03","modified_gmt":"2022-11-08T01:21:03","slug":"qualitative-strategic-and-tactical-measures","status":"publish","type":"page","link":"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/","title":{"rendered":"Qualitative Strategic and Tactical Measures"},"content":{"rendered":"<section class=\"wpb-content-wrapper\"><p>[vc_row][vc_column][vc_empty_space height=&#8221;1.45em&#8221;][vc_column_text]Users of the metrics framework will likely differ in the level of detail with which they wish to engage. Therefore, <strong>the qualitative metrics have been separated into three successive levels of specificity: STRATEGIC, TACTICAL, and OPERATIONAL<\/strong>. Please note that that all suggested qualitative metrics are guideposts and are intentionally non-specific to any given stakeholder within the clinical research enterprise. Users of the metrics framework can adapt them to the specific nature of their organization and work.<\/p>\n<ul>\n<li><strong>STRATEGIC:<\/strong> Some users may wish to look only at the 3-4 strategic \u201cmust have\u201d qualitative metrics per theme, which are in bold grey font, and designated by the theme letter and strategic metric number (e.g., D.1).<\/li>\n<li><strong>TACTICAL:<\/strong> Other users may wish to go beyond the strategic level \u201cmust have\u201d qualitative metrics and look additionally at the 2-3 suggested tactical level qualitative metrics. These are listed under each strategic metric with the theme letter, the strategic metric number, and the tactical metric number (e.g., D.1.1).<\/li>\n<li><strong>OPERATIONAL:<\/strong> Operational level metrics are not listed directly under the tactical metrics, because it is anticipated that users who wish to consider in more detail how to measure efforts on the tactical qualitative metrics would create their own operational level metrics. <strong>However, to assist those wishing to develop operational level metrics, <em>approach examples<\/em> in the format of logic model flowcharts have been included on the Qualitative Operational Measures page. These are available for 1-2 tactical level metrics for each theme<\/strong> and can be accessed by clicking on the \u201c(see operational example\u2026)\u201d that is in blue underlined font next to the tactical measure, or by going to the Qualitative Operational Measures page.<\/li>\n<\/ul>\n<p>[\/vc_column_text][vc_empty_space height=&#8221;1em&#8221;][vc_separator][vc_empty_space height=&#8221;1em&#8221;][\/vc_column][\/vc_row][vc_row][vc_column width=&#8221;1\/6&#8243;][vc_column_text el_id=&#8221;theme_marker_a&#8221;]A[\/vc_column_text][\/vc_column][vc_column width=&#8221;5\/6&#8243;][vc_column_text el_id=&#8221;domain1&#8243;]<\/p>\n<h2>Commitment, leadership, and resources to support DEI in CR (\u201cCommitment\u201d)<\/h2>\n<p>Theme A focuses on leadership actions to make Diversity, Equity, and Inclusion (DEI) a priority within and across institutions\/organizations. It encompasses processes such as creating a statement of commitment and clearly communicating that statement, and institutional support for commitment to DEI, both internally and externally. Theme A includes actions to set the stage for institutional accountability to DEI in Clinical Research (CR), including partnering with external advisors; designating and empowering institutional teams, committees, and positions to lead work in DEI; and committing to evaluation of institutional performance in DEI. <em>Please note:<\/em> the conception of metrics in A.2 relates to institutional (or study) performance and are reflected in the proposed quantitative and qualitative measures in this framework. However, the conception of metrics in A.3 relates to evaluating individual performance toward specific tasks involving DEI and, as they are specific to the individual, are beyond the scope of this document and are not enumerated here. Finally, Theme A also involves the generation or re-allocation of resources to support leadership, partner, and team commitment to DEI in CR.[\/vc_column_text][vc_tta_accordion color=&#8221;white&#8221; gap=&#8221;1&#8243; active_section=&#8221;0&#8243; no_fill=&#8221;true&#8221; collapsible_all=&#8221;true&#8221;][vc_tta_section title=&#8221;A.1 Statement of commitment to DEI in clinical research by the President, Executive Leadership Team, and Board&#8221; tab_id=&#8221;1546448728496-2f92f60e-b7b5&#8243;][vc_column_text]<\/p>\n<ol class=\"section_a1\">\n<li>Internal communication of commitment to DEI in CR<\/li>\n<li>Public communication of commitment to DEI (<a href=\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-operational-example-for-a-1-2\/\">see operational example A.1.2<\/a>)<\/li>\n<\/ol>\n<p>[\/vc_column_text][\/vc_tta_section][vc_tta_section title=&#8221;A.2 Resource commitment to support DEI in CR across institution\/organization&#8221; tab_id=&#8221;1667870984139-44020a36-1d3a&#8221;][vc_column_text]<\/p>\n<ol class=\"section_a2\">\n<li>Assessments of the institution&#8217;s financial, human, and physical resources to support DEI in CR<\/li>\n<li>Processes to generate\/re-allocate financial, human, and physical resources to support DEI in CR<\/li>\n<li>Criteria for vendor selection and contracting to support DEI in CR (<a href=\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-operational-example-for-a-2-3\/\">see operational example A.2.3<\/a>)<\/li>\n<\/ol>\n<p>[\/vc_column_text][\/vc_tta_section][vc_tta_section title=&#8221;A.3 Executive Leadership Team and Board action on commitment for DEI in CR&#8221; tab_id=&#8221;1667872500065-722e4659-ad0b&#8221;][vc_column_text]<\/p>\n<ol class=\"section_a3\">\n<li>Institutional\/organizational partnerships with external advisors that coordinate or conduct CR<\/li>\n<li>Processes for monitoring of institutional performance for DEI in CR<\/li>\n<\/ol>\n<p>[\/vc_column_text][\/vc_tta_section][vc_tta_section title=&#8221;A.4 Dedicated teams, committees, positions and specific roles with identified institutional structure&#8221; tab_id=&#8221;1667872634493-c6b43a04-841e&#8221;][vc_column_text]<\/p>\n<ol class=\"section_a4\">\n<li>Dedicated teams, committees, and positions for DEI (in CR and departments impacting CR)<\/li>\n<li>Demarcated roles, tasks, and supervisory\/reporting structures for teams, committees and positions for DEI<\/li>\n<li>Processes for monitoring of team, committee, and individual position performance for DEI<\/li>\n<\/ol>\n<p>[\/vc_column_text][\/vc_tta_section][\/vc_tta_accordion][\/vc_column][\/vc_row][vc_row][vc_column width=&#8221;1\/6&#8243; el_id=&#8221;theme_marker_b&#8221;][vc_column_text el_id=&#8221;theme_marker_b&#8221;]B[\/vc_column_text][\/vc_column][vc_column width=&#8221;5\/6&#8243;][vc_column_text]<\/p>\n<h2>Institutional and study metrics for DEI in CR, data collection, and analysis (\u201cData\u201d)<\/h2>\n<p>Theme B centers on the processes for setting up metrics and data collection systems to evaluate institutional\/organizational and\/or study (i.e., clinical trial) performance on DEI in CR. This involves consideration of the purpose(s) for the metrics and the question(s) that are driving data collection and analysis, in addition to which variables, data sources, and forms of analysis would be needed to complete the analysis. Although some quantitative and qualitative metrics at the institutional level and study level may not always align, DEI success at the institutional and at the study level are interdependent. Therefore, the qualitative measures in Theme B attempt to be sufficiently broad to capture both institutional and study processes for developing metrics and data collection\/analysis structures, but also specific enough so that the contextualization necessary for studies is not overlooked. Please note: Theme B does not yet include quantitative metrics. Qualitative metrics on analyses of data or review of results to plan for corrective action are covered in <a href=\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/#theme_marker_f\">Theme F<\/a> (Review).[\/vc_column_text][vc_tta_accordion color=&#8221;white&#8221; gap=&#8221;1&#8243; active_section=&#8221;0&#8243; no_fill=&#8221;true&#8221; collapsible_all=&#8221;true&#8221;][vc_tta_section title=&#8221;B.1 Defined process to establish metrics for evaluating institutional or study performance on DEI in CR&#8221; tab_id=&#8221;1667873445533-55633b08-af5d&#8221;][vc_column_text]<\/p>\n<ol class=\"section_b1\">\n<li>Statement of purpose to capture, measure, and report DEI metrics in clinical trials from the President, Executive Leadership Team, and Board<\/li>\n<li>Training, resources, and capacity to support the consideration, selection, and reporting of metrics<\/li>\n<li>Defined purpose(s) for the metrics, targets for success, and timeframes to assess the metrics (<a href=\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-operational-example-for-b-1-3\/\">see operational example B.1.3<\/a>)<\/li>\n<\/ol>\n<p>[\/vc_column_text][\/vc_tta_section][vc_tta_section title=&#8221;B.2 Identification of existing and\/or needed data, variables, and data sources&#8221; tab_id=&#8221;1667873655843-f3601492-04ff&#8221;][vc_column_text]<\/p>\n<ol class=\"section_b2\">\n<li>Institutional and\/or study question(s) defined in terms of the epidemiology of the condition(s) of concern and the population(s) of concern<\/li>\n<li>Map of existing internal and external data sources that collect data from participants, patient records, electronic systems, and\/or research records and the flow of data within the data infrastructure<\/li>\n<li>Data source audit to identify data variables (e.g. race) and values (e.g. White, Black or African American, Asian) that can be utilized to meet data needs for the defined questions<\/li>\n<\/ol>\n<p>[\/vc_column_text][\/vc_tta_section][vc_tta_section title=&#8221;B.3 Standardization of metrics and data collection and analysis practices&#8221; tab_id=&#8221;1667873764024-c838fe0e-cb7f&#8221;][vc_column_text]<\/p>\n<ol class=\"section_b3\">\n<li>Data dictionary that aligns terminology and formatting for DEI metrics, variables, and values to be utilized, in compliance with the latest regulatory guidelines<\/li>\n<li>Standardized data collection and reporting practices in place for departments or site(s)<\/li>\n<li>Analytic methodologies to optimally answer the institutional or study question(s) with available data sources, variables, and values<\/li>\n<\/ol>\n<p>[\/vc_column_text][\/vc_tta_section][\/vc_tta_accordion][\/vc_column][\/vc_row][vc_row][vc_column width=&#8221;1\/6&#8243;][vc_column_text el_id=&#8221;theme_marker_c&#8221;]C[\/vc_column_text][\/vc_column][vc_column width=&#8221;5\/6&#8243;][vc_column_text]<\/p>\n<h2>360-degree partnerships, communication, and engagement (\u201cEngagement\u201d)<\/h2>\n<p>Theme C begins with recognizing that partnership with the community is critically important at the outset of clinical research and leads to the co-development of communication and engagement activities. Planning for respectful communication involves the actions to understand how internal and external audiences wish to be engaged. CR institutions\/organizations can then develop necessary plans for physical, cultural, and linguistic accessibility (e.g., translation) of preferred modes of communication and participant-facing study materials. Theme C also encompasses processes to understand the lived experiences of individuals working and participating in clinical research and to build trust for initial and sustained engagement with community partners. <em>Please note:<\/em> Partnerships with external advisors who coordinate or conduct clinical trials are covered under <a href=\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/#theme_marker_a\">Theme A<\/a> (Commitment). Mentorship and career development is included in <a href=\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/#theme_marker_d\">Theme D<\/a> (Workforce). In addition, while it is important to prepare for 360-degree Partnerships, Communication and Engagement through clinical research staff training in areas such as implicit bias and cultural competency, all clinical research training is considered under Theme D (Workforce). Review processes and accountability measures, including community review of partnership sustainability, are covered in <a href=\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/#theme_marker_f\">Theme F<\/a> (Review).[\/vc_column_text][vc_tta_accordion color=&#8221;white&#8221; gap=&#8221;1&#8243; active_section=&#8221;0&#8243; no_fill=&#8221;true&#8221; collapsible_all=&#8221;true&#8221;][vc_tta_section title=&#8221;C.1 Developed and sustained partnerships with community sites, community organizations and community members&#8221; tab_id=&#8221;1668263117134-9fcf578c-f39d&#8221;][vc_column_text]<\/p>\n<ol class=\"section_c1\">\n<li>Defined process(es) for partnership with community sites, community groups, and their trusted members<\/li>\n<li>Plan\/s for community partner relationships to be supported and sustained<\/li>\n<\/ol>\n<p>[\/vc_column_text][\/vc_tta_section][vc_tta_section title=&#8221;C.2 Respectful and accessible communication platforms and materials&#8221; tab_id=&#8221;1668263302406-95f28d39-42ef&#8221;][vc_column_text]<\/p>\n<ol class=\"section_c2\">\n<li>Terminology\/imagery and communication that respect the preferences of intended audiences<\/li>\n<li>Communication platforms and materials that are physically accessible and usable for intended populations (<a href=\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-operational-example-for-c-2-2\/\">see operational example C.2.2<\/a>)<\/li>\n<li>Communication platforms and materials that are culturally and linguistically accessible and comprehensible to intended populations<\/li>\n<\/ol>\n<p>[\/vc_column_text][\/vc_tta_section][vc_tta_section title=&#8221;C.3 Opportunities for safe, respectful, empathetic, and open engagement&#8221; tab_id=&#8221;1668263360668-372cea05-3c26&#8243;][vc_column_text]<\/p>\n<ol class=\"section_c3\">\n<li>Internal: Lived experiences and related perspectives on clinical research are heard and understood<\/li>\n<li>External: Lived experiences and related perspectives on clinical research are heard and understood<\/li>\n<li>External: Connections fostered with community sites, trusted community members and potential trial participants<\/li>\n<\/ol>\n<p>[\/vc_column_text][\/vc_tta_section][\/vc_tta_accordion][\/vc_column][\/vc_row][vc_row][vc_column width=&#8221;1\/6&#8243;][vc_column_text el_id=&#8221;theme_marker_d&#8221;]D[\/vc_column_text][\/vc_column][vc_column width=&#8221;5\/6&#8243;][vc_column_text]<\/p>\n<h2>Educational and career opportunities to support DEI in CR (\u201cWorkforce\u201d)<\/h2>\n<p>Theme D focuses on actions to recruit and retain a diverse workforce that is representative of participant populations. It begins with recruitment, pipeline, and cohort programs for underrepresented clinical research staff, then moves to training and mentorships to support new hires. Finally, workforce retention also involves workplace environments, benefits, resources and support plans that enable all employees to remain physically and mentally healthy, performing at their best, and feeling valued. <em>Please note:<\/em> The term \u201cclinical research staff\u201d is not limited in scope to principal investigators and research coordinators, but also encompasses research nurses\/assistants\/monitors, patient navigators, pharmacists, medical writers, IRB chairs\/members, scientists, technicians, regulatory professionals, etc. The term \u201cequitable opportunities\u201d implies equitable availability of, accessibility to, consideration for, and functioning of programs that will appropriately meet the training needs and learning styles of diverse clinical research staff. \u201cTargeted opportunities\u201d are those that specifically support underrepresented clinical research staff in surmounting structural barriers to participation.[\/vc_column_text][vc_tta_accordion color=&#8221;white&#8221; gap=&#8221;1&#8243; active_section=&#8221;0&#8243; no_fill=&#8221;true&#8221; collapsible_all=&#8221;true&#8221;][vc_tta_section title=&#8221;D.1 Recruitment and pipeline programs for underrepresented CR staff&#8221; tab_id=&#8221;1668263451399-04c53c40-4932&#8243;][vc_column_text]<\/p>\n<ol class=\"section_d1\">\n<li>Equitable and targeted opportunities to access institutionally supported pipeline\/recruitment\/cohort programs such as CR leadership development, internships\/fellowships, or CR workforce training programs<\/li>\n<li>Vacancies for professional\/volunteer positions in CR accessible to diverse audiences and applications fairly assessed<\/li>\n<\/ol>\n<p>[\/vc_column_text][\/vc_tta_section][vc_tta_section title=&#8221;D.2 Clinical research training, development, mentorship programs for underrepresented CR staff&#8221; tab_id=&#8221;1668263578933-246d5b15-b447&#8243;][vc_column_text]<\/p>\n<ol class=\"section_d2\">\n<li>Equitable and targeted opportunities for training in clinical research, grant applications, and professional development (<a href=\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-operational-example-for-d-2-1\/\">see operational example D.2.1<\/a>)<\/li>\n<li>Equitable and targeted opportunities for mentorship programs, training partnerships, or networking<\/li>\n<\/ol>\n<p>[\/vc_column_text][\/vc_tta_section][vc_tta_section title=&#8221;D.3 Workplace environment supports the well-being and retention of employees from diverse backgrounds&#8221; tab_id=&#8221;1668263625485-e8737aa7-d0e5&#8243;][vc_column_text]<\/p>\n<ol class=\"section_d3\">\n<li>Required training for all employees on cultural humility, implicit bias, and accessibility by design<\/li>\n<li>Equitable and targeted benefits, flexible work policies, and opportunities to create\/participate in support groups<\/li>\n<li>Retention strategies, individualized plans, and support available through human resources<\/li>\n<\/ol>\n<p>[\/vc_column_text][\/vc_tta_section][\/vc_tta_accordion][\/vc_column][\/vc_row][vc_row][vc_column width=&#8221;1\/6&#8243;][vc_column_text el_id=&#8221;theme_marker_e&#8221;]E[\/vc_column_text][\/vc_column][vc_column width=&#8221;5\/6&#8243;][vc_column_text]<\/p>\n<h2>Strategies for inclusion of diverse participant populations in CR (\u201cInclusion strategies\u201d)<\/h2>\n<p>Unlike the other themes in this framework that could be applicable to institutional\/organizational, partnership, project, or study processes, Theme E is specific only to study processes. The measures under Theme E act in a way as a \u201cbackstop\u201d to the measures in the other themes. That is because the measures in Theme E check that DEI recommendations have been included and specified throughout study plans, communication plans, and participant-facing materials. <em>Please note:<\/em> The qualitative measures in Theme E assume that implementation will follow in the manner specified in the study plans, and therefore separate measures are not listed for implementation. However, the quantitative measures in Theme E, and the qualitative measures in <a href=\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/#theme_marker_f\">Theme F<\/a> (Review) and <a href=\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/#theme_marker_g\">Theme G<\/a> (Dissemination), can be utilized to assess implementation of strategies for inclusion of diverse participant populations in the clinical research.[\/vc_column_text][vc_tta_accordion color=&#8221;white&#8221; gap=&#8221;1&#8243; active_section=&#8221;0&#8243; no_fill=&#8221;true&#8221; collapsible_all=&#8221;true&#8221;][vc_tta_section title=&#8221;E.1 Study protocol drafted to be as inclusive as possible&#8221; tab_id=&#8221;1668263787184-9de89cea-344c&#8221;][vc_column_text]<\/p>\n<ol class=\"section_e1\">\n<li>Study question(s) identified based on relevance for intended populations<\/li>\n<li>Study designed to consider inclusion of intended populations (e.g., language, accessibility, frequency of visits, etc.)<\/li>\n<li>Eligibility criteria drafted for inclusivity (<a href=\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-operational-example-for-e-1-3\/\">see operational example E.1.3<\/a>)<\/li>\n<\/ol>\n<p>[\/vc_column_text][\/vc_tta_section][vc_tta_section title=&#8221;E.2 Planning for study feasibility, site selection&#8221; tab_id=&#8221;1668263909221-907bba62-3de0&#8243;][vc_column_text]<\/p>\n<ol class=\"section_e2\">\n<li>Feasibility assessments and selection of sites conducted with attention to DEI<\/li>\n<li>Supports to facilitate accessibility to clinical research by people of all abilities<\/li>\n<\/ol>\n<p>[\/vc_column_text][\/vc_tta_section][vc_tta_section title=&#8221;E.3 Planning inclusive processes for recruitment and retention of participants&#8221; tab_id=&#8221;1668263952256-99b83803-aced&#8221;][vc_column_text]<\/p>\n<ol class=\"section_e3\">\n<li>Planning documents, including overall study and site-specific communication plans, communication platforms, and participant-facing materials are respectful and accessible<\/li>\n<li>Recruitment and retention plans that have been developed through community engagement and consider participants\u2019 time, resources, and family\/life circumstances<\/li>\n<\/ol>\n<p>[\/vc_column_text][\/vc_tta_section][\/vc_tta_accordion][\/vc_column][\/vc_row][vc_row][vc_column width=&#8221;1\/6&#8243;][vc_column_text el_id=&#8221;theme_marker_f&#8221;]F[\/vc_column_text][\/vc_column][vc_column width=&#8221;5\/6&#8243;][vc_column_text]<\/p>\n<h2>Review, accountability, and course adjustment (\u201cReview\u201d)<\/h2>\n<p>Theme F involves actions to clean and analyze data (both quantitative and qualitative), and to review methodologies and results and of data analysis. Theme F enables stakeholders to begin drawing a picture of how well the institution\/organization, team, or study progressed with their DEI efforts in CR and to evaluate what worked well and\/or needs improvement. Collating and assessing all lessons learned will subsequently inform decision-making for course adjustment. This [institutional or study] course adjustment presents an opportunity to revise metrics and performance criteria, policies, tools, and to create mechanisms to hold institutions\/staff responsible for outcomes. <em>Please note:<\/em> Theme F does not yet include quantitative metrics. In addition, as in other themes, careful consideration of all perspectives and forms of expertise necessary for these processes, and thus whom to involve, will be important. For example, the people ideally responsible for cleaning and analyzing data may not be the same as those who review results, generate lessons learned, and\/or make decisions about corrective action. Also note that outputs from course adjustment in this theme loop back into <a href=\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/#theme_marker_a\">Theme A<\/a> (Commitment, specifically A.3.2), determination of metrics to be utilized in the future in <a href=\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/#theme_marker_b\">Theme B<\/a> (Data), and components of <a href=\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/#theme_marker_c\">Theme C<\/a> (Engagement), <a href=\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/#theme_marker_d\">Theme D<\/a> (Workforce), and <a href=\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/#theme_marker_e\">Theme E<\/a> (Inclusion strategies). Theme F also relates to Theme A (Commitment) in that F.3.3 assess if the commitment to develop metrics, embed them in review processes, and utilize them to hold institutions and staff accountable has been upheld. Theme F does not include dissemination of results, or advocacy for course adjustment or revised guidelines that are external to the institution or study (covered in <a href=\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/#theme_marker_g\">Theme G<\/a>&#8211; Dissemination).[\/vc_column_text][vc_tta_accordion color=&#8221;white&#8221; gap=&#8221;1&#8243; active_section=&#8221;0&#8243; no_fill=&#8221;true&#8221; collapsible_all=&#8221;true&#8221;][vc_tta_section title=&#8221;F.1 Cleaning and analysis of data and review of results&#8221; tab_id=&#8221;1668264019970-c6725197-2783&#8243;][vc_column_text]<\/p>\n<ol class=\"section_f1\">\n<li>Cleaned and analyzed data for diversity, equity, and inclusion metrics in each theme (<a href=\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-operational-example-for-f-1-1\/\">see operational example F.1.1<\/a>)<\/li>\n<li>Review of the methodologies and results of the data analyses<\/li>\n<\/ol>\n<p>[\/vc_column_text][\/vc_tta_section][vc_tta_section title=&#8221;F.2 Periodic review of goals and performance criteria&#8221; tab_id=&#8221;1668264146319-c042ba3a-9353&#8243;][vc_column_text]<\/p>\n<ol class=\"section_f2\">\n<li>Collation of lessons learned; Assessment of any unintended consequences<\/li>\n<li>Comparison of data analyses and lessons learned to goals and performance criteria<\/li>\n<\/ol>\n<p>[\/vc_column_text][\/vc_tta_section][vc_tta_section title=&#8221;F.3 Accountability and course adjustment&#8221; tab_id=&#8221;1668264189478-60e2ad30-0260&#8243;][vc_column_text]<\/p>\n<ol class=\"section_f3\">\n<li>Accountability for DEI performance by institutions and staff<\/li>\n<li>Revision of policies, standard operating procedures, investigator and IRB staff human participant education requirements, data forms, tools, and checklists<\/li>\n<li>Revision of metrics and performance criteria<\/li>\n<\/ol>\n<p>[\/vc_column_text][\/vc_tta_section][\/vc_tta_accordion][\/vc_column][\/vc_row][vc_row][vc_column width=&#8221;1\/6&#8243;][vc_column_text el_id=&#8221;theme_marker_g&#8221;]G[\/vc_column_text][\/vc_column][vc_column width=&#8221;5\/6&#8243;][vc_column_text]<\/p>\n<h2>Dissemination and expansion of work (\u201cDissemination\u201d)<\/h2>\n<p>Theme G focuses upon the dissemination of results, lessons learned, and course adjustments generated in Theme F (Review) for the purposes of transparency and accountability. Theme G includes soliciting diverse views in communication preparations for return of results, grey- and peer-reviewed publications, planning documents, tools, and other materials for information dissemination. Regardless of the topic being communicated, principles of transparency such as timely reporting (to all intended audiences internal and\/or external), use of plain language, clear descriptions of methodologies, and communication of favorable and unfavorable results should be upheld. Finally, Theme G encompasses advocacy for the work to be continuously evaluted, shared, and improved. While DEI metrics and goals for CR may be achieved, progress toward health equity and justice in CR are likely still needed. Theme G does not indicate an end of the road, but rather the opportunity for reflection and expansion of the work, for which stakeholders can revisit and (re)apply other themes and measures in this framework. <em>Please note:<\/em> Theme G does not yet include quantitative metrics.[\/vc_column_text][vc_tta_accordion color=&#8221;white&#8221; gap=&#8221;1&#8243; active_section=&#8221;0&#8243; no_fill=&#8221;true&#8221; collapsible_all=&#8221;true&#8221;][vc_tta_section title=&#8221;G.1 Mechanisms to solicit diverse views in assessment, authorship, and advocacy of DEI efforts for CR&#8221; tab_id=&#8221;1668264289000-539aed79-a495&#8243;][vc_column_text]<\/p>\n<ol class=\"section_g1\">\n<li>Diverse clinical research staff involved in review and authorship<\/li>\n<li>Patients, caregiver\/family, patient advocates, community members\/organizations, community and institutional providers involved in review and authorship<\/li>\n<\/ol>\n<p>[\/vc_column_text][\/vc_tta_section][vc_tta_section title=&#8221;G.2 Transparent and broad communication of results, analyses, and plans&#8221; tab_id=&#8221;1668264406233-6efd36f7-2514&#8243;][vc_column_text]<\/p>\n<ol class=\"section_g2\">\n<li>Internal communication of results, analyses, and plans (<a href=\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-operational-example-for-g-2-1\/\">see operational example G.2.1<\/a>)<\/li>\n<li>External communication of results, analyses and plans<\/li>\n<\/ol>\n<p>[\/vc_column_text][\/vc_tta_section][vc_tta_section title=&#8221;G.3 Institutional advocacy for reducing disparities and improving health equity&#8221; tab_id=&#8221;1668264457457-322807e3-5f20&#8243;][vc_column_text]<\/p>\n<ol class=\"section_g3\">\n<li>Institutional leaders and research teams active within institutional, local, national, or global networks\/forums\/conferences to share and\/or promote practices, policies, and\/or legislation<\/li>\n<li>Institutional leaders and research teams supporting others to access or generate forums within institutional, local, national, or global forums to promote DEI policies and\/or legislation<\/li>\n<\/ol>\n<p>[\/vc_column_text][\/vc_tta_section][\/vc_tta_accordion][\/vc_column][\/vc_row]<\/p>\n<\/section>","protected":false},"excerpt":{"rendered":"<p>[vc_row][vc_column][vc_empty_space height=&#8221;1.45em&#8221;][vc_column_text]Users of the metrics framework will likely differ in the level of detail with which they wish to engage. Therefore, the qualitative metrics have been separated into three successive levels of specificity: STRATEGIC, TACTICAL, and OPERATIONAL. Please note that that all suggested qualitative metrics are guideposts and are intentionally non-specific to any given stakeholder [&hellip;]<\/p>\n","protected":false},"author":5,"featured_media":0,"parent":2405,"menu_order":1,"comment_status":"closed","ping_status":"closed","template":"template-sub.php","meta":{"footnotes":""},"class_list":["post-2539","page","type-page","status-publish","hentry"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v25.0 (Yoast SEO v25.0) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Qualitative Strategic and Tactical Measures - Diversity, Inclusion, and Equity in Clinical Research<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Qualitative Strategic and Tactical Measures\" \/>\n<meta property=\"og:description\" content=\"[vc_row][vc_column][vc_empty_space height=&#8221;1.45em&#8221;][vc_column_text]Users of the metrics framework will likely differ in the level of detail with which they wish to engage. Therefore, the qualitative metrics have been separated into three successive levels of specificity: STRATEGIC, TACTICAL, and OPERATIONAL. Please note that that all suggested qualitative metrics are guideposts and are intentionally non-specific to any given stakeholder [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/\" \/>\n<meta property=\"og:site_name\" content=\"Diversity, Inclusion, and Equity in Clinical Research\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"12 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/\",\"url\":\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/\",\"name\":\"Qualitative Strategic and Tactical Measures - Diversity, Inclusion, and Equity in Clinical Research\",\"isPartOf\":{\"@id\":\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/#website\"},\"datePublished\":\"2022-11-08T01:21:03+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Tools\",\"item\":\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"EbD Metrics Framework\",\"item\":\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/\"},{\"@type\":\"ListItem\",\"position\":4,\"name\":\"Qualitative Strategic and Tactical Measures\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/#website\",\"url\":\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/\",\"name\":\"Diversity, Inclusion, and Equity in Clinical Research\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Qualitative Strategic and Tactical Measures - Diversity, Inclusion, and Equity in Clinical Research","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/","og_locale":"en_US","og_type":"article","og_title":"Qualitative Strategic and Tactical Measures","og_description":"[vc_row][vc_column][vc_empty_space height=&#8221;1.45em&#8221;][vc_column_text]Users of the metrics framework will likely differ in the level of detail with which they wish to engage. Therefore, the qualitative metrics have been separated into three successive levels of specificity: STRATEGIC, TACTICAL, and OPERATIONAL. Please note that that all suggested qualitative metrics are guideposts and are intentionally non-specific to any given stakeholder [&hellip;]","og_url":"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/","og_site_name":"Diversity, Inclusion, and Equity in Clinical Research","twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"12 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/","url":"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/","name":"Qualitative Strategic and Tactical Measures - Diversity, Inclusion, and Equity in Clinical Research","isPartOf":{"@id":"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/#website"},"datePublished":"2022-11-08T01:21:03+00:00","breadcrumb":{"@id":"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/qualitative-strategic-and-tactical-measures\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/"},{"@type":"ListItem","position":2,"name":"Tools","item":"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/"},{"@type":"ListItem","position":3,"name":"EbD Metrics Framework","item":"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/tools\/ebd-metrics-framework-and-user-guide\/"},{"@type":"ListItem","position":4,"name":"Qualitative Strategic and Tactical Measures"}]},{"@type":"WebSite","@id":"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/#website","url":"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/","name":"Diversity, Inclusion, and Equity in Clinical Research","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/wp-json\/wp\/v2\/pages\/2539"}],"collection":[{"href":"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/wp-json\/wp\/v2\/comments?post=2539"}],"version-history":[{"count":0,"href":"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/wp-json\/wp\/v2\/pages\/2539\/revisions"}],"up":[{"embeddable":true,"href":"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/wp-json\/wp\/v2\/pages\/2405"}],"wp:attachment":[{"href":"https:\/\/mrctcenter.org\/diversity-in-clinical-research\/wp-json\/wp\/v2\/media?parent=2539"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}