The Evaluation Associate will serve as a subject matter expert and advisor to Directors for Evaluation in leading multiple cross-departmental program evaluation activities. The Evaluation Associate will provide an in-depth analysis on the research and medical education programs and initiatives, specifically with the School of Medicine education program and the CTSA program, in order to develop strategic action plans and to determine the global impact of the programs and initiatives. The primary responsibilities of this position include: program management and evaluation for Medical Education and the CTSC, facilitating data capture and electronic tracking, assessing new approaches and best practices to measure impact, managing progress and outcomes reporting to funders and stakeholders, and providing input for grant and contract applications.
- Develop and administer data collection and reporting strategies for the CTSC and Medical Education programs, identifying information significant to the program’s strategic plan and assessing the impact of the research and education initiatives.
- Advise principal investigators in designing the evaluation of grant proposals, which may involve assisting in the design, implementation, and reporting of achievement of outcomes.
- Analyze and interpret data, write reports, and present results to stakeholders including senior leadership, curriculum committees, students, and faculty as requested. Effectively communicate how program evaluation data is used to direct curricular change. This includes evaluating the current system and recommending improvements to data collection processes and systems.
- Perform analysis of complex, confidential and sensitive issues of a broad scope related to tracking and evaluation of education activities. This includes managing data in various Evaluation Unit databases and applications and contacting investigators and trainees to ensure reporting requirements of the NIH are completed appropriately and in a timely manner. Maintain strict confidentiality, tact and professionalism in interactions and collaborative efforts with faculty, staff, students, and other internal and external contacts. Assist with the development and on-going collection and reporting of funder-required national level common metrics. Assist the Director of Evaluation with development, dissemination, and tracking REDCap surveys as needed. Interact with CTSC executive director and grant component lead persons to obtain and track investigators who have benefited from CTSC resources and data. Provides assistance to the Directors for Evaluation with special projects and/or duties as needed.
- Lead the assessment of the efficacy and performance of CWRU SOM curriculum through collaborating with senior leadership and faculty to determine criteria, and generate reports to assist curriculum committees and others in informing curricular change.
Serve on planning teams as necessary
Within the Department
Within the University
External to University: Contact with members of other CTSA programs; Interact with national organizations at national meetings
Education/Experience: PhD in Evaluation and Measurement preferred. Will consider PhD in statistics, qualitative analysis, health sciences, and education and minimum of three years progressive experience leading program measurement and evaluation, or equivalent combination of education and experience, required.
Preferred Experience: Experience in biomedical research environment, Experience in a university setting and with federally-funded biomedical research, such as NIH, NSF, CDC or other federal agency, preferred
- Strong understanding of sponsored research project budgeting and management required
- Strong track record of experience with leading evaluation efforts in a complex, multi-institutional, and matrixed organization preferred
- Demonstrated knowledge of both quantitative and qualitative research methods and design (including surveys, focus groups, interviews) and proficiency with qualitative data analysis and survey software (SPSS, SAS or comparable) as well as MS Office Suite required
- Excellent analytical skills with a demonstrated ability to translate complex data into actionable recommendations required
- Strong communication and presentation skills, both oral and written, with demonstrated expertise in technical report writing and grant proposal development
- Demonstrated ability to work as part of a team to collaborate effectively with a number of stakeholders, including administrators, academic units, faculty, graduate students, and staff and external partners required
- Strong methodological, analytical, and project management skills required
- Knowledge of Institutional Review Board (IRB) process and regulations required
- Demonstrated ability to maintain a high level of confidentiality, professionalism and sensitivity and to use discretion in interacting with various constituencies. Exhibits good judgment, flexibility, and initiative.
- Demonstrates judgment and initiative in anticipating needs and resolving problems.
- Proven ability to manage complex calendars, prioritizing activities and responsibilities.
- Demonstrates ability to accommodate interruptions, competing deadlines and changes in priorities.
- Analytical ability to evaluate and triage correspondence and tasks.
- Exceptional organizational skills and attention to detail.
- Knowledge of and familiarity with University constituencies, organizational structure, policies and procedures.
- Working knowledge of REDCap (Research Electronic Data Capture) or similar web application for building and managing online surveys and databases.
- Working Knowledge of general research processes.
- Working knowledge of evaluation practices and proficient in (AEA)
- Demonstrates expertise in Microsoft Office, Google Suite (Drive, Gmail, Docs, Sheets, Forms, Slides, Calendar), database management software and social networking analysis.
- Knowledge of social network analysis.
- Writing: grants, evaluation reports, summaries, recommendations
- Data collection, analysis, interpretation, and visualization
- Survey design, deployment, analysis, interpretation
- Collaborate with faculty, staff, and program leaders regarding collection and interpretation of data and information and development of evaluation plans
- Research using quantitative and qualitative methods
- Manage evaluation plans for both education and research programs
General office environment.
ABOUT THE CTSC:
The CTSC is the Cleveland-based part of a national consortium of research institutions working together to facilitate and transform scientific study relating to human health. With a shared goal of improved health, a broad scientific community - in the basic and behavioral sciences, in health advocacy, and in clinical practice - comes together with an engaged public community to leverage ideas and resources into results. The CTSC encourages and enables collaborative participation in the research enterprise through communications, education, advocacy, clinical practice, shared ideas and resources, and pilot funding. Northeast Ohio researchers are seeing expedited success in their studies, and patients are benefiting, as a result.
ABOUT THE SCHOOL OF MEDICINE EDUCATION AND TEACHING PROGRAMS:
The School of Medicine has three programs each being evaluated on an ongoing basis: University Program, College Program, Medical Scientist Training Program. Evaluation reports are presented to the Committee on Medical Education (CME). The CME serves to evaluate, review, and make recommendations concerning overall goals and policies of the CWRU SOM’s medical education program. In addition, the SOM houses a MSc in Physician Assistant Studies program with similar evaluation needs.The Evaluation Associate collects data at regular intervals to inform leadership of progress and invites feedback on the curriculum. Faculty and course evaluations are administered to the students at regular intervals soliciting perspectives on aspects of the curriculum.
Interested candidates can send a copy of their CV, cover letter, and references to Ginny Petrie at firstname.lastname@example.org