Program Evaluation

Program Evaluator

Clara Pelfrey, PhD, Program Evaluation Director

CTSC Program Evaluation integrates data tracking and evaluation for all CTSC research components and training cores, and incorporates a utilization-focused, participatory, and methodologically flexible approach which is based on the CDC Framework for Program Evaluation and the American Evaluation Association Program Evaluation Standards. We are actively involved in all levels of CTSA evaluation, from national to community based. Nationally, we participate in collaborations with several other CTSA Hubs to apply innovative approaches to evaluating CTSA Hubs.

Research and Impact Evaluation Services

Research and Impact Evaluation Consults are available for investigators doing clinical and translational science. One-hour consultations can be made through the Clinical and Translational Science Collaborative (CTSC) by going to SPARC Request and placing a request under “CTSC Administrative > Evaluation”. (A video on how to place requests are under the FAQs). These consults  include assistance with:

  • Data Collection: Developing data collection instruments such as surveys, data entry forms or databases in Redcap (secure and HIPAA compliant).
  • Bibliometric analysis: Bibliometrics are the statistical analyses of books, articles, or other publications and are used to track author or researcher output and impact.
    • SciVal enables you to visualize research performance, benchmark relative to peers, develop collaborative partnerships, and analyze research trends.
    • InCites enables analysis of an entire portfolio of publications using PubMed IDs. InCites has 3 modules that help tell the story of the portfolio regarding:
      • Influence - uses the Relative Citation Ratio (RCR) values, which measure the scientific influence of each paper by field- and time-adjusting the citations it has received, and benchmarking to the median for NIH publications.
      • Translation - measures how Human, Animal, or Molecular/Cellular Biology-oriented each paper is, and uses this information to track and predict citation by clinical articles.
      • Citations - disseminates link-level, public-domain citation data from the NIH Open Citation Collection (NIH-OCC)
  • Highlight investigator impact. There are several ways of highlighting the impact of a body of research that go beyond publications, citations and grants. Does the research show impact in the form of benefits to society?  The Translational Science Benefits Model and the Translating for Impact Toolkit both help assess current and future benefit to society in the form of:
    • Clinical & Medical Benefits (procedures, guidelines, tools and products),
    • Community & Public Health Guidelines (health activities and products, health care characteristics, health promotion)
    • Economic Benefits (commercial products, financial benefits and savings)
    • Policy & Legislative Benefits (advisory activities, policies and legislation).