Evaluation Guide

Overview

This guide describes evaluation requirements and instruments used for your activities supported by the NNLM All of Us Program Center (NAPC). Evaluation results play an important role to help us understand the impact of your activities and share results with the NIH All of Us Research Program. We appreciate your cooperation and support in our efforts. If you have any questions or concerns about NAPC evaluation activities, you can reach out to us at lib-NAPCengage@uiowa.edu.

Each guide tab covers a different evaluation component. Please refer to your particular funding guide’s Reporting tab to determine which components apply to your activity. Components may include:

  • Evaluation surveys for public events and staff trainings
  • All of Us website URL tracking
  • Focus groups
  • And more as they apply

What if I am using an evaluation tool not included in this guide?

Any other evaluation tools created for the project must be shared with or described to your award and evaluation liaison, as is required by NLM’s policy on Human Subject Research reviews (see your particular funding guide for additional information).

We need your feedback!

After the completion of your project, you may be asked to participate in a focus group or interview to help NAPC gain further insight into the successes and challenges of your project. These opportunities are encouraged, but not required. They will take no longer than one hour of your time and will be completed via Zoom.

Surveys

All NAPC funded projects are required to distribute and collect survey data to evaluate how projects promote awareness of All of Us, which is one of the award goals. Survey responses will help us understand the impact of your events on raising awareness of the NIH All of Us Research Program and increasing health literacy in communities. This information is shared with the NIH All of Us Research Program, whose funding makes these projects possible.

The NAPC has a standard set of questions to evaluate All of Us awareness in your community during funded project activities. Working with your NAPC evaluation liaison, you will use and/or integrate the following surveys into your project, as they apply:

  • All of Us Participant Survey: For any public-facing events which will include promotional information about All of Us.
  • All of Us Staff Survey: For any staff trainings to evaluate staff’s understanding of informing community members about All of Us.

Refer to the appropriate sections below for previews of survey questions.

Raw survey data must be shared with the NAPC no later than 2 weeks after the event’s conclusion. Please share the raw data for at least the standard All of Us survey questions, either in a spreadsheet, word document, pictures of paper surveys, etc. The following sections provide specific guidance when using each of the survey types.

 

NAPC Participant Survey

The participant survey question items are required to include in your evaluation of any public events. The NAPC Evaluation Team is available to support distributing these survey questions to your community. We are mindful of participant “survey fatigue,” so we want to support you in providing a seamless survey experience for your participants. Below are some suggestions on how to increase survey response rates and accuracy.

Download Participant Survey Preview

 

NAPC Staff Capacity Survey

The staff capacity survey items are required to include in any evaluation of NAPC-supported staff trainings. The NAPC Evaluation Team is available to support distributing these survey questions to your community.

Download Staff Capacity Survey Preview

 

Distributing the Surveys

The below suggestions are written with the participant survey in mind, but they can be adapted for the staff capacity survey.

 

In-person

Before Event

Have a staff member give attendees a heads-up about a post-event survey. Suggested script:

  • “Thank you for attending our event featuring information on All of Us Research Program! Please stick around after the event ends to complete an anonymous survey that will take less than five minutes. Your responses will not only help us understand the success of our event, but also can help us get more funding for future events like these. Thank you!”

If presenting pre-event visuals, include a slide sharing with attendees that a brief, anonymous survey will be handed out at the end of the event.

 

After Event

Before handing out the survey, share why the survey is important, what it is collecting, and that is anonymous and brief. Suggested talking points:

  • “This brief and anonymous survey will help us and the organizations that fund this event understand the impact of the event and how to improve future programs featuring the All of Us Research Program. Please be honest in your responses. Your responses can also help us get more funding for future events. If you have any questions about the survey, please let us know.”

Ask participants to return surveys to event staff and/or put the survey into an envelope or another confidential way.

 

Online

You can use your own survey platform (for example, Google forms, Survey Monkey, etc.). At NAPC, we use a platform called Qualtrics, and we can provide an anonymous link and/or QR Code to the participant survey personalized for your event/s. We can access the survey data immediately and will share them with you if you would like them. Let us know at least two weeks prior to the event if you need a survey link and/or QR code.

Before and after event example scripts above can be used to make participants aware of an end of event survey. Similarly, you can include tiny URL or QR code for the survey on a slide or poster board for easy participant access.

 

How to Return Survey Responses

Paper surveys may be returned by scanning or taking photos of the surveys and uploading them to your project workspace. You may also email them to Diana Brace, Evaluation Specialist, at diana-brace@uiowa.edu. If you would prefer to mail the hard copies, please send to:

Diana Brace
Center for Evaluation and Assessment
210 Lindquist Center
University of Iowa
Iowa City, IA 52242

If you use your own online survey, share response data either in your Project Workspace (Partnership Project Award only), or email your liaison with the file.

 

Incentives

Providing incentives can increase survey response rates and is an allowable expenditure through our funding. If you decide to include an incentive, please contact your NAPC liaison with any questions.

  • Optional Suggested Incentive Language: "We'd like your feedback by filling out our event survey! To show our appreciation, we will select x respondents to receive a $x gift card. If you'd like to participate in the raffle, please include your name and email address at the bottom of the survey. For your privacy, we will not save contact information after winners are selected."

Join All of Us URL

You will be assigned a unique URL to use in all your events, handouts, flyers, and other promotional materials to direct activity participants to the All of Us enrollment website. Library staff are not to recruit or directly enroll participants for All of Us. We use Google Analytics data to track traffic to joinallofus.org from all events. Some of the information we track include: how many people visited the joinallofus.org page, how many people registered to be participants in All of Us, etc. We do not collect identifying information. These numbers are reported to the NIH All of Us Research Program to show how funded events raise awareness of All of Us, and promote retention and enrollment in All of Us.

URLs are shared directly to you by your NAPC award liaisons or in your Project Workspace. You should have two (2) URLs to use for your project: one for digital materials (email blasts, e-newsletters, etc), and the other for print materials (handouts, flyers, etc.), These URLs need to be included in all of your event materials that are intended for community members. You DO NOT need to use the URLs for Internal planning notes or other documents.

 

When do I use the URLs?

These URLs need to be included in all event materials intended for community members. You should have two (2) URLs to use for your project: one for digital materials and one for print materials.

  • Digital materials: email blasts, e-newsletters, social media promotion, etc.
  • Print materials: handouts, flyers, etc.

You DO NOT need to use the URLs in surveys, internal planning notes, or documents. Feel free to reach out to your NAPC award liaison with any questions on how to use assigned URLs in your project.

This page was last updated on: 09/22/23 13:55