Evaluation Guide

This guide describes evaluation requirements and instruments used for your activities supported by the NNLM All of Us Program Center (NAPC). Evaluation results play an important role to help us understand the impact of your activities and share results with the NIH All of Us Research Program. We appreciate your cooperation and support in our efforts. If you have any questions or concerns about NAPC evaluation activities, you can reach out to us at lib-NAPCengage@uiowa.edu.

Each guide tab covers a different evaluation component. Please refer to your particular funding guide’s Reporting tab to determine which components apply to your activity. Components may include:

• Evaluation surveys for public events and staff trainings
• All of Us website URL tracking
• Focus groups
• And more as they apply

What if I am using an evaluation tool not included in this guide?

Any other evaluation tools created for the project must be shared with or described to your award and evaluation liaison, as is required by NLM’s policy on Human Subject Research reviews (see your particular funding guide for additional information).

We need your feedback!

After the completion of your project, you may be asked to participate in a focus group or interview to help NAPC gain further insight into the successes and challenges of your project. These opportunities are encouraged, but not required. They will take no longer than one hour of your time and will be completed via Zoom.

All NAPC funded projects are required to distribute and collect survey data to evaluate how projects promote awareness of All of Us, which is one of the award goals. Survey responses will help us understand the impact of your events on raising awareness of the NIH All of Us Research Program and increasing health literacy in communities. This information is shared with the NIH All of Us Research Program, whose funding makes these projects possible.

The NAPC has a standard set of questions to evaluate All of Us awareness in your community during funded project activities. Working with your NAPC evaluation liaison, you will use and/or integrate the following surveys into your project, as they apply:

• All of Us Participant Survey: For any public-facing events which will include promotional information about All of Us.
• All of Us Staff Survey: For any staff trainings to evaluate staff’s understanding of informing community members about All of Us.

Refer to the appropriate sections below for previews of survey questions.

Raw survey data must be shared with the NAPC no later than 2 weeks after the event’s conclusion. Please share the raw data for at least the standard All of Us survey questions, either in a spreadsheet, word document, pictures of paper surveys, etc. The following sections provide specific guidance when using each of the survey types.

 

NAPC Participant Survey

The participant survey question items are required to include in your evaluation of any public events. The NAPC Evaluation Team is available to support distributing these survey questions to your community. We are mindful of participant “survey fatigue,” so we want to support you in providing a seamless survey experience for your participants. Below are some suggestions on how to increase survey response rates and accuracy.

Download Participant Survey Preview

• English
• Spanish

 

NAPC Staff Capacity Survey

The staff capacity survey items are required to include in any evaluation of NAPC-supported staff trainings. The NAPC Evaluation Team is available to support distributing these survey questions to your community.

Download Staff Capacity Survey Preview

• English
• Spanish

 

Distributing the Surveys

The below suggestions are written with the participant survey in mind, but they can be adapted for the staff capacity survey.

 

In-person

Before Event

Have a staff member give attendees a heads-up about a post-event survey. Suggested script:

• “Thank you for attending our event featuring information on All of Us Research Program! Please stick around after the event ends to complete an anonymous survey that will take less than five minutes. Your responses will not only help us understand the success of our event, but also can help us get more funding for future events like these. Thank you!”

If presenting pre-event visuals, include a slide sharing with attendees that a brief, anonymous survey will be handed out at the end of the event.

 

After Event

Before handing out the survey, share why the survey is important, what it is collecting, and that is anonymous and brief. Suggested talking points:

• “This brief and anonymous survey will help us and the organizations that fund this event understand the impact of the event and how to improve future programs featuring the All of Us Research Program. Please be honest in your responses. Your responses can also help us get more funding for future events. If you have any questions about the survey, please let us know.”

Ask participants to return surveys to event staff and/or put the survey into an envelope or another confidential way.

 

Online

You can use your own survey platform (for example, Google forms, Survey Monkey, etc.). At NAPC, we use a platform called Qualtrics, and we can provide an anonymous link and/or QR Code to the participant survey personalized for your event/s. We can access the survey data immediately and will share them with you if you would like them. Let us know at least two weeks prior to the event if you need a survey link and/or QR code.

Before and after event example scripts above can be used to make participants aware of an end of event survey. Similarly, you can include tiny URL or QR code for the survey on a slide or poster board for easy participant access.

 

How to Return Survey Responses

Paper surveys may be returned by scanning or taking photos of the surveys and uploading them to your project workspace. You may also email them to Diana Brace, Evaluation Specialist, at diana-brace@uiowa.edu. If you would prefer to mail the hard copies, please send to:

Diana Brace
Center for Evaluation and Assessment
210 Lindquist Center
University of Iowa
Iowa City, IA 52242

If you use your own online survey, share response data either in your Project Workspace (Partnership Project Award only), or email your liaison with the file.

 

Incentives

Providing incentives can increase survey response rates and is an allowable expenditure through our funding. If you decide to include an incentive, please contact your NAPC liaison with any questions.

• Optional Suggested Incentive Language: "We'd like your feedback by filling out our event survey! To show our appreciation, we will select x respondents to receive a $x gift card. If you'd like to participate in the raffle, please include your name and email address at the bottom of the survey. For your privacy, we will not save contact information after winners are selected."

The library may be assigned a unique URL to use for your project. This URL must be included in all public-facing materials intended for community members, such as flyers, QR codes, newsletter links, social media posts, etc. handouts, flyers, and other promotional materials to direct activity participants to a local All of Us enrollment website. Library staff will not directly recruit or enroll participants for All of Us.

We use Google Analytics data to track traffic to joinallofus.org from all activities. To help us distinguish the web traffic from each library, each URL will contain a unique “Urchin Tracking Module” (UTM). UTMs are generally used to track marketing and advertising campaigns. For our purposes, we are using them to track the following information:

• Total Visitors to the All of Us website
• Visitors who Clicked to Sign Up or Join Now
• Completed All of Us Registrations
• Completed All of Us Consents

We do not collect personal identifying information. These numbers are reported to the NIH All of Us Research Program to show how funded events raise awareness and promote retention and enrollment in All of Us. Please get in touch with us if you have any questions about the use of UTMs or how to use assigned URLs in your project.

Example UTM

When you click on the URL: https://joinallofus.org/nlm, it redirects you to to the following full web address: https://www.joinallofus.org/?utm_source=nlm&utm_medium=referral&utm_campaign=nlm-national-awareness&utm_content=general

The portion that starts with “/?utm_source…” is the UTM label. This is what your library users will see or hear (if using assistive technology) when they click on the link within the customized interface.