Understand what is most appropriate for your community or activation in real time

Testing and Evaluation

## Leverage Community Insights 

While you know your community better than we do, you may decide you need additional support to understand what your audience or context needs. For example, you may want to test assumptions around: 

- __Language__ 
*Are the languages that will help you reach the most parents and caregivers the same languages that will help reach those who could most benefit from Vroom?*

- __Culture__ 
*Are there cultural norms or environmental factors that might require specific adaptation?* 

- __Formatting__ 
*Does the benefit of adapting for format outweigh the resource cost to do the adaptation?*

It is up to you to decide on the testing activities that best meet your needs. Some Vroom recommended testing activities are:  

- Surveys 
- Focus groups
- Rapid iteration/prototyping
- Field testing

Leverage Community Insights

## High-Level Testing Guidance 

There are many ways to examine and refine your Adaptation Plan. Based on our experience, a good process for evaluation might include the following. 

1. Ask yourself, __“What questions are we trying to answer?”__ 
Try to build on outreach work you have done in the past. Here are some questions you might seek to test:

- What type of messaging appeals to and motivates the parents in my community?
 - Which delivery channels do families find most comfortable and accessible?
 - Do different channels lead to different types of engagement?

2. Consider, __"What might be the best way(s) to get answers?"__ 
Do you need field testing, focus groups, insights, something else? Different testing methods have different advantages and disadvantages, as outlined below.

High-Level Testing Guidance

Surveys

Focus Groups

Prototyping/Field Testing

Testing Methods

3. __Make a concrete testing plan and start testing.__ 
 Include what questions you are trying to answer, the methods you will use, the timeframes and the roles and responsibilities. Try to think about the smallest, fastest, accurate and representative test that will allow you adjust quickly. Your questions should be as focused as possible. 

4. __Review your findings and incorporate this feedback into your work.__ Analyze your results objectively. Don’t get stuck on what *is* and lose sight of what *can be*! Use what you’ve learned to adjust your approach where needed.

Points 3 &4

Big Idea: Flowers Illustration

Representation matters! Find ways to ensure that the families you are seeking to reach are genuinely reflected in your approach.  

The Big Idea

Big Idea: Dinosaur Illustration

Default Nav Bar

Quiz

Module 4 Icon

This module will help you build your Adaptation Plan by asking you to think through key questions about how you want to use Vroom Content. Once you answer these questions, you should be ready to apply for an Adaptation, Localization and Translation (A.L.T.) Vroom Content License. 

Building Your Adaptation Plan

Module 4 Sections

Topic to Keep in Mind

Evaluating Resources

Internal Resources

Vroom Resources Available to You

Previously Translated Content

Languages

Translated Content - Images

Translated Content

What Vroom Cannot Provide

What Resources Can Vroom Provide? 

Quick Check

Quick Check: What Resources Can Vroom Provide? 

Vroom Tips are the heart of Vroom Content.


The Full Tip Collection

Remember when we covered the [Vroom Tips in 
Module 1](https://toolkit.vroom.org/module-1/vroom-tips-are-for-parents-and-caregivers?restored=1 "Module 1: Vroom Tips")? Now might be a good time to review those sections if you need a refresher!

Helpful Hint

The Vroom Tips collection can be sorted and searched using tags. For example, you can search for tips that are based on activities to do with a child at bedtime by searching the tag “bedtime.”

About Searching and Sorting

Finding the Right Vroom Tips

There are six categories of tags in the database. Each category contains many tags, as you’ll soon learn. 

Keep in Mind

Tags: Supported Skills and Brain Building Basics

Brain Building Image

Combining Tags

This content “batching” will also allow you to test your work along the way, get feedback and adjust your approach, if necessary. Content batching can also help break the adaptation process down into manageable blocks of work for you as well as our review and approvals process. 

When you adapt Vroom Content, we recommend breaking up the process into smaller pieces using these tags. Then you can prioritize the content that is most relevant for your audience and program.  

Using Tags as You Adapt

Using Tags as you Adapt - Image

For your application for an A.L.T. Vroom Content License, you will want to think through who in your organization will take on different parts of the adaptation process and which parts of your organization will be involved.  

Questions to Consider

You will want to consider the following questions:

A Sample Activation Plan

Here is an example of the planning process suggested by Child Care Aware of America:

Once Vroom Tips are adapted, they must be submitted to Vroom for approval.  


Vroom Approval

Remember [this process](https://www.vroom.org/for-professionals/adapting-vroom-content/page-2#:~:text=Steps%20to%20Adapting%20Vroom%20Content)? 

1. Toolkit
2. Application 
3. Application Review 
4. License Approval
5. Content Adaptation and Materials Development 
6. Adaptation and Materials Review 
7. Feedback and Iteration 
8. Approval

Review Process

Review Process - Body

Your Responsibilities

All adaptations of Vroom Content and uses of Vroom Trademarks __must be reviewed__ by Vroom prior to use.   

Don't Forget

Before using or distributing adapted content

Here is a sample of the form we will ask you to use as you submit your adapted tips back to Vroom for review and feedback. There may be a few rounds of back-and-forth until an adapted tip is approved. 

Vroom Tip Adaptation Template

If you adapt Vroom Tips, you will need to ensure each one still has all four essential elements. 

Quick Check: Adaptation Review

You are almost done! Before you move on to starting your Vroom Content License application, we’ll look with a little more detail at the critical adaptation parameters. 

Adaptation Guidelines

Adaptation Do's & Don'ts

Keep language simple and accessible. All adapted Vroom Content should be at or below a primary school level. 

Simple Modifications

NSPCC Example - title

General Changes (NSPCC Example)

Example Vroom Tip with minor changes

Example Sample Modifications

Pre-approved Adaptations

Remember, all final versions of content, including visual adaptations, must be submitted to Vroom for final review, approval, and archiving.  These adaptations may be shared with other communities.   