1. INTRODUCTION TO THE TOOLKIT

   • About the Toolkit
   • Toolkit Contents
   • Using the Toolkit
   • Case Study Background

2. INTRODUCTION TO EVALUATION

   • Defining Evaluation
   • Purpose of Evaluation
   • Types of Evaluation
   • Challenges to Conducting an Evaluation

   • Who Should Conduct the Evaluation

     • Assessing Readiness
     • Using a Team Approach
     • Using External Evaluators

   • Considerations for Planning

     • Human Subjects Protections
     • Cultural Competency
     • Budgeting for Evaluation
     • Working with Funders

   • Framework for Evaluation

     • Framework Components
     • Evaluation Standards

3. PLAN YOUR EVALUATION

   • Step 1: Engage Stakeholders

     • Engage Stakeholders
     • Identifying Key Stakeholders
     • Engaging Stakeholders
     • Tools and Resources

   • Step 2: Develop a Logic Model

     • Develop a Logic Model
     • What is a Program Description?
     • Introducing Logic Models
     • Creating a Logic Model for Evaluation
     • Tools and Resources

   • Step 3: Focus the Evaluation

     • Focus the Evaluation
     • Decide What to Evaluate
     • Develop Evaluation Questions
     • What Are Indicators?
     • Start the Evaluation Plan
     • Tools and Resources

   • Step 4a: Plan Data Collection

     • Plan Data Collection
     • Identify Data Sources
     • Select Data Collection Methods
     • Tools and Resources

   • Finalize Your Evaluation Plan

     • Identify the Person Responsible and a Timeline
     • Review Your Evaluation Plan
     • Tools and Resources

4. IMPLEMENT YOUR EVALUATION

   • Introduction
   • Review Your Evaluation Plan

   • Step 4b: Collect Data

     • Design Data Collection Instruments
     • Additional Considerations in Data Collection
     • Tools and Resources

   • Step 5: Analyze and Interpret Data

     • Analyze and Interpret Data
     • Organize the Data
     • Analyze the Data and Synthesize Results
     • Interpret the Results
     • Identify Limitations
     • Tools and Resources

   • Step 6: Share Results

     • Share Results
     • Develop Recommendations
     • Communicate the Findings
     • Follow-up
     • Tools and Resources

Develop Recommendations

After you have analyzed the data and determined what can be said about your program, you are ready to develop recommendations. Keep in mind that they are written as "action items" and must be supported by the evidence that you uncovered. They also must be realistic—that is, they must be things that are possible and within the control of decision-makers.

In Section 2, several reasons for conducting an evaluation were discussed, including:

• To measure progress toward goals.

• To determine if the program is effective in achieving the outcomes you want.

• To identify areas where the program could be improved.

Recommendations need to be aligned with the reasons for conducting the evaluation and what you hoped to learn. For example, if your evaluation was conducted for:

• Improving program operations, your recommendations may address ways to make the program more efficient by proposing changes to procedures or to resource allocation and use.

• Improving the program's ability to reach its outcomes, your recommendations may include:

  • Alternative approaches to reach the program outcomes.
  • Areas where training and technical assistance are needed.
  • Strategies to promote successful aspects of the program.

• Determining the future of the program, your recommendations may suggest:

  • Expanding or replicating a successful program to provide additional services.
  • Reducing or terminating a program that is not meeting its outcome.

As always, engaging stakeholders can be very helpful when formulating recommendations. Once your recommendations are written, you will want to communicate them, along with other results from your evaluation, to a wider audience. But before launching your communication efforts, it's good to pilot test your messages and recommendations with those who are closest to your program, to make sure all are comfortable with what is being shared. The next section discusses this further.