Implementation Evaluation asks about the practical lessons that emerge from putting a new project into action.  Rarely does a project go off without a hitch.  Lessons learned in implementation help grantees identify where their approach may need modifying and what critical next steps are needed.  In turn, these lessons can help others wishing to replicate grantees’ work avoid the pitfalls grantees experienced.  Finally, they teach the Foundation Trustees and staff important lessons that can help us improve our grantmaking capacity.

Implementation Evaluation is the appropriate focus for evaluation of:

• Demonstration projects for training or service delivery where the intervention/training model is still undergoing development
• Projects that seek to replicate an existing model in one or more new settings, or with a different population
• Planning and seed grants
• Service expansion grants
• Technical assistance grants
• Advocacy/Community Organizing Grants

Evaluation Questions Related to Project Implementation:

The following questions can guide applicants who feel that implementation evaluation is most appropriate for their proposal. Applicants should outline in the evaluation section of their proposals how they plan to gather information (from whom, at what intervals, and in what manner) to answer these questions. The list is intended to be illustrative — some questions may not be relevant to you, and you may think of others not on the list below that are important to consider. The proposal should document how you will gather information to answer these questions:

• What is your program model (goals, objectives, activities, resource inputs, short- and long-term outcomes, types of clients/participants targeted, timeframe, budget, etc.)?
• What aspects of your original program model were implemented as planned and what had to be changed?
• Why are revisions needed?
• What changes are made, and why did you select these new approaches and discard other options?
• What aspects of the program were felt to work particularly well, and why?
• Is there evidence that any unintended outcomes occur, either positive or negative, for either the program, its staff or for participants? For example, did you receive unexpected publicity, attract new volunteers, connect to new partner organizations, or identify and meet unexpected client needs? Alternately, did the project cause stress among or between staff, divert staff from other responsibilities they have to clients, or cost more than expected?
• How do you explain unintended outcomes?
• Did you confront any barriers that were not anticipated?
• Will you do things differently now, based on lessons learned to date? What next steps will you take/do you recommend to further revise the model and why?
• Are there conditions under which you would recommend that this program or service NOT be used, and why?