Evaluation

An evaluation is an assessment of a project to determine its impact and effectiveness. There are two main types of evaluations: formative and summative. Formative evaluations are ongoing evaluations during your project that may result in changes during its lifespan. Summative evaluations take place after the project’s completion and measure the project’s success.

Before beginning an evaluation, identify a specific change that your project is seeking. Evaluating the impact of your program may refer back to changes that were also monitored throughout the project, such as changes in attitudes, behaviors and relationships.

To plan an evaluation for your P/CVE project, the Center on Global Counterterrorism Cooperation (CGCC) suggests a series of steps:

1
Details
Define the purpose
2
Details
Determine the scope
3
Details
Identify an evaluator
4
Details
Selecting content
5
Details
Develop measurable indicators

These steps are further explained in the context of P/CVE programming in this resource.

Hedayah describes the types of evaluations that can be used for a P/CVE project, as shown in the table below.

Evaluation methods do not necessarily focus on whether the specific objective has been achieved but take into account a broader spectrum of variables. The diverse evaluation methods are not exclusive of one another and the same result (output/outcome/input) might be relevant for different methods.

Line of sight evaluation to evaluate if projects are aligned with CVE program outcomes and capabilities. In this type of evaluation, the aim is to measure and evaluate the design and effort of the program itself. Some key indicators might be:
  • The presence of a Theory of Change for the program
  • Activities that support outcomes and outputs
  • Outcomes and outputs that support the goal or objective
  • Sufficient resources to carry out program activities
  • Number of courses delivered, number of hours spent, or number of trainees taught
Project effectiveness evaluation to evaluate how projects meet their stated objectives. In this case, the measurement and evaluation is of performance of the program or project. Some key indicators might be:
  • Completion of program
  • Reach and scope in alignment with target
  • Budget spent to maximum capability
  • Resources (time and staff) utilized efficiently
Program benefit evaluation to evaluate if program outcomes result in desired benefits. Some key indicators might be:
  • Added value to the community of recipients and/or target population
  • Added value to the institutional frameworks of the recipients and/or target population
Outcomes evaluation to evaluate if projects contribute to program outcomes, and measure the effect of the program on the recipients. Some key indicators might be:
  • Change in attitude of recipients and/or target population
  • Change in behavior of recipients and/or target population
Program impact evaluation to evaluate if program benefits help realize the vision. Some key indicators might be:
  • Reduction of number of violent in Location X across Time Y
  • Reduction in percentage of population supporting violent extremism in Location X across Time Y