Methods and Tools

Methodology

Evaluation at UNODC is a process that assesses systematically and objectively the achievement of outcomes in the light of the relevance, efficiency, effectiveness, impact and sustainability of ongoing and completed projects and programmes against expected or planned results. It measures what has been achieved both positive and negative and lays emphasis on the assessment of outcomes and impacts rather than the delivery of outputs. Evaluation assesses the entire project cycle, taking stock of delivery mechanisms, constraints, weaknesses and learning where progress has not been made. Evaluation looks for significant lessons to be learned. It is a management tool for decision-making by management and provides an independent accountability system for member states.

Approach

Strategic Actions - A number of strategic actions must be taken in the short to medium term to ensure that a culture of evaluation is developed in UNODC. The execution of an independent evaluation function requires a radical re-orientation of the previous approach to evaluation and demands that evaluation plays a more strategic role and rise to the expectations of member states, donors and UNODC management. This is achieved by the plan that guarantees the evaluation of all major activities within the medium term period. The UNODC management and governing bodies put full responsibility and authority in the Independent Evaluation Unit to execute the strategy and the plan.

Evaluation Work Plan - The work plan is the first step in the implementation of this strategy. The Independent Evaluation Unit in consultation prepares the work plan with stakeholders and with inputs from management. The plan lays emphasis on creating a broad understanding of what UNODC has achieved by measuring performance at different levels. The realisation of this plan will however dependent on the commitment by member states and donors to provide the necessary resources for the implementation of the plan.

Innovation - The approach is innovative but avoids re-inventing the wheel; draws upon the experience of UNODC and others; uses what is available and adapts information and materials for our needs and benefit. It puts the Independent Evaluation Unit on the forefront of evaluation execution.

Training - creates a common understanding of evaluation, common knowledge and evaluation skills that enable programme/project managers to undertake self-evaluations, prepare TORs, facilitate evaluations and utilise evaluation results.

Five Pronged approach - In-depth evaluations, project evaluations, self-evaluations, desk evaluations and special studies provide a wide coverage of UNODC activities even when the samples for larger projects may be small.

Evaluation Tools

Basic Documents

Policy and Responsibilities

Conducting Evaluations

Strategic Framework Paper

Evaluation Policy - Guiding Principles for Evaluation in UNODC

Terms Of Reference Guidelines

Standards document

Norms for Evaluation in the UN System

Evaluation Report Guidelines

Glossary of terms

Standards for Evaluation in the UN System

Evaluation Assessment Questionnaire

Annual Evaluation Report Cycle and Guidelines

Thematic and Project Evaluation Cycle and Guidelines

Implementation Plan Recommendations