Nation evaluation group uneg originally published the evaluation competencies in 2008 for heads of evaluation departments and evaluators. Impact evaluation evaluation of the effectoutcome changes of behaviour and energy saved. Tools and guidance dimensions of evaluation quality. Development assistance committee, ocdegd91208, organisation for economic cooperation and development, paris, 1991, reprinted 2008. Evaluation is the systematic assessment of the design, implementation or results of an initiative for the purposes of learning or decisionmaking. Impact evaluation aims to determine changes in a given quality in individuals, households, communities or. Evaluation practice handbook world health organization.
Uneg s new strategy is now available, and outlines uneg s selfdefined role, vision and mission, and strategic objectives for 20202024 ilo annual evaluation report 20182019 learn more about the contribution of evaluation to the ilo and the road ahead in the new annual evaluation report 201819. There are a variety of evaluation designs, and the type of evaluation should match the development level of the program or program activity appropriately. United nations evaluation group uneg updated norms and standards for evaluation. Evaluation ethics, politics, standards, and guiding principles. However, care must be taken about generalizing from a specific context. Uneg norms and standards for evaluation, and unegs large archive of published reference books, are global public goods documenting best practices. Review of ethics principles and guidance in evaluation and. Therefore, to perform an impact evaluation, it is necessary to select a comparison group to represent the beneficiaries.
The 2005 norms and standards sought to facilitate systemwide collaboration on evaluation by ensuring that uneg members adhered to shared basic principles and applied best practices in managing, conducting and using evaluations. Some definitions focus on very precise understandings of impact, while others cast a much broader net. Reports should address the unicefadapted uneg evaluation reports standards. Ethics are a set of values and beliefs that guide choices. Uneg good practice guidelines for follow up to evaluations. Ecd, due to differing views of the purpose of ecd and of evaluation capacity itself bohni nielsen s. In 2005, uneg adopted the foundational document, norms and standards for evaluation in the united nations system. Used consistently, they help embed highquality evaluation. For the last ten years, it has been used successfully to strengthen and harmonize evaluation practice and has served as a key reference for evaluators around the globe. United nations evaluation group uneg united nations. An evaluation should be as systematic and impartial as possible uneg, 2005. Evaluation ethics, politics, standards, and guiding principles international program for development evaluation training. This assessment may lead to the formulation of potential improvements in the evaluation policy and practice. In line with uneg standards and norms, an evaluation is an assessment, as systematic and impartial as possible, of an activity, project, programme, strategy, policy, topic, theme, sector.
The analysis and recommendations of this document do not necessarily. Uneg originally published the evaluation competencies in 2008 for heads of evaluation departments and evaluators. Understanding of human rightsbased approaches to programming. Impact and impact evaluation in the ilo impact evaluation the ilo aligns itself with the united nations evaluation group uneg definitions and methodologies for ie. Outline of principles of impact evalation discussion dra.
A quarterly knowledge publication from independent development evaluation at the african development bank group introduction declared the international year of evaluation by evalpartners, 2015 appears to be the right moment to reflect on the rationale and challenges for performing impact evaluations of development programs. Describe the evaluations purpose and research questions give background on the program and its theory of change, with. Dac evaluation network, the united nations evaluation group uneg, the evaluation. Overview of impact evaluation page 2 an impact evaluation should only be undertaken when its intended use can be clearly identified and when it is likely to be able to produce useful findings, taking into account the availability of resources and the timing of decisions about the programme or policy under investigation. However, the last decade has witnessed many changes in global. An impact evaluation defines impact as the difference between the situation of the beneficiaries after the program and the hypothetical situation they would be living in had they not participated in it. Uneg quality checklist for evaluation terms of reference and inception reports. These revisions reflect the substantial consensus that evaluation competencies are important not only for evaluators and evaluation unit heads, but also for evaluation. At cdc, program evaluation supports our agency priorities. This corporate evaluation strategy 20162021, endorsed by the executive management. This means that an impact evaluation must establish what has been the cause of observed changes in this case impacts referred to as causal attribution also referred to as causal inference. It initially conducted research among uneg member evaluation units to establish the current status of and experience with impact evaluation in their programmes. The economic and social research council esrc framework for research ethics 2015 offers the following interpretation of ethics as the moral principles guiding research, from.
Guidance on selection, planning and management, 20. These revisions reflect the substantial consensus that evaluation competencies are important not only for evaluators and evaluation unit heads, but also for evaluation commissioners and users. Network of netorks on impact evaluation nonie is a network of networks for impact evaluation comprised of the organisation for economic cooperation and developments development assistance committee oecddac evaluation network, the united nations evaluation group uneg, the evaluation cooperation group ecg, and the international organization for cooperation in evaluation iocea. An impact evaluation approach which unpacks an initiatives theory of change, provides a framework to collect data on immediate, basic changes that lead to longer, more transformative change, and allows for the plausible assessment of the initiatives contribution to results via boundary partners. Please note that different classifications exist but the taxonomy is not important in.
Its main aim is to provide evidence on, and analyze the key issues, major strategic implications and urgent priorities facing uneg and its membership in the context of the agenda 2030. Types and uses of evaluation in order to plan the evaluation in accord with the most appropriate evaluation method, it is necessary to understand the difference between evaluation types. Uneg norms and standards united nations evaluation group. Integrating human rights and gender equality in evaluation towards uneg guidance.
The united nations evaluation group uneg norms and standards for evaluation, adopted in 2005, has served as a landmark document for the united nations and beyond. Evaluates a program during development in order to make early improvements. When programs conduct strong, practical evaluations on a routine basis, the findings are better positioned to. To assist in the early phases of program development. This guidance document was prepared by the uneg impact evaluation task. An evaluation is methodical, providing information that is credible, reliable, and useful to enable the. Types of evaluation centers for disease control and. Specialized experience andor methodological technical knowledge, including some specific data collection and analytical skills, may be particularly useful in the following areas. Beginning with the need for a theorydriven evaluation, and ending with a set of concrete tools to use in running an evaluation, they cover a range of practical materials useful for organizations that are considering a rigorous impact evaluation. Based on the uneg norms and standards for evaluation, this checklist. An impact evaluation provides information about the impacts produced by an intervention positive and negative, intended and unintended, direct and indirect. Uneg norms and standards for evaluation 2016 better.
A fundamental element of ie is establishing cause and effect chains to show if an intervention has worked and, if so, how. The evaluation process normally involves some identification of relevant standards. Purpose of impact evaluation impact evaluation serves both objectives of evaluation. Instead, there are many different sets of guidelines covering different aspects of the evaluation process see actionaid undated, uneg 2011. How impact is defined and used has a significantmessages effect on the design, management and evaluation of development programmes. Whos evaluation policy is based on the uneg definition of evaluation uneg. Program evaluation is an essential organizational practice in public health.
What strategies can we use to improve this program. Session 1 impact evaluation methodologies impact evaluation workshop, lilongwe, dec. Detail of uneg quality checklist for evaluation reports. Undp outcome evaluations should be timed to feed into the undaf evaluation and. Uneg norms and standards for evaluation 2016 evaluation. Uneg norms and standards for evaluation, and uneg s large archive of published reference books, are global public goods documenting best practices. Nonie is a network of networks for impact evaluation comprised of the organisation for. Instead, it is important to give adequate consideration to the various aspects of. The evaluation charter, issued by the executive director in may 2016, confirms the mandate and governance of the evaluation function, and establishes the necessary staff authorities, roles and institutional arrangements to operationalise the policy. Quality assessment system for decentralized evaluation. Evaluation guidelines united nations development programme. It initially conducted research among uneg member evaluation units to establish the current status of and experience with impact evaluation. United nations evaluation group uneg uneg was established in january 1984 as the interagency working group on evaluation iawg. How it works there is no specific methodology for carrying out a genderresponsive evaluation.
1196 924 204 174 378 205 267 1484 331 1211 228 1240 1465 492 303 557 86 488 1256 990 149 864 560 76 734 921 379 366 1550 975 75 308 843 1452 1349 1287 1166 1292