Impact evaluation aims to determine changes in a given quality in individuals, households, communities or. Tools and guidance dimensions of evaluation quality. An impact evaluation provides information about the impacts produced by an intervention positive and negative, intended and unintended, direct and indirect. Instead, there are many different sets of guidelines covering different aspects of the evaluation process see actionaid undated, uneg 2011. Based on the uneg norms and standards for evaluation, this checklist. Evaluation ethics, politics, standards, and guiding principles. Evaluation guidelines united nations development programme. Reports should address the unicefadapted uneg evaluation reports standards. Evaluation is an important source of evidence of the achievement of results and institutional performance. An evaluation should be as systematic and impartial as possible uneg, 2005. Ecd, due to differing views of the purpose of ecd and of evaluation capacity itself bohni nielsen s.
Uneg norms and standards for evaluation, and unegs large archive of published reference books, are global public goods documenting best practices. United nations evaluation group uneg updated norms and standards for evaluation. This means that an impact evaluation must establish what has been the cause of observed changes in this case impacts referred to as causal attribution also referred to as causal inference. The economic and social research council esrc framework for research ethics 2015 offers the following interpretation of ethics as the moral principles guiding research, from. Evaluation stage of the training cyclereporting, use and followup phase of the evaluation 35 tools and methods for evaluating training for gender equality 38 reaction 38 learning 39 behaviour 40 results impact 41 statement. Impact and impact evaluation in the ilo impact evaluation the ilo aligns itself with the united nations evaluation group uneg definitions and methodologies for ie.
Instead, it is important to give adequate consideration to the various aspects of. Uneg norms and standards united nations evaluation group. Beginning with the need for a theorydriven evaluation, and ending with a set of concrete tools to use in running an evaluation, they cover a range of practical materials useful for organizations that are considering a rigorous impact evaluation. This assessment may lead to the formulation of potential improvements in the evaluation policy and practice. How it works there is no specific methodology for carrying out a genderresponsive evaluation. Goldilocks resource resources and tools for impact evaluation. Nonie is a network of networks for impact evaluation comprised of the organisation for. Evaluation ethics, politics, standards, and guiding principles international program for development evaluation training.
These revisions reflect the substantial consensus that evaluation competencies are important not only for evaluators and evaluation unit heads, but also for evaluation. Understanding of human rightsbased approaches to programming. At cdc, program evaluation supports our agency priorities. Review of ethics principles and guidance in evaluation and. The evaluation process normally involves some identification of relevant standards. An impact evaluation approach which unpacks an initiatives theory of change, provides a framework to collect data on immediate, basic changes that lead to longer, more transformative change, and allows for the plausible assessment of the initiatives contribution to results via boundary partners. Please note that different classifications exist but the taxonomy is not important in. It initially conducted research among uneg member evaluation units to establish the current status of and experience with impact evaluation in their programmes. Session 1 impact evaluation methodologies impact evaluation workshop, lilongwe, dec. What strategies can we use to improve this program.
United nations evaluation group uneg, as a group of professional practitioners, undertook to define norms that aim at contributing to the professionalization of the evaluation function and at providing guidance to evaluation offices in preparing their evaluation policies or other aspects of their operations. Dac evaluation network, the united nations evaluation group uneg, the evaluation. A fundamental element of ie is establishing cause and effect chains to show if an intervention has worked and, if so, how. Evaluation practice handbook world health organization. The united nations evaluation group uneg norms and standards for evaluation, adopted in 2005, has served as a landmark document for the united nations and beyond. To assist in the early phases of program development. Outline of principles of impact evalation discussion dra. Uneg norms and standards for evaluation 2016 better.
Specialized experience andor methodological technical knowledge, including some specific data collection and analytical skills, may be particularly useful in the following areas. Quality assessment system for decentralized evaluation. The evaluation charter, issued by the executive director in may 2016, confirms the mandate and governance of the evaluation function, and establishes the necessary staff authorities, roles and institutional arrangements to operationalise the policy. In 2005, uneg adopted the foundational document, norms and standards for evaluation in the united nations system. Guidance on selection, planning and management, 20. Used consistently, they help embed highquality evaluation. Uneg good practice guidelines for follow up to evaluations.
In line with uneg standards and norms, an evaluation is an assessment, as systematic and impartial as possible, of an activity, project, programme, strategy, policy, topic, theme, sector. United nations evaluation group uneg united nations. Evaluation may focus on a broad range of topics including relevance, accessibility, comprehensiveness, integration, fulfillment of objectives, effectiveness, impact, cost, efficiency, and sustainability patton, 1997. Uneg quality checklist for evaluation terms of reference and inception reports. The 2005 norms and standards sought to facilitate systemwide collaboration on evaluation by ensuring that uneg members adhered to shared basic principles and applied best practices in managing, conducting and using evaluations. Therefore, to perform an impact evaluation, it is necessary to select a comparison group to represent the beneficiaries. Evaluation is the systematic assessment of the design, implementation or results of an initiative for the purposes of learning or decisionmaking. Ethics are a set of values and beliefs that guide choices.
Whos evaluation policy is based on the uneg definition of evaluation uneg. Network of netorks on impact evaluation nonie is a network of networks for impact evaluation comprised of the organisation for economic cooperation and developments development assistance committee oecddac evaluation network, the united nations evaluation group uneg, the evaluation cooperation group ecg, and the international organization for cooperation in evaluation iocea. Program evaluation is an essential organizational practice in public health. Types of evaluation centers for disease control and. Uneg s new strategy is now available, and outlines uneg s selfdefined role, vision and mission, and strategic objectives for 20202024 ilo annual evaluation report 20182019 learn more about the contribution of evaluation to the ilo and the road ahead in the new annual evaluation report 201819. An evaluation is methodical, providing information that is credible, reliable, and useful to enable the. However, care must be taken about generalizing from a specific context. Development assistance committee, ocdegd91208, organisation for economic cooperation and development, paris, 1991, reprinted 2008. Nation evaluation group uneg originally published the evaluation competencies in 2008 for heads of evaluation departments and evaluators. Types and uses of evaluation in order to plan the evaluation in accord with the most appropriate evaluation method, it is necessary to understand the difference between evaluation types. Overview of impact evaluation, methodological briefs. Evaluates a program during development in order to make early improvements. It initially conducted research among uneg member evaluation units to establish the current status of and experience with impact evaluation. Some definitions focus on very precise understandings of impact, while others cast a much broader net.
Uneg norms and standards for evaluation, and uneg s large archive of published reference books, are global public goods documenting best practices. When programs conduct strong, practical evaluations on a routine basis, the findings are better positioned to. This guidance document was prepared by the uneg impact evaluation task. Undp outcome evaluations should be timed to feed into the undaf evaluation and.
Goldilocks assembled this set of resources for use in designing and running an impact evaluation. This corporate evaluation strategy 20162021, endorsed by the executive management. These revisions reflect the substantial consensus that evaluation competencies are important not only for evaluators and evaluation unit heads, but also for evaluation commissioners and users. United nations evaluation group uneg uneg was established in january 1984 as the interagency working group on evaluation iawg. A quarterly knowledge publication from independent development evaluation at the african development bank group introduction declared the international year of evaluation by evalpartners, 2015 appears to be the right moment to reflect on the rationale and challenges for performing impact evaluations of development programs.
Uneg norms and standards for evaluation 2016 evaluation. Overview of impact evaluation page 2 an impact evaluation should only be undertaken when its intended use can be clearly identified and when it is likely to be able to produce useful findings, taking into account the availability of resources and the timing of decisions about the programme or policy under investigation. Describe the evaluations purpose and research questions give background on the program and its theory of change, with. In particular, the executive coordinator presented the 20172018 annual and financial. The analysis and recommendations of this document do not necessarily. An impact evaluation defines impact as the difference between the situation of the beneficiaries after the program and the hypothetical situation they would be living in had they not participated in it. Impact evaluation evaluation of the effectoutcome changes of behaviour and energy saved. Integrating human rights and gender equality in evaluation towards uneg guidance. Its main aim is to provide evidence on, and analyze the key issues, major strategic implications and urgent priorities facing uneg and its membership in the context of the agenda 2030. However, the last decade has witnessed many changes in global. For the last ten years, it has been used successfully to strengthen and harmonize evaluation practice and has served as a key reference for evaluators around the globe. Uneg originally published the evaluation competencies in 2008 for heads of evaluation departments and evaluators. How impact is defined and used has a significantmessages effect on the design, management and evaluation of development programmes. There are a variety of evaluation designs, and the type of evaluation should match the development level of the program or program activity appropriately.
516 656 333 552 1435 918 1084 31 852 1487 1214 1560 209 898 186 421 210 1098 371 228 319 450 163 1547 557 1444 1464 1296 226 617 481 653 852 327 932 551 1138