, Special Report No 2/97 concerning humanitarian aid from the European Union between 1992…

In forcesince 20 Feb 1997
b)

up to the end of 1995, attention was primarily focused on evaluating individual contracts, rather than programmes (66). This reflects the contract-based approach of ECHO as a whole (see paragraph 3.16). Even where ECHO contracted a consultant to evaluate a number of contracts of the same type in the same country at the same time (67), a report presenting common findings was not requested.

c)

to date, ECHO has not carried out joint evaluations where it is providing part of the financing. In the evaluation report on ECHO's contracts with the WFP for food aid to Tadjikistan covering the period April to December 1994, the consultant noted that the ECHO contracts could not be evaluated as a separate operation because they were part of the overall food support programme of the WFP. A joint evaluation with the WFP would have been preferable;

d)

the evaluators are not requested to present observations on the performance of ECHO in the various stages of the contract, either at headquarters or in the field. In a few cases, when they consider it essential for the assessment, the evaluators nonetheless raise such observations: this should be a standard part of the terms of reference (68);

e)

the mechanisms by which the results of the evaluations are fed back into the operational departments were not clear. Although the desks responsible for the operations were associated with evaluations from the outset, the findings were not more widely diffused throughout the departments, so that lessons learned in one area could have an impact on the design of operations in another area;

f)

several of the consultants point out that their evaluations are hampered by the inadequate statements of objectives, scope, work programme or identification of beneficiaries in the project proposals (69) (see paragraph 3.13).

5.4. Some of these shortcomings are being addressed by the Evaluation Unit, through the Manual, and the development of a database on findings. There remains, however, a need for the evaluations to cover the performance of ECHO explicitly.