ECHO's proposal and operational contract forms are such that the project proposals contain little information that can be used when assessing impact (see paragraph 5.12);
the narrative reports provided at the end of the contract are usually too vague to allow a precise evaluation of impact.
5.34. The evaluations contracted by ECHO, which are frequently carried out before the end of the project, discuss impact in general terms only. If the evaluator considers that the beneficiaries were reasonably well targeted, and the aid arrived, then the impact is assumed to have been good. Thus, for example the evaluations of the programmes of aid to Azerbaijan between 1992 and 1995 (totalling some 40 Mio ECU) observed that, in the health sector, all projects were considered to have had an important impact on the improvement of health care available to the refugees, but this was based on qualitative rather than quantitative assessments (73).
5.35. In a few rather isolated cases among those audited, there were some more precise indications of the impact of the intervention. Thus, for example, one NGO in Angola was able to close a semi-intensive nutritional centre in a camp for the displaced following a survey which showed that the level of malnutrition amongst children under five had declined to a level which no longer justified keeping the centre open.
5.36. The difficulty in measuring the impact of humanitarian aid operations means that particular attention needs to be paid to requiring partners to specify in their proposals what indicators will be monitored to assess impact. In addition to impact indicators, consideration should be given to specifying performance indicators: for example, whether seed distributions were carried out in time for the planting season, how intensively equipment will be used, as well as whether it was delivered on time.
Cost-effectiveness
5.37. Cost-effectiveness involves the use of economic criteria for evaluating operations. If an intervention is decided on non-economic criteria - for example, the use of an airlift to transport food supplies to a small, isolated population that is starving, or the establishment of intensive feeding facilities to help malnourished children -, the most that can be done is to examine whether the solution adopted was the least-cost one commensurate with achieving the desired result.