A New Tool Assesses Capacity Development Gains
Development professionals are regularly asked to assess results of Capacity Development programmes – a challenging task that is not always easily carried out. But a new tool, called the Rapid Assessment of Capacity, or RAC, has been designed with the intention of being fast, effective and low cost to implement.
Assessing programme outcomes is difficult and becomes even more difficult when measuring Capacity Development, where areas of action and deliverables are not always easily calculated.
However, the new RAC tool assesses the Capacity Development gains of a programme, making it easer to follow the contribution between Capacity Development support (like Technical Cooperation) and the chain of results.
The RAC is built on the logic structure of a more elaborated evaluation methodology and uses a mix of periodic assessments and ad hoc rapid survey methods so as to allow a standardised and recurrent assessment of the results of Capacity Development programmes.
The recent application of the RAC in Bolivia, Chad and Ukraine also offered useful inputs for the finalisation of the methodology.
The three cases presented very different opportunity frameworks and the motivation of the institutions and staff involved was very different in each instance. Thus, they provided a diversified sample for testing.
Jaime Rojas Elgueta, a consultant working with the Development Researchers’ Network used the new tool in Bolivia and is positive about its advantages.
“RAC is not an evaluation of the results of a given programme but rather an evaluation of how the programme has influenced the development of capacities of both the institutions and the individuals that interact with the programme,” said Mr Rojas Elgueta.
“This allows having, in a short time and with reduced costs, a concrete overview on how the capacities of cooperation programme stakeholders’ are being developed,” he said.
The interesting feature, which worked well in Bolivia, is that the coaching approach allows the evaluated persons and organisations to take an active part in the evaulation exercise.
The approach consists of creating a space for dialogue between different persons that have a common objective. The questions are not only asked by the evaluator but also between the colleagues themselves. No one is better placed to help identify new capacities than colleagues who work together. As a result, such participation can be an eye-opener for the evaluated persons and therefore be beneficial for the organisation itself.
The term Capacity Development, which emerged in international development in the 1990s, has since grown to be included in most cooperation programmes run by international development organisations. Greater information on Capacity Development trends can be of considerable assistance to development professionals, said Mr Rojas Elgueta, as it enables better forward planning and efficiency.
|For more information....|
Go to the Public Group on Capacity Development & Technical Cooperation Reform or on the Capacity Development & Technical Reform topic page.
For more details and downloads directly pertaining to RAC, visit this recent event page: http://capacity4dev.ec.europa.eu/public-cd-tc/event/capacity-development...
A full transcript of the interview with Mr Rojas Elgueta is available below:
JAIME ROJAS ELGUETA INTERVIEW ON THE RAC METHODOLOGY
Jaime Rojas Elgueta works for the Development Researchers Network, DRN.
1st question: What is the rapid assessment of capacity, or ‘RAC’?
The RAC (Rapid assessment of Capacity development) is a new evaluation tool that aims at evaluating the impact of the effects of a particular programme within the interaction processes of the individuals that participate in the given programme.
The RAC is not an evaluation of the results of a given programme but rather an evaluation of how the programme has influenced the development of capacities of both the institutions and the individuals that interact with the programme.
This allows having, in a short time, and with reduced costs, a concrete overview on how the capacities of cooperation programme stakeholders’ are being developed.
2nd question: can you please tell me how this method worked in Bolivia?
In Bolivia, we had the opportunity to test this new tool, the RAC, within the framework of a budget support programme to one of the key policies of the Bolivian Government, which is the Integral development with Coca policy. This is a four-year programme, with an EC contribution of 26 million Euro.
The characteristic of the RAC test was the possibility to work closely with the persons involved in the programme. The main characteristic, or the first step, was to make the interlocutors understand that we were not evaluating the results of the budget support programme but that our objective was to evaluate the impact of the activities and of the interactions undertaken by the programme with the different governmental interlocutors and with the final beneficiaries, which were the coca producer communities.
This allowed introducing a new tool into the RAC, that can be called either co-coaching or direct dialogue. That is to say that the evaluated persons had an active role in the evaluation, therefore obtaining immediate results in terms of identifying, detecting and observing which individual and organizational capacities were developed thanks to the interaction with the cooperation programme.
Furthermore, it has to be added that the interlocutors’ response, both from the political interlocutors (our interlocutors were the vice-ministry for integral development with Coca, the staff from the vice-ministry, other ministries, such as the Public Finance Ministry) but also from the communities, was an instant interest to participate in the evaluation; they perceived the advantages of this type of instrument.
3rd question: what’s the ‘value added’ of this type of coaching?
The value added of this instrument, other than what we have already said (which is the rapidity, the short period of time required to apply the RAC, the reduced cost and the immediacy of the results) is the possibility to have an exchange and a direct dialogue between the evaluators, the evaluated persons and institutions and the donors themselves. In the specific case of Bolivia, there was an active and direct participation of the EU Delegation in the country, in particular of the Head of Cooperation and of the persons in charge of the programme. We can therefore state that one of the values added is that of having an immediate and non intrusive instrument that allows the participation of all stakeholders.
Another value added is that the RAC results are both qualitative and quantitative. This allows having the necessary elements to observe, correct or reorient the cooperation strategies and policies in a given sector of intervention or in a given country. While the evaluations of results provide information on a specific programme, the type of information on the capacity development allows having a more political and strategic overview: which are the trends, what is happening with the development of capacities, which are the capacities that allow strengthening or increase the partnership relationship with the institutions and governments. This would be the main value added of the instrument.
The co-coaching, that allows the evaluated to be an active part in the evaluation exercise, introduces the dialogue, which is nothing more than an open dialogue between the evaluators and the evaluated but also between the evaluated themselves. It consists on creating a space for dialogue between different persons that have a common objective. For example, when we ask the persons that have participated in a programme, which are the capacities, the new capacities, what is the learning process… it is not only asked by the evaluator but also between the colleagues themselves. Who is better placed than the persons working together to help the others establish, to identify, which are the new capacities? One of the instant results to the participants is to be able to observe, to be aware of the new capacities: what have I learned from this programme, how is my career path evolving… And this also applies to the institution, because it not only assesses the individual capacities but also those of the institution, those of an organizational nature.