Skip to content

Posts tagged ‘think tanks’

Calls for new national think tanks in Africa: one or many?

Calls for new think tanks in Africa are getting more common. But while some see an opportunity for supporting the formation of several think tanks others favour large national Brookings-style centres. One big one or a few small ones?

Read more

Take the initiative: design your own support plans

Think tanks are too passive when it comes to the design of initiatives intended to support them. Funders and contractors treat them as recipients of Aid and think tanks let this happen. Instead, they should take the initiative and improve their negotiation position by developing, in collaboration with others, their own support plans.

Read more

From non-renewable resources to unlimited knowledge

Think tanks are too often focused on public policy: education, health, macroeconomics, etc. But few take notice of key sectors of the economy. There is a need for more think tanks to focus on sectors or industries of great importance to developing countries and target their natural resources: from extractive to knowledge economies.

Read more

An alternative to funding domestic think tanks: bring out the big guns

Should we worry about US think tanks opening offices in developing countries or emerging economies? While the model could present unfair competition to smaller domestic think tanks it can also have positive effects by encouraging new domestic philanthropy and developing research quality.

Read more

ODI’s award-winning online strategy explained

The ODI digital strategy, first outlined in a series of blogs for onthinktanks.org, was awarded Online Strategy of the Year 2012 at the prestigious Digital Communications Awards, held in Berlin on Friday. ODI beat off competition from multinational corporations and specialist digital agencies to claim this major award. This post is based on the speech give to the jury and explains very succinctly what the strategy is and where/why it has worked.

Read more

AusAid’s knowledge sector support programme for Indonesia

By far one of the most interesting programmes related to think tanks out there is AusAid’s Revitalising Indonesia’s knowledge sector for development policy. (But if I could change one thing I’d suggest dropping ‘development’: development policies is what developed countries call developing countries’ policies.) I heard of it last year on a trip to Indonesia to work with some think tanks.

I’ve given the programme some thought and felt it might be appropriate to make public my recommendations to whoever decides to take it on. It should be clear then that I am not supporting any one bid. (I realise I’ve said most of these things a few times before.)

First some responses to the ToRs:

  • As I have mentioned before, I am not too keen on the demand-supply-intermediaries framework used in many studies and interventions. This seems to suggest that there are 1) distinct and non-overlapping roles and that 2) there is a functioning market. While the marketplace is a powerful metaphor it can also be misleading. I’d like to see the programme implemented with an open mind and a view towards creating and developing and better and greater conversation. This, I believe, is a more appropriate metaphor.
  • I also feel that not enough attention has been given to Universities and their vital role in the knowledge sector. Who else will train the future policymakers, thinktankers, NGO staff, journalists, politicians, etc.? Universities and their capacity to nurture future leaders are crucial players of any knowledge sector.
  • Equally, the media, political parties, and the corporate world do not feature in the programme. If other initiatives are dealing with them then the winning bid, I hope, will take them into account and establish links with them. If there aren’t any then I hope they will make provisions to engage with these institutions. Without them think tanks (NGOs and the policymaking bodies of the State) cannot develop in the long run.

Some ideas for the implementation

The bidding parties must think outside the box. Although the programme wants to see think tanks, NGOs and the government strengthened, does this mean that it should only work with these actors? No. To strengthen all three Indonesia needs a constant stream of capable and competent young graduates: economists, sociologists, political scientists, etc. to staff them. And the long-term horizon of the programme would allow for these investments and even to see some returns.

So I would avoid ‘workshops’ for skills and focus my attention on improving the quality of undergraduate and graduate programmes; maybe by introducing modules, by supporting teachers, encouraging secondments from leading international universities, etc. In some cases think tanks’ staff could teach there but always in view of strengthening the teaching and research capacity of the universities themselves -not replacing them.

I would also put a cap on ‘capacity building’ support for organisations. I get a feeling that many organisations exist in a never-ending state of capacity building. I like to compare it with the 35+ year old undergraduates one sometimes finds in state-funded universities in Peru. While it is true that we never stop learning, there should be a limit to the number of years one is allowed to stay in school before graduating. What matters then is that these organisations are supported in learning how to learn by themselves.

When providing core funding the programme needs to make sure that the funds are not just spent; they must be invested. And this investment needs to be seen as an opportunity to create new ideas and not just get better at bidding for more work. I was impressed by CGD’s capacity to think around ideas. When I mention this to other think tanks they tend to respond by saying ‘oh, but they have core funding, we would too could if we had core funding’. Well, this is their chance to prove it.

A good indicator of success should be that the organisations supported do not just change policies but come up with great new ideas that turn the tables and position them as though leaders.

So I would hold awarding the small grants until I see the good ideas. And when they do get funded, why not try funding different ideas about the same problems and promote a public debate? Democracy, after all, is not democracy if the public is not involved and informed.

To support the ‘demand side’ (I am following the ToRs) I would like to se more research on the ‘policy back-box’ being done and widely distributed. Often one of the main barriers to using research is that recommendations get lost in the system; a system that neither researchers or policymakers fully understand. Initiatives like the Institute for Government in the UK are an excellent example of efforts to explain, as much as possible, government to government.

Also to support the demand side I’d recommend to see an effort to systematically review policies and programmes as a way of challenging policymakers to ‘show us the evidence’ behind their decisions. This does not mean, however, that all decisions must be based solely on evidence; but should be informed by it. Lets incorporate impact evaluations to policy choices, for example. A policy quality watchdog? A school of government?

The demand component, too, should target political parties. While the programme may not ‘allow it’ it is possible to use the same research, tools and trainings to be developed for policymakers for politicians. If not directly, maybe the programme should fund civil society organisations to work with parties and support their policymaking capacity.

If the programme addressed universities it would find that think tanks might be forced to join the intermediary component. In any case, an effort should be made to work with or through civil society organisations to support the most important intermediate of all: the media. Without a strong and informed media the public will be left out of the policymaking process. And while this may lead to policy change it will not be sustainable -we know this from recent experience in Latin America where economic reforms have led to growth and prosperity for many but are still highly opposed by a population that feels largely excluded from the process.

In terms of the enabling environment, the ToRs focus too much on public or foreign donor funding. The real challenge is to mobilise local philanthropists. Why not establish philanthropic networks and work with western or regional philanthropists to encourage their Indonesian peers to get involved? And why not target legislation to support this? Donor dialogue, in other words, should read ‘domestic donor dialogue’.

Another key component of the enabling environment is, of course, the availability of capable human resources for research and policy analysis. Why not support universities or encourage Indonesians to ‘return home’ to set up think tanks, work in the government or teach? The Chinese have benefited from this source of capital gain.

Finally, a key environmental issue (it covers all other components) is leadership. My experience is that some of the best think tank directors, like some of the best policymakers, are policy entrepreneurs. In any gathering of think tanks it is easy to see who went to the Kennedy School of Government and just landed the job as director by chance.

In terms of structure and management

Why not include, in the Steering Committee, individuals from national research funds or non-donor philanthropic organisations from other parts of the world? Brazil, India, South Africa, China? Why not include the directors or board members of leading think tanks and universities in the United States, Europe and a few emerging economies (but not ‘international development think tanks, please: they do not engage in mainstream politics like Indonesian think tanks and researchers and so do not really know what these organisations are going through)?

Maybe, too, include the leaders of initiatives such as the Think Tank Initiative, the Think Tank Fund and GDNet. cross-fertilization of ideas is always good.

While the temptation will be to organise the management structure of the programme along the lines of demand, supply, intermediaries and environment, I’d advice against it -or at least to include a matrix structure. Options could include focusing on the different type of organisations supported, the policy issues themselves, or the competencies and skills that the programme wants to develop.

To support these organisations the contractor needs to develop a very detailed and nuanced understanding of them. It is not enough to assume that all face similar challenges and therefore must need the same kind of support. Similar challenges may be the consequence of different causes: staff issues, poor management, an advocacy origin, non-demanding clients, etc. can all explain poor research quality. Therefore I think that staffing the programme with ‘client managers’ that monitor a few organisations at a time would be a good idea. And by monitoring I mean keeping a close link with them and making an effort to get under their skin and understand their organisational culture.

A programme of this size and importance should include a research component on the political economy of research uptake that besides revisiting the diagnostic studies, pays attention to, at least:

  • Philanthropy: barriers and opportunities
  • Political party programmatic capacity
  • The challenges and opportunities faced by the media in Indonesia and its capacity to participate in and promote an informed public policy debate
  • The labour market of experts in Indonesia: who sets the price of research?
  • How are new digital tools changing the way we learn, communicate and participate?

A key role then should be that of a director of research or technical advisor -who should draw from others across the world. Ideally, these studies should be undertaken in Indonesia itself with the intention of ‘making this a researchable subject’ just as we have done in Latin America, for example. But support to oversea the research agenda could come from outside Indonesia. Again, as I have said before (here and via onthinktanks many times before), try to avoid ‘development think tanks and researchers’ and instead look for think tanks and researchers in developing and developed countries focused on the same types of policies that the Indonesia programme wants to influence. International development think tanks do not deal with politics in the same way as the rest of the think tank community does. The work being done by Grupo FARO in Ecuador, CIPPEC in Argentina, and PLAAS and DRUSSA in South Africa, is worth paying attention to.

The technical advisor should be able to draw lessons from across the world rather than be a know-it-all kind of person. Because a key aspect of this role is to adapt and adopt lessons into the Indonesian content he or she must be either Indonesian or very familiar with the country and the community the programme wants to influence.

A weak point and a huge challenge for the programme is its monitoring and evaluation. I am afraid I cannot offer much advice on this expect that it should not be too focused on impact while not paying sufficient attention of the inputs. AusAid should make sure that whatever can be controlled is done properly, only then does it make sense to assess impact; which is beyond the programme’s control. A good alternative is to keep the evaluation of the programme independent from the delivery of the programme and to look for expert impact evaluators based in universities (and therefore with a focus on the discipline) to explore options and develop an appropriate approach for the programme. While the contractor may manage it, it should be under a sub-contract that clearly states the independence of the evaluators. Having one of the partners in the bid in charge of the evaluation is only likely to create disincentives towards objectivity.

As I mentioned in the opening sentences of this post I’ve decided to write this publicly so as to maintain my independence (and that of this blog) in the this process. While I am happy to offer advice to anyone who asks and cares to listen I am not supporting any bid in particular.

Foreign policy think tanks in developing countries

During the last couple of months we have been compiling a list of think tanks dedicated to foreign policy in developing nations. The idea behind this project was to get a better sense of the kind of topics that command the attention of researchers and policy makers when it comes to these nations’ relations to other countries and their interests in the international political arena. We were interested in this type of think tank in particular because, unlike their peers in the social and economic policy fields, domestic, rather than international, funders commonly fund these. And the search for sustainable and domestic sources of funding for think tanks in developing countries is a key concern for onthinktanks.org. The information that we have gathered from this first attempt at an annotated list of foreign policy think tanks has proven to be quite interesting, not only because of what we have found regarding the kind of topics they dedicate themselves to, but also because it brings up issues we have touched upon in the past, such as the use of social media and the nature of their funding. This post provides an analysis of the former.

One of the findings of the exercise is that foreign policy think tanks in developing nations are mostly focused on regional affairs. They care foremost about what is going on in their backyards, and so the topics they choose to research have to do with regional politics. For example, South Asian think tanks have much to do with security studies, be it traditional security or human security. Pakistani and Indian think tanks in particular deal with these issues, and are also interested in ethnic conflict, terrorism, and nuclear proliferation. This is to be expected, as these are also the main concerns of the region. Most Middle Eastern think tanks deal with the Arab–Israeli conflict, particularly those that are of countries directly involved in it. Curiously, they do not seem to focus as much on security studies, when common sense would believe it would be a main point of interest, regarding the volatility of the region.

Latin American foreign policy think tanks dedicate their efforts towards regional cooperation, economic integration, democracy studies, and defense. This is probably the case because there is a current regional integration process going on, UNASUR, and because this region has always been concerned with inserting itself into the international economic system, as well as with democratic stability. Also interesting is that most Latin American think tanks are hosted by universities, which is a good indication that foreign policy is still more of an academic pursuit and that there is, generally, little room for (or interest in) influencing public policy.

We found very few foreign policy think tanks in Africa: our list only includes South Africa. The two think tanks included work on issues such as peacekeeping and conflict management, arms control and disarmament, refugees and internally displaced persons, and economic integration: all relevant topics to African politics today.

Southeast Asian institutions are also mainly interested in national defense, ASEAN membership and impact, and Asia Pacific security. Why so much focus on these issues? There has currently been a significant arms race going on in this part of the world, as the Council on Foreign Relations’ blog Asia Unbound pointed out in 2010:

According to the Stockholm International Peace Research Institute (SIPRI), the amount spent on weapons purchases in Southeast Asia nearly doubled between 2005 and 2009 alone, with Vietnam recently paying $2.4 billion for Russian submarines and jetfighters designed for attacking ships. Other recent buyers have included Malaysia, which recently spent nearly $1 billion on new submarines of its own, and Thailand, which has drawn up its own shopping list of submarines and more advanced jet fighters, while Indonesia and Singapore also have announced recent sizable arms purchases.

Countries like Vietnam and Malaysia are arming up to send a signal to a rising China that they will continue to protect their strategic interests and their claims to energy resources in areas like the South China Sea, the Mekong basin, and other regions. And though China has not deviated from its increasingly aggressive approach to Southeast Asia, these arms figures should give it pause.

Another explanation for why there seem to be so many foreign policy and security focused think tanks in this region is these countries’ developmental state and the regional dynamics that emerged between them. Their developmental status and proximity to each other has caused them to be in constant competition and so their relations with each other, as well as their security, are a main point of concern.

Another fact that called our attention was the high number of foreign policy think tanks in China. These, of course, are all either totally government-funded or have some link to the state. As mentioned in a previous post, Chinese think tanks are expected to conduct research and policy analysis on domestic, regional and global issues, assisting the government in policy formulation. This investment clearly signals that China is looking for a position of leadership in the future and explains the wide variety of topics that its think tanks focus on: new trends in international trade, security, Sino-American relations, regional cooperation, and most telling of all, regional studies. All of the think tanks included in the list had significant departments on most of the regions of the world, which suggests that the Chinese government wants to be well informed far beyond its backyard.

Finally, it appears that foreign policy think tanks go beyond regional interests when their own nations have broader aspirations. The Chinese case is clear, but this can also be said for South Africa, Brazil and Mexico. Mexico´s close ties to the United States may explain academic interest in foreign policy affairs; as for Brazil, it is known that it looks to lead Latin America, particularly through UNASUR. Also, it is safe to say that South Africa is one of the most developed countries of Africa, and so researchers can branch out and dedicate themselves to topics that for the most part dominate African think tanks, like economic development.

In future posts we will explore other aspects of this community of think tanks. If you would like to contribute to the list please get in contact with a.moncada56@gmail.com / @Andriu56, comment this blog, or simply update the list directly on Wikipedia (and in the meantime help make knowledge public).

What social media and digital tools are think tanks using in their work? Views from a short clinic at the Think Tank Initiative Exchange 2012

What is the state of play for the use of digital tools in African, Asian and Latin American think tanks? A clinic I ran at the Think Tank Initiative Exchange 2012 in Cape Town found a good range of experiences with numerous tools and left me feeling positive that think tanks aren’t sticking their head in the sand in the face of the changes wrought by ‘digital disruption’ (at least for the self-selecting think tanks in the room).

Read more

Public funds for public policy research in Latin America: a study by Lardone and Roggero

Think tanks in Latin America are mostly dependent on private and foreign funding, while governments don’t have a policy toward funding them and the social sciences sector as a whole.  This is the conclusion that Martín Lardone and Marcos Roggero came to in Vínculos entre conocimiento y política: el rol de la investigación en el debate public en América Latina (edited by Norma Correa and Enrique Mendizabal). In their study about the role of the government in public policy research funding in Latin America, they found that governments in the region have a narrow view of research promotion so that regular public funding is mainly directed to “hard sciences” –biochemistry, medicine, agriculture, etc.-, leaving a marginal share of funding for the social sciences.

Lardone and Roggero identified two clear research funding mechanisms:

  •  on-budget, programmatic financingon a stable, systematic and structural basis that works along a long-term, permanent policy on research as a tool for development of a country and which has h a fixed allocation in the national budget through ministries, public agencies or universities; and
  • non-programmatic financing thatworks in an unstable and non-systematic way, funding researchers on a project-to-project basis.

The authors concluded that programmatic financing tends to favour research done in universities, well-established entities with fixed budgets, and “hard scientific” research. As an example, only 10% of projects approved by Colombia’s COLCIENCIAS, the national agency responsible for science and technologies, are related to social sciences and education, while the remaining 90% funds natural and exact sciences, engineering, medicine, agriculture, etc.

It is not surprising, either, to find efforts to promote in-house research through public policy research inside ministries and public agencies, such as in Indonesia, which follows a policy of Balitbangs, or government research units.

In Latin America, the large majority of think tanks are private and their finances are weak. They depend on private and foreign funding for international cooperation and foundations from abroad. As mentioned before, think tanks have difficulties to access public funding. The most common way of getting public fund is by offering their own services through short-term contracts, agreements, or sometimes bidding for work in government projects. Unfortunately this means that often projects aren’t longer than a year because governments are subject to one-year budget processes.On the other side, many think tanks in Latin America prefer to be distant from government funds, citing autonomy and independent agenda as key factors for their work.

Nonetheless, various new types of public financing for public policy research are appearing in Latin America, for example:

  1. Governments allocate funds coming from multilateral financers and international organisations (e.g. IADB, World Bank, UNDP) to research.
  2. Governments manage incoming funds from the international cooperation and channelthem to organisations (among them think tanks) through a bidding process. This type of management in being used in Bolivia, through the Vice-Ministry of Public Investment and External Financing. A similar system is employed in Colombia for projects of the Presidential Agency for Social Action and International Cooperation, where organisations participate on a voluntary basis.
  3. Governments channel their own funds through specialised public agencies, as in Costa Rica (that no longer relies on foreign funds) and Brazil, which has an ad-hoc agency for public policy research.
  4. Governments centralise demands for monitoring and evaluation and outsource this work to think tanks as a permanent policy. This is case of Mexico’s CONEVAL, the social development evaluation agency, and in Chile.
  5. Parliaments decide which think tanks to finance as advisers to groups or commissions. This system has been criticised for benefitting think tanks that are related to political parties, but at the same time it is a way of compensating for the governing party’s access to public agencies and information. This system is applied in Chile.

Helping think tanks work together: 10 recommendations for policy research consortia

It has now become obvious that funding for research in developing countries is increasingly provided through global or regional policy research programmes. These programmes have some of the following characteristics:

  • They involve more than one policy research centre, or think tank;
  • These centres are based in more than one country –often in more than one region;
  • They involve a leading centre among them (one that holds the contract, manages the programme, and is ultimately responsible) but others share the lead on various aspects of the programme (for instance, research quality, communications, monitoring and evaluation);
  • Research and communications are coordinated across the centres involved; and
  • The programme often constitutes a small project for the centres involved.

This approach is inspired by a number of assumptions and good intentions but, I am afraid, very little evidence to support them.

  • It assumes that there is research capacity or that it is possible to do research while building capacity to do it. This is possible, sure, but in many cases the capacity of the centres and individual researchers is so low that they would be better off involved in a capacity building programme and not one that has high quality research and policy change as its objectives. Also, differences in capacities across the participating centres does not help cohesion, and in fact damages the relationships between them. The better developed ones feel they are being slowed down by the others.
  • It also assumes that collaboration leads to better research outputs. This is true when researchers are close to each other (less than 10 meters, it seems) or when they know each other quite well. It also helps if they have similar skills and experience.
  • There is also the hope that these multi-centre and multi-country programmes will encourage south-south learning. This assumes that researchers (and policymakers) from developing countries like to learn from each other. Sure, there is nothing wrong with finding out about others but developing country researchers (and policymakers) are more likely to want to learn from their peers in developed countries where resources are more readily available and professional skills and organisational capabilities are more developed. And we must also remember that these centres have mandates to work in their own countries -they may be in developing countries but that does not mean they are part of the international development industry.
  • It also hopes that this collaboration will lead to collective action among the centres. Donors dream that these southern-based organisations will organise and launch global campaigns that can be presented at global events. The truth is that all research policy centres, in the north, the south, the west or the east are more interested in their own politics than on anyone else’s. Researchers, particularly those with an interest in policy, are obviously too busy with participating in the political process. And this is good. This is what we want. Getting them to focus on others (even global policy spaces) is a distraction.

But what worries me most is that these approaches to funding research impose complicated governance structures while limiting the resources available to manage it.

  • Funding for management is limited for most of the programmes I have worked with or know about. This includes limited funds for frequent meetings between the organisations involved, a professional and well-paid management team (including managers in each of the centres –particularly when each are charged with several projects), management systems and processes that may support planning, implementation, and monitoring, and to cover the costs of training and mentoring management staff.
  • Funding for communications is also increasingly limited. Donors are not too sure what to do about this anymore. They want more branded materials (which do not go well with the strategies of the centres’ themselves) but are not too keen on supporting the more general communication efforts of the centres. This is a shame because developing a communication strategy for a single project while the organisation does not have a strategy of its own is not a good idea.
  • Limited funding for communications is linked to limited funding for internal communications and networking. This is also a shame because if the funder wants good research and collective action across several countries in different regions of the world then more (much more) needs to be invested in this.

These things make no sense. If managing consortia and delivering outputs together (while at the same time developing the capacities of several of the researchers and centres) why are not more funds allocated to this?

Here are some recommendations for these programmes:

  1. (If the countries have been pre-defined) produce a baseline that focuses on the role of research in policy for the issue or sector that the consortium is working on: this will help develop the most appropriate strategies in the proposals. Why not do something like what AusAid has done in Indonesia? (If the countries have not been pre-defined) then make this the fist task for the winning consortium: which may mean that the final composition of the consortium should be left open.
  2. (If the countries have been pre-defined) make sure that there is absorptive capacity: or make provisions to do so (see ‘start with the building blocks below’)
  3. The Terms of Reference should focus on objectives but not on how to achieve them: this should be the proposed by the bidding consortia. By focusing on objectives the funder will benefit from more options and multiple approaches. It will be able to choose from the best ideas and even ask their preferred bidder to incorporate them or members of other bids. More ideas are usually good.
  4. The objective should be, where possible, to influence the public policy debate: policy change will come later and when it comes by means of public debate then this change will be more sustainable and will, in the process, strengthen the politics (and practice) of the countries where it happens. The idea that policy change is always a good thing is dangerous. When policy change happens as a consequence of opaque lobbying and undue pressure from internal or external players policymaking institutions that we seek to develop are being undermined. If, on the other hand, change is encouraged via the strengthening of democratic institutions (political parties, bureaucracies, parliaments, the media, civil society, etc.) then we can be sure that more and more evidence will make it into the policymaking process in the future.
  5. Start with the building blocks: if the consortium is new, the funder should first fund efforts to 1) develop the consortium (and this is very difficult) and 2) ensure that capacity is (at least relatively) homogenous across. 2-5 years of this before the consortium is asked to move on with research and policy influence. If possible the leading centre (that holds the contract) should not be charged with developing the capacity of the others: why not include an organisation that has that expertise and role? There are plenty of lessons being learned on this, lets put them into practice.
  6. Spend more on management: the rules for admin costs for NGOs should not apply here. These are not service delivery initiatives where the funds are intended to reach the poor. Funds for research never reach the poor. They are intended to pay for activities carried out by the research centres and so there should not be a rule related to how much can be spent on management. But, beware, management is not the same as overhead. There should be a competent manager in each of the partner organisations in charge of running the projects.
  7. Spend more on communications: again, the rules for marketing of aid should not apply. If the funder wants research to make a contribution then it has to spend on communications. The rule DFID had of 10% (or 30%; other funders have similar rules) needs to be reviewed to encourage the consortia to spend however is necessary -in the past I have argued that larger research programmes may need to spend less than smaller ones because the sheer volume of research may be sufficient to have impact. The same percentage for all makes no sense. But the most important thing is to have the right people on the job: dedicated and competent communication managers and officers in each centre.
  8. Where necessary recruit internationally -but always recruit competitively: all posts should be filled by the right people (including researchers). Before a consortia starts working its team members’ competencies ought to be reviewed. All team members should have the same minimum competencies. If they do not then an effort to find new team members needs to be made by developing job descriptions and launching an open and international recruitment process. If no successful candidates are found in a country then the consortia can choose to focus on developing the capacity of the weaker partners or simply recruit foreign candidates (this, by the way, can be a great way of inserting new skills into the organisations -and nationality ought to have nothing to do with being good at management, communications or research; otherwise multinationals who move staff across the world would be incapable of making a profit). Also, recruiting internationally does not mean paying ridiculous fees. There are many young yet experienced managers, researchers, and communicators very keen to work abroad. A good salary will do. And, by expanding the pool of potential recruits the costs will inevitably go down (today, many research centres in the poorest countries ask for astronomical fees because they know there are few options to them).
  9. Research must be seen as one more component: and it may not be the most important one. if the objective is to influence policy and practice then this may be possible by promoting debate, translating existing research, etc. These may even be more cost-effective than the usual: ‘do lots of research, the disseminate with a few months to go on the contract, and evaluated’ approach we are more familiar with. Other pure research or mostly research programmes should also be funded.
  10. Evaluate components accordingly: one big evaluation focusing on outcomes is not very useful. Start with the inputs (did they have the right people and resources?) and the activities (is the research of high quality, is the communications strategy appropriate, is the online strategy good, etc?) first. If they are not then what is the point of evaluating their impact? In these circumstances evaluating impact tells us nothing of the effect the work had.
Follow

Get every new post delivered to your Inbox.

Join 3,401 other followers