more on monitoring and evaluating influence
I just read a fantastic quote that is worth sharing. On the evaluation of a given think tank in affecting an important change in public policy, Murray Weidenbaum, in his book ‘The competition of ideas: the world of the washington think tanks‘, reports that John Hamre (from the Center for Strategic International Studies, CSIS) is reminded:
of the case of Anna Nicole Smith’s baby, where several men volunteered that they were the father. However, in the case of public policy there is no equivalent of a DNA test to declare the parentage with a comparable degree of certainty.
Other telling quotes on the same issue include one by Edwin Fueulner, President of the Heritage Foundation (recognised as one of the most influential DC think tanks), who accepts that:
…we still have no clear answers.
And David Frum, former resident fellow at the American Enterprise Institute (and a former White House speech writer, who provides a straight forward answer to the question of what may be useful indicators of think tanks’ influence:
None. You can’t measure influence.
This is also Weidenbaum’s view. In fact, he begins the book by stating that although:
Think tanks play an active role in the complex processes in which national public policy is made … The reader will learn that no think tank is as influential as it claims to be, especially in its messages to its financial supporters. Not every think tank researcher is brilliant or a person of great experience and judgement. Nor is every think tank report lucid or even relevant to the needs to the time.
Instead, he encourages a more nuanced exploration of the rich and complex world that is the US marketplace of ideas.





Indeed, the quote on DNA is excellent! I would argue, though, that evaluating policy impact is heavily influenced by the genuine reasons for doing this. Do we want to make a good impression on donors, colleagues, experts? Do we want to learn from what we do and better focus our energy? Do we seek to empower our staff? Are we motivated by improving strategic thinking?
Even recognizing the vast complexity of this field, there is large room for generating valuable knowledge throguh M&E of policy influence. However, the quality and use of this knowledge will vary significantly. We need to decide what we really want it for.