{"id":942,"date":"2014-05-21T16:44:16","date_gmt":"2014-05-21T16:44:16","guid":{"rendered":"https:\/\/onthinktanks.org\/?p=942"},"modified":"2024-01-29T12:36:28","modified_gmt":"2024-01-29T17:36:28","slug":"what-do-policymakers-want","status":"publish","type":"post","link":"https:\/\/onthinktanks.org\/articles\/what-do-policymakers-want\/","title":{"rendered":"What do policymakers want?"},"content":{"rendered":"

[Editor\u2019s note: this post has been edited to include a recent study from Australia.]<\/em><\/p>\n

Three\u00a0recent reports on the views of policymakers have been making the rounds in influential blogs and online spaces.<\/p>\n

From the United States<\/h3>\n

The first is a report on what\u00a0White House policymakers in the US want from researchers<\/a> that first came to my attention via Duncan Green\u2019s blog. The paper:\u00a0What Do Policymakers Want From Us?<\/a>, by\u00a0Paul Avey\u00a0and\u00a0Michael Desch, found, interestingly that:<\/p>\n

\n
\n
\n

policymakers do regularly follow academic social science research and scholarship on national security affairs hoping to draw upon its substantive expertise. But put into question the direct relevance of the most scientific approaches to international relations.<\/p><\/blockquote>\n

And, to\u00a0the surprise of many, their fundings challenge:<\/p>\n

the \u201ctrickle down\u201d theory that basic social science research eventually influences policymakers.<\/p><\/blockquote>\n

The authors try to answer a question that many think tanks have asked themselves (but rarely actually ask policymakers);<\/p>\n

\n
\n
\n

What, precisely, do the most senior national security policymakers want from international relations scholars?<\/p><\/blockquote>\n

\n
\n
\n

They arrive at a number of interesting findings. Some are well known by now but other, I think, are worth highlighting:<\/p>\n

Theory is not a bad word<\/strong>: I remember, before \u201cTheory of Change\u201d became all the rage, being asked by DFID to remove the word \u201ctheory\u201d (in relation to brief mention to theories of political change) from a 15 page How to Note on how to plan and monitor policy influencing strategies (I was also asked to cut the note as it was too long). \u00a0DFID and other agencies have employed lots of \u2018knowledge brokers\u2019 to digest theory for policymakers and protect them from the hard world of academic research. The problem, however, aren\u2019t the theories or the complex ideas that researchers often deal with. The problem is jargon!<\/p>\n

While policymakers do use theory they are skeptical of much of academic social science which they see as jargon-ridden and overly focused on technique, at the expense of substantive findings.<\/p><\/blockquote>\n

Smart policymakers are not researchers best friends<\/strong>\u00a0(at least not for those who like to claim impact): A few months ago,\u00a0Philipe Martin\u00a0<\/a>wrote about an interesting situation among the think tanks of the TTI. Apparently, the policymakers that knew the think tanks better also distrusted them more. In other words, the more one knows about something the more one is skeptical or critical about those who claim to know about it, too.<\/p>\n

Not surprisingly, rank in government is often negatively associated with tolerance for sophisticated methods; more striking, in our view, is that level of education also has that same negative correlation, indicating that it is those most familiar with those theories and techniques who are most skeptical of them.<\/p><\/blockquote>\n

It is about people -and ideas, but mostly people<\/strong>: In the\u00a0world of intelligence services<\/a>\u00a0the most important contributions to policy\/decisions happens not via \u2018briefs\u2019 or \u2018documents\u2019 but conversations. From that post:<\/p>\n

At the National Intelligence Council, I came to think that, for all the technology, strategic analysis was best done in person. I came to\u00a0think\u00a0that our real product weren\u2019t those papers, the NIEs (National Intelligence Estimates). Rather they were the NIOs, the National Intelligence Officers \u2013the experts, not the papers.<\/p><\/blockquote>\n

The paper on the White House agrees:<\/p>\n

Finally, policymakers believe that the most important contributions scholars can make are not as direct policy participants or trainers of aspiring government employees, but rather as informal advisors or creators of new knowledge. However, severe time constraints limit their ability to use such scholarship in any but its\u2019 very briefest presentation.<\/p><\/blockquote>\n

From Britain<\/h3>\n

The second paper comes from Britain and deal with the role that the media, especially printed newspapers, play in reaching and influencing policymakers. Earlier this year I organised an event in Lima in which we\u00a0asked a journalist, a politician, and a researcher how they preferred to access information<\/a>. The political panelist was very clear in the role that the media played in shaping his agenda -even his agenda for the day.<\/p>\n

This paper by Colin Talbot and Carole Talbot at Manchester University:\u00a0Sir Humphrey and the professors: What does Whitehall want from academics?\u00a0<\/a>Makes this very same point.<\/p>\n

The findings include the following:<\/p>\n

How do they access expertise?<\/strong><\/p>\n

Research reports and newspapers and magazines top the ways in which policymakers like to access expertise.<\/p>\n

Most interestingly, though, policymakers where asked about\u00a0what disciplines they found more useful<\/strong>. Not surprisingly, the findings show that more applied or applicable disciplines came on top. Many think tanks tend to organise themselves along disciplines (economics, law, social sciences, etc.) and therefore fail to capture policymakers\u2019 own preferences.<\/p>\n

The report offers an interesting approach to explore this issue in other contexts.<\/p>\n

\n
\n
\n

From Australia<\/h3>\n

The third paper is one recently published via the\u00a0LSE Impact of Social Sciences blog<\/a>:\u00a0Australian survey indicates policy-makers still have major reservations about assigning priority to academic research<\/a>\u00a0by\u00a0\u00a0Michele Ferguson<\/a>,\u00a0Brian Head<\/a>,\u00a0Adrian Cherney\u00a0<\/a><\/strong>and\u00a0Paul Boreham<\/strong><\/a><\/strong>.\u00a0\u00a0In fact, the Australian report is a whole project that includes several papers: Are Australian policymakers interested in social science research?<\/p>\n

Among their publications is included a survey:<\/p>\n

the responses from the survey indicated that academic research, while valued and considered relevant, is not being used by the majority of staff in policy decision-making. Policy staff at both federal and state levels indicated major reservations about assigning high priority to academic research in their policy development work and only 16 percent of respondents reported that university research results have regularly influenced changes in policies developed by their unit.<\/p><\/blockquote>\n

But most interesting is the difference in the perception of influence between policymakers and researchers. This table speaks for it self:<\/p>\n

\"\"<\/p>\n

Academics certainly think quite highly of themselves. My own experience working with think tanks in developing countries would tend to confirm this. The thousands of case studies that research funders like to commission (and think tanks like to produce) overestimate the role that research plays\u00a0on policymaking.<\/p>\n

The Australian researchers provide an excellent list of key results that are worth publishing:<\/p>\n\n\n\n\n\n\n
\n

Policy-makers<\/strong><\/p>\n<\/td>\n<\/tr>\n

94%<\/strong>\u00a0\u2013 Indicated that the internet is an important means of obtaining research information82%<\/strong>\u00a0\u2013 Reported difficulties in accessing full-text versions of academic articles and reports<\/p>\n

81<\/strong>%<\/strong>\u00a0\u2013 Agreed that the policy-making process is driven by budgetary considerations<\/p>\n

71<\/strong>%<\/strong>\u00a0\u2013 Perceived that urgent day-to-day issues take precedence over \u201clong-term\u201d thinking<\/p>\n

71<\/strong>%<\/strong>\u00a0\u2013 When using academic research, consider it a high priority that the research findings are unbiased<\/p>\n

61%<\/strong>\u00a0\u2013 Reported that in the last 12 months they had written a policy-related document that drew on academic research<\/td>\n<\/tr>\n

\n

Academic researchers<\/strong><\/p>\n<\/td>\n<\/tr>\n

84<\/strong>%\u00a0<\/strong>\u2013 Agreed that academic reward systems do not adequately recognise dissemination of work to non-academic end-users81<\/strong>%\u00a0<\/strong>\u2013 Indicated that the amount of time needed to invest in coordinating the work between different partners in research collaborations is potentially problematic<\/p>\n

80%<\/strong>\u00a0\u2013 Find there are different research orientations between academics and external partners<\/p>\n

77%<\/strong>\u00a0\u2013 Agreed that research partnerships have provided them with opportunities for their research to have an impact on policy and practice<\/p>\n

73<\/strong>%\u00a0<\/strong>\u2013 Agreed that the academic requirement to publish in peer-reviewed journals inhibits a focus on policy and practitioner audiences<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

All papers are worth reading in detail. There have been previous efforts in international development think tanks to undertake similar surveys. Unfortunately, they have never been large enough nor sufficiently robust to yield much more than anecdotal evidence.<\/p>\n

The Australian study in particular converse a number of angles and issues. It also provides excellent recommendations (published in the LSE blog).<\/p>\n

It is quite telling that they are:<\/p>\n

    \n
  1. Common sense things: 1) to be influential, academic research must be accesible, 2) all actors must take the time and effort to build and maintain relationships, 3) choose the best channels and tools and be consistent, 4) create opportunities to bring policymakers and academics together.<\/li>\n
  2. They should be part of the day to day job of research centres by now. I am amazed at funders still hiring consultants and \u2018encouraging\u2019 their grantees to make their research more accesible, or build relationships with the media or with policymakers. These should have been incorporated into think tanks\u2019 and even more academically leaning research centres\u2019 core mandates.<\/li>\n<\/ol>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

    What do policymakers want? Three studies, one from the White House, one from Whitehall, and one from Australia, provide excellent information and insights into what they need from researchers and how they prefer to get it. You may not be surprised to find that they like theory and distrust anyone who talks more jargon than them.<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_relevanssi_hide_post":"","_relevanssi_hide_content":"","_relevanssi_pin_for_all":"","_relevanssi_pin_keywords":"","_relevanssi_unpin_keywords":"","_relevanssi_related_keywords":"","_relevanssi_related_include_ids":"","_relevanssi_related_exclude_ids":"","_relevanssi_related_no_append":"","_relevanssi_related_not_related":"","_relevanssi_related_posts":"","_relevanssi_noindex_reason":"","footnotes":""},"tags":[3442,181],"acf":[],"_links":{"self":[{"href":"https:\/\/onthinktanks.org\/wp-json\/wp\/v2\/posts\/942"}],"collection":[{"href":"https:\/\/onthinktanks.org\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/onthinktanks.org\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/onthinktanks.org\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/onthinktanks.org\/wp-json\/wp\/v2\/comments?post=942"}],"version-history":[{"count":0,"href":"https:\/\/onthinktanks.org\/wp-json\/wp\/v2\/posts\/942\/revisions"}],"wp:attachment":[{"href":"https:\/\/onthinktanks.org\/wp-json\/wp\/v2\/media?parent=942"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/onthinktanks.org\/wp-json\/wp\/v2\/tags?post=942"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}