Bækgaard, M., Baethge, C., Blom-Hansen, J., Dunlop, C.A., Esteve, M., Jakobsen, M., Kisida, B., Marvel, J.D., Moseley, A., Serritzlew, S., Stewart, P.A., Kjærgaard Thomsen, M. and Wolf, P.J. (2015) ‘Doing Experiments in Public Management Research: A Practical Guide’, IPMJ, 18, 2: 323-342.
This paper provides advice on how to meet the practical challenges of experimental methods within... more This paper provides advice on how to meet the practical challenges of experimental methods within public management research. We focus on lab, field, and survey experiments. For each of these types of experiments we outline the major challenges and limitations encountered when implementing experiments in practice and discuss tips, standards, and common mistakes to avoid. The paper is multi-authored in order to benefit from the practical lessons drawn by a number of experimental researchers. Observational data are routinely used in both quantitative and qualitative public management research. They can be used to study a broad range of research questions. However, it is often challenging to draw causal conclusions from studies of observational data. This is due to selection bias, omitted variables and endogeneity, which are problems that may be difficult to avoid when collecting observational data. There are various techniques that can be employed ex-post to remedy these problems. But these solutions may not always be available, and they are often challenging in terms of complexity. In contrast, the core idea of experimental methods is collect good data that do not need ex-post correction in order to be used for causal analysis. This is why experimental methods are sometimes referred to as a design-based approach to causal research. The emphasis is on building a strong research design. The quality of the data means that the ensuing analysis of the collected data can often be done in a simple and transparent way. The evidence may lie in a simple comparison of means between control and experiment groups. Experiments come in different types which each have distinct advantages and disadvantages. They are discussed in more detail by Blom-Hansen, Morton and Serritzlew (2015). In this paper we focus on the challenges of practical experimental research.
Uploads
Books by Claire Dunlop
Policy successes and failures offer important lessons for public officials, but often they do not learn from these experiences. The studies in this volume investigate this broken link. The book defines policy learning and failure and organises the main studies in these fields along the key dimensions of processes, products and analytical levels. Drawing together a range of experts in the field, the volume sketches a research agenda linking policy scholars with policy practice.
Articles by Claire Dunlop