Innovative qualitative methods
E-cigarettes: evolution or revolution? Using mobile qual to understand smoking rituals
Daniel Clay Emily Fu, TNS BMRB
This workshop explores the potential for mobile auto-ethnography to provide insight into a complex behaviour – the use of e-cigarettes. Respondents self-documented their behaviour through a smartphone app, following up with reflective online discussion. The method challenged boundaries between qualitative and quantitative data.
Government initiatives
What are the opportunities and challenges that innovative research methods present to government users of research?
Jonathan Smetherham, Dept. for Work and Pensions
The GSR (Government Social Research) Innovative Methods Group has recently carried out research in government to better understand the opportunities and challenges that innovative research methods present to government users of research. This presentation will explore the key findings.
Making an impact

Visualising complex data to engage a non-researcher audience

Daniel Ellis & Dr Louise Morpeth, Dartington Social Research Unit
To make the implementation data of an evidence-based programme interesting and accessible to a broad audience, an interactive visualisation tool was created, allowing users to explore what would traditionally be a large and unwieldy static spreadsheet in an intuitive manner. Discusses the how-tos, benefits and pitfalls.
Ethics and technology
Qualitative research among teenagers: Getting beyond the one-word answers from a potentially vulnerable audience
Rachel Cope Sania Haq, mruk
Researchers – and their clients – are increasingly seeking to consult young people, while at the same time being acutely aware of the need to protect them. A multi-stage, online research approach is described, with reference to the ethical issues raised by the project, given the potential vulnerabilities of this audience.
Behavioural research
Using randomised control trials to test the effectiveness of service improvements
Toby Blume Sherilyn Dos Santos, London Borough of Lambeth
How a London Borough used an RCT and behavioural insights to test the attributable effects of small changes to Council Tax bills. The experiment was designed to improve payment rates, reduce the costs of collection and debt recovery and to help residents avoid incurring preventable charges and court costs.
Maintaining quality
Using non-probability web surveys to measure sexual behaviours and attitudes in the general population
Bob Erens, London School of Hygiene & Tropical Medicine & Andrew Copas, University College London
A large-scale methodological experiment compares results from four British web panel surveys with a national probability sample survey of sexual behaviour, using computer-assisted self-interviews (CASI). Findings will be presented and implications discussed.
Innovative quantitative methods
The use of geo-trigger technology in research using smartphones
Nicola Moss & Steve Ginnis, Ipsos MORI
Local residents were invited to get involved in a litter survey via their smartphone, when they entered one of four city centre locations. The presentation considers when the use of geo-trigger technology is appropriate, and the issues to keep in mind. The respondent profile, user experience, response rates and reasons for non-participation are also explored.
Innovations in cognitive testing
Are you seeing what I’m seeing? Using eye-tracking to develop paper and web forms
Debbie Collins & Jo d’Ardenne, NatCen Social Research
Does eye-tracking technology improve the design of web and paper forms, offering new insights that cannot be gleaned from existing methods such as usability testing and cognitive interviewing? Cases studies – testing a web questionnaire, an event history calendar and an electoral ballot paper – investigate the issues.
Making an impact
Putting knowledge transfer into practice: Increasing the impact of research and information relating to sight loss
Catherine Dennison, Thomas Pocklington Trust, Sally McManus, NatCen Social Research, & Fay Sadro, RNIB
A comprehensive programme was created to maximise the use of research by the sight loss sector, with a mix of traditional approaches such as workshops, and newer methods of networking. Considers the challenge of making research findings accessible to everyone, and shares insights.
Ethics and technology
Ethical research using technology
Helen Kara, Independent researcher
Technology raises a whole new set of ethical problems for researchers to solve. But, conversely, it can also help in overcoming ethical difficulties. This presentation will examine the issues, illustrating potential pitfalls and benefits, while seeking to raise awareness of the ethical implications of the use of technology in research.
Innovative qualitative methods
Ethnography goes digital: Researching professionals using a qualitative mobile app
Isabella Pereira & Chris Perry, Ipsos MORI
A case study of a qualitative research project using a mobile app, supported by more traditional methods. This presentation discusses the strengths and weaknesses of using a qualitative mobile app, and how an app can be applied to research of hard-to-reach audiences and sensitive issues.
Innovative quantitative methods
Just pray for the best? Introducing new survey technologies into the Church of England
Dave Ruston, Research by Design Sarah Barter-Godfrey, Church of England
A survey of church congregations tested a mobile app vs. a historical, tried and tested paper method. Stakeholder engagement, user acceptability, response rates, quality, modal effects and practical barriers are discussed. Delegates can access the survey via mobiles.
Innovations in cognitive testing
The re-design of ONS business surveys: An agile approach
Katherine Ralph Bethan Jones, ONS
Substantial changes were needed on a range of ONS business survey questionnaires, to a challenging deadline. A new ‘agile’ approach to question-testing was developed to meet this demand without sacrificing quality. The pros and cons of the new approach compared to previous methods are discussed.
Behavioural research
Do consumers have a hierarchy of priorities when engaging with markets?
Justin Gutmann, Citizens Advice Colin Strong, GfK
Research into consumer behaviour in regulated markets used behavioural tracking with survey approaches, measuring the impact of ‘nudges’ without full scale field trials. There are implications for the role of behavioural science to better understand behaviour and to drive public policy.
Maintaining quality
Propensity score adjustments for non-probability samples: Using web panels to collect data on sexual health
Andrew Copas, University College London & Bob Erens, London School of Hygiene & Tropical Medicine
Propensity score adjustments are proposed as a way to counteract the potential for self-selection bias in web panel surveys. An experiment using four panels found that adjustments gave some improvement for the most heavily biased estimates, but this was not consistent.
Government initiatives
Supporting organisations to undertake rigorous evaluations - the role of government administrative datasets
Nicola Webb, Ministry of Justice & Tracey Gyateng, New Philanthropy Capital
The MoJ has simplified access to government-held offending data, and provides organisations which may have limited expertise in evaluation and data analysis with the results of quasi-experimental studies of their impact. Explores the methodological and organisational challenges, and the wider implications.