The Pros and Cons of the Delphi Method
The use of the Delphi Method
The Delphi method is a structured communication technique used to achieve consensus among a group of experts, involving multiple rounds of anonymous questionnaires with controlled feedback.
Originally it was developed by the RAND Corporation in the 1950s to gather expert insights and predict the impact of emerging technologies on defense strategies. But the Delphi method has since then become a powerful tool, used in various fields, for instance to define best practices in healthcare. The Delphi method is of particular value as a research technique where there are gaps in the current evidence base which would be challenging to address with more traditional methods (e.g. RCTs). This may be due to inherent limitations of these approaches (e.g. narrow focus, ethical or practical barriers) or resource/time constraints.
As leading providers of Delphi consensus for the Pharmaceutical and Medtech industries, we are sharing 2 big pros and cons we have found in our experience using the method:
Pros of the Delphi Method
The Delphi method generates precise results that are based on trusted opinion
When delivered effectively, the Delphi method’s systematic design and controlled feedback mechanisms ensure that conclusions are reached with high confidence to reliably fulfil research objectives. A defining feature of the Delphi method design is the anonymity it provides to participants, able to respond without the influence of group dynamics for genuine and unbiased input. This produces the advantage of each participant’s voice weighing equally on the outcome. With other consensus development methods, such as the consensus conference for instance, it can be more difficult to mitigate the influence of strong personalities on the work.
The Delphi method is a time and cost-effective technique to answer a research question
The Delphi method can easily be used for projects with sensitive timeframes and that require to reach different geographical regions (including internationally). The technique can gather perspectives from a wide range of experts in real-time.. This is possible with the use of online platforms to remove the logistical challenges and expenses of in-person meetings or site visits that may be a feature of other approaches. The controlled feedback process also streamlines communication, meaning that avoids lengthy discussion or lack of a concluding result. Typically, modified Delphi studies which rely on 2 rounds of survey can be completed within 6-8 months.
Cons of the Delphi Method
The Delphi method is not designed to foster open discussion
The Delphi method’s structured feedback process limits the opportunity for open discussion among participants. This could be a drawback when deeper exploration of ideas is necessary or when opinions are highly polarized. However, incorporating a small expert steering group in the study design to reflect on the results from the surveys and to further capture expert opinion can mitigate this limitation.
The Delphi method’s success relies on the quality of participants
Since the method is often used in situations where definitive answers are not available and expert opinion is paramount, it is crucial that participants have the appropriate knowledge and experience to ensure the validity of the conclusions drawn. This emphasizes the importance of carefully selecting qualified experts by using strong inclusion criteria. Furthermore, as the Delphi method requires controlled, iterative feedback, if participants fail to complete subsequent rounds, the quality and quantity of the data can suffer. Delphi studies should consequently be designed with a strong strategy to effectively engage participation throughout the process.
Conclusion
The Delphi method is a powerful tool for generating expert opinion data and achieving consensus to answer a research question. It presents advantages over other consensus techniques, but its success is highly dependent on the strategy that has been put in place to oversee the process, including the choice and the management of experts.
Discover how Triducive can help
Triducive is an expert medical communications agency that generates consensus-led evidence, which is published and supports change in healthcare. Through Delphi consensus studies, Triducive has experience in publishing over 50 manuscripts in peer-reviewed journals. Our team of healthcare experts and scientific writers is ready to provide guidance and support at any stage of the evidence generation process. Contact us for more information about Delphi consensus studies.