Skip to content
CalibrumResearch across industries
Non-Medical Delphi References

Non-medical Delphi references

Explore published studies and Surveylet references across education, policy, technology, sustainability, and other fields.

Diagram of a non-medical Delphi process from diverse expert perspectives to shared consensus

Published research

Browse references in descending publication order, newest first, or filter by field. Dated publications and project records appear first; undated archival records follow.

57 references

Showing all references.

1

Communities of Practice (CoPs) – supporting innovation and opportunity in practice and research

Megan Hennessy et al. · Australian Association of Gerontology Conference 2026 · Workforce / education / implementation

This conference material describes a 47-item, eight-week real-time Delphi conducted with the Calibrum system and 37 international experts from diverse domains including health and aged care, higher education, government, and business. The work produced a structured reporting guide for Communities of Practice.

2

Talent identification and development recommendations in youth sports: a real-time Delphi study

Kyle J. M. Bennett, William McCalman, Scott G. Goddard, A. Mark Williams & Job Fransen · Journal of Applied Sport Psychology · 2026

The researchers facilitated their real-time Delphi using SurveyLET (Calibrum). Experts evaluated agreement and feasibility, viewed immediate aggregated results with distribution charts and median/interquartile-range statistics, and reviewed anonymous comments before deciding whether to revise their judgments.

3

REDIRECT — Evaluation of Democratic Reconnection Strategies Through Three Real-Time Delphi Studies

Russo and Şişman · University of Salento · EU Horizon Europe REDIRECT project · Deliverable D6.2, September 2025 · Democratic participation / policy

In the EU-funded REDIRECT project, researchers conducted three Real-Time Delphi studies on reconnecting citizens, political parties, and parliaments with democratic decision-making. The published report explicitly names Calibrum as the selected platform after evaluating alternatives, citing its practical design, user-friendliness, and reliable support. Surveylet enabled aggregated expert feedback and revisions within the active studies. The follow-up policy recommendations report (D6.3, January 2026) builds on those Delphi findings.

4

A Framework for Corporate Digital Responsibility: Conceptualization and Operationalization

Kübra Çalışkan · Sakarya University · PhD thesis, July 2025 · Corporate digital governance / AI ethics

The thesis explicitly identifies Surveylet (Calibrum Inc.) as the platform for an April 2025 Real-Time Delphi. Nine industry experts assessed 352 proposed corporate digital responsibility indicators for priority and traceability; 292 indicators met the study's consensus criteria. The research demonstrates structured, multidimensional expert assessment for responsible digital governance.

5

Long-term scenario analysis for the post-mobile era in Germany

Lisa-Marei Keding · Heriot-Watt University doctoral thesis · 2025 · Post-mobile futures / Real-Time Delphi

This published doctoral thesis combines a real-time Delphi with time-perspective analysis to explore possible post-smartphone futures in Germany through 2040. The project matches the Surveylet post-mobile study identified in Calibrum's project records.

7

Steps in Carrying out a Delphi Study

Anthony Jorm · Using the Delphi Method to Establish Expert Consensus · Palgrave Macmillan / Springer Nature · July 30, 2025

In its open-access section on software for running Delphi studies, this practical guide identifies Surveylet as software specifically developed for Delphi studies, alongside eDelphi, SmartDelphi, DelphiManager, Mesydel, and RAND ExpertLens.

9

Foresight Scenarios: The Future Impact of Technology in Freight Forwarding, an International Delphi Study

Müßigmann, von der Gracht & Hartmann · IEEE Transactions on Engineering Management · 2025 · Freight forwarding / technology foresight

This international Delphi study gathered estimates from 84 experts to examine how digitization and technological change may reshape freight forwarding over the coming decades. Archived Calibrum project materials for the associated freight-forwarding foresight study confirm that Surveylet was used for the Delphi survey.

10

Professional Women's Football in Germany by 2031

WHU Center for Sports and Management · 2024 · Sports foresight / women's football

This published WHU Delphi report states that its six-week expert survey was administered online using Surveylet by Calibrum. Eighty-four experts assessed 14 projections concerning the future development of professional women's football in Germany.

11

How will IT megatrends and Legal Tech technologies influence the future IT strategies of law firms in Germany?

Michael W. Scheit · Heriot-Watt University doctoral thesis · December 2024 · Legal Tech / AI-enhanced Real-Time Delphi

This published doctoral thesis uses an AI-enhanced real-time Delphi to examine how emerging IT megatrends and Legal Tech technologies may shape German law-firm strategy. The project corresponds to the Surveylet Legal Tech study identified in Calibrum's project records.

14

Criteria classification decision trees for problematic and avoidable plastic products

UK–Brazil informal technical dialogue / Chatham House · INC-4 briefing report · 2024 · Global plastics treaty

This follow-on real-time Delphi assessed classification-tree options and criteria for problematic and avoidable plastic products. Its published methodological annex states that the exercise used specialist software produced by Calibrum called Surveylet.

16

Top-Tier Sport Product and Its Production in 2030

WHU Center for Sports and Management · 2023 · Sports media / future production

This published Delphi research report identifies Surveylet by Calibrum as the online platform used for a six-week study with 99 experts. The panel assessed 25 projections concerning the future product and production model for top-tier sport.

17

2024 Integrated System Plan Delphi Panel

Australian Energy Market Operator · 2023/2024 · Energy policy / scenario weighting

AEMO's published 2024 ISP materials document a Delphi panel used to assess the relative likelihood of three energy-system scenarios. The resulting anonymous expert likelihoods were used as scenario weightings in development of the 2024 Integrated System Plan.

20

Evaluation of potential criteria for identifying chemicals and polymers of concern and problematic plastic products

UK–Brazil informal technical dialogue / Chatham House · INC-3 briefing report · 2023 · Global plastics treaty

Chatham House convened a country-led real-time Delphi for the UK and Brazil to evaluate criteria for chemicals and polymers of concern and problematic plastic products. The corresponding project and methodology records identify the specialist real-time Delphi platform as Surveylet from Calibrum.

21

The Impact of Technology on the Future of Football

WHU Center for Sports and Management · 2022 · Football / technology foresight

The WHU report states that its four-week Delphi survey was administered using Surveylet by Calibrum. Ninety-one experts from multiple confederations assessed future technology developments and their likely influence on international football.

23

Zukunft 2030 – Sportsponsoring im Wandel

WHU Center for Sports and Management · 2021 · Sports sponsorship / foresight

This published WHU Delphi report explicitly states that the four-month online Delphi was conducted using Surveylet by Calibrum. Fifty-one industry experts evaluated future developments in the sports-sponsorship market through 2030.

24

The Impact of Technology on the Future of Winter Sports

WHU Center for Sports and Management · 2021 · Winter sports / technology foresight

This WHU Delphi report identifies Surveylet by Calibrum as the online platform used for a four-week study with 53 experts examining technology, COVID-19, esports, gaming, and other forces shaping the future of winter sports.

26

Lessons Learned from a Two-Round Delphi-based Scenario Study

Schmalz, Spinler & Ringbeck · MethodsX · 2021

This technical methods paper identifies Calibrum among available web-based real-time Delphi platforms while explaining practical lessons from Delphi-based scenario research. It is a methodological software reference rather than a project-specific Surveylet deployment.

28

Envisioning an international validation process for New Approach Methodologies in chemical hazard and risk assessment

Mondou, Maguire, Pain, Crump, Hecker, Basu & Hickey · Environmental Advances · 2021 · Regulatory science / chemical risk assessment

This Delphi brought together government, industry, and NGO experts in Europe and North America to identify priorities for validating and adopting New Approach Methodologies in chemical risk assessment. The published article's methodology contains a direct Calibrum website citation, and the project matches Calibrum's archived McGill University Surveylet study on New Approach Methodologies.

29

Outsourcing in humanitarian logistics – status quo and future directions

Goßler, Wakolbinger & Burkart · International Journal of Physical Distribution & Logistics Management · 2020

This two-round e-Delphi, conducted with 31 practitioners from 24 humanitarian organizations, was administered electronically using Calibrum Surveylet to identify and assess future outsourcing developments in humanitarian logistics.

31

The transition towards a green economy and its implications for quality infrastructure

Vidican Auktor, Altenburg & Stamm · German Development Institute / PTB · 2020 · Green technology / quality infrastructure

This foresight study examined green-technology diffusion and the quality-infrastructure capabilities needed in developing countries. Its methodology reports that, after reviewing available tools, the team selected the Surveylet tool developed by Calibrum Surveys for the expert Delphi work.

32

Discovering a New World of Color and Appearance Management Solutions

APTech / PRIMIR · Nima Hunter, Inc. · Study highlights · Color and appearance management · 2019

This published industry study reports consensus forecasts concerning adoption of emerging color and appearance management technologies, software, and measurement hardware. It corresponds to the Surveylet APTech/PRIMIR project identified in Calibrum's project records.

35

SpaceScape: The Future of Space in 100 Years

UAE Space Agency · VTT Technical Research Centre of Finland · International Astronautical Congress, Washington, DC · 2019

This high-profile space foresight exercise used a Surveylet-supported Delphi-style expert consultation to explore the future space landscape over a 100-year horizon, including space exploration, settlement, technology pathways, policy, investment, and international collaboration.

36

Citizen science: generating ideas and exploring consensus

THIS Institute · 2018 · Consensus-methods report / Delphi software comparison

This methods report compares tools for generating ideas and exploring consensus and lists Surveylet by Calibrum as a paid platform supporting both Delphi and real-time Delphi, noting its use across European Commission projects.

37

Real-Time Delphi in Practice: A Comparative Analysis of Existing Software-Based Tools

Aengenheyster, Cuhls, Gerhold, Heiskanen-Schüttler, Huck & Muszynska · Technological Forecasting and Social Change · 2017

This important real-time Delphi methodology article compared existing software-based tools and included Surveylet among the evaluated platforms. It is a strong public reference for Surveylet’s position as a professional real-time Delphi platform used in academic and applied foresight work.

39

SSH-FUTURES: Social Sciences and Humanities for Europe

European research policy · Social sciences and humanities · 2015

This project investigated the future role of social sciences and humanities in Europe and their relationship to social demand and research policy.

41

Characterizing ethical decision-making and its influences

Organizational leadership · Ethics and decision-making · 2014

This exploratory Delphi study identified how higher-administration leaders in the United States and Poland define ethical decision-making and understand its influencing factors.

45

FESTOS: Security threats posed by emerging technologies

Emerging technology · Security foresight · 2011

FESTOS focused on future security threats posed by emerging technologies, including ICT, nanotechnology, biotechnology, robotics, new materials, and converging technologies.

46

Some initial methodological considerations in the development and design of Delphi surveys

Elizabeth Stevenson · methodological report · circa 2010 · Delphi software evaluation

This independent methodological report evaluates software options for Delphi research and describes Calibrum’s flexibility in question types and branching, multiple rounds, participant communications, Excel export, web publication of results, and available support.

47

SAFE FOODS: Food risk management

Food safety · Integrated risk analysis · 2009

SAFE FOODS focused on an integrated risk-analysis approach that considered consumer concerns and transparency in food risk management.

49

Evidence on the main factors inhibiting mobility and career development of researchers

European Commission / University of Manchester consortium · 2008 · Researcher mobility / European Research Area

The European Commission study used the targeted RINDICATE online survey and a parallel researcher-mobility survey. The final report states that the targeted online survey was developed using the Calibrum system; more than 6,000 RINDICATE invitations were sent.

50

Perspectives in developing industrial enzymes by using technological intelligence

Castellanos Domínguez, Ramírez Martínez & Montañez · Ingeniería e Investigación · 2006 · Industrial enzymes / biotechnology foresight

This peer-reviewed article emerged from the Colombian biotechnology foresight work and describes the Delphi component of the technology-intelligence process. The publication identifies Surveylet® from Calibrum in connection with the expert consultation.

51

Colombian biotechnology foresight 2005–2015: online Delphi exercise

Colciencias / Universidad del Valle · Colombia · 2005 · Biotechnology foresight

The Colombian biotechnology foresight report explicitly states that its online Delphi used Surveylet software from Calibrum, licensed by Colciencias and Universidad del Valle. The project assembled a list of 405 invited experts.

52

FISTERA: The future of European information technologies

FISTERA Thematic Network · European Commission-related foresight · 2004–2005 · ICT and social implications

The published FISTERA Delphi Report explicitly states that the project used Calibrum Corporation's Surveylet system to design, gather, manage, and process its Delphi questionnaires. The same contemporary report documents Calibrum's online foresight work beginning in 1999, the 2001 Surveylet installation at ICS-UNIDO in Trieste, and subsequent European and Latin American foresight applications.

53

EUFORIA: Knowledge Society foresight

European Foundation for the Improvement of Living and Working Conditions · 2003–2004 · Knowledge society / multilingual policy Delphi

A contemporary EUFORIA publication identifies the project as an innovative cross-national multilingual online Delphi conducted in English, Finnish, German, and Greek and explicitly identifies the online software as Surveylet from Calibrum Corporation.

54

MobiCom: The evolution of mobile commerce

Mobile commerce · Business strategy and scenario planning · 2002

The MobiCom project involved industrial partners in scenario planning and insight generation related to the future shape of mobile service markets.

55

EXTACAST: Political forecasting

Political forecasting · Expert prediction and revision

A panel with diverse expertise was invited to make and justify forecasts through Surveylet, then revise based on anonymized forecasts from other panelists.

Delphi methods are useful far beyond medicine

Delphi studies are helpful whenever a team needs structured judgment from experts or stakeholders, especially when the topic is complex, future-oriented, uncertain, multidisciplinary, or difficult to resolve through a simple survey or meeting.

Surveylet can support multi-round Delphi, real-time Delphi, expert prioritization, scenario development, rating studies, stakeholder consultation, and structured feedback workflows across many non-medical domains.

The references below highlight public non-medical Delphi, real-time Delphi, foresight, policy, sustainability, and stakeholder-consensus work. Where a publication or project directly identifies Surveylet or Calibrum, that connection is stated explicitly; other entries are included as broader examples of how Delphi methods are used outside healthcare.

Common non-medical Delphi use cases

Policy and public sector planning

Prioritize options, identify gaps, and gather structured expert input for government, international development, and public programs.

Technology foresight

Explore future scenarios, emerging technologies, innovation priorities, and long-term uncertainty.

Education and workforce

Develop competencies, future skills, professional standards, and education priorities.

Environment and sustainability

Support stakeholder consensus around sustainability, food safety, water reuse, climate, and environmental programs.

Organizational strategy

Help leadership teams and expert panels align around strategic priorities, risks, and decision criteria.

Research prioritization

Rank research gaps, funding priorities, collaborative opportunities, and future research directions.

Scenario planning

Use structured expert input to develop plausible futures, opportunities, threats, and action roadmaps.

Stakeholder consultation

Collect and synthesize input from multiple groups while reducing dominance effects and preserving structured feedback.

Conferences, boards, and workshops

Help larger groups evaluate options, identify priorities, surface disagreement, and record a structured decision without relying only on sequential open discussion.

Why teams use Delphi outside healthcare

Delphi is especially useful when evidence is incomplete, perspectives differ, participants are distributed, or an ordinary meeting risks being shaped by hierarchy or the loudest voices.

Anonymous expert input

Participants can contribute candidly without hierarchy, seniority, status, or group dynamics dominating the conversation.

Structured feedback

Panelists can review controlled group feedback, comments, ratings, or rankings before reconsidering their responses.

Measurable agreement

Teams can define consensus thresholds, identify disagreement, and document uncertainty in a transparent way.

Prioritization

Large lists of ideas, risks, criteria, recommendations, or research questions can be narrowed into an ordered set of priorities.

Distributed participation

Experts and stakeholders can participate remotely across organizations, regions, institutions, or countries.

Repeatable process

The method provides a clear process that can be documented for reports, boards, sponsors, grant funders, or publications.

What these studies have in common

Complex topics

They involve uncertainty, multiple perspectives, and questions where one dataset or one expert is not enough.

Distributed expertise

They bring together experts, stakeholders, practitioners, policymakers, or affected communities.

Structured feedback

They use organized rating, comments, feedback, revision, and prioritization rather than informal discussion alone.

How Surveylet supports non-medical Delphi work

Multi-round studies

Support repeated rating rounds, feedback, comments, and consensus tracking.

Real-time Delphi

Allow participants to review structured feedback and revise responses during an active survey window.

Prioritization and ranking

Collect structured input on priorities, scenarios, statements, criteria, and recommendations.

Stakeholder segmentation

Support comparisons across expert groups, roles, sectors, regions, or stakeholder categories.

Randomization controls

Use page sequence randomization and other allocation workflows when survey fatigue or exposure balance matters.

Ratings, rankings, and comments

Collect structured quantitative ratings, rankings, qualitative comments, and rationale for decisions.

Exports and reporting

Prepare responses, comments, consensus status, and round-by-round results for analysis, stakeholder reports, steering committees, publications, and decision materials.

Platform access or study support

Some teams only need Surveylet as a specialized Delphi platform. Others want help designing the study, structuring the questionnaire, configuring Surveylet, managing rounds, analyzing results, or preparing reports.

Surveylet platform

For teams with their own methodology lead that need purpose-built Delphi and real-time Delphi administration, participant access and response tracking, ratings and comments, consensus feedback, and data exports.

Calibrum support services

For teams that want help with study design, questionnaire and scale refinement, Surveylet configuration, launch and round management, analysis and reporting.

Planning a non-medical Delphi study?

Calibrum can provide Surveylet as a specialized Delphi platform, help design and report a multi-round or real-time consensus process, across policy, education, strategy, technology, workforce planning, forecasting, sustainability, stakeholder engagement, and other non-medical fields.