479:". The basic difference to Internet Delphi is that the process of a Real-Time Delphi is not characterised by single iterated rounds. In fact, real-time calculation and provision of responses are the key characteristics of Real-Time Delphis. Various other labels for Real-Time Delphi can be found in literature and many authors are not completely aware of the differences: "Electronic Delphi", "Computer Delphi", "Computer-aided Delphi", and "Technology Delphi". However, it is important to truly understand the design and process a researcher has chosen to find out whether real-time calculations and provisions have been applied or not.
570:
round-less approach is the fact that, in order to take part in the study, participants can login and logout with their personalised account as often as they want during the time frame provided. Their already given answers will be saved and recalled when they login the next time. So, by design of the study, there are no explicit single rounds to answer the questions. Updating and playing back the information to the other participants follow immediately in succession to the process of answering. Here, it becomes clear that the process of answering can be
521:, the Real-Time Delphi approach is characterised by a continuous round-less procedure leading to a reduced time frame needed to conduct such studies. Consequently, conducting large-scale studies of huge complexity in a relatively short period of time becomes possible. Another core methodological innovation is the fact that experts may not only judge once or twice, depending on the number of rounds, as it has been usual in a Conventional Delphi study. During a Real-Time Delphi, experts can independently reassess their responses as often as they want.
583:
First, they can login to the portal whenever they want; therefore, one could argue that the degree of convenience of taking part is increased for the participant due to a 24-hour availability of the portal. Second, panellists can contribute to whatever aspects in the questionnaire they want, especially when having gone through each question at least once. Here, a substantial aspect of Real-Time
Delphis becomes obvious: Turoff and Hiltz explain that a Real-Time Delphi study offers a design of
854:. The author argues that computer-based Delphi can be especially relevant in the context of e-democracy, not only for the roundless approach, the real-time updating of statistical response, or the large number of panellists, but for the possibility to establish split panels corresponding to different groups (such as policy-makers, experts, and citizens), which the administrator can give different tasks and privileges, depending on the issues and the type of decision-making process.
31:
553:"reasons window" opens, which shows the statements of other participants to underline their point of view. So, the respective legitimisations given by others may cause a respondent to recapture his own point of view. In the next step the expert can change his own answer, add new arguments to underline his point of view, or leave his answer unchanged. In addition, the
606:
first time and getting a second sheet with the group responses in the second round, the Real-Time Delphi already shows the second screen (i.e. group responses) immediately after answering each question. Having answered each question at least once, the participant can usually control which question to reassess from a "consensus portal", which serves as a kind of
544:– usually web-based – is needed for facilitating real-time calculations and visualisation of results. It is generally proposed in the existing literature that the experts participating in the study see not only their own answers but also the median and interquartile range of all given responses immediately after answering a quantitative question. Besides the
666:
414:(i.e. participants could independently login and logout how often and when they desired). The stated aspects are some of the key characteristics of Real-Time Delphi studies, which shows that the original idea of conducting such studies can be traced back to the respective year. Today, nevertheless, technological
605:
The key features of Delphi studies, such as anonymity, controlled feedback and group response, are also met in the context of Real-Time Delphi studies. However, the issue of iteration is, by design of the technique, not valid for Real-Time Delphi studies anymore. Instead of answering each question a
454:
In 2017, Angenheyster and colleagues published a study, which compares various Real-time Delphi platforms. Analysis criteria include among others visual appearance, data output, user friendliness, administration, and types of questions. A cross-disciplinary study by
Beiderbeck et al. focused on new
651:
The greatest weakness of the real-time approach is that it is missing a wholly integrated, scientifically founded concept. The real-time Delphi idea is still a very new concept, which requires further research and application to become a tool for full-scale operations. Especially the editing of the
629:
The basic strengths of a Real-Time Delphi study are its efficiency and applicability to all Delphi topics (i.e. common problem sets, decision making issues, cross impact studies, etc.). Figure 2 illustrates that the process of a Real-Time Delphi differs. Important is to point out that the number of
532:
during and improved possibilities for analysis after the study. Additionally, the
Internet provides the possibility to invite a worldwide expert panel to participate in the study. Second, the degree of interaction among the experts can be increased due to the fact that they can immediately react on
500:
range (IQR). It has to be pointed out that the numerical visualisations as well as the qualitative inputs change in the course of other participants changing their responses. Consequently, a participant can find out to what extent his own responses from an earlier point of time are still within the
450:
Based on the findings in this seminal paper, Heiko von der Gracht developed a second Real-time Delphi platform until 2008. In subsequent years, von der Gracht and colleagues used the platform extensively for prospective research studies. In 2011, von der Gracht and Gordon presented a joint paper at
582:
can be reached, which is one of the major advantages of web-based tools. Turoff and Hiltz argue that the issue of asynchronous interaction is probably one of the least understood characteristics of Real-Time
Delphis. Zipfinger points out two advantages of asynchronous participation of the experts:
565:
or significantly different from the median. This application helps to see and understand immediately the own assessment and to think about reasons for the deviation from group opinions or else a high degree of consent. The respondent's attention will be called by highlighting questions with a high
634:
needed during the response phases (i.e. after opening the online tool) are usually less. Having developed the online tool in advance, the intermediate analysis done by the facilitator of the study is rather uncomplicated in comparison to the
Conventional Delphi. The overall shortened time period
625:
As with all Delphi studies, the process of defining and selecting experts is still extremely important. The
Conventional Delphi study is then divided into several steps of response round, analysis through the facilitator, playing back the information, next response round, and so on. However, the
552:
of participants can be shown which serves as a justification for their numerical assessment of the question. Additionally, it can be shown to the expert how many respondents have already given their answers. To examine the qualitative arguments of others participants can click on a button, and a
366:
with regard to the time frame needed to perform such studies. Friedewald, von
Oertzen, and Cuhls underline that aspect by writing, in "a Real-Time-Delphi, the participants do not only judge twice but can change their opinion as often as they like when they see the aggregated results of the other
978:
Monguet, J., Ferruzca, M., GutiĂ©rrez, A., Alatriste, Y., MartĂnez, C., Cordoba, C., Fernández, J., et al. (2010). Vector
Consensus: Decision Making for Collaborative Innovation Communities. Communications in Computer and Information Science (Vol. 110, pp. 218–227). Viana do Castelo, Portugal:
569:
After operating a question in the described procedure, the participant can continue to the next question or press a "save"-button in the program, which leads to an immediate update of the median, interquartile range, and given arguments, and then leave the program. A second advantage of the
375:. Friedewald et al. further state that the Real-Time Delphi method has beneath its explorative and predictive elements also normative and communicative elements. These latter are investigated by Bolognini, who explores the potential of computer-based Delphi as a communication technique for
482:
The typical Real-Time Delphi process can be described in the way that participants get access to an online questionnaire portal for a certain time frame, within which they are allowed to log in and log out as often as they want. Whenever they login, they will see all their
647:
connected wirelessly to the web site where the software resides, with anticipated completion of the exercise in say 20 min.". On the other hand, it can be thought of a larger panel of experts operating asynchronously from remote locations within a longer period of time.
426:
connections, high definition graphic, and advanced processor performance) facilitate more sophisticated studies in this context. The general idea to develop a faster advanced form of Delphi studies by using ideas and basic concepts of Turoff, was initiated by the U.S.
638:
Gordon and Pease point out that a Real-Time Delphi study is applicable for a wide range of possible circumstances under which the consultation of experts is necessary. On the one hand, the authors give the example of a "small group operating synchronously in a
613:
Having asked the question how the accomplishment of a Real-Time Delphi study differs from conducting a usual Delphi study, Gordon and Pease point out that a Real-Time Delphi study can be implemented via a site on the
Internet or in any other network (e.g.
652:
alpha (i.e. the first) inputs of respondents, the real-time presentation of group results, and the tracking of progress over time should be integrated in a kind of administrator package to make the accomplishment of a Real-Time Delphi less difficult.
968:
Turoff, M., & Hiltz, S. (1995). Computer based Delphi processes. In M. Adler & E. Ziglio, E. (Eds.), Gazing into the Oracle: The Delphi Method and its
Application to Social Policy and Public Health (pp. 56-88). London: Jessica Kingsley
491:
answers of previous sessions and they can change all answers as desired within the given period of time. Besides their own answers they will see the ongoing – hence, real-time – responses of other participants, and with regard to
455:
directions and advancements of the Delphi method, including real-time formats. The authors provide a methodological toolbox for designing Delphi surveys including among others sentiment analyses of the field of psychology.
1084:
828:
Friedewald, M., von Oertzen, J., & Cuhls, K. (2007). European Perspectives on the Information Society (EPIS) (Delphi Report Deliverable 2.3.1). European Techno-Economic Policy Support Network (ETEPS
594:
A further advantage is the fact that the administrator of the study can set an arbitrary time frame in which participants have to log in and take part in the questionnaire. So, whenever the
602:
of the study is satisfied with the existing answers (i.e. in terms of quantity and quality), he can declare the study to be ended and close the online tool (i.e. "freeze" the responses).
814:
Gordon, T. J., & Pease, A. (2006). RT Delphi: An Efficient, “Round-less”, Almost Real Time Delphi Method. Journal of Technological Forecasting and Social Change,73(4), 321-333.
362:
Gordon and Pease define the advanced approach as an innovative way to conduct Delphi studies that do not involve sequential "rounds" and consequently lead to a higher degree of
431:(DARPA), which awarded a grant in 2004 to develop an approach to improve "speed and efficiency of collecting judgments in tactical situations". A small software company named
610:
to access single questions again. So, on the one hand, the procedure differs from a Conventional Delphi and, on the other hand, the iteration into single rounds is missing.
382:
Comparative studies of von der Gracht and colleagues have revealed that Real-time Delphi studies are comparable to the outcome of conventional round-based Delphi surveys.
591:
process. So, in comparison to face-to-face discussions, the Real-Time Delphi approach gives room for individuality and different cognitive abilities of the participants.
410:
of the participants, continuous operations and analysis of results (i.e. participants were able to see given answers of the other participants in real-time), as well as
901:
730:
and improved understanding of global issues, opportunities, challenges, and strategies. More information on the project can be found on www.millennium-project.org
533:
others' comments. Additionally, the time frame between giving own answers and getting insights into others' responses is very short, which encourages stronger
1004:
Zipfinger, S. (2007). Computer-Aided Delphi: An Experimental Study of Comparing Round-Based with Real-Time Implementation of the Method. Linz: Trauner Verlag.
1106:
920:
428:
326:
753:. Further illustrative examples in academic journals include cases from logistics, social business, professional services, retail, and automotive.
774:
Hartman, F. T., & Baldwin, A. (1995). Using Technology to Improve Delphi Method. Journal of Computing in Civil Engineering, 9(4), 244-249.
848:
883:
Turoff, M. (1972). Delphi Conferencing: Computer-Based Conferencing with Anonymity. Technological Forecasting and Social Change, 3, 159-204.
734:
537:
with the respective issue in question. Hartman and Baldwin argue that with the help of this procedure the validity of results is maximised.
275:
738:
447:, principal consultant and CEO of Articulate Software, published the findings and methodology together with Theodore Gordon in 2006.
709:
691:
524:
Hartman and Baldwin discuss further advantages of the Real-Time Delphi approach: First, the number of experts participating in the
1018:
517:
and the real-time calculation and provision of group responses. Whereas Conventional Delphi studies are characterised by repeating
1129:
Validating an Innovative Real-Time Delphi Approach – A methodological comparison between real-time and conventional Delphi studies
864:
Validating an Innovative Real-Time Delphi Approach – A methodological comparison between real-time and conventional Delphi studies
566:
degree of deviation with a different colour and by asking him to give further reasons for his deviation from the group opinion.
467:
differs from a Conventional Delphi study. The basic framework is to think of a Delphi study which is conducted in form of an
841:
Democrazia elettronica: Metodo Delphi e politiche pubbliche (Electronic Democracy: Delphi Method and Public Policy-Making)
505:(i.e. IQR). The core innovation, then, of Real-Time Delphi studies is the real-time calculation and provision of results.
90:
750:
681:
1197:
1192:
995:
Gordon, T. J. (2007). Energy forecasts using a “Roundless” approach to running a Delphi study. Foresight, 9(2), 27-35.
285:
217:
192:
85:
938:
Preparing, conducting, and analyzing Delphi surveys: Cross-disciplinary practices, new directions, and advancements
319:
295:
38:
1187:
132:
411:
1166:
607:
584:
312:
57:
635:
needed to conduct a real-time study underlines that the approach can be regarded as generally more efficient.
545:
270:
160:
80:
615:
534:
746:
723:
549:
251:
97:
558:
451:
WFS Annual Summit 2011, which summarizes the lessons learned of 40 RTD studies across the two platforms.
432:
575:
419:
247:
175:
70:
1151:
1136:
1111:
1040:
925:
871:
493:
395:
588:
518:
1182:
1067:
727:
687:
525:
476:
468:
376:
372:
676:
626:
Real-Time Delphi study is, after granting access to the online tool, rather a self-running process.
514:
562:
502:
497:
423:
351:
300:
47:
579:
1089:
619:
403:
290:
280:
170:
165:
146:
127:
75:
30:
1102:
Heading Towards a Multimodal City of the Future? Multi-Stakeholder Scenarios for Urban Mobility
906:. In: Conference Proceedings of World Future 2011, p. 129-160, 10. July 2011, via researchgate.
367:
participants". So, here it becomes clear that the Real-Time Delphi approach requires real-time
1062:
942:
844:
541:
484:
222:
1023:
947:
488:
227:
212:
137:
122:
52:
1045:
644:
640:
571:
260:
207:
107:
102:
65:
22:
1014:
Energy-Constrained and Low-Carbon Scenarios for the Transportation and Logistics Industry
733:
Another stream of projects based on real-time Delphi studies was conducted by the former
892:
Häder, M. (2002). Delphi-Befragungen. Ein Arbeitsbuch. Wiesbaden: Westdeutscher Verlag.
440:
265:
237:
112:
1144:
Real-Time Delphi in practice — A comparative analysis of existing software-based tools
1080:
Delphi-based strategic issue management: crafting consumer goods supply chain strategy
916:
Real-Time Delphi in practice — A comparative analysis of existing software-based tools
599:
1176:
436:
399:
347:
232:
202:
180:
587:
which allows every individual to choose the sequence and speed to contribute to the
464:
394:), Delphi approach originates in a paper published by Turoff back in 1972 about an
197:
513:
The core methodological innovation of Real-Time Delphi studies are the absence of
1036:
Heading Toward a More Social Future - Scenarios for Social Enterprises in Germany
1127:
Detailed description of RTD platform and comparison of classical vs. RT Delphi:
903:
New Frontiers in Delphi Research: Experiences with Real-Time Delphi in Foresight
631:
368:
155:
722:
Numerous examples for real-time Delphi applications can be found. Among them,
595:
554:
529:
444:
415:
363:
745:, among them the T&L2030 Series of five different studies together with
407:
391:
1159:
Using the Delphi method to engage stakeholders: A comparison of two studies
402:. The conference was characterized by remote locations of participants, an
726:
conducted by Glenn, Gordon, & Florescu in 2009 provides a context for
1085:
International Journal of Physical Distribution & Logistics Management
496:
the group as a whole will be visualised in terms of median, average, and
472:
117:
742:
1058:
The Future of the Foresight Professionals: Results from a Delphi Study
622:) and is, therefore, not conducted in paper-and-pencil form any more.
471:. However, a Conventional round-based Delphi study conducted via the
390:
The basic idea of a real-time, therefore computer-based (usually
659:
561:, a so-called "flag", if his answer is within or outside the
459:
Differences between conventional and real-time Delphi method
350:. The advanced method "is a consultative process that uses
735:
Institute for Futures Studies and Knowledge Management
354:" to increase efficiency of the Delphi process.
540:In order to conduct a Real-Time Delphi study,
1148:Technological Forecasting & Social Change
1133:Technological Forecasting & Social Change
1107:Technological Forecasting & Social Change
1019:International Journal of Logistics Management
921:Technological Forecasting & Social Change
868:Technological Forecasting & Social Change
320:
8:
1110:. Volume 89, November 2014, Pages 201-221,
991:
989:
987:
985:
964:
962:
960:
958:
956:
824:
822:
820:
528:can be increased due to a higher degree of
979:Springer. doi:10.1007/978-3-642-16419-4_22
810:
808:
806:
804:
802:
800:
770:
768:
766:
751:Transportation & Logistics 2030 Series
327:
313:
18:
1066:. Volume 71, August 2015, Pages 132-145,
798:
796:
794:
792:
790:
788:
786:
784:
782:
780:
710:Learn how and when to remove this message
656:Examples of real-time Delphi applications
429:Defense Advanced Research Projects Agency
1142:Comparison of different RTD platforms:
762:
245:
145:
37:
21:
1167:doi:10.1016/j.evalprogplan.2009.06.006
1088:. Vol. 44, Issue 5, 2014, p. 373-391,
443:to develop what DARPA was asking for.
924:. Volume 118, May 2017, Pages 15-27,
843:(in Italian), Rome: Carocci Editore,
7:
1022:. Vol. 27, No. 1, 2016, p. 142-166,
463:The question arises how a Real-Time
1152:doi:10.1016/j.techfore.2017.01.023
1137:doi:10.1016/j.techfore.2011.04.006
1135:. 78, 9, 2011, p. 1681–1694,
1112:doi:10.1016/j.techfore.2013.08.036
926:doi:10.1016/j.techfore.2017.01.023
872:doi:10.1016/j.techfore.2011.04.006
739:EBS University of Business and Law
14:
1068:doi:10.1016/j.futures.2015.03.005
1044:. Vol 55, No. 1, 2014, p. 56-89,
1165:. 33, 2, 2010, p. 147-154,
690:has been specified. Please help
664:
29:
1163:Evaluation and Program Planning
1090:doi:10.1108/IJPDLM-09-2012-0289
406:to access and give judgments,
1:
1157:Early research in the field:
1024:doi:10.1108/IJLM-12-2013-0150
948:doi:10.1016/j.mex.2021.101401
870:. 78, 9, 2011, p. 1681–1694,
346:) is an advanced form of the
1150:. 118, 2017, p. 15-27,
1046:doi:10.1177/0007650314523096
839:Maurizio Bolognini (2001),
509:Methodological advancements
286:Science fiction prototyping
218:Reference class forecasting
1214:
946:. Volume 8, 2021, 101401,
680:to meet Knowledge (XXG)'s
439:was awarded an innovation
412:asynchronous participation
16:Form of the Delphi method
585:structured communication
396:online Delphi conference
58:Global catastrophic risk
546:quantitative assessment
271:Exploratory engineering
161:Causal layered analysis
1041:Business & Society
747:PricewaterhouseCoopers
724:The Millennium Project
98:Historical materialism
630:interventions of the
616:intra-company network
535:cognitive examination
420:computer aided design
176:Cross impact analysis
692:improve this section
550:qualitative judgment
469:online questionnaire
422:possibilities (e.g.
377:electronic democracy
563:interquartile range
559:attention indicator
433:Articulate Software
424:high-speed internet
358:Definition and idea
352:computer technology
301:Technology scouting
48:Accelerating change
1198:Futures techniques
1193:Estimation methods
620:local area network
494:metric assessments
291:Speculative design
171:Consensus forecast
166:Chain-linked model
128:Resource depletion
1063:Futures (journal)
850:978-88-430-2035-5
720:
719:
712:
682:quality standards
673:This section may
557:will be shown an
542:computer software
519:sequential rounds
398:conducted in the
371:and provision of
337:
336:
223:Scenario planning
86:Space exploration
1205:
1188:Systems thinking
1115:
1099:
1093:
1077:
1071:
1055:
1049:
1033:
1027:
1011:
1005:
1002:
996:
993:
980:
976:
970:
966:
951:
935:
929:
913:
907:
899:
893:
890:
884:
881:
875:
861:
855:
853:
836:
830:
826:
815:
812:
775:
772:
715:
708:
704:
701:
695:
668:
667:
660:
645:laptop computers
589:problem solution
578:and a worldwide
340:Real-time Delphi
329:
322:
315:
228:Systems analysis
213:Horizon scanning
186:Real-time Delphi
123:Population cycle
53:Cashless society
33:
19:
1213:
1212:
1208:
1207:
1206:
1204:
1203:
1202:
1173:
1172:
1124:
1119:
1118:
1100:
1096:
1078:
1074:
1056:
1052:
1034:
1030:
1012:
1008:
1003:
999:
994:
983:
977:
973:
967:
954:
936:
932:
914:
910:
900:
896:
891:
887:
882:
878:
862:
858:
851:
838:
837:
833:
827:
818:
813:
778:
773:
764:
759:
728:global thinking
716:
705:
699:
696:
685:
669:
665:
658:
641:conference room
526:real-time study
515:iterated rounds
511:
477:Internet Delphi
461:
388:
373:group responses
360:
333:
261:Critical design
208:Future workshop
108:Kardashev scale
103:Kondratiev wave
23:Futures studies
17:
12:
11:
5:
1211:
1209:
1201:
1200:
1195:
1190:
1185:
1175:
1174:
1171:
1170:
1155:
1140:
1123:
1120:
1117:
1116:
1094:
1072:
1050:
1028:
1006:
997:
981:
971:
952:
930:
908:
894:
885:
876:
856:
849:
831:
816:
776:
761:
760:
758:
755:
718:
717:
688:cleanup reason
672:
670:
663:
657:
654:
510:
507:
460:
457:
441:research grant
387:
384:
359:
356:
335:
334:
332:
331:
324:
317:
309:
306:
305:
304:
303:
298:
293:
288:
283:
278:
273:
268:
266:Design fiction
263:
255:
254:
243:
242:
241:
240:
238:Trend analysis
235:
230:
225:
220:
215:
210:
205:
200:
195:
190:
189:
188:
178:
173:
168:
163:
158:
150:
149:
143:
142:
141:
140:
135:
130:
125:
120:
115:
110:
105:
100:
95:
94:
93:
88:
83:
78:
73:
68:
60:
55:
50:
42:
41:
35:
34:
26:
25:
15:
13:
10:
9:
6:
4:
3:
2:
1210:
1199:
1196:
1194:
1191:
1189:
1186:
1184:
1181:
1180:
1178:
1168:
1164:
1160:
1156:
1153:
1149:
1145:
1141:
1138:
1134:
1130:
1126:
1125:
1121:
1113:
1109:
1108:
1103:
1098:
1095:
1091:
1087:
1086:
1081:
1076:
1073:
1069:
1065:
1064:
1059:
1054:
1051:
1047:
1043:
1042:
1037:
1032:
1029:
1025:
1021:
1020:
1015:
1010:
1007:
1001:
998:
992:
990:
988:
986:
982:
975:
972:
965:
963:
961:
959:
957:
953:
949:
945:
944:
939:
934:
931:
927:
923:
922:
917:
912:
909:
905:
904:
898:
895:
889:
886:
880:
877:
873:
869:
865:
860:
857:
852:
846:
842:
835:
832:
825:
823:
821:
817:
811:
809:
807:
805:
803:
801:
799:
797:
795:
793:
791:
789:
787:
785:
783:
781:
777:
771:
769:
767:
763:
756:
754:
752:
748:
744:
740:
736:
731:
729:
725:
714:
711:
703:
693:
689:
683:
679:
678:
671:
662:
661:
655:
653:
649:
646:
642:
636:
633:
627:
623:
621:
617:
611:
609:
608:control panel
603:
601:
600:administrator
597:
592:
590:
586:
581:
577:
573:
567:
564:
560:
556:
551:
547:
543:
538:
536:
531:
527:
522:
520:
516:
508:
506:
504:
503:group opinion
499:
498:interquartile
495:
490:
486:
480:
478:
474:
470:
466:
458:
456:
452:
448:
446:
442:
438:
437:San Francisco
434:
430:
425:
421:
418:and advanced
417:
413:
409:
405:
401:
400:United States
397:
393:
385:
383:
380:
378:
374:
370:
365:
357:
355:
353:
349:
348:Delphi method
345:
341:
330:
325:
323:
318:
316:
311:
310:
308:
307:
302:
299:
297:
294:
292:
289:
287:
284:
282:
279:
277:
274:
272:
269:
267:
264:
262:
259:
258:
257:
256:
253:
249:
244:
239:
236:
234:
233:Threatcasting
231:
229:
226:
224:
221:
219:
216:
214:
211:
209:
206:
204:
203:Futures wheel
201:
199:
196:
194:
191:
187:
184:
183:
182:
179:
177:
174:
172:
169:
167:
164:
162:
159:
157:
154:
153:
152:
151:
148:
144:
139:
138:Swanson's law
136:
134:
131:
129:
126:
124:
121:
119:
116:
114:
111:
109:
106:
104:
101:
99:
96:
92:
89:
87:
84:
82:
79:
77:
74:
72:
69:
67:
64:
63:
61:
59:
56:
54:
51:
49:
46:
45:
44:
43:
40:
36:
32:
28:
27:
24:
20:
1162:
1158:
1147:
1143:
1132:
1128:
1105:
1101:
1097:
1083:
1079:
1075:
1061:
1057:
1053:
1039:
1035:
1031:
1017:
1013:
1009:
1000:
974:
941:
937:
933:
919:
915:
911:
902:
897:
888:
879:
867:
863:
859:
840:
834:
732:
721:
706:
697:
674:
650:
637:
628:
624:
612:
604:
593:
580:expert panel
576:asynchronous
568:
539:
523:
512:
485:quantitative
481:
465:Delphi study
462:
453:
449:
389:
381:
361:
343:
339:
338:
198:Future-proof
185:
1183:Forecasting
969:Publishers.
694:if you can.
632:facilitator
572:synchronous
489:qualitative
475:is called "
416:innovations
404:online tool
369:calculation
252:forecasting
246:Technology
156:Backcasting
133:Singularity
113:Moore's law
71:Mathematics
1177:Categories
1122:References
596:researcher
555:respondent
530:automation
445:Adam Pease
364:efficiency
281:Hype cycle
248:assessment
147:Techniques
408:anonymity
392:web-based
193:Foresight
943:MethodsX
700:May 2011
675:require
473:internet
118:Peak oil
91:Universe
39:Concepts
743:Germany
677:cleanup
386:History
81:Climate
62:Future
1161:. In:
1146:. In:
1131:. In:
1104:. In:
1082:. In:
1060:. In:
1038:. In:
1016:. In:
940:. In:
918:. In:
866:. In:
847:
181:Delphi
829:Net).
757:Notes
643:with
66:Earth
845:ISBN
487:and
250:and
76:Race
741:in
737:of
686:No
598:or
574:or
435:in
344:RTD
296:TRL
276:FTA
1179::
984:^
955:^
819:^
779:^
765:^
749::
618:,
548:a
379:.
1169:.
1154:.
1139:.
1114:.
1092:.
1070:.
1048:.
1026:.
950:.
928:.
874:.
713:)
707:(
702:)
698:(
684:.
342:(
328:e
321:t
314:v
Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.