33:
149:
It is not enough to simply place cameras around the scene to be captured. The geometry of the camera set up must be measured by a process known in computer vision as "camera calibration." Manual alignment would be too cumbersome so typically a "best effort" alignment is performed prior to capturing a
145:
In order to acquire the views necessary to allow a high-quality rendering of the scene from any angle, several cameras are placed around the scene; either in a studio environment or an outdoor venue, such as a sporting arena for example. The output
Multiview Video (MVV) must then be packaged suitably
169:
Multiview video capture varies from partial (usually about 30 degrees) to complete (360 degrees) coverage of the scene. Therefore, it is possible to output stereoscopic views suitable for viewing with a 3D display or other 3D methods. Systems with more physical cameras can capture images with more
170:
coverage of the viewable scene, however, it is likely that certain regions will always be occluded from any viewpoint. A larger number of cameras should make it possible to obtain high quality output because less interpolation is needed.
153:
Restricted free viewpoint television views for large environments can be captured from a single location camera system mounted on a moving platform. Depth data must also be captured, which is necessary to generate the free viewpoint. The
108:. With FTV, the focus of attention can be controlled by the viewers rather than a director, meaning that each viewer may be observing a unique viewpoint. It remains to be seen how FTV will affect television watching as a group activity.
173:
More cameras mean that efficient coding of the
Multiview Video is required. This may not be such a big disadvantage as there are representations that can remove the redundancy in MVV; such as inter view coding using
252:
1279:
387:
1309:
1231:
1603:
1304:
1136:
120:
community for a long time but only in recent years has the speed and quality reached levels that are suitable for serious consideration as an end-user system.
1536:
1269:
1264:
465:
1299:
1645:
1367:
1021:
1384:
1404:
683:
146:
so that the data may be compressed and also so that the users' viewing device may easily access the relevant views to interpolate new views.
1314:
1284:
1274:
1254:
1224:
420:. The user is not able to change viewpoint but the camera operator is able to choose any virtual viewpoint by synthesizing images from an
54:
735:
355:
1469:
1294:
709:
1324:
189:
In terms of hardware, the user requires a viewing device that can decode MVV and synthesize new viewpoints, and a 2D or 3D display.
76:
438:
430:
265:
1474:
645:
405:
1459:
1217:
437:
created the first-ever live on-air 3D reconstruction during the London 2012 Olympic Games; their website now seems to point to
1640:
458:
1568:
1499:
1350:
1192:
1151:
227:
1187:
623:
580:
198:
310:
1319:
893:
525:
127:(Japan) has done much to promote the use of the term "free viewpoint television" and has published many papers on the
47:
41:
1464:
545:
413:
1516:
1182:
761:
699:
535:
520:
515:
451:
58:
1620:
1494:
1177:
585:
210:
128:
1655:
1556:
1546:
1289:
652:
640:
1593:
1561:
1340:
1172:
565:
206:
179:
1598:
1409:
1355:
923:
560:
340:
96:) is a system for viewing natural video, allowing the user to interactively control the viewpoint and
1521:
1504:
1484:
1454:
1141:
1041:
786:
618:
399:
1650:
1526:
1389:
158:
capture system is an example with limited functionality. The first full commercial implementation,
101:
1541:
1449:
1434:
1394:
881:
704:
155:
209:
after the work of a group called '3DAV' (3D Audio and Visual) headed by
Aljoscha Smolic at the
183:
1479:
1424:
1376:
766:
570:
486:
222:
124:
1588:
1551:
1399:
1259:
1109:
954:
844:
801:
725:
540:
474:
359:
232:
202:
1583:
1531:
1240:
1116:
1104:
1036:
1006:
989:
959:
908:
673:
630:
492:
434:
417:
117:
105:
17:
427:
339:
Carranza, Joel; Theobalt, Christian; Magnor, Marcus A.; Seidel, Hans-Peter (July 2003).
1608:
1578:
1489:
1414:
1345:
1131:
1001:
869:
740:
269:
163:
159:
97:
1634:
1573:
1026:
994:
678:
590:
498:
421:
395:
116:
Systems for rendering arbitrary views of natural scenes have been well known in the
1511:
1062:
979:
969:
964:
949:
876:
821:
811:
796:
668:
635:
575:
409:
134:
377:
1419:
1031:
984:
913:
816:
806:
791:
756:
1016:
886:
859:
555:
1099:
1011:
974:
550:
530:
314:
383:
363:
1146:
854:
849:
443:
1067:
864:
1126:
1121:
1094:
944:
898:
613:
255:." APSIPA Transactions on Signal and Information Processing 1 (2012).
175:
100:
of a dynamic scene from any 3D position. The equivalent system for
1209:
1156:
939:
918:
903:
1046:
1213:
447:
290:
391:
150:
test pattern that is used to generate calibration parameters.
26:
131:, although other techniques can be, and are used for FTV.
378:
Canon announced development of a Free
Viewpoint TV system
291:"Geometry videos: A new representation for 3D animations"
380:
on 21 September 2017, to be showcased at Inter BEE 2017.
1375:
1366:
1333:
1247:
1165:
1087:
1080:
1055:
932:
837:
830:
779:
749:
718:
692:
661:
606:
599:
508:
1225:
459:
8:
268:. Diseno-art.com. 2009-11-02. Archived from
1372:
1232:
1218:
1210:
1084:
834:
603:
466:
452:
444:
137:might be considered a predecessor to FTV.
266:"Real Time Racing | Automotive News"
77:Learn how and when to remove this message
40:This article includes a list of general
244:
1385:3D reconstruction from multiple images
341:"Free-viewpoint video of human actors"
186:representation, geometry videos, etc.
1405:Simultaneous localization and mapping
1137:Software related to augmented reality
684:Simultaneous localization and mapping
7:
736:Omnidirectional (360-degree) camera
408:is a system developed by Professor
1470:Automatic number-plate recognition
710:Image-based modeling and rendering
46:it lacks sufficient corresponding
25:
311:"Joschi's Home (Aljoscha Smolic)"
201:(MPEG) has normalized Annex H of
123:Professor Masayuki Tanimoto from
1475:Automated species identification
31:
1646:Applications of computer vision
1460:Audio-visual speech recognition
313:. Iphome.hhi.de. Archived from
253:FTV (free-viewpoint television)
1305:Recognition and categorization
1:
1569:Optical character recognition
1500:Content-based image retrieval
1152:Vuforia Augmented Reality SDK
228:Rendering (computer graphics)
1188:List of PlayStation VR games
581:Virtual reality applications
348:ACM Transactions on Graphics
199:Moving Picture Experts Group
162:, was delivered in 2009 by
1672:
1465:Automatic image annotation
1300:Noise reduction techniques
546:Projection augmented model
1617:
1430:Free viewpoint television
1183:List of Oculus Rift games
762:Omnidirectional treadmill
731:Free viewpoint television
700:Asynchronous reprojection
536:On-set virtual production
521:Computer-mediated reality
516:Cinematic virtual reality
482:
402:to develop an FTV system.
90:Free viewpoint television
18:Free-viewpoint television
1495:Computer-aided diagnosis
1178:List of Meta Quest games
586:Virtual reality sickness
211:Heinrich-Hertz Institute
129:ray space representation
1557:Moving object detection
1547:Medical image computing
1310:Research infrastructure
1280:Image sensor technology
653:Virtual retinal display
641:Virtual reality headset
61:more precise citations.
1594:Video content analysis
1562:Small object detection
1341:Computer stereo vision
1173:List of HTC Vive games
566:Six degrees of freedom
439:Intel freeD 360 Replay
416:for CBS's coverage of
207:Multiview Video Coding
180:Multiview Video Coding
1641:Television technology
1599:Video motion analysis
1410:Structure from motion
1356:3D object recognition
1022:The Sword of Damocles
924:Windows Mixed Reality
561:Simulation hypothesis
364:10.1145/882262.882309
251:Tanimoto, Masayuki. "
205:in March 2009 called
1522:Foreground detection
1505:Reverse image search
1485:Bioimage informatics
1455:Activity recognition
1142:Virtual reality game
787:Cyberith Virtualizer
619:Head-mounted display
400:University of Surrey
1589:Autonomous vehicles
1527:Gesture recognition
1390:2D to 3D conversion
428:Replay Technologies
141:Capture and display
1604:Video surveillance
1542:Landmark detection
1450:3D pose estimation
1435:Volumetric capture
1395:Gaussian splatting
1351:Object recognition
1265:Commercial systems
882:Microsoft HoloLens
705:Foveated rendering
433:2018-07-08 at the
396:Snell & Wilcox
156:Google Street View
104:video is known as
102:computer-simulated
98:generate new views
1628:
1627:
1537:Image restoration
1480:Augmented reality
1445:
1444:
1425:4D reconstruction
1377:3D reconstruction
1270:Feature detection
1207:
1206:
1203:
1202:
1076:
1075:
850:Golden-i headsets
775:
774:
767:Wearable computer
571:Spatial computing
487:Augmented reality
223:3D reconstruction
125:Nagoya University
87:
86:
79:
16:(Redirected from
1663:
1552:Object detection
1517:Face recognition
1400:Shape from focus
1373:
1260:Digital geometry
1234:
1227:
1220:
1211:
1110:virtual graffiti
1085:
955:Google Cardboard
845:Apple Vision Pro
835:
802:PlayStation Move
726:360-degree video
604:
541:Persistent world
475:Extended reality
468:
461:
454:
445:
390:project between
367:
345:
326:
325:
323:
322:
307:
301:
300:
298:
297:
287:
281:
280:
278:
277:
262:
256:
249:
233:Volumetric video
82:
75:
71:
68:
62:
57:this article by
48:inline citations
35:
34:
27:
21:
1671:
1670:
1666:
1665:
1664:
1662:
1661:
1660:
1631:
1630:
1629:
1624:
1613:
1584:Robotic mapping
1532:Image denoising
1441:
1362:
1329:
1295:Motion analysis
1243:
1241:Computer vision
1238:
1208:
1199:
1161:
1117:Meta Horizon OS
1105:Interactive art
1072:
1051:
1037:Virtual fixture
1007:Samsung Gear VR
960:Google Daydream
928:
909:PlayStation VR2
826:
771:
745:
714:
688:
674:Finger tracking
657:
631:Head-up display
595:
504:
493:Virtual reality
478:
472:
435:Wayback Machine
418:Super Bowl XXXV
374:
343:
338:
335:
330:
329:
320:
318:
309:
308:
304:
295:
293:
289:
288:
284:
275:
273:
264:
263:
259:
250:
246:
241:
219:
195:
193:Standardization
143:
118:computer vision
114:
106:virtual reality
83:
72:
66:
63:
53:Please help to
52:
36:
32:
23:
22:
15:
12:
11:
5:
1669:
1667:
1659:
1658:
1656:Motion capture
1653:
1648:
1643:
1633:
1632:
1626:
1625:
1618:
1615:
1614:
1612:
1611:
1609:Video tracking
1606:
1601:
1596:
1591:
1586:
1581:
1579:Remote sensing
1576:
1571:
1566:
1565:
1564:
1559:
1549:
1544:
1539:
1534:
1529:
1524:
1519:
1514:
1509:
1508:
1507:
1497:
1492:
1490:Blob detection
1487:
1482:
1477:
1472:
1467:
1462:
1457:
1452:
1446:
1443:
1442:
1440:
1439:
1438:
1437:
1432:
1422:
1417:
1415:View synthesis
1412:
1407:
1402:
1397:
1392:
1387:
1381:
1379:
1370:
1364:
1363:
1361:
1360:
1359:
1358:
1348:
1346:Motion capture
1343:
1337:
1335:
1331:
1330:
1328:
1327:
1322:
1317:
1312:
1307:
1302:
1297:
1292:
1287:
1282:
1277:
1272:
1267:
1262:
1257:
1251:
1249:
1245:
1244:
1239:
1237:
1236:
1229:
1222:
1214:
1205:
1204:
1201:
1200:
1198:
1197:
1196:
1195:
1185:
1180:
1175:
1169:
1167:
1163:
1162:
1160:
1159:
1154:
1149:
1144:
1139:
1134:
1132:Pervasive game
1129:
1124:
1119:
1114:
1113:
1112:
1102:
1097:
1091:
1089:
1082:
1078:
1077:
1074:
1073:
1071:
1070:
1065:
1059:
1057:
1053:
1052:
1050:
1049:
1044:
1039:
1034:
1029:
1024:
1019:
1014:
1009:
1004:
1002:PlayStation VR
999:
998:
997:
992:
982:
977:
972:
967:
962:
957:
952:
947:
942:
936:
934:
930:
929:
927:
926:
921:
916:
911:
906:
901:
896:
891:
890:
889:
879:
874:
873:
872:
862:
857:
852:
847:
841:
839:
832:
828:
827:
825:
824:
819:
814:
809:
804:
799:
794:
789:
783:
781:
777:
776:
773:
772:
770:
769:
764:
759:
753:
751:
747:
746:
744:
743:
741:VR photography
738:
733:
728:
722:
720:
716:
715:
713:
712:
707:
702:
696:
694:
690:
689:
687:
686:
681:
676:
671:
665:
663:
662:3D interaction
659:
658:
656:
655:
650:
649:
648:
638:
633:
628:
627:
626:
616:
610:
608:
601:
597:
596:
594:
593:
588:
583:
578:
573:
568:
563:
558:
553:
548:
543:
538:
533:
528:
523:
518:
512:
510:
506:
505:
503:
502:
496:
490:
483:
480:
479:
473:
471:
470:
463:
456:
448:
442:
441:
425:
403:
381:
373:
372:External links
370:
369:
368:
334:
331:
328:
327:
302:
282:
257:
243:
242:
240:
237:
236:
235:
230:
225:
218:
215:
194:
191:
164:Real Time Race
142:
139:
113:
110:
85:
84:
39:
37:
30:
24:
14:
13:
10:
9:
6:
4:
3:
2:
1668:
1657:
1654:
1652:
1649:
1647:
1644:
1642:
1639:
1638:
1636:
1623:
1622:
1621:Main category
1616:
1610:
1607:
1605:
1602:
1600:
1597:
1595:
1592:
1590:
1587:
1585:
1582:
1580:
1577:
1575:
1574:Pose tracking
1572:
1570:
1567:
1563:
1560:
1558:
1555:
1554:
1553:
1550:
1548:
1545:
1543:
1540:
1538:
1535:
1533:
1530:
1528:
1525:
1523:
1520:
1518:
1515:
1513:
1510:
1506:
1503:
1502:
1501:
1498:
1496:
1493:
1491:
1488:
1486:
1483:
1481:
1478:
1476:
1473:
1471:
1468:
1466:
1463:
1461:
1458:
1456:
1453:
1451:
1448:
1447:
1436:
1433:
1431:
1428:
1427:
1426:
1423:
1421:
1418:
1416:
1413:
1411:
1408:
1406:
1403:
1401:
1398:
1396:
1393:
1391:
1388:
1386:
1383:
1382:
1380:
1378:
1374:
1371:
1369:
1365:
1357:
1354:
1353:
1352:
1349:
1347:
1344:
1342:
1339:
1338:
1336:
1332:
1326:
1323:
1321:
1318:
1316:
1313:
1311:
1308:
1306:
1303:
1301:
1298:
1296:
1293:
1291:
1288:
1286:
1283:
1281:
1278:
1276:
1273:
1271:
1268:
1266:
1263:
1261:
1258:
1256:
1253:
1252:
1250:
1246:
1242:
1235:
1230:
1228:
1223:
1221:
1216:
1215:
1212:
1194:
1191:
1190:
1189:
1186:
1184:
1181:
1179:
1176:
1174:
1171:
1170:
1168:
1164:
1158:
1155:
1153:
1150:
1148:
1145:
1143:
1140:
1138:
1135:
1133:
1130:
1128:
1125:
1123:
1120:
1118:
1115:
1111:
1108:
1107:
1106:
1103:
1101:
1098:
1096:
1093:
1092:
1090:
1086:
1083:
1079:
1069:
1066:
1064:
1061:
1060:
1058:
1054:
1048:
1045:
1043:
1040:
1038:
1035:
1033:
1030:
1028:
1027:VFX1 Headgear
1025:
1023:
1020:
1018:
1015:
1013:
1010:
1008:
1005:
1003:
1000:
996:
993:
991:
988:
987:
986:
983:
981:
978:
976:
973:
971:
968:
966:
963:
961:
958:
956:
953:
951:
948:
946:
943:
941:
938:
937:
935:
931:
925:
922:
920:
917:
915:
912:
910:
907:
905:
902:
900:
897:
895:
892:
888:
885:
884:
883:
880:
878:
875:
871:
868:
867:
866:
863:
861:
858:
856:
853:
851:
848:
846:
843:
842:
840:
836:
833:
829:
823:
820:
818:
815:
813:
810:
808:
805:
803:
800:
798:
795:
793:
790:
788:
785:
784:
782:
778:
768:
765:
763:
760:
758:
755:
754:
752:
748:
742:
739:
737:
734:
732:
729:
727:
724:
723:
721:
717:
711:
708:
706:
703:
701:
698:
697:
695:
691:
685:
682:
680:
679:Pose tracking
677:
675:
672:
670:
667:
666:
664:
660:
654:
651:
647:
644:
643:
642:
639:
637:
634:
632:
629:
625:
622:
621:
620:
617:
615:
612:
611:
609:
605:
602:
598:
592:
591:Virtual world
589:
587:
584:
582:
579:
577:
574:
572:
569:
567:
564:
562:
559:
557:
554:
552:
549:
547:
544:
542:
539:
537:
534:
532:
529:
527:
524:
522:
519:
517:
514:
513:
511:
507:
500:
499:Mixed reality
497:
494:
491:
488:
485:
484:
481:
476:
469:
464:
462:
457:
455:
450:
449:
446:
440:
436:
432:
429:
426:
423:
422:active vision
419:
415:
411:
407:
404:
401:
397:
393:
389:
386:is a British
385:
382:
379:
376:
375:
371:
365:
361:
357:
353:
349:
342:
337:
336:
332:
317:on 2009-11-26
316:
312:
306:
303:
292:
286:
283:
272:on 2011-04-17
271:
267:
261:
258:
254:
248:
245:
238:
234:
231:
229:
226:
224:
221:
220:
216:
214:
212:
208:
204:
200:
192:
190:
187:
185:
181:
177:
171:
167:
165:
161:
157:
151:
147:
140:
138:
136:
132:
130:
126:
121:
119:
111:
109:
107:
103:
99:
95:
91:
81:
78:
70:
60:
56:
50:
49:
43:
38:
29:
28:
19:
1619:
1512:Eye tracking
1429:
1368:Applications
1334:Technologies
1320:Segmentation
1063:Project Iris
980:Oculus Quest
970:Liquid Image
965:Google Glass
877:Meta Quest 3
865:Meta Quest 2
822:Wizdish ROVR
812:Virtuix Omni
797:Oculus Touch
730:
669:Eye tracking
636:Smartglasses
600:Technologies
576:Telepresence
410:Takeo Kanade
351:
347:
333:Bibliography
319:. Retrieved
315:the original
305:
294:. Retrieved
285:
274:. Retrieved
270:the original
260:
247:
196:
188:
172:
168:
152:
148:
144:
135:QuickTime VR
133:
122:
115:
93:
89:
88:
73:
64:
45:
1420:Visual hull
1315:Researchers
1032:Virtual Boy
985:Oculus Rift
919:Vuzix Blade
914:Valve Index
817:Wired glove
807:Razer Hydra
792:Leap Motion
780:Peripherals
757:Haptic suit
719:Photography
358:: 569–577.
59:introducing
1651:3D imaging
1635:Categories
1290:Morphology
1248:Categories
1056:Unreleased
1042:Virtuality
1017:SixthSense
860:Magic Leap
556:Room-scale
406:Eye Vision
321:2010-09-13
296:2016-12-08
276:2010-09-13
239:References
203:MPEG-4 AVC
42:references
1100:ARToolKit
1012:Sensorama
975:Oculus Go
551:Real life
531:Metaverse
526:Immersion
184:ray space
67:July 2020
1325:Software
1285:Learning
1275:Geometry
1255:Datasets
1147:visionOS
1081:Software
950:EyePhone
855:HTC Vive
693:Software
509:Concepts
431:Archived
217:See also
1088:General
1068:Sega VR
838:Current
831:Devices
624:optical
607:Display
424:system.
112:History
55:improve
1127:OpenXR
1122:OpenVR
1095:ARCore
995:Rift S
945:castAR
933:Former
899:PICO 4
614:EyeTap
182:, the
176:MPEG-4
44:, but
1166:Games
1157:WebXR
940:AntVR
904:Pimax
750:Other
384:iview
354:(3).
344:(PDF)
160:iFlex
1047:VR-1
894:OSVR
646:list
501:(MR)
495:(VR)
489:(AR)
477:(XR)
398:and
197:The
1193:VR2
990:CV1
870:Pro
414:CMU
412:at
392:BBC
388:DTI
360:doi
356:ACM
178:or
94:FTV
1637::
394:,
352:22
350:.
346:.
213:.
166:.
1233:e
1226:t
1219:v
887:2
467:e
460:t
453:v
366:.
362::
324:.
299:.
279:.
92:(
80:)
74:(
69:)
65:(
51:.
20:)
Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.