109:(HUD). The important difference is that the scene available to the eye is also available to the computer that projects the head-up display. This enables the EyeTap to modify the computer generated scene in response to the natural scene. One use, for instance, would be a sports EyeTap: here the wearer, while in a stadium, would be able to follow a particular player in a field and have the EyeTap display statistics relevant to that player as a floating box above the player. Another practical use for the EyeTap would be in a construction yard as it would allow the user to reference the blueprints, especially in a 3D manner, to the current state of the building, display a list of current materials and their current locations as well perform basic measurements. Or, even in the business world, the EyeTap has great potential, for it would be capable of delivering to the user constant up to date information on the stock market, the user's corporation, and meeting statuses. On a more day-to-day basis some of Steve Mann's first uses for the technology was using it to keep track of names of people and places, his to-do lists, and keeping track of his other daily ordeals. The EyeTap Criteria are an attempt to define how close a real, practical device comes to such an ideal. EyeTaps could have great use in any field where the user would benefit from real-time interactive information that is largely visual in nature. This is sometimes referred to as
95:
387:
32:
530:
395:
212:
20:
538:
201:
The EyeTap is essentially a half-silvered mirror in front of the user's eye, reflecting some of the light into a sensor. The sensor then sends the image to the aremac, a display device capable of displaying data at any fitting depth. The output rays from the aremac are reflected off the half-silvered
71:
to send the same scene (with reduced intensity) to both the eye and a camera. The camera then digitizes the reflected image of the scene and sends it to a computer. The computer processes the image and then sends it to a projector. The projector sends the image to the other side of the beam splitter
153:
The EyeTap has applications in the world of cyborg logging, as it allows the user the ability to perform real-time visual capture of their daily lives from their own point of view. In this way, the EyeTap could be used to create a lifelong cyborg log or “glog” of the user's life and the events they
63:
on the original scene available to the eye. This structure allows the user's eye to operate as both a monitor and a camera as the EyeTap intakes the world around it and augments the image the user sees allowing it to overlay computer-generated data over top of the normal world the user would
144:
Users may find that they experience side effects such as headaches and difficulty sleeping if usage occurs shortly before sleep. Mann finds that due to his extensive use of the device that going without it can cause him to feel "nauseous, unsteady, naked" when he removes it.
417:
72:
so that this computer-generated image is reflected into the eye to be superimposed on the original scene. Stereo EyeTaps modify light passing through both eyes, but many research prototypes (mainly for reasons of ease of construction) only tap one eye.
169:
and its viewfinder which in turn was rigged to a helmet. Ever since this first version, it has gone through multiple models as wearable computing evolves, allowing the EyeTap to shrink down to a smaller and less weighty version.
154:
participate in, potentially recording enough media to allow producers centuries in the future to present the user's life as interactive entertainment (or historical education) to consumers of that era.
471:
504:
1536:
865:
728:
1421:
1083:
1135:
481:
1109:
205:
In these cases, the EyeTap views infrared light, as well as the overall design schematic of how the EyeTap manipulates lightrays.
1045:
422:
1619:
858:
1592:
1551:
654:
1587:
1023:
980:
269:
245:
128:
due to its abilities to direct visual information to parts of the retina that function well. As well, Eyetap's role in
1293:
925:
802:
777:
531:"Part man, part machine – all nerd ; 'Wearable computer' pioneer Steve Mann keeps one eye locked on the future"
1629:
945:
60:
1582:
1161:
1130:
1099:
935:
920:
915:
851:
111:
729:"Sousveillance: Inventing and Using Wearable Computing Devices for Data Collection in Surveillance Environments"
1577:
985:
173:
Currently the EyeTap consists of the eyepiece used to display the images, the keypad which the user can use to
1052:
1040:
178:
1572:
965:
751:
562:"Designing EyeTap Digital Eyeglasses for Continuous Lifelong Capture and Sharing of Personal Experiences"
1323:
960:
580:
224:
162:
79:
36:
700:
298:
39:
wearing a metal frame Laser EyeTap (computer-controlled laser light source run from "GlassEye" camera)
1541:
1441:
1186:
1018:
476:
165:
created the first version of the EyeTap, which consisted of a computer in a backpack wired up to a
94:
1281:
1104:
328:
388:"Now computers are built to suit Wearable technology has a few wrinkles, but usage is expanding"
446:
1166:
970:
886:
743:
117:
83:
48:
24:
1624:
1509:
1354:
1244:
1201:
1125:
940:
874:
336:
1516:
1504:
1436:
1406:
1389:
1359:
1308:
1073:
1030:
892:
593:
190:
106:
631:
1531:
1401:
1269:
1140:
705:
360:
228:
174:
67:
In order to capture what the eye is seeing as accurately as possible, an EyeTap uses a
1613:
1426:
1394:
1078:
990:
898:
133:
129:
99:
68:
505:"SCIENTIST AT WORK: STEVE MANN; Real-Life Cyborg Challenges Reality With Technology"
31:
1462:
1379:
1369:
1364:
1349:
1276:
1221:
1211:
1196:
1068:
1035:
975:
250:
240:
1431:
1384:
1313:
1216:
1206:
1191:
1156:
677:
1416:
1286:
1259:
955:
608:
810:
747:
59:
to record the scene available to the eye as well as a display to superimpose
1499:
1411:
1374:
950:
930:
211:
181:
which can be attached to most articles of clothing and in some cases even a
125:
52:
561:
678:"Blind photographer Arun Blake consulting on Eyetap and blindness in 2004"
1546:
1254:
1249:
202:
mirror back into the eye of the user along with the original light rays.
186:
843:
19:
1467:
1264:
1526:
1521:
1494:
1344:
1298:
166:
56:
560:
Mann, Steve; James Fung; Chris Aimone; Anurag Sehgal; Daniel Chen.
98:
Inventor Steve Mann using weather-resistant EyeTap together with a
1556:
1339:
1318:
1303:
182:
124:
Eyetap has been explored as a potential tool for individuals with
93:
1446:
847:
472:"Cyborg genius claims he's the next step in human evolution"
355:
353:
210:
329:"Professor's 25 years of cyborg life mirrors tech advances"
82:
to develop and promote EyeTap-related technologies such as
836:
177:
with the EyeTap and have it perform the desired tasks, a
418:"Being Steve Mann: Cyberwear pioneer alters his reality"
78:
is also the name of an organization founded by inventor
270:"Seattle band has already benefited by using ringtone"
322:
320:
293:
291:
1565:
1487:
1480:
1455:
1332:
1237:
1230:
1179:
1149:
1118:
1092:
1061:
1006:
999:
908:
727:Mann, Steve; Jason Nolan; Barry Wellman (2003).
803:"EyeTap: The eye itself as display and camera"
859:
8:
132:has been explored by Mann, Jason Nolan and
1484:
1234:
1003:
866:
852:
844:
655:"Snap photo first, answer questions later"
16:Wearable computer worn in front of the eye
778:"Captain Cyborg faces Canadian challenge"
30:
18:
261:
589:
578:
503:Schechter, Bruce (25 September 2001).
1537:Software related to augmented reality
1084:Simultaneous localization and mapping
653:McCullagh, Declan (26 October 2004).
7:
630:Brian, Bergstein (15 January 2004).
607:McCullagh, Declan (27 August 2003).
327:Bergstein, Brian (12 January 2004).
51:device that is worn in front of the
1136:Omnidirectional (360-degree) camera
208:A conceptual diagram of an EyeTap:
1110:Image-based modeling and rendering
776:Haines, Lester (15 January 2004).
480:. 3 September 2009. Archived from
185:device so the user can access the
14:
423:The Atlanta Journal-Constitution
361:"The ultimate wearable computer"
299:"Why life as a cyborg is better"
699:Butler, Don (5 February 2009).
447:"Part Man, Part Film, All Mann"
701:"Part VI: Everyone's watching"
386:Grieser, Andy (20 June 2001).
227:) are the most common type of
1:
1552:Vuforia Augmented Reality SDK
567:. EyeTap Personal Imaging Lab
105:An EyeTap is somewhat like a
1588:List of PlayStation VR games
981:Virtual reality applications
426:. 26 March 2000. p. A17
246:Optical head-mounted display
807:EyeTap Personal Imaging Lab
609:"Newsmaker: Cyborgs unite!"
529:Shinn, Eric (8 July 2001).
445:Brad King (12 March 2002).
1648:
946:Projection augmented model
736:Surveillance & Society
61:computer-generated imagery
1583:List of Oculus Rift games
1162:Omnidirectional treadmill
1131:Free viewpoint television
1100:Asynchronous reprojection
936:On-set virtual production
921:Computer-mediated reality
916:Cinematic virtual reality
882:
112:computer-mediated reality
1578:List of Meta Quest games
986:Virtual reality sickness
149:Cyborglogs & EyeTaps
1053:Virtual retinal display
1041:Virtual reality headset
23:Man wearing a one-eyed
1620:Multimodal interaction
1573:List of HTC Vive games
966:Six degrees of freedom
809:. 2004. Archived from
588:Cite journal requires
215:
197:Principle of operation
102:
40:
28:
1422:The Sword of Damocles
1324:Windows Mixed Reality
961:Simulation hypothesis
632:"Computer's eye view"
225:Charge-coupled device
214:
140:Possible side effects
97:
34:
22:
1542:Virtual reality game
1187:Cyberith Virtualizer
1019:Head-mounted display
477:The Jamaica Observer
115:, commonly known as
398:on October 22, 2012
126:visual disabilities
47:is a concept for a
1282:Microsoft HoloLens
1105:Foveated rendering
813:on 5 February 2012
680:. Lemmingworks.org
509:The New York Times
216:
103:
84:wearable computers
49:wearable computing
41:
29:
1630:Augmented reality
1607:
1606:
1603:
1602:
1476:
1475:
1250:Golden-i headsets
1175:
1174:
1167:Wearable computer
971:Spatial computing
887:Augmented reality
541:on April 11, 2013
305:. 19 January 2004
274:The Seattle Times
118:augmented reality
1637:
1510:virtual graffiti
1485:
1355:Google Cardboard
1245:Apple Vision Pro
1235:
1202:PlayStation Move
1126:360-degree video
1004:
941:Persistent world
875:Extended reality
868:
861:
854:
845:
840:
839:
837:Official website
823:
822:
820:
818:
799:
793:
792:
790:
788:
773:
767:
766:
764:
762:
757:on 25 March 2009
756:
750:. Archived from
733:
724:
718:
717:
715:
713:
696:
690:
689:
687:
685:
673:
667:
666:
664:
662:
650:
644:
643:
641:
639:
627:
621:
620:
618:
616:
604:
598:
597:
591:
586:
584:
576:
574:
572:
566:
557:
551:
550:
548:
546:
537:. Archived from
526:
520:
519:
517:
515:
500:
494:
493:
491:
489:
468:
462:
461:
459:
457:
442:
436:
435:
433:
431:
414:
408:
407:
405:
403:
394:. Archived from
383:
377:
376:
374:
372:
357:
348:
347:
345:
343:
337:Associated Press
324:
315:
314:
312:
310:
295:
286:
285:
283:
281:
266:
35:EyeTap inventor
25:injection-molded
1647:
1646:
1640:
1639:
1638:
1636:
1635:
1634:
1610:
1609:
1608:
1599:
1561:
1517:Meta Horizon OS
1505:Interactive art
1472:
1451:
1437:Virtual fixture
1407:Samsung Gear VR
1360:Google Daydream
1328:
1309:PlayStation VR2
1226:
1171:
1145:
1114:
1088:
1074:Finger tracking
1057:
1031:Head-up display
995:
904:
893:Virtual reality
878:
872:
835:
834:
831:
826:
816:
814:
801:
800:
796:
786:
784:
775:
774:
770:
760:
758:
754:
731:
726:
725:
721:
711:
709:
698:
697:
693:
683:
681:
675:
674:
670:
660:
658:
652:
651:
647:
637:
635:
629:
628:
624:
614:
612:
606:
605:
601:
587:
577:
570:
568:
564:
559:
558:
554:
544:
542:
528:
527:
523:
513:
511:
502:
501:
497:
487:
485:
484:on 4 March 2016
470:
469:
465:
455:
453:
444:
443:
439:
429:
427:
416:
415:
411:
401:
399:
392:Chicago Tribune
385:
384:
380:
370:
368:
359:
358:
351:
341:
339:
326:
325:
318:
308:
306:
297:
296:
289:
279:
277:
276:. 18 April 2005
268:
267:
263:
259:
237:
221:
199:
160:
151:
142:
107:head-up display
92:
55:that acts as a
17:
12:
11:
5:
1645:
1644:
1641:
1633:
1632:
1627:
1622:
1612:
1611:
1605:
1604:
1601:
1600:
1598:
1597:
1596:
1595:
1585:
1580:
1575:
1569:
1567:
1563:
1562:
1560:
1559:
1554:
1549:
1544:
1539:
1534:
1532:Pervasive game
1529:
1524:
1519:
1514:
1513:
1512:
1502:
1497:
1491:
1489:
1482:
1478:
1477:
1474:
1473:
1471:
1470:
1465:
1459:
1457:
1453:
1452:
1450:
1449:
1444:
1439:
1434:
1429:
1424:
1419:
1414:
1409:
1404:
1402:PlayStation VR
1399:
1398:
1397:
1392:
1382:
1377:
1372:
1367:
1362:
1357:
1352:
1347:
1342:
1336:
1334:
1330:
1329:
1327:
1326:
1321:
1316:
1311:
1306:
1301:
1296:
1291:
1290:
1289:
1279:
1274:
1273:
1272:
1262:
1257:
1252:
1247:
1241:
1239:
1232:
1228:
1227:
1225:
1224:
1219:
1214:
1209:
1204:
1199:
1194:
1189:
1183:
1181:
1177:
1176:
1173:
1172:
1170:
1169:
1164:
1159:
1153:
1151:
1147:
1146:
1144:
1143:
1141:VR photography
1138:
1133:
1128:
1122:
1120:
1116:
1115:
1113:
1112:
1107:
1102:
1096:
1094:
1090:
1089:
1087:
1086:
1081:
1076:
1071:
1065:
1063:
1062:3D interaction
1059:
1058:
1056:
1055:
1050:
1049:
1048:
1038:
1033:
1028:
1027:
1026:
1016:
1010:
1008:
1001:
997:
996:
994:
993:
988:
983:
978:
973:
968:
963:
958:
953:
948:
943:
938:
933:
928:
923:
918:
912:
910:
906:
905:
903:
902:
896:
890:
883:
880:
879:
873:
871:
870:
863:
856:
848:
842:
841:
830:
829:External links
827:
825:
824:
794:
768:
719:
706:Ottawa Citizen
691:
676:Nolan, Jason.
668:
645:
634:. CJOnline.com
622:
599:
590:|journal=
552:
521:
495:
463:
437:
409:
378:
367:. 25 June 2001
349:
316:
287:
260:
258:
255:
254:
253:
248:
243:
236:
233:
229:digital camera
220:
217:
198:
195:
159:
156:
150:
147:
141:
138:
91:
88:
15:
13:
10:
9:
6:
4:
3:
2:
1643:
1642:
1631:
1628:
1626:
1623:
1621:
1618:
1617:
1615:
1594:
1591:
1590:
1589:
1586:
1584:
1581:
1579:
1576:
1574:
1571:
1570:
1568:
1564:
1558:
1555:
1553:
1550:
1548:
1545:
1543:
1540:
1538:
1535:
1533:
1530:
1528:
1525:
1523:
1520:
1518:
1515:
1511:
1508:
1507:
1506:
1503:
1501:
1498:
1496:
1493:
1492:
1490:
1486:
1483:
1479:
1469:
1466:
1464:
1461:
1460:
1458:
1454:
1448:
1445:
1443:
1440:
1438:
1435:
1433:
1430:
1428:
1427:VFX1 Headgear
1425:
1423:
1420:
1418:
1415:
1413:
1410:
1408:
1405:
1403:
1400:
1396:
1393:
1391:
1388:
1387:
1386:
1383:
1381:
1378:
1376:
1373:
1371:
1368:
1366:
1363:
1361:
1358:
1356:
1353:
1351:
1348:
1346:
1343:
1341:
1338:
1337:
1335:
1331:
1325:
1322:
1320:
1317:
1315:
1312:
1310:
1307:
1305:
1302:
1300:
1297:
1295:
1292:
1288:
1285:
1284:
1283:
1280:
1278:
1275:
1271:
1268:
1267:
1266:
1263:
1261:
1258:
1256:
1253:
1251:
1248:
1246:
1243:
1242:
1240:
1236:
1233:
1229:
1223:
1220:
1218:
1215:
1213:
1210:
1208:
1205:
1203:
1200:
1198:
1195:
1193:
1190:
1188:
1185:
1184:
1182:
1178:
1168:
1165:
1163:
1160:
1158:
1155:
1154:
1152:
1148:
1142:
1139:
1137:
1134:
1132:
1129:
1127:
1124:
1123:
1121:
1117:
1111:
1108:
1106:
1103:
1101:
1098:
1097:
1095:
1091:
1085:
1082:
1080:
1079:Pose tracking
1077:
1075:
1072:
1070:
1067:
1066:
1064:
1060:
1054:
1051:
1047:
1044:
1043:
1042:
1039:
1037:
1034:
1032:
1029:
1025:
1022:
1021:
1020:
1017:
1015:
1012:
1011:
1009:
1005:
1002:
998:
992:
991:Virtual world
989:
987:
984:
982:
979:
977:
974:
972:
969:
967:
964:
962:
959:
957:
954:
952:
949:
947:
944:
942:
939:
937:
934:
932:
929:
927:
924:
922:
919:
917:
914:
913:
911:
907:
900:
899:Mixed reality
897:
894:
891:
888:
885:
884:
881:
876:
869:
864:
862:
857:
855:
850:
849:
846:
838:
833:
832:
828:
812:
808:
804:
798:
795:
783:
779:
772:
769:
753:
749:
745:
741:
737:
730:
723:
720:
708:
707:
702:
695:
692:
679:
672:
669:
656:
649:
646:
633:
626:
623:
610:
603:
600:
595:
582:
563:
556:
553:
540:
536:
532:
525:
522:
510:
506:
499:
496:
483:
479:
478:
473:
467:
464:
452:
448:
441:
438:
425:
424:
419:
413:
410:
397:
393:
389:
382:
379:
366:
362:
356:
354:
350:
338:
334:
330:
323:
321:
317:
304:
300:
294:
292:
288:
275:
271:
265:
262:
256:
252:
249:
247:
244:
242:
239:
238:
234:
232:
230:
226:
223:CCD Cameras (
218:
213:
209:
206:
203:
196:
194:
192:
188:
184:
180:
176:
171:
168:
164:
157:
155:
148:
146:
139:
137:
135:
134:Barry Wellman
131:
130:sousveillance
127:
122:
120:
119:
114:
113:
108:
101:
100:hydraulophone
96:
90:Possible uses
89:
87:
85:
81:
77:
73:
70:
69:beam splitter
65:
62:
58:
54:
50:
46:
38:
33:
26:
21:
1463:Project Iris
1380:Oculus Quest
1370:Liquid Image
1365:Google Glass
1277:Meta Quest 3
1265:Meta Quest 2
1222:Wizdish ROVR
1212:Virtuix Omni
1197:Oculus Touch
1069:Eye tracking
1036:Smartglasses
1013:
1000:Technologies
976:Telepresence
815:. Retrieved
811:the original
806:
797:
785:. Retrieved
782:The Register
781:
771:
759:. Retrieved
752:the original
739:
735:
722:
710:. Retrieved
704:
694:
682:. Retrieved
671:
659:. Retrieved
648:
636:. Retrieved
625:
613:. Retrieved
602:
581:cite journal
569:. Retrieved
555:
543:. Retrieved
539:the original
535:Toronto Star
534:
524:
512:. Retrieved
508:
498:
486:. Retrieved
482:the original
475:
466:
454:. Retrieved
450:
440:
428:. Retrieved
421:
412:
400:. Retrieved
396:the original
391:
381:
369:. Retrieved
364:
340:. Retrieved
332:
307:. Retrieved
302:
278:. Retrieved
273:
264:
251:Google Glass
241:Smartglasses
231:used today.
222:
207:
204:
200:
172:
161:
152:
143:
123:
116:
110:
104:
75:
74:
66:
44:
42:
1432:Virtual Boy
1385:Oculus Rift
1319:Vuzix Blade
1314:Valve Index
1217:Wired glove
1207:Razer Hydra
1192:Leap Motion
1180:Peripherals
1157:Haptic suit
1119:Photography
787:2 September
761:6 September
712:2 September
684:6 September
661:6 September
657:. CNET News
638:3 September
615:6 September
611:. CNET News
545:3 September
514:3 September
488:24 February
456:3 September
430:3 September
402:3 September
371:3 September
342:2 September
309:3 September
303:Daily Times
280:3 September
191:online data
1614:Categories
1456:Unreleased
1442:Virtuality
1417:SixthSense
1260:Magic Leap
956:Room-scale
257:References
219:Components
163:Steve Mann
80:Steve Mann
64:perceive.
37:Steve Mann
1500:ARToolKit
1412:Sensorama
1375:Oculus Go
951:Real life
931:Metaverse
926:Immersion
748:1477-7487
451:Wired.com
365:USA Today
333:USA Today
175:interface
1547:visionOS
1481:Software
1350:EyePhone
1255:HTC Vive
1093:Software
909:Concepts
817:14 March
571:14 March
235:See also
187:Internet
1625:Eyewear
1488:General
1468:Sega VR
1238:Current
1231:Devices
1024:optical
1007:Display
158:History
1527:OpenXR
1522:OpenVR
1495:ARCore
1395:Rift S
1345:castAR
1333:Former
1299:PICO 4
1014:EyeTap
746:
167:camera
76:EyeTap
57:camera
45:EyeTap
27:EyeTap
1566:Games
1557:WebXR
1340:AntVR
1304:Pimax
1150:Other
755:(PDF)
742:(3).
732:(PDF)
565:(PDF)
183:Wi-Fi
1447:VR-1
1294:OSVR
1046:list
901:(MR)
895:(VR)
889:(AR)
877:(XR)
819:2012
789:2009
763:2009
744:ISSN
714:2009
686:2009
663:2009
640:2009
617:2009
594:help
573:2012
547:2009
516:2009
490:2013
458:2009
432:2009
404:2009
373:2009
344:2009
311:2009
282:2009
189:and
1593:VR2
1390:CV1
1270:Pro
179:CPU
53:eye
43:An
1616::
805:.
780:.
738:.
734:.
703:.
585::
583:}}
579:{{
533:.
507:.
474:.
449:.
420:.
390:.
363:.
352:^
335:.
331:.
319:^
301:.
290:^
272:.
193:.
136:.
121:.
86:.
1287:2
867:e
860:t
853:v
821:.
791:.
765:.
740:1
716:.
688:.
665:.
642:.
619:.
596:)
592:(
575:.
549:.
518:.
492:.
460:.
434:.
406:.
375:.
346:.
313:.
284:.
Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.
