245:, where she audited commercial facial recognition technologies from Microsoft, Amazon, IBM, Face++, and Kairos. They found that these technologies were significantly less accurate for darker-skinned women than for white men. With support from other top AI researchers and increased public pressure and campaigning, their work led IBM and Amazon to agree to support facial recognition regulation and later halt the sale of their product to police for at least a year. Raji also interned at machine learning startup
31:
260:
and worked with their
Ethical AI team on creating model cards, a documentation framework for more transparent machine learning model reporting. She also co-led the development of internal auditing practices at Google. Her contributions at Google were separately presented and published at the
751:
Raji, Inioluwa
Deborah; Smart, Andrew; White, Rebecca N.; Mitchell, Margaret; Gebru, Timnit; Hutchinson, Ben; Smith-Loud, Jamila; Theron, Daniel; Barnes, Parker (2020-01-03). "Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing".
221:, graduating in 2019. In 2015, she founded Project Include, a nonprofit providing increased student access to engineering education, mentorship, and resources in low income and immigrant communities in the
773:
Mitchell, Margaret; Wu, Simone; Zaldivar, Andrew; Barnes, Parker; Vasserman, Lucy; Hutchinson, Ben; Spitzer, Elena; Raji, Inioluwa
Deborah; Gebru, Timnit (2019-01-29). "Model Cards for Model Reporting".
730:
Raji, Inioluwa
Deborah; Gebru, Timnit; Mitchell, Margaret; Buolamwini, Joy; Lee, Joonseok; Denton, Emily (2020-01-03). "Saving Face: Investigating the Ethical Concerns of Facial Recognition Auditing".
266:
262:
541:
516:
408:
1018:
1063:
896:
871:
681:
1083:
1048:
1033:
1023:
706:
1068:
1058:
1073:
801:
146:
492:
1043:
1038:
657:
400:
225:. She received a Doctor of Philosophy - PhD, in Computer Science from the University of California, Berkeley in Aug 2021.
1078:
425:
276:
working on setting industry machine learning transparency standards and benchmarking norms. Raji was a Tech Fellow at the
603:"Actionable auditing: Investigating the impact of publicly naming biased performance results of commercial ai products"
602:
846:
81:
624:
242:
158:
1028:
904:
177:
working on how to operationalize ethical considerations in machine learning engineering practice. A current
1053:
1008:
542:"U of T Engineering alumna Inioluwa Deborah Raji named to MIT Technology Review's Top Innovators Under 35"
825:
Xiang, Alice; Raji, Inioluwa
Deborah (2019-11-25). "On the Legal Compatibility of Fairness Definitions".
566:
1013:
975:
378:
320:
218:
182:
67:
222:
455:
373:
174:
950:
826:
807:
779:
753:
731:
281:
178:
161:
on researching gender and racial bias in facial recognition technology. She has also worked with
110:
401:"'This is bigger than just Timnit': How Google tried to silence a critic and ignited a movement"
287:
Raji's work on bias in facial recognition systems has been highlighted in the 2020 documentary
797:
632:
327:
273:
166:
114:
789:
292:
277:
170:
142:
118:
100:
77:
980:
344:
250:
625:"Amazon Is Pushing Facial Technology That a Study Says Could Be Biased (Published 2019)"
484:
309:
234:
150:
1002:
872:"Coded Bias: Director Shalini Kantayya on Solving Facial Recognition's Serious Flaws"
238:
198:
141:(born 1995/1996) is a Nigerian-Canadian computer scientist and activist who works on
126:
44:
811:
590:
313:
154:
305:
206:
707:"The two-year fight to stop Amazon from selling face recognition to the police"
288:
636:
793:
567:"Deborah Raji of Mozilla on Forbes 30 under 30, Mentorship in AI & more"
776:
Proceedings of the
Conference on Fairness, Accountability, and Transparency
682:"IBM walked away from facial recognition. What about Amazon and Microsoft?"
658:"Why it matters that IBM is getting out of the facial recognition business"
925:
280:
worked on algorithmic and AI auditing. Currently, she is a fellow at the
246:
210:
202:
48:
610:
Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and
Society
517:"She is holding companies accountable for biased AI facial technology"
213:, Canada, when she was four years old. Eventually her family moved to
334:
257:
214:
186:
162:
122:
30:
831:
784:
758:
736:
308:
AI Innovations Award in category AI for Good (received with
267:
ACM Conference on
Fairness, Accountability, and Transparency
149:, and algorithmic auditing. Raji has previously worked with
340:
2021 100 Brilliant Women in AI Ethics Hall of Fame
Honoree
847:"About Face: A Survey of Facial Recognition Evaluation"
256:
She participated in a research mentorship program at
165:’s Ethical AI team and been a research fellow at the
426:"Mozilla Welcomes Two New Fellows in Trustworthy AI"
106:
96:
73:
63:
55:
37:
21:
897:"AI innovation winners announced in San Francisco"
284:researching algorithmic auditing and evaluation.
16:Nigerian-Canadian computer scientist and activist
272:In 2019, Raji was a summer research fellow at
456:"Inioluwa Deborah Raji | Innovators Under 35"
8:
485:"Inioluwa Deborah Raji - Forbes 30 Under 30"
189:as one of the world's top young innovators.
571:RE•WORK Blog - AI & Deep Learning News
349:magazine 100 Most Influential People in AI
337:30 Under 30 Award in Enterprise Technology
29:
18:
830:
783:
757:
735:
217:. She studied Engineering Science at the
359:
330:(received with Buolamwini and Gebru)
7:
511:
509:
479:
477:
475:
450:
448:
446:
420:
418:
367:
365:
363:
1019:Artificial intelligence researchers
974:Shaw, Simmone (September 7, 2023).
181:fellow, she has been recognized by
85:Algorithmic auditing and evaluation
1064:Canadian women computer scientists
14:
955:100 Brilliant Women in AI Ethics™
656:Heilweil, Rebecca (2020-06-10).
411:from the original on 2021-02-26.
399:Schwab, Katharine (2021-02-26).
495:from the original on 2020-12-01
930:Electronic Frontier Foundation
623:Singer, Natasha (2019-01-25).
41:1995/1996 (age 28–29)
1:
926:"Pioneer Award Ceremony 2020"
1084:Nigerian emigrants to Canada
1049:Machine learning researchers
1034:Canadian computer scientists
1024:University of Toronto alumni
903:. 2019-07-12. Archived from
612:: 429–435. January 27, 2019.
1069:Computer vision researchers
1059:Facial recognition software
323:35 Under 35 Innovator Award
253:model for flagging images.
82:Fairness (machine learning)
1100:
243:Algorithmic Justice League
159:Algorithmic Justice League
1074:Black Canadian scientists
460:www.innovatorsunder35.com
372:Hao, Karen (2020-06-17).
132:
89:
28:
249:, where she worked on a
193:Early life and education
1044:Scientists from Ontario
1039:People from Mississauga
976:"Inioluwa Deborah Raji"
794:10.1145/3287560.3287596
546:U of T Engineering News
521:U of T Engineering News
374:"Inioluwa Deborah Raji"
591:Deborah Raji. LinkedIn
711:MIT Technology Review
379:MIT Technology Review
321:MIT Technology Review
274:The Partnership on AI
219:University of Toronto
183:MIT Technology Review
139:Inioluwa Deborah Raji
68:University of Toronto
23:Inioluwa Deborah Raji
1079:Black Canadian women
778:. pp. 220–229.
223:Greater Toronto Area
878:. 14 September 2020
229:Career and research
175:New York University
629:The New York Times
430:Mozilla Foundation
282:Mozilla Foundation
111:Mozilla Foundation
901:Innovation Matrix
328:EFF Pioneer Award
233:Raji worked with
197:Raji was born in
167:Partnership on AI
147:AI accountability
136:
135:
115:Partnership on AI
91:Scientific career
1091:
993:
992:
990:
988:
971:
965:
964:
962:
961:
947:
941:
940:
938:
937:
922:
916:
915:
913:
912:
893:
887:
886:
884:
883:
868:
862:
861:
859:
858:
843:
837:
836:
834:
822:
816:
815:
787:
770:
764:
763:
761:
748:
742:
741:
739:
727:
721:
720:
718:
717:
703:
697:
696:
694:
693:
678:
672:
671:
669:
668:
653:
647:
646:
644:
643:
620:
614:
613:
607:
599:
593:
588:
582:
581:
579:
578:
563:
557:
556:
554:
553:
538:
532:
531:
529:
528:
513:
504:
503:
501:
500:
481:
470:
469:
467:
466:
452:
441:
440:
438:
437:
422:
413:
412:
396:
390:
389:
387:
386:
369:
293:Shalini Kantayya
278:AI Now Institute
171:AI Now Institute
143:algorithmic bias
119:AI Now Institute
101:Computer Science
78:Algorithmic bias
33:
19:
1099:
1098:
1094:
1093:
1092:
1090:
1089:
1088:
999:
998:
997:
996:
986:
984:
973:
972:
968:
959:
957:
949:
948:
944:
935:
933:
924:
923:
919:
910:
908:
895:
894:
890:
881:
879:
870:
869:
865:
856:
854:
845:
844:
840:
824:
823:
819:
804:
772:
771:
767:
750:
749:
745:
729:
728:
724:
715:
713:
705:
704:
700:
691:
689:
680:
679:
675:
666:
664:
655:
654:
650:
641:
639:
622:
621:
617:
605:
601:
600:
596:
589:
585:
576:
574:
565:
564:
560:
551:
549:
540:
539:
535:
526:
524:
515:
514:
507:
498:
496:
483:
482:
473:
464:
462:
454:
453:
444:
435:
433:
424:
423:
416:
398:
397:
393:
384:
382:
371:
370:
361:
356:
301:
299:Selected awards
265:conference and
251:computer vision
231:
205:, and moved to
195:
125:
121:
117:
113:
84:
80:
64:Alma mater
51:
42:
24:
17:
12:
11:
5:
1097:
1095:
1087:
1086:
1081:
1076:
1071:
1066:
1061:
1056:
1051:
1046:
1041:
1036:
1031:
1029:Mozilla people
1026:
1021:
1016:
1011:
1001:
1000:
995:
994:
966:
951:"Hall of Fame"
942:
917:
888:
863:
838:
817:
802:
765:
743:
722:
698:
673:
648:
615:
594:
583:
558:
533:
505:
471:
442:
414:
391:
358:
357:
355:
352:
351:
350:
341:
338:
331:
324:
317:
310:Joy Buolamwini
300:
297:
235:Joy Buolamwini
230:
227:
194:
191:
151:Joy Buolamwini
134:
133:
130:
129:
108:
104:
103:
98:
94:
93:
87:
86:
75:
74:Known for
71:
70:
65:
61:
60:
57:
53:
52:
43:
39:
35:
34:
26:
25:
22:
15:
13:
10:
9:
6:
4:
3:
2:
1096:
1085:
1082:
1080:
1077:
1075:
1072:
1070:
1067:
1065:
1062:
1060:
1057:
1055:
1054:MIT Media Lab
1052:
1050:
1047:
1045:
1042:
1040:
1037:
1035:
1032:
1030:
1027:
1025:
1022:
1020:
1017:
1015:
1012:
1010:
1009:Living people
1007:
1006:
1004:
983:
982:
977:
970:
967:
956:
952:
946:
943:
931:
927:
921:
918:
907:on 2020-12-09
906:
902:
898:
892:
889:
877:
873:
867:
864:
852:
848:
842:
839:
833:
828:
821:
818:
813:
809:
805:
803:9781450361255
799:
795:
791:
786:
781:
777:
769:
766:
760:
755:
747:
744:
738:
733:
726:
723:
712:
708:
702:
699:
687:
683:
677:
674:
663:
659:
652:
649:
638:
634:
630:
626:
619:
616:
611:
604:
598:
595:
592:
587:
584:
572:
568:
562:
559:
547:
543:
537:
534:
522:
518:
512:
510:
506:
494:
490:
486:
480:
478:
476:
472:
461:
457:
451:
449:
447:
443:
431:
427:
421:
419:
415:
410:
406:
402:
395:
392:
381:
380:
375:
368:
366:
364:
360:
353:
348:
347:
342:
339:
336:
332:
329:
325:
322:
318:
315:
311:
307:
303:
302:
298:
296:
294:
290:
285:
283:
279:
275:
270:
268:
264:
259:
254:
252:
248:
244:
240:
239:MIT Media Lab
236:
228:
226:
224:
220:
216:
212:
208:
204:
200:
199:Port Harcourt
192:
190:
188:
184:
180:
176:
172:
168:
164:
160:
156:
152:
148:
144:
140:
131:
128:
127:MIT Media Lab
124:
120:
116:
112:
109:
105:
102:
99:
95:
92:
88:
83:
79:
76:
72:
69:
66:
62:
58:
54:
50:
46:
45:Port Harcourt
40:
36:
32:
27:
20:
1014:1990s births
985:. Retrieved
979:
969:
958:. Retrieved
954:
945:
934:. Retrieved
932:. 2020-08-24
929:
920:
909:. Retrieved
905:the original
900:
891:
880:. Retrieved
876:Stanford HAI
875:
866:
855:. Retrieved
853:. 2021-02-01
850:
841:
820:
775:
768:
746:
725:
714:. Retrieved
710:
701:
690:. Retrieved
688:. 2020-06-10
685:
676:
665:. Retrieved
661:
651:
640:. Retrieved
628:
618:
609:
597:
586:
575:. Retrieved
573:. 2021-02-03
570:
561:
550:. Retrieved
548:. 2020-06-23
545:
536:
525:. Retrieved
523:. 2019-02-11
520:
497:. Retrieved
488:
463:. Retrieved
459:
434:. Retrieved
432:. 2020-10-16
429:
405:Fast Company
404:
394:
383:. Retrieved
377:
345:
314:Timnit Gebru
306:Venture Beat
291:directed by
286:
271:
255:
232:
196:
155:Timnit Gebru
138:
137:
107:Institutions
90:
686:VentureBeat
207:Mississauga
56:Nationality
1003:Categories
987:October 3,
960:2021-02-27
936:2021-02-27
911:2021-02-27
882:2021-03-15
857:2021-02-26
832:1912.00761
785:1810.03993
759:2001.00973
737:2001.00964
716:2021-02-27
692:2021-02-27
667:2021-02-27
642:2021-02-27
577:2021-02-27
552:2021-02-27
527:2021-02-26
499:2021-02-27
465:2021-02-26
436:2021-02-27
385:2021-02-27
354:References
289:Coded Bias
157:, and the
637:0362-4331
812:52946140
493:Archived
409:Archived
247:Clarifai
59:Canadian
237:at the
211:Ontario
203:Nigeria
179:Mozilla
49:Nigeria
851:DeepAI
810:
800:
635:
489:Forbes
335:Forbes
258:Google
215:Ottawa
187:Forbes
163:Google
123:Google
97:Fields
827:arXiv
808:S2CID
780:arXiv
754:arXiv
732:arXiv
606:(PDF)
343:2023
333:2021
326:2020
319:2020
304:2019
989:2023
981:Time
798:ISBN
633:ISSN
346:Time
312:and
263:AAAI
241:and
185:and
169:and
38:Born
790:doi
662:Vox
173:at
1005::
978:.
953:.
928:.
899:.
874:.
849:.
806:.
796:.
788:.
709:.
684:.
660:.
631:.
627:.
608:.
569:.
544:.
519:.
508:^
491:.
487:.
474:^
458:.
445:^
428:.
417:^
407:.
403:.
376:.
362:^
295:.
269:.
209:,
201:,
153:,
145:,
47:,
991:.
963:.
939:.
914:.
885:.
860:.
835:.
829::
814:.
792::
782::
762:.
756::
740:.
734::
719:.
695:.
670:.
645:.
580:.
555:.
530:.
502:.
468:.
439:.
388:.
316:)
Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.
