Knowledge

Risk of astronomical suffering

Source 📝

2130: 31: 3145: 2142: 120:, it could also potentially increase the level of contrast in the hedonic range that sentient beings could experience. He argues that these technologies might make it feasible to create "hyperpain" or "dolorium" that experience levels of suffering beyond the human range. He also argues that there are other potential S-risks that are more exotic, such as those posed by the 2762: 3148: 2755: 3112: 2698: 2748: 2829: 2771: 2577: 1582: 921: 878: 149: 847: 76:
by introducing wild animals, who "generally lead short, miserable lives full of sometimes the most brutal suffering", to other planets, either intentionally or inadvertently.
2900: 712: 2940: 1975: 3177: 2935: 1873: 3119: 3099: 2705: 2416: 2281: 2203: 926: 2251: 1029: 574: 792: 2905: 2426: 2032: 1970: 2945: 2506: 705: 462: 404: 1111: 1049: 2421: 1604: 1044: 943: 3087: 2004: 698: 584: 2824: 1024: 256: 139: 633: 316: 2834: 2521: 2261: 2196: 1589: 1285: 2789: 2663: 2431: 1636: 1133: 1106: 737: 286: 3212: 2895: 994: 2411: 2241: 1384: 1290: 742: 673: 113: 223: 98:
has been proposed as a way to mitigate s-risks in locked-in conscious AI and certain AI-adjacent biological systems like
3126: 2986: 2915: 2526: 2451: 2406: 2037: 1434: 1334: 3197: 3187: 3132: 2677: 2622: 2189: 2168: 1917: 1116: 1066: 2393: 2286: 1577: 1429: 1404: 814: 179: 121: 105: 112:
is a potential s-risk. Pearce argues that while technological mastery over the pleasure-pain axis and solving the
3167: 2885: 2869: 2819: 2729: 2656: 2516: 2401: 2047: 1980: 1823: 1555: 1550: 1424: 1254: 1096: 883: 3172: 2920: 2839: 2684: 2597: 2582: 2456: 2153: 2042: 1937: 1863: 1690: 1319: 1019: 721: 164: 159: 117: 54: 3207: 2775: 2486: 2236: 2148: 1717: 1572: 868: 532:"Position: Enforced Amnesia as a Way to Mitigate the Potential Risk of Silent Suffering in the Conscious AI" 61: 2844: 2712: 2541: 2276: 2163: 1997: 1944: 1838: 1661: 1506: 864: 144: 3202: 2799: 2670: 2632: 1567: 1379: 841: 802: 174: 99: 73: 484: 426: 2890: 2296: 1729: 1631: 1496: 1458: 1208: 1012: 906: 84: 384: 3105: 2531: 2073: 1853: 1724: 1646: 1244: 1190: 1138: 1101: 1091: 797: 342:"Nonconscious Cognitive Suffering: Considering Suffering Risks of Embodied Artificial Intelligence" 109: 3192: 2612: 2572: 2557: 2511: 2476: 2446: 2231: 2212: 1776: 1771: 1749: 1734: 1626: 1414: 1394: 1344: 1307: 1297: 1148: 985: 512: 454: 154: 134: 69: 2740: 2129: 3071: 3046: 2864: 2649: 2501: 2496: 2372: 2337: 2312: 2226: 2009: 1910: 1705: 1513: 1478: 1439: 1389: 1280: 1264: 1007: 970: 948: 933: 916: 834: 620: 580: 504: 446: 396: 249:"S-risks: Why they are the worst existential risks, and how to prevent them (EAG Boston 2017)" 72:, which could potentially lead to "constant and catastrophic wars" and an immense increase in 65: 3093: 3066: 2966: 2814: 2691: 2342: 2332: 2271: 2158: 2093: 1922: 1900: 1744: 1712: 1700: 1676: 1302: 1249: 1239: 1198: 1128: 1123: 852: 760: 610: 594: 496: 438: 363: 353: 215: 53:
than all that has occurred on Earth so far. They are sometimes categorized as a subclass of
3031: 3011: 3001: 2991: 2925: 2859: 2461: 2436: 2256: 1987: 1828: 1399: 1259: 1175: 1163: 1143: 1039: 829: 809: 732: 248: 34:
Scope–severity grid from Bostrom's paper "Existential Risk Prevention as Global Priority"
2854: 2617: 2607: 2592: 2562: 2536: 2481: 2327: 2291: 2246: 1965: 1905: 1890: 1843: 1739: 1685: 1545: 1203: 1180: 1153: 1071: 1061: 963: 958: 824: 775: 308: 169: 88: 599:"Artificial Suffering: An Argument for a Global Moratorium on Synthetic Phenomenology" 3182: 3161: 3061: 3006: 2976: 2587: 2567: 2491: 2108: 1992: 1949: 1895: 1883: 1868: 1858: 1781: 1695: 1671: 1666: 1540: 1535: 1530: 1446: 1034: 975: 938: 890: 516: 458: 557:"Quora Answers by David Pearce (2015 - 2024) : Transhumanism with a human face" 3051: 2981: 2794: 2466: 2388: 2362: 2357: 2347: 2322: 2134: 2068: 1800: 1786: 1641: 1451: 1419: 1409: 1312: 1158: 1056: 1002: 911: 770: 278: 30: 500: 442: 556: 3056: 3041: 2849: 2809: 2441: 2266: 2113: 1795: 1656: 1651: 1488: 1473: 1349: 1324: 953: 873: 780: 765: 654: 358: 341: 3021: 2996: 2971: 2930: 2910: 2317: 2063: 1878: 1848: 1833: 1621: 1609: 1369: 1231: 857: 638: 615: 598: 200: 624: 531: 508: 450: 400: 3036: 3026: 2804: 2367: 1805: 1594: 1523: 1468: 1463: 1329: 1170: 1076: 819: 690: 219: 80: 50: 385:"Superintelligence As a Cause or Cure For Risks of Astronomical Suffering" 3016: 2602: 2471: 2352: 2098: 2083: 1614: 1599: 1501: 1339: 787: 427:"Space colonization and suffering risks: Reassessing the "maxipok rule"" 368: 2078: 1932: 1927: 1764: 1754: 1562: 1374: 1086: 1081: 95: 17: 2950: 2181: 2088: 2014: 536:
Proceedings of the 41st International Conference on Machine Learning
1759: 1518: 29: 2103: 674:"Reducing Risks of Astronomical Suffering: A Neglected Priority" 2744: 2185: 694: 576:
Avoiding the Worst: How to Prevent a Moral Catastrophe
340:
Umbrello, Steven; Sorgner, Stefan Lorenz (June 2019).
2830:
Existential risk from artificial general intelligence
2578:
Existential risk from artificial general intelligence
922:
Self-indication assumption doomsday argument rebuttal
634:"The grim fate that could be 'worse than extinction'" 150:
Existential risk from artificial general intelligence
2398:
All-Party Parliamentary Group for Future Generations
848:
Safety of high-energy particle collision experiments
603:
Journal of Artificial Intelligence and Consciousness
3080: 2959: 2901:
Center for Human-Compatible Artificial Intelligence
2878: 2782: 2722: 2641: 2550: 2381: 2305: 2219: 2056: 2025: 1958: 1816: 1487: 1362: 1273: 1230: 1223: 1189: 993: 984: 899: 753: 2941:Leverhulme Centre for the Future of Intelligence 1976:List of apocalyptic and post-apocalyptic fiction 201:"Existential Risk Prevention as Global Priority" 2936:Institute for Ethics and Emerging Technologies 2417:Centre for Enabling EA Learning & Research 1874:List of dates predicted for apocalyptic events 3120:Superintelligence: Paths, Dangers, Strategies 3100:Open letter on artificial intelligence (2015) 2756: 2706:Superintelligence: Paths, Dangers, Strategies 2197: 879:Existential risk from artificial intelligence 706: 60:Sources of possible s-risks include embodied 8: 2282:Psychological barriers to effective altruism 927:Self-referencing doomsday argument rebuttal 672:Althaus, David; Gloor, Lukas (2016-09-14). 2763: 2749: 2741: 2252:Distributional cost-effectiveness analysis 2204: 2190: 2182: 1227: 1030:Climate change and civilizational collapse 990: 713: 699: 691: 614: 367: 357: 2906:Centre for the Study of Existential Risk 2427:Centre for the Study of Existential Risk 2033:Centre for the Study of Existential Risk 1971:Apocalyptic and post-apocalyptic fiction 383:Sotala, Kaj; Gloor, Lukas (2017-12-27). 2946:Machine Intelligence Research Institute 2507:Machine Intelligence Research Institute 191: 3178:Philosophy of artificial intelligence 7: 1050:Tipping points in the climate system 335: 333: 2422:Center for High Impact Philanthropy 1045:Extinction risk from climate change 944:New World Order (conspiracy theory) 277:Hilton, Benjamin (September 2022). 3088:Statement on AI risk of extinction 2005:List of fictional doomsday devices 25: 2825:Ethics of artificial intelligence 1025:Cataclysmic pole shift hypothesis 140:Ethics of artificial intelligence 3144: 3143: 2835:Friendly artificial intelligence 2262:Equal consideration of interests 2141: 2140: 2128: 1286:Decline in amphibian populations 49:, are risks involving much more 2664:Famine, Affluence, and Morality 2432:Development Media International 1637:Four Horsemen of the Apocalypse 1134:Land surface effects on climate 1107:Human impact on the environment 738:Future of an expanding universe 465:from the original on 2019-04-29 407:from the original on 2021-04-16 319:from the original on 2023-07-09 289:from the original on 2024-05-09 259:from the original on 2023-10-08 229:from the original on 2014-07-14 39:Risks of astronomical suffering 27:Risks of astronomical suffering 2896:Center for Applied Rationality 2628:Risk of astronomical suffering 1: 2412:Centre for Effective Altruism 2242:Disability-adjusted life year 1583:Interpretations of Revelation 1385:Cosmological phase transition 1291:Decline in insect populations 743:Ultimate fate of the universe 659:Center for Reducing Suffering 501:10.1016/j.futures.2020.102638 485:"Risks of space colonization" 443:10.1016/j.futures.2018.04.008 313:Center for Reducing Suffering 236:– via Existential Risk. 114:hard problem of consciousness 2916:Future of Humanity Institute 2527:Raising for Effective Giving 2452:Future of Humanity Institute 2038:Future of Humanity Institute 1435:Potentially hazardous object 1335:Interplanetary contamination 116:could lead to the potential 83:researcher, has warned that 3133:Artificial Intelligence Act 3127:Do You Trust This Computer? 2678:Living High and Letting Die 2623:Neglected tropical diseases 1918:Nemesis (hypothetical star) 1067:Global terrestrial stilling 579:. Independently published. 483:Kovic, Marko (2021-02-01). 425:Torres, Phil (2018-06-01). 359:10.3390/philosophies4020024 3229: 2394:Against Malaria Foundation 2287:Quality-adjusted life year 1430:Asteroid impact prediction 1405:Heat death of the universe 815:Mutual assured destruction 655:"S-risks: An introduction" 632:Minardi, Di (2020-10-15). 247:Daniel, Max (2017-06-20). 180:Wirehead (science fiction) 122:many-worlds interpretation 3141: 2886:Alignment Research Center 2870:Technological singularity 2820:Effective accelerationism 2730:Effective Altruism Global 2657:The End of Animal Farming 2517:Nuclear Threat Initiative 2402:Animal Charity Evaluators 2122: 2048:Nuclear Threat Initiative 1981:List of apocalyptic films 1824:2011 end times prediction 1556:Prophecy of Seventy Weeks 1551:Abomination of desolation 1425:Asteroid impact avoidance 1255:List of extinction events 1097:Environmental degradation 884:Technological singularity 728: 722:Global catastrophic risks 616:10.1142/S270507852150003X 530:Tkachenko, Yegor (2024). 2921:Future of Life Institute 2840:Instrumental convergence 2685:The Most Good You Can Do 2598:Intensive animal farming 2583:Global catastrophic risk 2457:Future of Life Institute 2043:Future of Life Institute 1945:Resurrection of the dead 1938:Post-tribulation rapture 1320:Colony collapse disorder 678:Center on Long-Term Risk 653:Baumann, Tobias (2017). 573:Baumann, Tobias (2022). 307:Baumann, Tobias (2017). 253:Center on Long-Term Risk 165:Suffering-focused ethics 160:Global catastrophic risk 118:eradication of suffering 2776:artificial intelligence 2487:The Good Food Institute 2237:Demandingness objection 869:Artificial intelligence 220:10.1111/1758-5899.12002 91:more prone to s-risks. 62:artificial intelligence 2845:Intelligence explosion 2713:What We Owe the Future 2542:Wild Animal Initiative 2277:Moral circle expansion 1998:List of disaster films 1839:Apocalyptic literature 939:Malthusian catastrophe 865:Synthetic intelligence 199:Bostrom, Nick (2013). 145:Ethics of terraforming 124:of quantum mechanics. 35: 3213:Wild animal suffering 2800:AI capability control 2671:The Life You Can Save 2633:Wild animal suffering 1380:Coronal mass ejection 842:Electromagnetic pulse 803:Kinetic energy weapon 175:Wild animal suffering 74:wild animal suffering 33: 2891:Center for AI Safety 2297:Venture philanthropy 1782:War of Gog and Magog 1459:Near-Earth supernova 1209:Human overpopulation 1013:Mass mortality event 907:Anthropogenic hazard 85:biological computing 79:Steven Umbrello, an 3106:Our Final Invention 2532:Sentience Institute 1854:Blood moon prophecy 1647:Number of the Beast 1245:Holocene extinction 1191:Earth Overshoot Day 1139:Ocean acidification 1102:Habitat destruction 1092:Ecological collapse 798:Kinetic bombardment 733:Future of the Earth 110:genetic engineering 3198:Technology hazards 3188:Space colonization 2613:Malaria prevention 2573:Economic stability 2558:Biotechnology risk 2512:Malaria Consortium 2477:Giving What We Can 2447:Fistula Foundation 2232:Charity assessment 2213:Effective altruism 2169:Doomsday scenarios 1735:Beast of the Earth 1627:Book of Revelation 1415:Virtual black hole 1395:False vacuum decay 1345:Pollinator decline 1308:Biological warfare 1298:Biotechnology risk 1149:Resource depletion 155:Experience machine 135:AI control problem 70:space colonization 36: 3155: 3154: 3072:Eliezer Yudkowsky 3047:Stuart J. Russell 2865:Superintelligence 2738: 2737: 2650:Doing Good Better 2522:Open Philanthropy 2502:Mercy for Animals 2497:The Humane League 2373:Eliezer Yudkowsky 2338:William MacAskill 2313:Sam Bankman-Fried 2227:Aid effectiveness 2179: 2178: 2010:Zombie apocalypse 1911:Postmillennialism 1706:Great Tribulation 1479:Stellar collision 1440:Near-Earth object 1390:Geomagnetic storm 1358: 1357: 1281:Biodiversity loss 1265:Genetic pollution 1219: 1218: 1008:Biodiversity loss 971:Societal collapse 949:Nuclear holocaust 934:Economic collapse 917:Doomsday argument 835:Antimatter weapon 595:Metzinger, Thomas 66:superintelligence 55:existential risks 16:(Redirected from 3220: 3168:Consequentialism 3147: 3146: 3094:Human Compatible 3067:Roman Yampolskiy 2815:Consequentialism 2772:Existential risk 2765: 2758: 2751: 2742: 2692:Practical Ethics 2343:Dustin Moskovitz 2333:Holden Karnofsky 2272:Marginal utility 2206: 2199: 2192: 2183: 2144: 2143: 2135:World portal 2133: 2132: 2094:Financial crisis 1923:Nibiru cataclysm 1901:Premillennialism 1745:Dhul-Suwayqatayn 1713:Son of perdition 1701:Olivet Discourse 1677:Whore of Babylon 1303:Biological agent 1250:Human extinction 1240:Extinction event 1228: 1199:Overexploitation 1129:Land consumption 1124:Land degradation 991: 853:Micro black hole 761:Chemical warfare 715: 708: 701: 692: 687: 685: 684: 668: 666: 665: 649: 647: 646: 628: 618: 590: 561: 560: 553: 547: 546: 544: 543: 527: 521: 520: 480: 474: 473: 471: 470: 422: 416: 415: 413: 412: 380: 374: 373: 371: 361: 337: 328: 327: 325: 324: 304: 298: 297: 295: 294: 274: 268: 267: 265: 264: 244: 238: 237: 235: 234: 228: 205: 196: 108:has argued that 21: 3228: 3227: 3223: 3222: 3221: 3219: 3218: 3217: 3173:Future problems 3158: 3157: 3156: 3151: 3137: 3076: 3032:Steve Omohundro 3012:Geoffrey Hinton 3002:Stephen Hawking 2987:Paul Christiano 2967:Scott Alexander 2955: 2926:Google DeepMind 2874: 2860:Suffering risks 2778: 2769: 2739: 2734: 2718: 2637: 2603:Land use reform 2546: 2462:Founders Pledge 2437:Evidence Action 2377: 2301: 2257:Earning to give 2215: 2210: 2180: 2175: 2154:Future problems 2127: 2118: 2052: 2021: 1988:Climate fiction 1954: 1829:2012 phenomenon 1812: 1718:Sheep and Goats 1605:2 Thessalonians 1483: 1400:Gamma-ray burst 1354: 1269: 1260:Genetic erosion 1215: 1185: 1176:Water pollution 1144:Ozone depletion 1040:Desertification 980: 895: 830:Doomsday device 810:Nuclear warfare 749: 724: 719: 682: 680: 671: 663: 661: 652: 644: 642: 631: 593: 587: 572: 569: 567:Further reading 564: 555: 554: 550: 541: 539: 529: 528: 524: 482: 481: 477: 468: 466: 424: 423: 419: 410: 408: 382: 381: 377: 339: 338: 331: 322: 320: 306: 305: 301: 292: 290: 276: 275: 271: 262: 260: 246: 245: 241: 232: 230: 226: 203: 198: 197: 193: 189: 184: 130: 100:brain organoids 43:suffering risks 28: 23: 22: 15: 12: 11: 5: 3226: 3224: 3216: 3215: 3210: 3208:Utilitarianism 3205: 3200: 3195: 3190: 3185: 3180: 3175: 3170: 3160: 3159: 3153: 3152: 3142: 3139: 3138: 3136: 3135: 3130: 3123: 3116: 3109: 3102: 3097: 3090: 3084: 3082: 3078: 3077: 3075: 3074: 3069: 3064: 3059: 3054: 3049: 3044: 3039: 3034: 3029: 3024: 3019: 3014: 3009: 3004: 2999: 2994: 2989: 2984: 2979: 2974: 2969: 2963: 2961: 2957: 2956: 2954: 2953: 2948: 2943: 2938: 2933: 2928: 2923: 2918: 2913: 2908: 2903: 2898: 2893: 2888: 2882: 2880: 2876: 2875: 2873: 2872: 2867: 2862: 2857: 2855:Machine ethics 2852: 2847: 2842: 2837: 2832: 2827: 2822: 2817: 2812: 2807: 2802: 2797: 2792: 2786: 2784: 2780: 2779: 2770: 2768: 2767: 2760: 2753: 2745: 2736: 2735: 2733: 2732: 2726: 2724: 2720: 2719: 2717: 2716: 2709: 2702: 2695: 2688: 2681: 2674: 2667: 2660: 2653: 2645: 2643: 2639: 2638: 2636: 2635: 2630: 2625: 2620: 2618:Mass deworming 2615: 2610: 2608:Life extension 2605: 2600: 2595: 2593:Global poverty 2590: 2585: 2580: 2575: 2570: 2565: 2563:Climate change 2560: 2554: 2552: 2548: 2547: 2545: 2544: 2539: 2537:Unlimit Health 2534: 2529: 2524: 2519: 2514: 2509: 2504: 2499: 2494: 2489: 2484: 2482:Good Food Fund 2479: 2474: 2469: 2464: 2459: 2454: 2449: 2444: 2439: 2434: 2429: 2424: 2419: 2414: 2409: 2404: 2399: 2396: 2391: 2385: 2383: 2379: 2378: 2376: 2375: 2370: 2365: 2360: 2355: 2350: 2345: 2340: 2335: 2330: 2328:Hilary Greaves 2325: 2320: 2315: 2309: 2307: 2303: 2302: 2300: 2299: 2294: 2292:Utilitarianism 2289: 2284: 2279: 2274: 2269: 2264: 2259: 2254: 2249: 2247:Disease burden 2244: 2239: 2234: 2229: 2223: 2221: 2217: 2216: 2211: 2209: 2208: 2201: 2194: 2186: 2177: 2176: 2174: 2173: 2172: 2171: 2166: 2161: 2156: 2151: 2149:Apocalypticism 2138: 2123: 2120: 2119: 2117: 2116: 2111: 2106: 2101: 2096: 2091: 2086: 2081: 2076: 2071: 2066: 2060: 2058: 2054: 2053: 2051: 2050: 2045: 2040: 2035: 2029: 2027: 2023: 2022: 2020: 2019: 2018: 2017: 2007: 2002: 2001: 2000: 1993:Disaster films 1990: 1985: 1984: 1983: 1978: 1968: 1966:Alien invasion 1962: 1960: 1956: 1955: 1953: 1952: 1947: 1942: 1941: 1940: 1935: 1925: 1920: 1915: 1914: 1913: 1908: 1906:Amillennialism 1903: 1893: 1891:Millenarianism 1888: 1887: 1886: 1876: 1871: 1866: 1861: 1856: 1851: 1846: 1844:Apocalypticism 1841: 1836: 1831: 1826: 1820: 1818: 1814: 1813: 1811: 1810: 1809: 1808: 1798: 1793: 1792: 1791: 1790: 1789: 1784: 1779: 1769: 1768: 1767: 1762: 1757: 1752: 1747: 1742: 1740:Dhu al-Qarnayn 1737: 1732: 1722: 1721: 1720: 1715: 1710: 1709: 1708: 1698: 1693: 1688: 1686:Great Apostasy 1683: 1682: 1681: 1680: 1679: 1674: 1669: 1664: 1659: 1654: 1649: 1644: 1639: 1624: 1619: 1618: 1617: 1612: 1602: 1597: 1592: 1587: 1586: 1585: 1575: 1565: 1560: 1559: 1558: 1553: 1543: 1533: 1531:Last Judgement 1528: 1527: 1526: 1521: 1511: 1510: 1509: 1504: 1493: 1491: 1489:Eschatological 1485: 1484: 1482: 1481: 1476: 1471: 1466: 1461: 1456: 1455: 1454: 1449: 1444: 1443: 1442: 1432: 1427: 1417: 1412: 1407: 1402: 1397: 1392: 1387: 1382: 1377: 1372: 1366: 1364: 1360: 1359: 1356: 1355: 1353: 1352: 1347: 1342: 1337: 1332: 1327: 1322: 1317: 1316: 1315: 1310: 1305: 1295: 1294: 1293: 1288: 1277: 1275: 1271: 1270: 1268: 1267: 1262: 1257: 1252: 1247: 1242: 1236: 1234: 1225: 1221: 1220: 1217: 1216: 1214: 1213: 1212: 1211: 1204:Overpopulation 1201: 1195: 1193: 1187: 1186: 1184: 1183: 1181:Water scarcity 1178: 1173: 1168: 1167: 1166: 1156: 1154:Sea level rise 1151: 1146: 1141: 1136: 1131: 1126: 1121: 1120: 1119: 1117:on marine life 1114: 1104: 1099: 1094: 1089: 1084: 1079: 1074: 1072:Global warming 1069: 1064: 1062:Global dimming 1059: 1054: 1053: 1052: 1042: 1037: 1032: 1027: 1022: 1020:Cascade effect 1017: 1016: 1015: 1005: 999: 997: 995:Climate change 988: 982: 981: 979: 978: 973: 968: 967: 966: 961: 956: 946: 941: 936: 931: 930: 929: 924: 914: 909: 903: 901: 897: 896: 894: 893: 888: 887: 886: 881: 876: 862: 861: 860: 855: 845: 839: 838: 837: 832: 827: 825:Doomsday Clock 822: 817: 807: 806: 805: 795: 790: 785: 784: 783: 778: 776:Cyberterrorism 773: 763: 757: 755: 751: 750: 748: 747: 746: 745: 735: 729: 726: 725: 720: 718: 717: 710: 703: 695: 689: 688: 669: 650: 629: 597:(2021-02-19). 591: 586:979-8359800037 585: 568: 565: 563: 562: 548: 522: 475: 417: 375: 329: 299: 269: 239: 190: 188: 185: 183: 182: 177: 172: 170:Waluigi effect 167: 162: 157: 152: 147: 142: 137: 131: 129: 126: 41:, also called 26: 24: 14: 13: 10: 9: 6: 4: 3: 2: 3225: 3214: 3211: 3209: 3206: 3204: 3201: 3199: 3196: 3194: 3191: 3189: 3186: 3184: 3181: 3179: 3176: 3174: 3171: 3169: 3166: 3165: 3163: 3150: 3140: 3134: 3131: 3129: 3128: 3124: 3122: 3121: 3117: 3115: 3114: 3113:The Precipice 3110: 3108: 3107: 3103: 3101: 3098: 3096: 3095: 3091: 3089: 3086: 3085: 3083: 3079: 3073: 3070: 3068: 3065: 3063: 3062:Frank Wilczek 3060: 3058: 3055: 3053: 3050: 3048: 3045: 3043: 3040: 3038: 3035: 3033: 3030: 3028: 3025: 3023: 3020: 3018: 3015: 3013: 3010: 3008: 3007:Dan Hendrycks 3005: 3003: 3000: 2998: 2995: 2993: 2990: 2988: 2985: 2983: 2980: 2978: 2977:Yoshua Bengio 2975: 2973: 2970: 2968: 2965: 2964: 2962: 2958: 2952: 2949: 2947: 2944: 2942: 2939: 2937: 2934: 2932: 2929: 2927: 2924: 2922: 2919: 2917: 2914: 2912: 2909: 2907: 2904: 2902: 2899: 2897: 2894: 2892: 2889: 2887: 2884: 2883: 2881: 2879:Organizations 2877: 2871: 2868: 2866: 2863: 2861: 2858: 2856: 2853: 2851: 2848: 2846: 2843: 2841: 2838: 2836: 2833: 2831: 2828: 2826: 2823: 2821: 2818: 2816: 2813: 2811: 2808: 2806: 2803: 2801: 2798: 2796: 2793: 2791: 2788: 2787: 2785: 2781: 2777: 2773: 2766: 2761: 2759: 2754: 2752: 2747: 2746: 2743: 2731: 2728: 2727: 2725: 2721: 2715: 2714: 2710: 2708: 2707: 2703: 2701: 2700: 2699:The Precipice 2696: 2694: 2693: 2689: 2687: 2686: 2682: 2680: 2679: 2675: 2673: 2672: 2668: 2666: 2665: 2661: 2659: 2658: 2654: 2652: 2651: 2647: 2646: 2644: 2640: 2634: 2631: 2629: 2626: 2624: 2621: 2619: 2616: 2614: 2611: 2609: 2606: 2604: 2601: 2599: 2596: 2594: 2591: 2589: 2588:Global health 2586: 2584: 2581: 2579: 2576: 2574: 2571: 2569: 2568:Cultured meat 2566: 2564: 2561: 2559: 2556: 2555: 2553: 2549: 2543: 2540: 2538: 2535: 2533: 2530: 2528: 2525: 2523: 2520: 2518: 2515: 2513: 2510: 2508: 2505: 2503: 2500: 2498: 2495: 2493: 2492:Good Ventures 2490: 2488: 2485: 2483: 2480: 2478: 2475: 2473: 2470: 2468: 2465: 2463: 2460: 2458: 2455: 2453: 2450: 2448: 2445: 2443: 2440: 2438: 2435: 2433: 2430: 2428: 2425: 2423: 2420: 2418: 2415: 2413: 2410: 2408: 2407:Animal Ethics 2405: 2403: 2400: 2397: 2395: 2392: 2390: 2387: 2386: 2384: 2382:Organizations 2380: 2374: 2371: 2369: 2366: 2364: 2361: 2359: 2356: 2354: 2351: 2349: 2346: 2344: 2341: 2339: 2336: 2334: 2331: 2329: 2326: 2324: 2321: 2319: 2316: 2314: 2311: 2310: 2308: 2304: 2298: 2295: 2293: 2290: 2288: 2285: 2283: 2280: 2278: 2275: 2273: 2270: 2268: 2265: 2263: 2260: 2258: 2255: 2253: 2250: 2248: 2245: 2243: 2240: 2238: 2235: 2233: 2230: 2228: 2225: 2224: 2222: 2218: 2214: 2207: 2202: 2200: 2195: 2193: 2188: 2187: 2184: 2170: 2167: 2165: 2164:Risk analysis 2162: 2160: 2157: 2155: 2152: 2150: 2147: 2146: 2139: 2137: 2136: 2131: 2125: 2124: 2121: 2115: 2112: 2110: 2109:Social crisis 2107: 2105: 2102: 2100: 2097: 2095: 2092: 2090: 2087: 2085: 2082: 2080: 2077: 2075: 2072: 2070: 2067: 2065: 2062: 2061: 2059: 2055: 2049: 2046: 2044: 2041: 2039: 2036: 2034: 2031: 2030: 2028: 2026:Organizations 2024: 2016: 2013: 2012: 2011: 2008: 2006: 2003: 1999: 1996: 1995: 1994: 1991: 1989: 1986: 1982: 1979: 1977: 1974: 1973: 1972: 1969: 1967: 1964: 1963: 1961: 1957: 1951: 1950:World to come 1948: 1946: 1943: 1939: 1936: 1934: 1931: 1930: 1929: 1926: 1924: 1921: 1919: 1916: 1912: 1909: 1907: 1904: 1902: 1899: 1898: 1897: 1896:Millennialism 1894: 1892: 1889: 1885: 1884:Messianic Age 1882: 1881: 1880: 1877: 1875: 1872: 1870: 1869:Gog and Magog 1867: 1865: 1862: 1860: 1859:Earth Changes 1857: 1855: 1852: 1850: 1847: 1845: 1842: 1840: 1837: 1835: 1832: 1830: 1827: 1825: 1822: 1821: 1819: 1815: 1807: 1804: 1803: 1802: 1799: 1797: 1794: 1788: 1785: 1783: 1780: 1778: 1775: 1774: 1773: 1770: 1766: 1763: 1761: 1758: 1756: 1753: 1751: 1748: 1746: 1743: 1741: 1738: 1736: 1733: 1731: 1728: 1727: 1726: 1723: 1719: 1716: 1714: 1711: 1707: 1704: 1703: 1702: 1699: 1697: 1696:New Jerusalem 1694: 1692: 1689: 1687: 1684: 1678: 1675: 1673: 1672:War in Heaven 1670: 1668: 1667:Two witnesses 1665: 1663: 1660: 1658: 1655: 1653: 1650: 1648: 1645: 1643: 1640: 1638: 1635: 1634: 1633: 1630: 1629: 1628: 1625: 1623: 1620: 1616: 1613: 1611: 1608: 1607: 1606: 1603: 1601: 1598: 1596: 1593: 1591: 1588: 1584: 1581: 1580: 1579: 1576: 1574: 1571: 1570: 1569: 1566: 1564: 1561: 1557: 1554: 1552: 1549: 1548: 1547: 1544: 1542: 1539: 1538: 1537: 1536:Second Coming 1534: 1532: 1529: 1525: 1522: 1520: 1517: 1516: 1515: 1512: 1508: 1505: 1503: 1500: 1499: 1498: 1495: 1494: 1492: 1490: 1486: 1480: 1477: 1475: 1472: 1470: 1467: 1465: 1462: 1460: 1457: 1453: 1450: 1448: 1445: 1441: 1438: 1437: 1436: 1433: 1431: 1428: 1426: 1423: 1422: 1421: 1418: 1416: 1413: 1411: 1408: 1406: 1403: 1401: 1398: 1396: 1393: 1391: 1388: 1386: 1383: 1381: 1378: 1376: 1373: 1371: 1368: 1367: 1365: 1361: 1351: 1348: 1346: 1343: 1341: 1338: 1336: 1333: 1331: 1328: 1326: 1323: 1321: 1318: 1314: 1311: 1309: 1306: 1304: 1301: 1300: 1299: 1296: 1292: 1289: 1287: 1284: 1283: 1282: 1279: 1278: 1276: 1272: 1266: 1263: 1261: 1258: 1256: 1253: 1251: 1248: 1246: 1243: 1241: 1238: 1237: 1235: 1233: 1229: 1226: 1222: 1210: 1207: 1206: 1205: 1202: 1200: 1197: 1196: 1194: 1192: 1188: 1182: 1179: 1177: 1174: 1172: 1169: 1165: 1162: 1161: 1160: 1157: 1155: 1152: 1150: 1147: 1145: 1142: 1140: 1137: 1135: 1132: 1130: 1127: 1125: 1122: 1118: 1115: 1113: 1110: 1109: 1108: 1105: 1103: 1100: 1098: 1095: 1093: 1090: 1088: 1085: 1083: 1080: 1078: 1075: 1073: 1070: 1068: 1065: 1063: 1060: 1058: 1055: 1051: 1048: 1047: 1046: 1043: 1041: 1038: 1036: 1035:Deforestation 1033: 1031: 1028: 1026: 1023: 1021: 1018: 1014: 1011: 1010: 1009: 1006: 1004: 1001: 1000: 998: 996: 992: 989: 987: 983: 977: 976:World War III 974: 972: 969: 965: 962: 960: 957: 955: 952: 951: 950: 947: 945: 942: 940: 937: 935: 932: 928: 925: 923: 920: 919: 918: 915: 913: 910: 908: 905: 904: 902: 898: 892: 891:Transhumanism 889: 885: 882: 880: 877: 875: 872: 871: 870: 866: 863: 859: 856: 854: 851: 850: 849: 846: 843: 840: 836: 833: 831: 828: 826: 823: 821: 818: 816: 813: 812: 811: 808: 804: 801: 800: 799: 796: 794: 791: 789: 786: 782: 779: 777: 774: 772: 769: 768: 767: 764: 762: 759: 758: 756: 754:Technological 752: 744: 741: 740: 739: 736: 734: 731: 730: 727: 723: 716: 711: 709: 704: 702: 697: 696: 693: 679: 675: 670: 660: 656: 651: 641: 640: 635: 630: 626: 622: 617: 612: 608: 604: 600: 596: 592: 588: 582: 578: 577: 571: 570: 566: 558: 552: 549: 537: 533: 526: 523: 518: 514: 510: 506: 502: 498: 494: 490: 486: 479: 476: 464: 460: 456: 452: 448: 444: 440: 436: 432: 428: 421: 418: 406: 402: 398: 394: 390: 386: 379: 376: 370: 365: 360: 355: 351: 347: 343: 336: 334: 330: 318: 314: 310: 303: 300: 288: 284: 280: 273: 270: 258: 254: 250: 243: 240: 225: 221: 217: 213: 209: 208:Global Policy 202: 195: 192: 186: 181: 178: 176: 173: 171: 168: 166: 163: 161: 158: 156: 153: 151: 148: 146: 143: 141: 138: 136: 133: 132: 127: 125: 123: 119: 115: 111: 107: 103: 101: 97: 92: 90: 89:system design 86: 82: 77: 75: 71: 68:, as well as 67: 63: 58: 56: 52: 48: 44: 40: 32: 19: 3203:Terraforming 3125: 3118: 3111: 3104: 3092: 3052:Jaan Tallinn 2992:Eric Drexler 2982:Nick Bostrom 2795:AI alignment 2711: 2704: 2697: 2690: 2683: 2676: 2669: 2662: 2655: 2648: 2627: 2467:GiveDirectly 2389:80,000 Hours 2363:Peter Singer 2358:Derek Parfit 2348:Yew-Kwang Ng 2323:Nick Bostrom 2126: 2069:Cyberwarfare 1787:Third Temple 1642:Lake of fire 1452:Rogue planet 1420:Impact event 1410:Proton decay 1363:Astronomical 1313:Bioterrorism 1159:Supervolcano 1057:Flood basalt 1003:Anoxic event 912:Collapsology 900:Sociological 771:Cyberwarfare 681:. Retrieved 677: 662:. Retrieved 658: 643:. Retrieved 637: 606: 602: 575: 551: 540:. Retrieved 535: 525: 492: 488: 478: 467:. Retrieved 434: 430: 420: 409:. Retrieved 392: 388: 378: 369:2318/1702133 349: 346:Philosophies 345: 321:. Retrieved 312: 309:"S-risk FAQ" 302: 291:. Retrieved 283:80,000 Hours 282: 272: 261:. Retrieved 252: 242: 231:. Retrieved 211: 207: 194: 106:David Pearce 104: 93: 78: 59: 46: 42: 38: 37: 3057:Max Tegmark 3042:Martin Rees 2850:Longtermism 2810:AI takeover 2551:Focus areas 2442:Faunalytics 2306:Key figures 2267:Longtermism 2145:Categories 2114:Survivalism 1801:Zoroastrian 1657:Seven seals 1652:Seven bowls 1578:Historicism 1474:Solar flare 1350:Overfishing 1325:Defaunation 1112:coral reefs 874:AI takeover 793:Nanoweapons 781:Cybergeddon 766:Cyberattack 389:Informatica 279:"'S-risks'" 214:(1): 15–3. 3162:Categories 3022:Shane Legg 2997:Sam Harris 2972:Sam Altman 2911:EleutherAI 2642:Literature 2318:Liv Boeree 2074:Depression 2064:Ransomware 1879:Messianism 1849:Armageddon 1834:Apocalypse 1622:Antichrist 1610:Man of sin 1507:Three Ages 1370:Big Crunch 1232:Extinction 1224:Biological 986:Ecological 858:Strangelet 683:2021-02-10 664:2021-02-10 645:2021-02-11 639:BBC Future 542:2024-06-11 495:: 102638. 469:2021-02-10 411:2021-02-10 323:2023-09-14 293:2023-09-14 263:2023-09-14 233:2024-02-12 187:References 3193:Suffering 3037:Huw Price 3027:Elon Musk 2931:Humanity+ 2805:AI safety 2368:Cari Tuna 1959:Fictional 1806:Saoshyant 1691:New Earth 1662:The Beast 1595:Preterism 1568:Christian 1524:Kali Yuga 1469:Micronova 1464:Hypernova 1330:Dysgenics 1171:Verneshot 1077:Hypercane 820:Dead Hand 625:2705-0785 609:: 43–66. 517:230597480 509:0016-3287 459:149794325 451:0016-3287 437:: 74–85. 401:1854-3871 352:(2): 24. 87:may make 81:AI ethics 51:suffering 3149:Category 3017:Bill Joy 2783:Concepts 2472:GiveWell 2353:Toby Ord 2220:Concepts 2099:Pandemic 2084:Epidemic 2079:Droughts 1933:Prewrath 1864:End time 1730:Al-Qa'im 1615:Katechon 1600:2 Esdras 1590:Idealism 1573:Futurism 1502:Maitreya 1497:Buddhist 1340:Pandemic 788:Gray goo 463:Archived 405:Archived 317:Archived 287:Archived 257:Archived 224:Archived 128:See also 94:Induced 2159:Hazards 2057:General 1928:Rapture 1777:Messiah 1765:Sufyani 1755:Israfil 1725:Islamic 1563:Messiah 1541:1 Enoch 1375:Big Rip 1087:Ecocide 1082:Ice age 489:Futures 431:Futures 96:amnesia 47:s-risks 18:S-risks 2960:People 2951:OpenAI 2723:Events 2089:Famine 2015:Zombie 1817:Others 1772:Jewish 1750:Dajjal 1632:Events 1546:Daniel 1447:winter 1274:Others 1164:winter 964:winter 959:famine 954:cobalt 623:  583:  538:. PMLR 515:  507:  457:  449:  399:  3081:Other 2774:from 2104:Riots 1796:Norse 1760:Mahdi 1519:Kalki 1514:Hindu 844:(EMP) 513:S2CID 455:S2CID 395:(4). 227:(PDF) 204:(PDF) 3183:Risk 621:ISSN 581:ISBN 505:ISSN 447:ISSN 397:ISSN 64:and 2790:AGI 611:doi 497:doi 493:126 439:doi 435:100 364:hdl 354:doi 216:doi 45:or 3164:: 867:/ 676:. 657:. 636:. 619:. 607:08 605:. 601:. 534:. 511:. 503:. 491:. 487:. 461:. 453:. 445:. 433:. 429:. 403:. 393:41 391:. 387:. 362:. 348:. 344:. 332:^ 315:. 311:. 285:. 281:. 255:. 251:. 222:. 210:. 206:. 102:. 57:. 2764:e 2757:t 2750:v 2205:e 2198:t 2191:v 714:e 707:t 700:v 686:. 667:. 648:. 627:. 613:: 589:. 559:. 545:. 519:. 499:: 472:. 441:: 414:. 372:. 366:: 356:: 350:4 326:. 296:. 266:. 218:: 212:4 20:)

Index

S-risks

suffering
existential risks
artificial intelligence
superintelligence
space colonization
wild animal suffering
AI ethics
biological computing
system design
amnesia
brain organoids
David Pearce
genetic engineering
hard problem of consciousness
eradication of suffering
many-worlds interpretation
AI control problem
Ethics of artificial intelligence
Ethics of terraforming
Existential risk from artificial general intelligence
Experience machine
Global catastrophic risk
Suffering-focused ethics
Waluigi effect
Wild animal suffering
Wirehead (science fiction)
"Existential Risk Prevention as Global Priority"
doi

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.