Knowledge (XXG)

Claude (language model)

Source 📝

40: 283:
On June 20, 2024, Anthropic released Claude 3.5 Sonnet, which demonstrated significantly improved performance on benchmarks compared to the larger Claude 3 Opus, notably in areas such as coding, multistep workflows, chart interpretation, and text extraction from images. Released alongside 3.5 Sonnet
271:
Claude 3 was released on March 14, 2024, with claims in the press release to have set new industry benchmarks across a wide range of cognitive tasks. The Claude 3 family includes three state-of-the-art models in ascending order of capability: Haiku, Sonnet, and Opus. The default version of Claude 3,
163:
Constitutional AI is an approach developed by Anthropic for training AI systems, particularly language models like Claude, to be harmless and helpful without relying on extensive human feedback. The method, detailed in the paper "Constitutional AI: Harmlessness from AI Feedback" involves two phases:
179:
For the reinforcement learning from AI feedback (RLAIF) phase, responses are generated, and an AI compares their compliance with the constitution. This dataset of AI feedback is used to train a preference model that evaluates responses based on how much they satisfy the constitution. Claude is then
175:
In the supervised learning phase, the model generates responses to prompts, self-critiques these responses based on a set of guiding principles (a "constitution"), and revises the responses. Then the model is fine-tuned on these revised responses.
212:
Claude was the initial version of Anthropic's language model released in March 2023, Claude demonstrated proficiency in various tasks but had certain limitations in coding, math, and reasoning capabilities. Anthropic partnered with companies like
461: 324:) in AI development, with discussions centered on balancing ethical considerations and practical functionality. Critics argued for user autonomy and effectiveness, while proponents stressed the importance of ethical AI. 307:
Claude 2 received criticism for its stringent ethical alignment that may reduce usability and performance. Users have been refused assistance with benign requests, for example with the programming question "How can I
191:
This approach enables the training of AI assistants that are both helpful and harmless, and that can explain their objections to harmful requests, enhancing transparency and reducing reliance on human supervision.
155:. They have been pre-trained to predict the next word in large amounts of text. Claude models have then been fine-tuned with Constitutional AI with the aim of making them helpful, honest, and harmless. 292:
Limited-use access using Claude 3.5 Sonnet is free of charge, but requires both an e-mail address and a cellphone number. A paid plan is also offered for more usage and access to all Claude 3 models.
245:
Claude 2 was the next major iteration of Claude, which was released in July 2023 and available to the general public, whereas the Claude 1 was only available to selected users approved by Anthropic.
233:
Claude was released as two versions, Claude and Claude Instant, with Claude Instant being a faster, less expensive, and lighter version. Claude Instant has an input context length of 100,000
284:
was the new Artifacts capability in which Claude was able to create code in a dedicated window in the interface and preview select code in real time such as websites or SVGs.
260:
Claude 2.1 doubled the number of tokens that the chatbot could handle, increasing it to a window of 200,000 tokens, which equals around 500 pages of written material.
688: 489:
Bai, Yuntao; Kadavath, Saurav; Kundu, Sandipan; Askell, Amanda; Kernion, Jackson; Jones, Andy; Chen, Anna; Goldie, Anna; Mirhoseini, Azalia (December 15, 2022),
185: 514: 808: 766: 462:"Latest Generative AI Boldly Labeled As Constitutional AI Such As Claude By Anthropic Has Heart In The Right Place, Says AI Ethics And AI Law" 196: 275:
Claude 3 drew attention for demonstrating an apparent ability to realize it is being artificially tested during needle in a haystack tests.
344: 188:(RLHF), except that the comparisons used to train the preference model are AI-generated, and that they are based on the constitution. 152: 90: 590: 373: 859: 793: 214: 313: 714: 515:"A ChatGPT rival just published a new constitution to level up its AI guardrails, and prevent toxic and racist responses" 869: 248:
Claude 2 expanded its context window from 9,000 tokens to 100,000 tokens. Features included the ability to upload
854: 295:
On May 1, 2024, Anthropic announced the Claude Team plan, its first enterprise offering for Claude, and a Claude
272:
Opus, has a context window of 200,000 tokens, but this is being expanded to 1 million for specific use cases.
263:
Anthropic states that the new model is less likely to produce false statements compared to its predecessors.
609: 874: 169: 143:. The first model was released in March 2023. Claude 3, released in March 2024, can also analyze images. 637: 136: 110: 85: 165: 77: 787: 494: 320:
server?" This has led to a debate over the "alignment tax" (the cost of ensuring an AI system is
767:"Amazon-backed Anthropic launches iPhone app and business tier to compete with OpenAI's ChatGPT" 864: 234: 105: 95: 638:"Anthropic Announces Claude 2.1 LLM with Wider Context Window and Support for AI Tools" 401: 309: 434: 848: 809:"Criticisms Arise Over Claude AI's Strict Ethical Protocols Limiting User Assistance" 222: 715:"Anthropic has a fast new AI model — and a clever new way to interact with chatbots" 571: 739: 543: 321: 252:
and other documents that enables Claude to read, summarize, and assist with tasks.
181: 689:"Anthropic's Claude 3 causes stir by seeming to realize when it was being tested" 662: 195:
The "constitution" for Claude included 75 points, including sections from the
47: 140: 52: 591:"Anthropic's Claude Instant: A Smaller, Faster and Cheaper Language Model" 17: 296: 39: 317: 499: 374:"Anthropic's Claude 3 chatbot claims to outperform ChatGPT, Gemini" 345:"OpenAI rival Anthropic makes its Claude chatbot even more useful" 218: 771: 610:"The $ 1 billion gamble to ensure AI doesn't destroy humanity" 249: 544:"What Is Claude AI and Anthropic? ChatGPT's Rival Explained" 402:"What to Know About Claude 2, Anthropic's Rival to ChatGPT" 184:
with this preference model. This technique is similar to
837: 121: 116: 104: 76: 58: 46: 566: 564: 429: 427: 425: 423: 491:Constitutional AI: Harmlessness from AI Feedback 740:"Introducing the Claude Team plan and iOS app" 537: 535: 367: 365: 8: 338: 336: 237:(which corresponds to around 75,000 words). 32: 663:"Introducing the next generation of Claude" 396: 394: 484: 482: 186:reinforcement learning from human feedback 38: 31: 498: 632: 630: 197:UN Universal Declaration of Human Rights 332: 785: 7: 807:Glifton, Gerald (January 3, 2024). 542:Drapkin, Aaron (October 27, 2023). 153:generative pre-trained transformers 25: 608:Matthews, Dylan (July 17, 2023). 27:Large language model by Anthropic 589:Yao, Deborah (August 11, 2023). 372:Whitney, Lance (March 4, 2024). 343:Davis, Wes (November 21, 2023). 713:Pierce, David (June 20, 2024). 687:Edwards, Benj (March 5, 2024). 1: 765:Field, Hayden (May 1, 2024). 460:Eliot, Lance (May 25, 2023). 217:(productivity software) and 891: 792:: CS1 maint: url-status ( 64:; 1 year ago 37: 435:"Claude's Constitution" 170:reinforcement learning 860:Large language models 221:(to help develop the 137:large language models 572:"Introducing Claude" 86:Large language model 166:supervised learning 34: 870:Virtual assistants 151:Claude models are 578:. March 14, 2023. 159:Constitutional AI 130: 129: 16:(Redirected from 882: 855:Machine learning 841: 840: 838:Official website 824: 823: 821: 819: 804: 798: 797: 791: 783: 781: 779: 762: 756: 755: 753: 751: 736: 730: 729: 727: 725: 710: 704: 703: 701: 699: 684: 678: 677: 675: 673: 659: 653: 652: 650: 648: 634: 625: 624: 622: 620: 605: 599: 598: 586: 580: 579: 568: 559: 558: 556: 554: 539: 530: 529: 527: 525: 519:Business Insider 510: 504: 503: 502: 486: 477: 476: 474: 472: 457: 451: 450: 448: 446: 431: 418: 417: 415: 413: 398: 389: 388: 386: 384: 369: 360: 359: 357: 355: 340: 316:processes in my 126: 123: 96:Foundation model 72: 70: 65: 42: 35: 21: 890: 889: 885: 884: 883: 881: 880: 879: 845: 844: 836: 835: 832: 827: 817: 815: 806: 805: 801: 784: 777: 775: 764: 763: 759: 749: 747: 738: 737: 733: 723: 721: 712: 711: 707: 697: 695: 686: 685: 681: 671: 669: 661: 660: 656: 646: 644: 636: 635: 628: 618: 616: 607: 606: 602: 588: 587: 583: 570: 569: 562: 552: 550: 541: 540: 533: 523: 521: 512: 511: 507: 488: 487: 480: 470: 468: 459: 458: 454: 444: 442: 433: 432: 421: 411: 409: 408:. July 18, 2023 400: 399: 392: 382: 380: 371: 370: 363: 353: 351: 342: 341: 334: 330: 305: 290: 281: 269: 258: 243: 231: 210: 205: 161: 149: 135:is a family of 120: 100: 68: 66: 63: 62:March 2023 59:Initial release 28: 23: 22: 15: 12: 11: 5: 888: 886: 878: 877: 872: 867: 862: 857: 847: 846: 843: 842: 831: 830:External links 828: 826: 825: 799: 757: 731: 705: 679: 654: 626: 600: 581: 560: 531: 505: 478: 452: 419: 390: 361: 331: 329: 326: 304: 301: 289: 286: 280: 277: 268: 265: 257: 254: 242: 239: 230: 229:Claude Instant 227: 209: 206: 204: 201: 180:fine-tuned to 160: 157: 148: 145: 128: 127: 118: 114: 113: 108: 102: 101: 99: 98: 93: 88: 82: 80: 74: 73: 60: 56: 55: 50: 44: 43: 26: 24: 14: 13: 10: 9: 6: 4: 3: 2: 887: 876: 875:2023 software 873: 871: 868: 866: 863: 861: 858: 856: 853: 852: 850: 839: 834: 833: 829: 814: 810: 803: 800: 795: 789: 774: 773: 768: 761: 758: 746:. May 1, 2024 745: 741: 735: 732: 720: 716: 709: 706: 694: 690: 683: 680: 668: 664: 658: 655: 643: 639: 633: 631: 627: 615: 611: 604: 601: 596: 592: 585: 582: 577: 573: 567: 565: 561: 549: 545: 538: 536: 532: 520: 516: 509: 506: 501: 496: 492: 485: 483: 479: 467: 463: 456: 453: 441:. May 9, 2023 440: 436: 430: 428: 426: 424: 420: 407: 403: 397: 395: 391: 379: 375: 368: 366: 362: 350: 346: 339: 337: 333: 327: 325: 323: 319: 315: 311: 302: 300: 298: 293: 287: 285: 278: 276: 273: 266: 264: 261: 255: 253: 251: 246: 240: 238: 236: 228: 226: 224: 220: 216: 207: 202: 200: 198: 193: 189: 187: 183: 177: 173: 171: 167: 158: 156: 154: 146: 144: 142: 139:developed by 138: 134: 125: 119: 115: 112: 109: 107: 103: 97: 94: 92: 89: 87: 84: 83: 81: 79: 75: 61: 57: 54: 51: 49: 45: 41: 36: 30: 19: 816:. Retrieved 813:Light Square 812: 802: 776:. Retrieved 770: 760: 748:. Retrieved 743: 734: 722:. Retrieved 718: 708: 696:. Retrieved 693:Ars Technica 692: 682: 670:. Retrieved 666: 657: 645:. Retrieved 641: 617:. Retrieved 613: 603: 594: 584: 575: 551:. Retrieved 547: 522:. Retrieved 518: 513:Mok, Aaron. 508: 490: 469:. Retrieved 465: 455: 443:. Retrieved 438: 410:. Retrieved 405: 381:. Retrieved 377: 352:. Retrieved 348: 306: 294: 291: 282: 274: 270: 262: 259: 247: 244: 232: 211: 194: 190: 178: 174: 162: 150: 132: 131: 48:Developer(s) 29: 818:January 23, 647:January 23, 619:January 23, 595:AI Business 553:January 23, 524:January 23, 412:January 23, 354:January 23, 111:Proprietary 849:Categories 500:2212.08073 328:References 279:Claude 3.5 256:Claude 2.1 225:chatbot). 788:cite news 744:Anthropic 719:The Verge 667:Anthropic 576:Anthropic 471:March 27, 445:March 26, 439:Anthropic 349:The Verge 303:Criticism 141:Anthropic 53:Anthropic 865:Chatbots 750:June 22, 724:June 20, 698:March 9, 672:March 4, 383:March 5, 267:Claude 3 241:Claude 2 147:Training 18:Claude 3 548:Tech.co 322:aligned 297:iOS app 117:Website 106:License 69:2023-03 67: ( 778:May 3, 466:Forbes 318:ubuntu 314:python 288:Access 235:tokens 215:Notion 208:Claude 203:Models 133:Claude 122:claude 33:Claude 642:InfoQ 495:arXiv 378:ZDNET 219:Quora 182:align 820:2024 794:link 780:2024 772:CNBC 752:2024 726:2024 700:2024 674:2024 649:2024 621:2024 555:2024 526:2024 473:2024 447:2024 414:2024 406:TIME 385:2024 356:2024 312:all 310:kill 250:PDFs 168:and 78:Type 614:Vox 223:Poe 124:.ai 91:GPT 851:: 811:. 790:}} 786:{{ 769:. 742:. 717:. 691:. 665:. 640:. 629:^ 612:. 593:. 574:. 563:^ 546:. 534:^ 517:. 493:, 481:^ 464:. 437:. 422:^ 404:. 393:^ 376:. 364:^ 347:. 335:^ 299:. 199:. 172:. 822:. 796:) 782:. 754:. 728:. 702:. 676:. 651:. 623:. 597:. 557:. 528:. 497:: 475:. 449:. 416:. 387:. 358:. 71:) 20:)

Index

Claude 3

Developer(s)
Anthropic
Type
Large language model
GPT
Foundation model
License
Proprietary
claude.ai
large language models
Anthropic
generative pre-trained transformers
supervised learning
reinforcement learning
align
reinforcement learning from human feedback
UN Universal Declaration of Human Rights
Notion
Quora
Poe
tokens
PDFs
iOS app
kill
python
ubuntu
aligned

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.