Knowledge

Talk:Linear least squares

Source 📝

653:"To readers who know linear algebra..." - the assumption is that they do, but again, this is a topic of interest for a vast number of people who wouldn't be familiar with LA-notation. I also disagree with your statement that removing LA notation would not accurately reflect reliable sources, because there are plenty of sources including high-school textbooks and statistics books written for the humanities which do not assume a background in linear algebra, but still cover least squares (and many other topics which I indicated should not be in LA-notation). Many, many books cover the topics with just index-notation (which is taught in high-school and non-STEM university mathematics), even(!) tabular calculations. I am not suggesting that tables be employed, just that articles which may be of use and interest to an audience (e.g. likely those with high-school mathematics/non-STEM math university education), be accessible to them based on their background. However, knowing from other discussions on math pages how many orders of magnitude more an article's pedantic accuracy is more important than readability and accessibility for the mathematics contributors and editors, I highly doubt any mathematics-related wikipedia article will be left without LA or set-builder notation - the dearth of them should actually indicate there is a problem because every article ends up reading like a university-level mathematics textbook, despite the claim that wikipedia is not a textbook! 572:
formulation and statistics involving terms like homoscedasticity in the first paragraph and it doesn't get easier from there. Everyone who does not know what least squares is will find this article useless. This problem is rampant in Knowledge. It would be a lot better if Mathematicians refrained from editing articles until they make an effort to express things in high school algebra, and not make things so perfectly precise and complete that no one understands it except graduate-level experts editing it, trying to one-up each other. Their proof of superiority to prevent future edits is to make sure no one wanting to make it intelligible is unable to prove the alien language is in error. Lack of edits is not proof it's finally perfectly correct, but proof no one understand it.
609:
2nd/3rd year, and quite often is not used extensively in practising fields of engineering/CS (aside from R&D/academia). This makes articles in LA notation inaccessible to any student in high school, or from the humanities who would likely have only studied elementary matrix operations, if at all. I understand wikipedia is not a textbook, but it is an encyclopedia, and I remember pouring over hardcover Encyclopedia Britannica back when I was a teenager in school as a good source of information which I could easily follow.
298: 277: 397: 387: 366: 215: 477: 246: 608:
I agree with this. Actually, I would propose that ALL linear algebra notation be removed from math articles on non-advanced topics that would be of interest for general users, simply because LA notation is not taught as a course in universities unless you are in STEM fields, that too until you are in
731:
It's possible that some of these generalisations could be motivated more pictorially, but linear algebra rapidly becomes essential -- numerical solvers will at the very least require loading up matrices; while understanding the different solution algorithms and their different pros and cons I would
767:
But reading even the referenced sections, I see there is a lot of repetition and content overlap - sometimes within the same section. It may not be immediately apparent (especially to readers who aren't as familiar with the concept), because although this same concept is studied in Statistics and
571:
Imagine you're a high school student or undergrad engineer who came to this article to learn how do a least squares calculation so that you can understand it. You want to see some math that simply explains it instead of reading a lot of text. Instead, you're presented only with a linear algebra
794:
Yes, I agree that this article could benefit from some cleaning up. I think that it has been accruing cruft from editors of various viewpoints for a bit too long. If the length could decrease while still covering all of the important content, then that would be a good thing. :)
778:
Also, I hope frequent editors of this article aren't concerned if the article size reduces a bit. I spent most of last year TA-ing two undergraduate courses (Statistics for ML and Linear Algebra + Multi-variable calc) so I'll explain the bigger edits in detail.
682:
Thanks for your input (although I think that you've misunderstood some of my statements). I will work on moving the example higher in the text. I will try to craft a presentation that doesn't use linear algebra, before the presentation that does.
482:
This article is substantially duplicated by a piece in an external publication. Since the external publication copied Knowledge rather than the reverse, please do not flag this article as a copyright violation of the following source:
153: 768:
Linear Algebra (starting from high school level classes) - the notations and terminologies are very different. For instance, the first and third paragraphs in the Discussion section are saying the exact same thing.
635:
But this does not mean that the entire article should require linear algebra. Math articles work best when they begin with an elementary treatment, just as you say, and then move on to the harder stuff.
631:
often present linear least squares in linear algebra notation. To remove linear algebra entirely would mean that we do not accurately reflect reliable sources and do not serve those readers well. It's a
657: 610: 348: 537: 453: 536:
redirects here, but this page never quite defines the normal equations in full generality, just for a 2 variable example. This is completely standard stuff and really should be added!
147: 771:
I'm not the most bold editor but I'm going to try my best to clean up the redundant info here and add some verifiable sources, and would appreciate if fellow editors helped
206: 489:
Non-linear least squares: Least squares, nonlinear regression, linear least squares, errors and residuals in statistics, gradient, Gauss-Newton Algorithm, parabola
824: 338: 44: 839: 443: 79: 591:. And part of the problem is that writing technical material for audiences at varying levels is difficult and time-consuming. But your complaint stands. 829: 419: 834: 627:
To readers who know linear algebra, linear least squares is vastly simpler in linear algebra notation than in other notation. That's why the
588: 314: 85: 819: 202: 198: 194: 190: 661: 614: 541: 514: 410: 371: 168: 305: 282: 135: 551:
I noticed that too. It seems to be lacking a basic introduction to the concept of finding the least squares solution to Ax = b.
720:
Also, it's perhaps worth flagging that most readers looking for a first article on least squares should probably be heading to
99: 30: 104: 20: 74: 784: 639:
What do you think of the Example section of this article? Is it accessible? What if we moved it earlier in the article?
594:
What do you think of the Example section of this article? Is it accessible? What if we moved it earlier in the article?
556: 257: 129: 65: 628: 214: 185: 125: 225: 780: 552: 175: 109: 587:
I agree that many math-related Knowledge articles are difficult to understand. Part of the problem is that
725: 263: 396: 297: 276: 761: 24: 245: 717:
readable if the example is moved further up -- it currently sits well as a self-contained appendix.
161: 55: 418:
on Knowledge. If you would like to participate, please visit the project page, where you can join
313:
on Knowledge. If you would like to participate, please visit the project page, where you can join
141: 772: 402: 230: 70: 386: 365: 573: 511: 504: 51: 800: 737: 688: 644: 599: 227: 577: 813: 721: 732:
think is necessarily going to involve some core linear algebra however you cut it.
796: 764:, and as I said in my edit message, I intend to add some refs myself this week. 733: 684: 640: 595: 415: 229: 804: 788: 741: 692: 665: 648: 618: 603: 581: 560: 545: 476: 392: 310: 728:
rather than this article, which is more focussed on generalisations of OLS.
507: 775:
the article and suggest any improvements or citations as they see fit.
656:
The example is accessible and should be at the beginning of the page.
760:
I just added an unreferenced section template under the section
471: 239: 231: 15: 160: 414:, a collaborative effort to improve the coverage of 309:, a collaborative effort to improve the coverage of 33:for general discussion of the article's subject. 567:Problem with mathematicians editing Knowledge 174: 8: 495: 360: 271: 658:2405:6E00:2F8A:7000:343C:362D:8785:4E87 611:2405:6E00:2F8A:7000:343C:362D:8785:4E87 362: 273: 243: 589:Knowledge:Knowledge is not a textbook 7: 538:2601:281:8200:36:D6A0:25B0:7C03:7A6E 408:This article is within the scope of 303:This article is within the scope of 825:High-importance Statistics articles 262:It is of interest to the following 23:for discussing improvements to the 14: 840:Mid-priority mathematics articles 713:IMO the article will become even 428:Knowledge:WikiProject Mathematics 756:Starting to clean up the article 475: 431:Template:WikiProject Mathematics 395: 385: 364: 323:Knowledge:WikiProject Statistics 296: 275: 244: 213: 45:Click here to start a new topic. 830:WikiProject Statistics articles 762:Linear least squares#Discussion 448:This article has been rated as 343:This article has been rated as 326:Template:WikiProject Statistics 805:20:02, 15 September 2024 (UTC) 789:19:30, 15 September 2024 (UTC) 1: 561:01:41, 19 December 2023 (UTC) 422:and see a list of open tasks. 317:and see a list of open tasks. 42:Put new text under old text. 835:B-Class mathematics articles 604:12:54, 21 January 2022 (UTC) 582:11:58, 21 January 2022 (UTC) 546:05:31, 4 December 2020 (UTC) 820:B-Class Statistics articles 50:New to Knowledge? Welcome! 856: 742:21:42, 22 March 2023 (UTC) 693:18:38, 22 March 2023 (UTC) 666:10:58, 22 March 2023 (UTC) 649:03:02, 21 March 2023 (UTC) 629:Knowledge:Reliable sources 619:02:52, 21 March 2023 (UTC) 447: 380: 342: 291: 270: 80:Be welcoming to newcomers 454:project's priority scale 491:, Betascript Publishing 487:Surhone, L. M. (2009), 411:WikiProject Mathematics 726:Ordinary least squares 306:WikiProject Statistics 252:This article is rated 75:avoid personal attacks 207:Auto-archiving period 100:Neutral point of view 434:mathematics articles 105:No original research 25:Linear least squares 499:Additional comments 329:Statistics articles 781:AradhanaChatterjee 553:The-erinaceous-one 403:Mathematics portal 258:content assessment 86:dispute resolution 47: 525: 524: 521: 520: 468: 467: 464: 463: 460: 459: 359: 358: 355: 354: 238: 237: 66:Assume good faith 43: 847: 534:normal equations 528:Normal equations 496: 492: 479: 472: 436: 435: 432: 429: 426: 405: 400: 399: 389: 382: 381: 376: 368: 361: 349:importance scale 331: 330: 327: 324: 321: 300: 293: 292: 287: 279: 272: 255: 249: 248: 240: 232: 218: 217: 208: 179: 178: 164: 95:Article policies 16: 855: 854: 850: 849: 848: 846: 845: 844: 810: 809: 758: 569: 530: 486: 433: 430: 427: 424: 423: 401: 394: 374: 345:High-importance 328: 325: 322: 319: 318: 286:High‑importance 285: 256:on Knowledge's 253: 234: 233: 228: 205: 121: 116: 115: 114: 91: 61: 12: 11: 5: 853: 851: 843: 842: 837: 832: 827: 822: 812: 811: 808: 807: 757: 754: 753: 752: 751: 750: 749: 748: 747: 746: 745: 744: 729: 718: 702: 701: 700: 699: 698: 697: 696: 695: 673: 672: 671: 670: 669: 668: 654: 637: 633: 622: 621: 606: 592: 568: 565: 564: 563: 529: 526: 523: 522: 519: 518: 501: 500: 494: 493: 480: 466: 465: 462: 461: 458: 457: 446: 440: 439: 437: 420:the discussion 407: 406: 390: 378: 377: 369: 357: 356: 353: 352: 341: 335: 334: 332: 315:the discussion 301: 289: 288: 280: 268: 267: 261: 250: 236: 235: 226: 224: 223: 220: 219: 181: 180: 118: 117: 113: 112: 107: 102: 93: 92: 90: 89: 82: 77: 68: 62: 60: 59: 48: 39: 38: 35: 34: 28: 13: 10: 9: 6: 4: 3: 2: 852: 841: 838: 836: 833: 831: 828: 826: 823: 821: 818: 817: 815: 806: 802: 798: 793: 792: 791: 790: 786: 782: 776: 774: 769: 765: 763: 755: 743: 739: 735: 730: 727: 723: 722:Least squares 719: 716: 712: 711: 710: 709: 708: 707: 706: 705: 704: 703: 694: 690: 686: 681: 680: 679: 678: 677: 676: 675: 674: 667: 663: 659: 655: 652: 651: 650: 646: 642: 638: 634: 630: 626: 625: 624: 623: 620: 616: 612: 607: 605: 601: 597: 593: 590: 586: 585: 584: 583: 579: 575: 566: 562: 558: 554: 550: 549: 548: 547: 543: 539: 535: 527: 516: 515:9786130332143 513: 509: 506: 503: 502: 498: 497: 490: 485: 484: 481: 478: 474: 473: 470: 455: 451: 445: 442: 441: 438: 421: 417: 413: 412: 404: 398: 393: 391: 388: 384: 383: 379: 373: 370: 367: 363: 350: 346: 340: 337: 336: 333: 316: 312: 308: 307: 302: 299: 295: 294: 290: 284: 281: 278: 274: 269: 265: 259: 251: 247: 242: 241: 222: 221: 216: 212: 204: 200: 196: 192: 189: 187: 183: 182: 177: 173: 170: 167: 163: 159: 155: 152: 149: 146: 143: 140: 137: 134: 131: 127: 124: 123:Find sources: 120: 119: 111: 110:Verifiability 108: 106: 103: 101: 98: 97: 96: 87: 83: 81: 78: 76: 72: 69: 67: 64: 63: 57: 53: 52:Learn to edit 49: 46: 41: 40: 37: 36: 32: 26: 22: 18: 17: 777: 770: 766: 759: 714: 632:non-starter. 570: 533: 531: 488: 469: 450:Mid-priority 449: 409: 375:Mid‑priority 344: 304: 264:WikiProjects 210: 184: 171: 165: 157: 150: 144: 138: 132: 122: 94: 19:This is the 425:Mathematics 416:mathematics 372:Mathematics 148:free images 31:not a forum 814:Categories 320:Statistics 311:statistics 283:Statistics 724:and then 532:The page 508:698560686 88:if needed 71:Be polite 21:talk page 186:Archives 56:get help 29:This is 27:article. 452:on the 347:on the 254:B-class 211:90 days 154:WP refs 142:scholar 797:Mgnbar 773:wikify 734:Jheald 685:Mgnbar 641:Mgnbar 596:Mgnbar 260:scale. 126:Google 636:So... 169:JSTOR 130:books 84:Seek 801:talk 785:talk 738:talk 715:less 689:talk 662:talk 645:talk 615:talk 600:talk 578:talk 574:Ywaz 557:talk 542:talk 512:ISBN 505:OCLC 339:High 162:FENS 136:news 73:and 444:Mid 176:TWL 816:: 803:) 787:) 740:) 691:) 664:) 647:) 617:) 602:) 580:) 559:) 544:) 510:, 209:: 201:, 197:, 193:, 156:) 54:; 799:( 783:( 736:( 687:( 660:( 643:( 613:( 598:( 576:( 555:( 540:( 517:. 456:. 351:. 266:: 203:4 199:3 195:2 191:1 188:: 172:· 166:· 158:· 151:· 145:· 139:· 133:· 128:( 58:.

Index

talk page
Linear least squares
not a forum
Click here to start a new topic.
Learn to edit
get help
Assume good faith
Be polite
avoid personal attacks
Be welcoming to newcomers
dispute resolution
Neutral point of view
No original research
Verifiability
Google
books
news
scholar
free images
WP refs
FENS
JSTOR
TWL
Archives
1
2
3
4

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.