Knowledge

Talk:Information geometry

Source đź“ť

179: 158: 84: 74: 53: 401:
would amount to one unit of distance along the manifold. Given furthermore, as is postulated by the no free lunch theorem, that the direction of evolution (angle of travel through the space) at any given moment, is, at best, random, to represent the no free lunch theorem on this manifold would be to, at each time differential dt, travel (on average) a distance differential dx, in a random direction. I.e., a random walk.
22: 509:. Unfortunately, that revision removed a bunch of simply-worded, easy to understand text, replacing it with the current impenetrable raft of goo. So part of the effort must be to revive some part of the older content, and provide it as the intro. And certain parts of this article, e.g. the alpha connection, probably should be (??) moved to its own stand-alone article. 368:
intuitive; the second one introduces a system that I don't remember being described, following a path which I don't understand, and asserts an implication which is not at all obvious; and the third one goes even farther afield by making a connection to intelligent design of all things. Is it supposed
460:
I plan to cut out large parts of this article; most/all of it recapitulates large parts of well-known differential geometry concepts that are well-explained in other WP articles. After cutting these out, I'll see whats left, and try to turn that into a real article. I figure someone will scream in
331:
I had to look at the history of this talk page to see what you were talking about. Yeah, it was strange nonsense of some kind. However, in general, one should not ever delete stuff from the talk pages (unless moving it to an archive page). It would have sufficed to just put a section heading on it,
591:
I removed most of the material and started on a rewrite to make this more readable. It still needs a lot of work, though. I couldn't get that one paragraph to format correctly, which is due to my inexperience with Knowledge. I'm a geometer by background, so hopefully someone with more knowledge of
545:
I was interested in information geometry, read part of the Amari book and wanted to share the basics. I'm not an expert, though. You get the drift of what you're saying. You can probably do a better job than me. So please go ahead. Generally I think for the sake of the flow of thoughts to create
388:
First, 1. if you integrate, from one point to another (x0 to x1), so as to find the length of that path, over a geodesic, what you get is an expression that includes -ln(p); information, and that value represents the difference between probability models x0 and x1. (points on the space represent
523:
I agree with your assessment. A number of the concepts of differential geometry are summarized here so briefly by intransparent formulas that it looks more like note-cards than an encyclopedia article. It would be better to replace them by more generally worded descriptions with pointers to more
400:
Stuart Kauffman proposed the "no free lunch theory". where the geometry of the space; the particular metric that defines the geometry; represents the "fitness landscape". In information geometry, a unit evolution on the landscape - i.e. one bit of information change in the state of the system,
490:
Ugh. That still leaves behind a huge raft of formulas with no intuitive explanation given at all. Even the very first section gives a standard information-theoretic argument that can be found in textbooks, but here it is so awkwardly worded that I cannot figure out quite how to fix it. The next
394:
Second para: This is intuitively obvious when you understand what the geometry represents, by understanding the first paragraph. If the state of a system changes at an average rate of x bits of information, and the metric for distance represents bits of information, as stated in the first
281:
I am slowly working on this, but welcome help. If no one is opposed, I will continue to remove whole sections as I re-write since the current later sections are pretty randomly organized. I know Information Geometry rather well, but this is my first wiki article, so I welcome comments and
395:
paragraph, then all points on a circle of radius dx (i.e. infinitesimal radius) centered on the state of the system at time t are equally likely to be the state of the system at time t+dt. This is equivalent to saying that, on average, trajectories will follow a random walk.
315:
Any objections to removing all of the following? The comments are somewhat bizarre and unrelated to the true nature of information geometry. Furthermore, they are generally quite old and unsigned. Please make an effort to sign your posts to facilitate discussion.
524:
in-depth articles. Information geometry is a synthesis of statistics, information theory and differential geometry, but it spends all the time on the latter, trying to do a hurry-up, technical, but inadequate precis of a semester course in differential geometry.
361:"With this in mind, the information space can be thought of as a fitness landscape, a trajectory through this space being an "evolution". The Brownian motion of evolution trajectories thus represents the no free lunch phenomenon discussed by Stuart Kauffman" 546:
the right mindset it is better to repeat the essential and in addition add a reference to the general topic. This benefits most of the people dropping by because they want to learn and thus are rather new to the topic.
358:"Thus, if a point in information space represents the state of a system, then the trajectory of that point will, on average, be a random walk through information space, i.e. will diffuse according to Brownian motion." 266:
This article is in urgent need of a total rewrite. As it exists, it is surely one of the worst in all Knowledge. I will add it to my list, but my time is very limited. Can anyone else take a crack at it?
251:
A lot of the statements made in this article are not strictly true under all circumstances. Thus, many of the statements made should be modified to mention the scope of circumstances that the claims are
229: 476:
Removed most of stuff on tangent spaces and metrics and tensors, as this is covered in any & all textbooks, and have nothing to do with info geom. Will try to attack rest of article later.
140: 355:"Intuitively, this says the distance between two points on a statistical differential manifold is the amount of information between them, i.e. the informational difference between them." 592:
statistics can help with the statistical background and flesh out the applications a bit more. If need be, I can try to provide citations for where IG is used in those fields.
630: 219: 620: 130: 635: 106: 615: 593: 195: 625: 427: 572: 525: 297: 97: 58: 186: 163: 33: 364:
These lines are meaningless to me. Can we replace them with something that carries meaning? The first one is indeed
551: 597: 491:
sections are hardly better. As I read through John Baez's posts, I'll try to clean this up, may take a while.
431: 576: 529: 301: 446: 321: 287: 257: 547: 39: 83: 178: 157: 568: 423: 406: 21: 272: 296:
I agree with these assessments, see also the remarks below under "Removing most of the material".
194:
on Knowledge. If you would like to participate, please visit the project page, where you can join
105:
on Knowledge. If you would like to participate, please visit the project page, where you can join
89: 73: 52: 442: 317: 283: 253: 514: 496: 481: 466: 337: 268: 609: 102: 601: 580: 555: 533: 518: 500: 485: 470: 450: 435: 409: 373: 341: 325: 305: 291: 276: 261: 510: 492: 477: 462: 461:
pain about this, so scream here. I'm sure some compromise must be possible.
333: 191: 79: 370: 383:
supposed to be a joke? Making a connection to intelligent design?!?!
15: 565:
Hi, would someone be so kind to add some (simple) examples?
420:
These are all in Amari's book, listed in the references.
506: 332:
to separate if from the reasonable discussion below.
190:, a collaborative effort to improve the coverage of 101:, a collaborative effort to improve the coverage of 505:Hmm the raft of dense formulas was added in this 8: 566: 152: 47: 154: 49: 19: 7: 184:This article is within the scope of 95:This article is within the scope of 38:It is of interest to the following 631:Mid-importance Statistics articles 14: 621:Mid-priority mathematics articles 115:Knowledge:WikiProject Mathematics 204:Knowledge:WikiProject Statistics 177: 156: 118:Template:WikiProject Mathematics 82: 72: 51: 20: 636:WikiProject Statistics articles 224:This article has been rated as 207:Template:WikiProject Statistics 135:This article has been rated as 1: 534:20:24, 28 November 2014 (UTC) 456:Removing most of the material 441:This has been taken care of. 389:different probability models) 306:20:26, 28 November 2014 (UTC) 262:06:20, 30 December 2010 (UTC) 198:and see a list of open tasks. 109:and see a list of open tasks. 616:C-Class mathematics articles 556:17:34, 4 December 2012 (UTC) 626:C-Class Statistics articles 451:04:26, 25 August 2011 (UTC) 436:14:58, 11 August 2010 (UTC) 326:04:43, 25 August 2011 (UTC) 292:04:31, 25 August 2011 (UTC) 652: 410:16:11, 29 April 2007 (UTC) 374:22:07, 26 April 2007 (UTC) 602:23:53, 1 April 2019 (UTC) 277:16:31, 25 July 2011 (UTC) 223: 172: 134: 67: 46: 581:10:43, 21 May 2017 (UTC) 519:21:44, 9 July 2012 (UTC) 501:21:27, 9 July 2012 (UTC) 486:18:26, 9 July 2012 (UTC) 471:17:11, 9 July 2012 (UTC) 342:21:36, 9 July 2012 (UTC) 141:project's priority scale 561:Examples or Motivation? 98:WikiProject Mathematics 187:WikiProject Statistics 28:This article is rated 348:Intuitive explanation 352:The article states: 121:mathematics articles 210:Statistics articles 90:Mathematics portal 34:content assessment 583: 571:comment added by 426:comment added by 244: 243: 240: 239: 236: 235: 151: 150: 147: 146: 643: 438: 230:importance scale 212: 211: 208: 205: 202: 181: 174: 173: 168: 160: 153: 123: 122: 119: 116: 113: 92: 87: 86: 76: 69: 68: 63: 55: 48: 31: 25: 24: 16: 651: 650: 646: 645: 644: 642: 641: 640: 606: 605: 594:141.211.130.151 589: 587:Article rewrite 563: 548:Roland Puntaier 507:single revision 458: 421: 418: 416:Citation Needed 350: 313: 249: 209: 206: 203: 200: 199: 166: 120: 117: 114: 111: 110: 88: 81: 61: 32:on Knowledge's 29: 12: 11: 5: 649: 647: 639: 638: 633: 628: 623: 618: 608: 607: 588: 585: 562: 559: 543: 542: 541: 540: 539: 538: 537: 536: 457: 454: 428:76.175.193.183 417: 414: 413: 412: 403: 402: 397: 396: 391: 390: 385: 384: 369:to be a joke? 349: 346: 345: 344: 312: 309: 248: 245: 242: 241: 238: 237: 234: 233: 226:Mid-importance 222: 216: 215: 213: 196:the discussion 182: 170: 169: 167:Mid‑importance 161: 149: 148: 145: 144: 133: 127: 126: 124: 107:the discussion 94: 93: 77: 65: 64: 56: 44: 43: 37: 26: 13: 10: 9: 6: 4: 3: 2: 648: 637: 634: 632: 629: 627: 624: 622: 619: 617: 614: 613: 611: 604: 603: 599: 595: 586: 584: 582: 578: 574: 573:77.109.103.69 570: 560: 558: 557: 553: 549: 535: 531: 527: 526:178.38.60.255 522: 521: 520: 516: 512: 508: 504: 503: 502: 498: 494: 489: 488: 487: 483: 479: 475: 474: 473: 472: 468: 464: 455: 453: 452: 448: 444: 439: 437: 433: 429: 425: 415: 411: 408: 405: 404: 399: 398: 393: 392: 387: 386: 382: 378: 377: 376: 375: 372: 367: 362: 359: 356: 353: 347: 343: 339: 335: 330: 329: 328: 327: 323: 319: 310: 308: 307: 303: 299: 298:178.38.60.255 294: 293: 289: 285: 279: 278: 274: 270: 264: 263: 259: 255: 246: 231: 227: 221: 218: 217: 214: 197: 193: 189: 188: 183: 180: 176: 175: 171: 165: 162: 159: 155: 142: 138: 132: 129: 128: 125: 108: 104: 100: 99: 91: 85: 80: 78: 75: 71: 70: 66: 60: 57: 54: 50: 45: 41: 35: 27: 23: 18: 17: 590: 567:— Preceding 564: 544: 459: 443:IGApprentice 440: 419: 380: 365: 363: 360: 357: 354: 351: 318:IGApprentice 314: 295: 284:IGApprentice 280: 265: 254:IGApprentice 250: 225: 185: 137:Mid-priority 136: 96: 62:Mid‑priority 40:WikiProjects 422:—Preceding 282:criticisms. 112:Mathematics 103:mathematics 59:Mathematics 610:Categories 407:Kevin Baas 201:Statistics 192:statistics 164:Statistics 311:Substance 269:Aetheling 569:unsigned 424:unsigned 247:General 228:on the 139:on the 30:C-class 252:valid. 36:scale. 511:linas 493:linas 478:linas 463:linas 334:linas 598:talk 577:talk 552:talk 530:talk 515:talk 497:talk 482:talk 467:talk 447:talk 432:talk 381:that 379:Was 338:talk 322:talk 302:talk 288:talk 273:talk 258:talk 366:not 220:Mid 131:Mid 612:: 600:) 579:) 554:) 532:) 517:) 499:) 484:) 469:) 449:) 434:) 371:A5 340:) 324:) 304:) 290:) 275:) 260:) 596:( 575:( 550:( 528:( 513:( 495:( 480:( 465:( 445:( 430:( 336:( 320:( 300:( 286:( 271:( 267:— 256:( 232:. 143:. 42::

Index


content assessment
WikiProjects
WikiProject icon
Mathematics
WikiProject icon
icon
Mathematics portal
WikiProject Mathematics
mathematics
the discussion
Mid
project's priority scale
WikiProject icon
Statistics
WikiProject icon
WikiProject Statistics
statistics
the discussion
Mid
importance scale
IGApprentice
talk
06:20, 30 December 2010 (UTC)
Aetheling
talk
16:31, 25 July 2011 (UTC)
IGApprentice
talk
04:31, 25 August 2011 (UTC)

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.

↑