Knowledge

Stochastic tunneling

Source 📝

56:
that lie above the best minimum found are suppressed. If the dynamical process can escape the well around the current minimum estimate it will not be trapped by other local minima that are higher. Wells with deeper minima are enhanced. The dynamical process is accelerated by
39:
of the function to be objective minimized in which the function is nonlinearly transformed to allow for easier tunneling among regions containing function minima. Easier tunneling allows for faster exploration of sample space and faster convergence to a good solution.
760: 295: 467: 156: 49: 52:
Schematic one-dimensional test function (black) and STUN effective potential (red & blue), where the minimum indicated by the arrows is the best minimum found so far. All
746: 364: 89: 497: 180: 322: 384: 195: 389: 192:
This goal is achieved by Monte Carlo sampling of a transformed function that lacks this slow dynamics. In the "standard-form" the transformation reads
94: 798: 578:
K. Hamacher & W. Wenzel (1999). "The Scaling Behaviour of Stochastic Minimization Algorithms in a Perfect Funnel Landscape".
695: 185:
The general idea of STUN is to circumvent the slow dynamics of ill-shaped energy functions that one encounters for example in
500: 36: 540:
K. Hamacher (2006). "Adaptation in Stochastic Tunneling Global Optimization of Complex Potential Energy Landscapes".
68:
by randomly "hopping" from the current solution vector to another with a difference in the function value of
687: 679: 527: 740: 704: 647: 599: 550: 675: 512: 325: 159: 28: 777: 728: 663: 637: 615: 589: 566: 517: 65: 61: 32: 20: 627:
W. Wenzel & K. Hamacher (1999). "A Stochastic tunneling approach for global minimization".
720: 522: 333: 71: 482: 769: 712: 655: 629: 607: 558: 165: 499:
is then adjusted to tunnel out of the minimum and pursue a more globally optimum solution.
300: 542: 708: 651: 603: 554: 369: 53: 792: 683: 619: 570: 781: 732: 667: 580: 290:{\displaystyle f_{STUN}:=1-\exp \left(-\gamma \cdot \left(E(x)-E_{o}\right)\right)} 479:
A variation on always tunneling is to do so only when trapped at a local minimum.
462:{\displaystyle \min \left(1;\exp \left(-\beta \cdot \Delta f_{STUN}\right)\right)} 91:. The acceptance probability of such a trial jump is in most cases chosen to be 659: 562: 773: 186: 761:
IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
324:
is the lowest function value found so far. This transformation preserves the
611: 151:{\displaystyle \min \left(1;\exp \left(-\beta \cdot \Delta E\right)\right)} 756:"Improving FPGA Placement with Dynamically Adaptive Stochastic Tunneling" 642: 594: 724: 716: 503:
is the recommended way of determining if trapped at a local minimum.
755: 386:
in the original algorithm giving a new acceptance probability of
48: 688:"Equation of State Calculations by Fast Computing Machines" 471:
The effect of such a transformation is shown in the graph.
485: 392: 372: 336: 303: 198: 168: 97: 74: 491: 461: 378: 358: 316: 289: 174: 150: 83: 393: 98: 8: 745:: CS1 maint: multiple names: authors list ( 64:-based optimization techniques sample the 641: 593: 484: 475:Dynamically adaptive stochastic tunneling 434: 391: 371: 341: 335: 308: 302: 271: 203: 197: 167: 162:criterion) with an appropriate parameter 96: 73: 47: 16:Stochastic method of global optimization 738: 7: 189:by tunneling through such barriers. 427: 132: 75: 14: 696:The Journal of Chemical Physics 501:Detrended fluctuation analysis 261: 255: 1: 754:Mingjie Lin (December 2010). 660:10.1103/PhysRevLett.82.3003 815: 774:10.1109/tcad.2010.2061670 678:, Arianna W. Rosenbluth, 563:10.1209/epl/i2006-10058-0 366:is then used in place of 27:(STUN) is an approach to 682:, Augusta H. Teller and 359:{\displaystyle f_{STUN}} 84:{\displaystyle \Delta E} 799:Stochastic optimization 612:10.1103/PhysRevE.59.938 492:{\displaystyle \gamma } 680:Marshall N. Rosenbluth 528:Differential evolution 493: 463: 380: 360: 318: 291: 176: 175:{\displaystyle \beta } 152: 85: 58: 494: 464: 381: 361: 319: 317:{\displaystyle E_{o}} 292: 177: 153: 86: 51: 483: 390: 370: 334: 301: 196: 166: 95: 72: 25:stochastic tunneling 709:1953JChPh..21.1087M 676:Nicholas Metropolis 652:1999PhRvL..82.3003W 604:1999PhRvE..59..938H 555:2006EL.....74..944H 513:Simulated annealing 29:global optimization 518:Parallel tempering 489: 459: 376: 356: 314: 287: 172: 148: 81: 66:objective function 62:Monte Carlo method 59: 33:Monte Carlo method 21:numerical analysis 768:(12): 1858–1869. 717:10.1063/1.1699114 636:(15): 3003–3007. 523:Genetic algorithm 379:{\displaystyle E} 806: 785: 750: 744: 736: 703:(6): 1087–1092. 692: 671: 645: 630:Phys. Rev. Lett. 623: 597: 574: 507:Other approaches 498: 496: 495: 490: 468: 466: 465: 460: 458: 454: 453: 449: 448: 447: 385: 383: 382: 377: 365: 363: 362: 357: 355: 354: 323: 321: 320: 315: 313: 312: 296: 294: 293: 288: 286: 282: 281: 277: 276: 275: 217: 216: 181: 179: 178: 173: 157: 155: 154: 149: 147: 143: 142: 138: 90: 88: 87: 82: 814: 813: 809: 808: 807: 805: 804: 803: 789: 788: 753: 737: 690: 674: 643:physics/9903008 626: 595:physics/9810035 577: 543:Europhys. Lett. 539: 536: 509: 481: 480: 477: 430: 417: 413: 400: 396: 388: 387: 368: 367: 337: 332: 331: 328:of the minima. 304: 299: 298: 267: 251: 247: 237: 233: 199: 194: 193: 164: 163: 122: 118: 105: 101: 93: 92: 70: 69: 46: 17: 12: 11: 5: 812: 810: 802: 801: 791: 790: 787: 786: 751: 672: 624: 588:(1): 938–941. 575: 549:(6): 944–950. 535: 532: 531: 530: 525: 520: 515: 508: 505: 488: 476: 473: 457: 452: 446: 443: 440: 437: 433: 429: 426: 423: 420: 416: 412: 409: 406: 403: 399: 395: 375: 353: 350: 347: 344: 340: 311: 307: 285: 280: 274: 270: 266: 263: 260: 257: 254: 250: 246: 243: 240: 236: 232: 229: 226: 223: 220: 215: 212: 209: 206: 202: 171: 146: 141: 137: 134: 131: 128: 125: 121: 117: 114: 111: 108: 104: 100: 80: 77: 45: 42: 15: 13: 10: 9: 6: 4: 3: 2: 811: 800: 797: 796: 794: 783: 779: 775: 771: 767: 763: 762: 757: 752: 748: 742: 734: 730: 726: 722: 718: 714: 710: 706: 702: 698: 697: 689: 686:(June 1953). 685: 684:Edward Teller 681: 677: 673: 669: 665: 661: 657: 653: 649: 644: 639: 635: 632: 631: 625: 621: 617: 613: 609: 605: 601: 596: 591: 587: 583: 582: 576: 572: 568: 564: 560: 556: 552: 548: 545: 544: 538: 537: 533: 529: 526: 524: 521: 519: 516: 514: 511: 510: 506: 504: 502: 486: 474: 472: 469: 455: 450: 444: 441: 438: 435: 431: 424: 421: 418: 414: 410: 407: 404: 401: 397: 373: 351: 348: 345: 342: 338: 329: 327: 309: 305: 283: 278: 272: 268: 264: 258: 252: 248: 244: 241: 238: 234: 230: 227: 224: 221: 218: 213: 210: 207: 204: 200: 190: 188: 183: 169: 161: 144: 139: 135: 129: 126: 123: 119: 115: 112: 109: 106: 102: 78: 67: 63: 55: 50: 43: 41: 38: 34: 31:based on the 30: 26: 22: 765: 759: 741:cite journal 700: 694: 633: 628: 585: 581:Phys. Rev. E 579: 546: 541: 478: 470: 330: 191: 187:spin glasses 184: 60: 24: 18: 534:References 160:Metropolis 620:119096368 571:250761754 487:γ 428:Δ 425:⋅ 422:β 419:− 411:⁡ 265:− 245:⋅ 242:γ 239:− 231:⁡ 225:− 170:β 133:Δ 130:⋅ 127:β 124:− 116:⁡ 76:Δ 793:Category 37:sampling 782:8706692 733:1046577 725:4390578 705:Bibcode 668:5113626 648:Bibcode 600:Bibcode 551:Bibcode 780:  731:  723:  666:  618:  569:  297:where 778:S2CID 729:S2CID 691:(PDF) 664:S2CID 638:arXiv 616:S2CID 590:arXiv 567:S2CID 57:that. 54:wells 747:link 721:OSTI 326:loci 44:Idea 770:doi 713:doi 656:doi 608:doi 559:doi 408:exp 394:min 228:exp 113:exp 99:min 19:In 795:: 776:. 766:29 764:. 758:. 743:}} 739:{{ 727:. 719:. 711:. 701:21 699:. 693:. 662:. 654:. 646:. 634:82 614:. 606:. 598:. 586:59 584:. 565:. 557:. 547:74 219::= 182:. 23:, 784:. 772:: 749:) 735:. 715:: 707:: 670:. 658:: 650:: 640:: 622:. 610:: 602:: 592:: 573:. 561:: 553:: 456:) 451:) 445:N 442:U 439:T 436:S 432:f 415:( 405:; 402:1 398:( 374:E 352:N 349:U 346:T 343:S 339:f 310:o 306:E 284:) 279:) 273:o 269:E 262:) 259:x 256:( 253:E 249:( 235:( 222:1 214:N 211:U 208:T 205:S 201:f 158:( 145:) 140:) 136:E 120:( 110:; 107:1 103:( 79:E 35:-

Index

numerical analysis
global optimization
Monte Carlo method
sampling

wells
Monte Carlo method
objective function
Metropolis
spin glasses
loci
Detrended fluctuation analysis
Simulated annealing
Parallel tempering
Genetic algorithm
Differential evolution
Europhys. Lett.
Bibcode
2006EL.....74..944H
doi
10.1209/epl/i2006-10058-0
S2CID
250761754
Phys. Rev. E
arXiv
physics/9810035
Bibcode
1999PhRvE..59..938H
doi
10.1103/PhysRevE.59.938

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.