Knowledge

Biconvex optimization

Source đź“ť

1040: 1528: 657: 292: 177: 937: 364: 56: 538: 441: 808: 82: 932: 223: 108: 587: 558: 481: 461: 384: 312: 197: 1569: 946: 1426: 801: 739: 23:
where the objective function and the constraint set can be biconvex. There are methods that can find the global optimum of these problems.
1507: 969: 563:
A common practice for solving a biconvex problem (which does not guarantee global optimality of the solution) is alternatively updating
1598: 1021: 882: 989: 755:
Chen, Caihua (2016). ""The direct extension of ADMM for multi-block convex minimization problems is not necessarily convergent"".
1100: 794: 1562: 1593: 1377: 1039: 599: 1485: 1105: 1421: 1389: 1588: 659:
is block multi-convex iff it is convex with respect to each of the individual arguments while holding all others fixed.
1470: 1095: 1416: 1372: 974: 1555: 1265: 994: 1155: 817: 228: 113: 1340: 1202: 320: 1384: 1283: 999: 877: 1475: 1460: 1350: 1228: 854: 821: 1364: 1330: 1233: 1175: 1056: 862: 842: 725: 684: 29: 1411: 1238: 1150: 486: 389: 786: 1535: 1480: 1345: 1298: 1288: 1140: 1128: 941: 924: 829: 20: 1215: 1184: 1170: 1160: 951: 772: 707: 867: 61: 1223: 901: 735: 729: 1303: 1293: 1197: 1074: 979: 961: 914: 825: 764: 699: 680: 202: 87: 1319: 566: 1539: 1307: 1192: 1079: 1013: 984: 543: 466: 446: 369: 297: 182: 1582: 1465: 1449: 711: 1403: 909: 776: 1527: 685:"Biconvex sets and optimization with biconvex functions: a survey and extensions" 589:
by fixing one of them and solving the corresponding convex optimization problem.
1490: 872: 768: 703: 731:
Deterministic global optimization : theory, methods, and applications
892: 1212: 592:
The generalization to functions of more than two arguments is called a
1447: 1263: 1126: 1054: 840: 790: 1038: 1543: 652:{\displaystyle f(x_{1},\ldots ,x_{K})\to \mathbb {R} } 602: 569: 546: 489: 469: 449: 392: 372: 323: 300: 231: 205: 185: 116: 90: 64: 32: 1402: 1363: 1329: 1318: 1276: 1211: 1183: 1169: 1139: 1088: 1067: 1012: 960: 923: 900: 891: 853: 651: 581: 552: 532: 475: 455: 435: 378: 358: 306: 286: 217: 191: 171: 102: 76: 50: 1563: 802: 8: 281: 245: 166: 130: 692:Mathematical Methods of Operations Research 287:{\displaystyle B_{x}=\{y\in Y:(x,y)\in B\}} 172:{\displaystyle B_{y}=\{x\in X:(x,y)\in B\}} 1570: 1556: 1444: 1360: 1326: 1273: 1260: 1180: 1136: 1123: 1064: 1051: 897: 850: 837: 809: 795: 787: 645: 644: 632: 613: 601: 568: 545: 494: 488: 468: 448: 397: 391: 371: 352: 351: 322: 299: 236: 230: 204: 184: 121: 115: 89: 63: 31: 1043:Optimization computes maxima and minima. 674: 672: 366:is called a biconvex function if fixing 359:{\displaystyle f(x,y):B\to \mathbb {R} } 668: 1239:Principal pivoting algorithm of Lemke 7: 1524: 1522: 734:. Dordrecht : Kluwer Academic Publ. 883:Successive parabolic interpolation 51:{\displaystyle B\subset X\times Y} 14: 1203:Projective algorithm of Karmarkar 679:Gorski, Jochen; Pfeuffer, Frank; 1526: 1198:Ellipsoid algorithm of Khachiyan 1101:Sequential quadratic programming 938:Broyden–Fletcher–Goldfarb–Shanno 533:{\displaystyle f_{y}(x)=f(x,y)} 436:{\displaystyle f_{x}(y)=f(x,y)} 1156:Reduced gradient (Frank–Wolfe) 641: 638: 606: 527: 515: 506: 500: 430: 418: 409: 403: 348: 339: 327: 272: 260: 157: 145: 1: 1486:Spiral optimization algorithm 1106:Successive linear programming 1542:. You can help Knowledge by 1224:Simplex algorithm of Dantzig 1096:Augmented Lagrangian methods 58:is called a biconvex set on 1615: 1521: 1599:Applied mathematics stubs 1503: 1456: 1443: 1427:Push–relabel maximum flow 1272: 1259: 1229:Revised simplex algorithm 1135: 1122: 1063: 1050: 1036: 849: 836: 769:10.1007/s10107-014-0826-5 726:Floudas, Christodoulos A. 704:10.1007/s00186-007-0161-1 77:{\displaystyle X\times Y} 952:Symmetric rank-one (SR1) 933:Berndt–Hall–Hall–Hausman 757:Mathematical Programming 1476:Parallel metaheuristics 1284:Approximation algorithm 995:Powell's dog leg method 947:Davidon–Fletcher–Powell 843:Unconstrained nonlinear 19:is a generalization of 1538:-related article is a 1461:Evolutionary algorithm 1044: 653: 583: 554: 534: 477: 457: 437: 380: 360: 308: 288: 219: 218:{\displaystyle x\in X} 193: 173: 104: 103:{\displaystyle y\in Y} 78: 52: 1594:Generalized convexity 1234:Criss-cross algorithm 1057:Constrained nonlinear 1042: 863:Golden-section search 654: 596:function. A function 584: 555: 535: 478: 458: 438: 381: 361: 309: 289: 220: 194: 174: 105: 79: 53: 17:Biconvex optimization 1151:Cutting-plane method 600: 567: 544: 487: 467: 447: 390: 370: 321: 298: 229: 203: 199:and for every fixed 183: 114: 88: 62: 30: 1589:Convex optimization 1536:applied mathematics 1481:Simulated annealing 1299:Integer programming 1289:Dynamic programming 1129:Convex optimization 990:Levenberg–Marquardt 582:{\displaystyle x,y} 294:is a convex set in 179:is a convex set in 84:if for every fixed 21:convex optimization 1161:Subgradient method 1045: 970:Conjugate gradient 878:Nelder–Mead method 649: 594:block multi-convex 579: 550: 530: 473: 453: 433: 376: 356: 304: 284: 215: 189: 169: 100: 74: 48: 1551: 1550: 1516: 1515: 1499: 1498: 1439: 1438: 1435: 1434: 1398: 1397: 1359: 1358: 1255: 1254: 1251: 1250: 1247: 1246: 1118: 1117: 1114: 1113: 1034: 1033: 1030: 1029: 1008: 1007: 741:978-0-7923-6014-8 681:Klamroth, Kathrin 553:{\displaystyle X} 476:{\displaystyle y} 456:{\displaystyle Y} 379:{\displaystyle x} 307:{\displaystyle Y} 192:{\displaystyle X} 1606: 1572: 1565: 1558: 1530: 1523: 1445: 1361: 1327: 1304:Branch and bound 1294:Greedy algorithm 1274: 1261: 1181: 1137: 1124: 1065: 1052: 1000:Truncated Newton 915:Wolfe conditions 898: 851: 838: 811: 804: 797: 788: 781: 780: 752: 746: 745: 722: 716: 715: 689: 683:(22 June 2007). 676: 658: 656: 655: 650: 648: 637: 636: 618: 617: 588: 586: 585: 580: 559: 557: 556: 551: 539: 537: 536: 531: 499: 498: 482: 480: 479: 474: 462: 460: 459: 454: 442: 440: 439: 434: 402: 401: 385: 383: 382: 377: 365: 363: 362: 357: 355: 313: 311: 310: 305: 293: 291: 290: 285: 241: 240: 224: 222: 221: 216: 198: 196: 195: 190: 178: 176: 175: 170: 126: 125: 109: 107: 106: 101: 83: 81: 80: 75: 57: 55: 54: 49: 1614: 1613: 1609: 1608: 1607: 1605: 1604: 1603: 1579: 1578: 1577: 1576: 1519: 1517: 1512: 1495: 1452: 1431: 1394: 1355: 1332: 1321: 1314: 1268: 1243: 1207: 1174: 1165: 1142: 1131: 1110: 1084: 1080:Penalty methods 1075:Barrier methods 1059: 1046: 1026: 1022:Newton's method 1004: 956: 919: 887: 868:Powell's method 845: 832: 815: 785: 784: 754: 753: 749: 742: 724: 723: 719: 687: 678: 677: 670: 665: 628: 609: 598: 597: 565: 564: 542: 541: 540:is convex over 490: 485: 484: 465: 464: 445: 444: 443:is convex over 393: 388: 387: 368: 367: 319: 318: 296: 295: 232: 227: 226: 201: 200: 181: 180: 117: 112: 111: 86: 85: 60: 59: 28: 27: 12: 11: 5: 1612: 1610: 1602: 1601: 1596: 1591: 1581: 1580: 1575: 1574: 1567: 1560: 1552: 1549: 1548: 1531: 1514: 1513: 1511: 1510: 1504: 1501: 1500: 1497: 1496: 1494: 1493: 1488: 1483: 1478: 1473: 1468: 1463: 1457: 1454: 1453: 1450:Metaheuristics 1448: 1441: 1440: 1437: 1436: 1433: 1432: 1430: 1429: 1424: 1422:Ford–Fulkerson 1419: 1414: 1408: 1406: 1400: 1399: 1396: 1395: 1393: 1392: 1390:Floyd–Warshall 1387: 1382: 1381: 1380: 1369: 1367: 1357: 1356: 1354: 1353: 1348: 1343: 1337: 1335: 1324: 1316: 1315: 1313: 1312: 1311: 1310: 1296: 1291: 1286: 1280: 1278: 1270: 1269: 1264: 1257: 1256: 1253: 1252: 1249: 1248: 1245: 1244: 1242: 1241: 1236: 1231: 1226: 1220: 1218: 1209: 1208: 1206: 1205: 1200: 1195: 1193:Affine scaling 1189: 1187: 1185:Interior point 1178: 1167: 1166: 1164: 1163: 1158: 1153: 1147: 1145: 1133: 1132: 1127: 1120: 1119: 1116: 1115: 1112: 1111: 1109: 1108: 1103: 1098: 1092: 1090: 1089:Differentiable 1086: 1085: 1083: 1082: 1077: 1071: 1069: 1061: 1060: 1055: 1048: 1047: 1037: 1035: 1032: 1031: 1028: 1027: 1025: 1024: 1018: 1016: 1010: 1009: 1006: 1005: 1003: 1002: 997: 992: 987: 982: 977: 972: 966: 964: 958: 957: 955: 954: 949: 944: 935: 929: 927: 921: 920: 918: 917: 912: 906: 904: 895: 889: 888: 886: 885: 880: 875: 870: 865: 859: 857: 847: 846: 841: 834: 833: 816: 814: 813: 806: 799: 791: 783: 782: 763:(1–2): 57–59. 747: 740: 717: 698:(3): 373–407. 667: 666: 664: 661: 647: 643: 640: 635: 631: 627: 624: 621: 616: 612: 608: 605: 578: 575: 572: 549: 529: 526: 523: 520: 517: 514: 511: 508: 505: 502: 497: 493: 472: 452: 432: 429: 426: 423: 420: 417: 414: 411: 408: 405: 400: 396: 375: 354: 350: 347: 344: 341: 338: 335: 332: 329: 326: 303: 283: 280: 277: 274: 271: 268: 265: 262: 259: 256: 253: 250: 247: 244: 239: 235: 214: 211: 208: 188: 168: 165: 162: 159: 156: 153: 150: 147: 144: 141: 138: 135: 132: 129: 124: 120: 99: 96: 93: 73: 70: 67: 47: 44: 41: 38: 35: 13: 10: 9: 6: 4: 3: 2: 1611: 1600: 1597: 1595: 1592: 1590: 1587: 1586: 1584: 1573: 1568: 1566: 1561: 1559: 1554: 1553: 1547: 1545: 1541: 1537: 1532: 1529: 1525: 1520: 1509: 1506: 1505: 1502: 1492: 1489: 1487: 1484: 1482: 1479: 1477: 1474: 1472: 1469: 1467: 1466:Hill climbing 1464: 1462: 1459: 1458: 1455: 1451: 1446: 1442: 1428: 1425: 1423: 1420: 1418: 1415: 1413: 1410: 1409: 1407: 1405: 1404:Network flows 1401: 1391: 1388: 1386: 1383: 1379: 1376: 1375: 1374: 1371: 1370: 1368: 1366: 1365:Shortest path 1362: 1352: 1349: 1347: 1344: 1342: 1339: 1338: 1336: 1334: 1333:spanning tree 1328: 1325: 1323: 1317: 1309: 1305: 1302: 1301: 1300: 1297: 1295: 1292: 1290: 1287: 1285: 1282: 1281: 1279: 1275: 1271: 1267: 1266:Combinatorial 1262: 1258: 1240: 1237: 1235: 1232: 1230: 1227: 1225: 1222: 1221: 1219: 1217: 1214: 1210: 1204: 1201: 1199: 1196: 1194: 1191: 1190: 1188: 1186: 1182: 1179: 1177: 1172: 1168: 1162: 1159: 1157: 1154: 1152: 1149: 1148: 1146: 1144: 1138: 1134: 1130: 1125: 1121: 1107: 1104: 1102: 1099: 1097: 1094: 1093: 1091: 1087: 1081: 1078: 1076: 1073: 1072: 1070: 1066: 1062: 1058: 1053: 1049: 1041: 1023: 1020: 1019: 1017: 1015: 1011: 1001: 998: 996: 993: 991: 988: 986: 983: 981: 978: 976: 973: 971: 968: 967: 965: 963: 962:Other methods 959: 953: 950: 948: 945: 943: 939: 936: 934: 931: 930: 928: 926: 922: 916: 913: 911: 908: 907: 905: 903: 899: 896: 894: 890: 884: 881: 879: 876: 874: 871: 869: 866: 864: 861: 860: 858: 856: 852: 848: 844: 839: 835: 831: 827: 823: 819: 812: 807: 805: 800: 798: 793: 792: 789: 778: 774: 770: 766: 762: 758: 751: 748: 743: 737: 733: 732: 727: 721: 718: 713: 709: 705: 701: 697: 693: 686: 682: 675: 673: 669: 662: 660: 633: 629: 625: 622: 619: 614: 610: 603: 595: 590: 576: 573: 570: 561: 547: 524: 521: 518: 512: 509: 503: 495: 491: 470: 450: 427: 424: 421: 415: 412: 406: 398: 394: 373: 345: 342: 336: 333: 330: 324: 315: 301: 278: 275: 269: 266: 263: 257: 254: 251: 248: 242: 237: 233: 212: 209: 206: 186: 163: 160: 154: 151: 148: 142: 139: 136: 133: 127: 122: 118: 97: 94: 91: 71: 68: 65: 45: 42: 39: 36: 33: 24: 22: 18: 1544:expanding it 1533: 1518: 1471:Local search 1417:Edmonds–Karp 1373:Bellman–Ford 1143:minimization 975:Gauss–Newton 925:Quasi–Newton 910:Trust region 818:Optimization 760: 756: 750: 730: 720: 695: 691: 593: 591: 562: 316: 25: 16: 15: 1491:Tabu search 902:Convergence 873:Line search 463:and fixing 317:A function 1583:Categories 1322:algorithms 830:heuristics 822:Algorithms 663:References 1277:Paradigms 1176:quadratic 893:Gradients 855:Functions 642:→ 623:… 349:→ 276:∈ 252:∈ 210:∈ 161:∈ 137:∈ 95:∈ 69:× 43:× 37:⊂ 1508:Software 1385:Dijkstra 1216:exchange 1014:Hessians 980:Gradient 728:(2000). 712:15900842 1351:Kruskal 1341:BorĹŻvka 1331:Minimum 1068:General 826:methods 777:5646309 1213:Basis- 1171:Linear 1141:Convex 985:Mirror 942:L-BFGS 828:, and 775:  738:  710:  26:A set 1534:This 1412:Dinic 1320:Graph 773:S2CID 708:S2CID 688:(PDF) 1540:stub 1378:SPFA 1346:Prim 940:and 736:ISBN 1308:cut 1173:and 765:doi 761:155 700:doi 1585:: 824:, 820:: 771:. 759:. 706:. 696:66 694:. 690:. 671:^ 560:. 483:, 386:, 314:. 225:, 110:, 1571:e 1564:t 1557:v 1546:. 1306:/ 810:e 803:t 796:v 779:. 767:: 744:. 714:. 702:: 646:R 639:) 634:K 630:x 626:, 620:, 615:1 611:x 607:( 604:f 577:y 574:, 571:x 548:X 528:) 525:y 522:, 519:x 516:( 513:f 510:= 507:) 504:x 501:( 496:y 492:f 471:y 451:Y 431:) 428:y 425:, 422:x 419:( 416:f 413:= 410:) 407:y 404:( 399:x 395:f 374:x 353:R 346:B 343:: 340:) 337:y 334:, 331:x 328:( 325:f 302:Y 282:} 279:B 273:) 270:y 267:, 264:x 261:( 258:: 255:Y 249:y 246:{ 243:= 238:x 234:B 213:X 207:x 187:X 167:} 164:B 158:) 155:y 152:, 149:x 146:( 143:: 140:X 134:x 131:{ 128:= 123:y 119:B 98:Y 92:y 72:Y 66:X 46:Y 40:X 34:B

Index

convex optimization


Klamroth, Kathrin
"Biconvex sets and optimization with biconvex functions: a survey and extensions"
doi
10.1007/s00186-007-0161-1
S2CID
15900842
Floudas, Christodoulos A.
Deterministic global optimization : theory, methods, and applications
ISBN
978-0-7923-6014-8
doi
10.1007/s10107-014-0826-5
S2CID
5646309
v
t
e
Optimization
Algorithms
methods
heuristics
Unconstrained nonlinear
Functions
Golden-section search
Powell's method
Line search
Nelder–Mead method

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.

↑