(Lance and Bill did a vidcast about the OpenAI Document Drop. See here. My spellcheck thinks that vidcast and OpenAI are not words.)
The Metric TSP problem is TSP where, for all vertices \(x,y,z\),
\(w(x,z) \le w(x,y) + w(y,z) \).
In 1976 Christofides and Serdyukov (independently of each other) showed that there is a poly time algorithm for a 1.5-approx to Metric TSP.
Some people thought the 1.5 could be improved.
Some people thought that 1.5 is optimal.
1.5 is a natural number. Hmm, that's not quite right. 1.5 is a pretty number. It would not be a surprise if someone had proven
If there is a poly time (\(1.5-\epsilon\)) approx then P=NP.
Indeed, people tried to prove that.
In 2020 Anna R. Karlin, Nathan Klein, and Shayan Oveis Gharan proved
there is a poly time (\(1.5-\frac{1}{10^{36}}\)) approximation algorithm.
Darling thinks this result is hilarious. I tried to tell her that the result is important since
a) We now know that 1.5 is NOT optimal.
b) One of the authors, Nathan Klein, had been in my REU program in 2015.
c) The arxiv version has one author using their middle initial, one author doing nothing for their middle name, and one author spelling out their entire middle name. I think that's unusual.
She was not impressed.
Nobody believes that \(1.5-\frac{1}{10^{36}}\) is optimal.
Is there a current conjecture? Klein told me he thinks 4/3. A pretty number.
The recent results on Matrix Mult and Int Mult give a contrast involving pretty runtime and ugly runtimes.
MATRIX MULT
Let \(\omega\) be the least \(a\) such that two \(n\times n\) matrices can be multiplied together with \(O(n^a)\) operations. This definition is not quite right for two reasons:
(i) It is possible (though I think unlikely) that there is no least \(a\), For example, if there is a sequence of algorithms with runtime \(O(n^{2.1})\), \(O(n^{2.01})\), \(O(n^{2.001})\), \(\ldots\), then there is no least \(a\),
(ii) It is possible (though I thought unlikely before Oct 6, 2026), that the runtime may be different over different fields.
We keep the incorrect definition to prove that ChatGPT is not the boss of me.
Here are some known results. I may have missed some:
The traditional algorithm: \(\omega\le 3\).
Strassen's Algorithm (1969): \(\omega\le \log_2 7 = 2.807\ldots \).
Coppersmith-Winograd (1990): \(\omega \le 2.376\ldots \).
Stothers (2010): \(\omega \le 2.3736\ldots\).
V.V. Williams (2012): \(\omega \le 2.3728642\ldots \). (Stothers and V.V. Williams were independent.)
Alman and V.V. Williams (2020): \(\omega < 2.3728596\).
Alman, Duan, V.V. Williams, Y. Xu, Z. Xu, and Zhou (2024): \(\omega < 2.371339 \). (The preprint was in 2024. The published paper was in 2025.)
Google DeepMind's AI-based optimizer (August 2026): \(\omega < 2.371177\).
The value 2.371177 was the best upper bound on \(\omega\) for about 2 months.
The Chrysler Building was the tallest building in the world for about 11 months: from May 27, 1930 until May 1, 1931. The Empire State Building was the new champion. After May 1, 1931, the Chrysler Building wasn't even the tallest building in Manhattan. Fame is fleeting in both mathematics and architecture.
Note:
a) I believe that all of the algorithms above work over any field.
Google AI agrees with that, but ChatGPT correctly reminded me that Google AI's opinion is not a proof and that I should seek a citation or a counterexample. If you know of a citation to confirm the any-field statement, or a counterexample to the any-field statement, please leave a comment.
b) After 1990 the improvements are really small.
c) None of these bounds is a pretty candidate for the true exponent.
We need notation that makes the field explicit.
Let \(\mathbb{F}\) be a field. Let \(\omega(\mathbb{F})\) be the least \(a\) such that two \(n\times n\) matrices over \(\mathbb{F}\) can be multiplied together with \(O(n^a)\) operations. (ChatGPT is still not the boss of me.)
OpenAI showed the following:
a) \(\omega(\mathbb{C})\le 2.25\). 2.25 is a very pretty number. It makes my heart go pitter-patter.
b) For every field \(\mathbb{F}\) they have \(\omega(\mathbb{F}) < 2.371054886006746\).
Lean-formalized.
A separate GitHub project claims to extend the 2.25 bound to every field with a Lean-checked proof. I have not checked the extension (as opposed to all of the new results OpenAI has dropped, which I have checked line by line with a quill pen and inkwell by the light of an oil lamp). The project is
here.
Back to the issue at hand.
The drop from \(\omega \le 2.37\) to \(2.25\) is a Bob Beamon moment. Recall that before the 1968 Summer Olympics in Mexico City, the world record for the long jump was 27 feet, 4.75 inches (8.35 meters). During those Olympics, Bob Beamon jumped 29 feet, 2.5 inches (8.9 meters). A massive improvement. His record stood until 1991, when Mike Powell jumped 29 feet, 4.5 inches (8.95 meters). Gee, only two inches more! Mike Powell's jump still holds the record. So Beamon had the record for 23 years, and Powell has the record for 35 years. If matrix multiplication follows the same pattern, we may wait 23 years for the next improvement and 35 more years for the one after that. However, since we are dealing with silicon instead of carbon, it may be 23 days and 35 days.
I am happy that the new upper bound on \(\omega\) is a pretty number and hence a plausible candidate for optimal. If no one improves the result within 23 days, I will think 2.25 is optimal.
INT MULT
Improved Algorithms for Integer Multiplication of two \(n\)-bit numbers.
In 1971 Schonhage and Strassen conjectured that there is an algorithm for integer multiplication that takes \(O(n\log n)\) bit operations. In 2019, Harvey and van der Hoeven proved this conjecture. Is there an algorithm that takes less time? Or is \(O(n\log n)\) optimal?
OpenAI obtained an algorithm that takes \(O(n(\log n)^{1-\kappa})\) bit operations, where \(\kappa=2^{-82}\). Really? \(2^{-82}\)? I declined to tell Darling about this one.
Google tells me that OpenAI did not lean-verify this one but
open-source contributors later completed an independent Lean verification of the algorithm and improved the bound. The link is
here. The improvement first pushed the small term to \(2^{-34}\) and then to \(2^{-14.38}\). I won't tell Darling these results until its down to \(2^{-1}\).
Note the contrast between matrix multiplication and integer multiplication.
Matrix multiplication went from a runtime too ugly to be optimal---(O(n^{2.371\ldots})\)---to one pretty enough to be optimal---\(O(n^{2.25})\).
Integer multiplication went from a runtime pretty enough to be optimal---\(O(n\log n)\)---to one too ugly to be optimal---\(O(n(\log n)^{1-\kappa})\), where \(\kappa=2^{-14.38}\)
Is L=BPL lean accepted by community?
ReplyDeleteJust because the first improvement for a problem shaves a very small constant for the exponent does not mean that that's where things end. It's a proof of concept that better is possible, so it should only encourage people to work harder and find the right answer.
ReplyDeletecan you give an example where the first improvement on an algorihtm was something like 1/2^{10} or smaller, but this encouraged people to work on it some more and eventually a reasonable algorithm emerged. I ask non rhetorically as always.
DeleteSee the entire sequence of works on faster flow algorithms in sparse graphs. Surely I am missing some: n^(3/2-1/14) unit capacity max flow (https://arxiv.org/abs/1608.06016, was also a FOCS best paper award), n^(3/2-1/14) unit capacity min cost flow (https://arxiv.org/abs/1605.01717), n^(3/2-1/8) unit capacity max flow (https://arxiv.org/abs/1910.14276), n^(3/2-1/6) unit capacity max flow (https://arxiv.org/abs/2009.03260, https://arxiv.org/abs/2003.08929), n^(3/2-1/16) unit capacity min cost flow (https://arxiv.org/abs/2003.04863), n^(3/2-128) max flow (https://arxiv.org/abs/2101.07233), n^(3/2-1/762) min cost flow (https://arxiv.org/abs/2111.10368), n^(3/2-1/58) min cost flow (https://arxiv.org/abs/2112.00722), and finally almost linear time (https://arxiv.org/abs/2203.00671).
DeleteWhether the improvement in the exponent is 1/2^10 or 1/10 doesn't matter. It's a proof of concept that better can be done, and brings new ideas to the table.
if you have a sequence of algorithms A_0, A_1, .... for matrix multiplication
ReplyDeleteand the run time complexity of A_i is O(n^c_i)
and the run times coverage to O(n^2),
e.g. 1000 n^{2+0.1^i}
and given n, we can generate A_i in time O(n^2)
would matrix multiplication be in O(n^2)?
is there a lowerbound that says it cannot be done in quadratic time?
2 seems a much nicer number than 2.25
To your first question: not necessarily. For example, the constant factors hidden by the O(-) notation could be growing very fast and this would ruin the sort of approach you have in mind.
DeleteTo your second question: less than n^2 time is not even enough time to read all the entries in the matrices. So yes, O(n^2) is a lower bound on the running time.
if you read carefully, I put an actual sequence of run times that coverages to some O(n^2) function, with an example. so your first answer does not satisfy the requirements I stated.
Deletefor the second one, Omega(n^2) is obvious. I am asking for a lower bound that works rule out O(n^2).
btw, O(n^2) lower bound is meaningless, you should have written Omega(n^2) lower bound.
DeleteWhy not (1+\epsilon)?
ReplyDeleteTo print the output takes n^2 time so you cannot do Matrix Mult in n^{1.99}.
DeleteI was implying traveling salesman approximation.
DeleteAH- Indeed- Inspired by your question I looked up if its know that (1+ep) approx implies P=NP. It does not. So YES, it is possible that Metric TSP has poly time (1+ep) approx.And if so then the result I wrote about might be the first step. THEN AGAIN the answer really could be 4/3. Maybe OpenAI will figure this out within the next month.
DeleteI asked google AI what the experts think, and do any think (1+ep). It told me that 1+ep implies P=NP. I reminded it that it JUST told me that 1+ep DOES NOT imply P=NP. It apologized.
DeleteIt's Karlin, Klein, and Oveis Gharan;Not "Karlin, Klein, Gharan, and Oveis"
ReplyDeleteFixed. I added the names as they appear on the arxiv paper, and made a comment about that. Thanks!
DeleteOveis Gharan is Shayan's compound last name. So, no middle name spelled out.
ReplyDeleteETH is false???
ReplyDeletehttps://github.com/openai/math/blob/main/preprints%2FThe-Exponential-Time-Hypothesis-is-False-October-25-2026%2Fpaper.pdf
Serious people are looking at it. The jury is still out but I suspect we will know that ETH is false in a month. For the new results in complexity theory, they are in two categories; (1) People thoght they true: Unique games Conj, L=RL (2) People surprised: ETH, 3SUM in subquadratic, APSP in subcubic. Matrix Mult bein gin 2.25 didn't surprise anyone, but the big leap to it did. int mult being just a shade LESS than nlog n---not sure what people thought. I thought nlog n would be optimal.
DeleteIs ETH the halloween dumping I predicted? In a month P is PP dumped? New year SAT in O(n) and apocalypse begins?
DeleteOpenAI claims that they have refuted ETH:
ReplyDeletehttps://github.com/openai/math/blob/main/lean/docs/378.md
Anthropic seems to have independently proven the same thing.
This is probably the most exciting and frightening year in the math and theoretical computer science. I am starting to think we might see a solution to P vs. NP not just in my lifetime but over the next few years.
hey, so didn't I warn you guys on this blog that OpenAI had already way back resolved PvsNP and I wasn't allowed to even mention in which way they resolved it? Then some laughing faces here telling me that it's not possible .... Actually there is more to it. 3 of the core member people told me a few weeks ago something much much bigger is about to happen and be announced by OpenAI. And yes, there is a bug in that current version of the paper, as one member of the inner core team shared. It's a mixed bag these clowns working there ... so be careful.
ReplyDeletethe only clown around here is you
Deleteyou, an anonymous person in the Internet, claim you have heard from someone something, and not only you cannot give us any evidence and cannot even respond respectfully to people that point out rationally why your claim is likely false, you cannot even tell what the answer is.
and then you have the audacity to tell other people that they are clowns because they don't believe some anonymous Internet guy's vague claims over the Internet
zero evidence for vague claim by an anonymous over the Internet -> zero bits of information about the topic
+ claiming that other people are clown -> evidence the guy himself is a clown
Another anonymous.. at least you should believe in rumors over experts now.
DeleteI am not joking but I myself am aware of two tricks to P is NP (you can ask why I haven't published.. I don't know). I did not think of OpenAI proof but it has the right ingredients to improvements though obstruse (my tricks are not). All the tricks I know yield collapses of classes and I do not know why OpenAI tricks should be different (implying OpenAI is hiding).
DeleteThough philosophically similar to an extent the shape of my improvements are different. Never in my wildest thoughts I concocted a shape of (n log log n)/sqrt(log n) in exponent. Lipton had a posting having shape of n/(log n) in exponent along.with another shape. I never understood where he got.n/(log n) as an.hypothesis but the other shape was easy to guess the origin.
DeleteI can understand your emotional outburst, but let facts address your the most relevant point. Was it not before or did the result come a few days afterwards ... by result i mean OPENAI releasing ETH is false.
ReplyDeleteJust way and you see what is meant. Stop using or maybe start using AI to improve your writing skills, nowhere in my comment did I say or mention anything about clowns. This is your inner voice talking about inner insecurities?
ETH result is very far from an answer to P vs. NP. My prior for us finding an algorithm for SAT that is much better than experimental has gone down slightly, but we are not even in 2^n^0.9 territory yet, so my prior for the road to P vs. NP being long has not changed.
Delete