Can LLMs directly produce correct solutions to fully specified constrained optimization problems without access to a solver?

Adam DeJans Jr. just posted “𝗪𝗶𝗹𝗹 𝗔𝗜 𝗲𝘃𝗲𝗻𝘁𝘂𝗮𝗹𝗹𝘆 𝗿𝗲𝗽𝗹𝗮𝗰𝗲 𝗠𝗜𝗟𝗣 𝘀𝗼𝗹𝘃𝗲𝗿𝘀 𝗹𝗶𝗸𝗲 𝗚𝘂𝗿𝗼𝗯𝗶?”. He wrote:

“A few years ago, I probably would have laughed at that question. Today, I’m not so sure. Some fascinating research is emerging around AI models directly solving mathematical optimization problems. And I’m not talking about asking ChatGPT to formulate a MILP. I’m talking about models actually generating solutions.”

See also the related research paper.