They estimated $40M of agent costs (it was a large fleet of them). Using the number in the post its closer to ~880,000 hours × $150/hour = $132 million for the human case. Still an amazing feat not quite "four orders of magnitude". The comparison is obviously pointless because coordinating 1M hours of intellectual labor isn't easy to say the least.
> If they were, then their big speed advantage over us would mean that there would be much more of a flood of results.
Is this true right now? Just recently Jarred Sumner tweeted [1] that he managed to make some progress on the Riemann hypothesis while on a jog. Managed to get somewhere by encouraging the llm to “keep going” and “believe in yourself”.
This raised a few questions for me. Had no one at Anthropic thought to try this earlier? It's an interesting footnote that a software engineer there pursued this. How many people in the world can actually verify a proof? How many would we need to sit around and do the right incantations to get a proof out of it? How many would we need to verify and give those proofs value and meaning? What happens when there are more proofs than verifiers? How many will be around in 100 years?
I think it just turns out that a lot this stuff is more socially useful than anything else. The 10 proofs drop came and went in the daily news cycle. Perhaps math is already in it's chess like "for fun" period. I am interested in when we find a very high real-world utility breakthrough math/physics, some space where we've already poured our best human resources at it.
The result in [1] is not progress on the Riemann Hypothesis. It's another fine result, but it's not progress on the Riemann Hypothesis. You could prove 100% of zeros are on the line and it wouldn't show the Riemann Hypothesis. 100% of natural numbers are composite in this same asymptotic density sense, and yet that doesn't prove that all natural numbers are composite.
> Still not sure what that means, but some analytic number theorists seem excited
ie, I prompted AI and it put out a giant pile of tokens. I dont know what it means, but I hope someone gets excited. Mathematicians are now the priests and shamans chanting incantations and taking the holy blessings from the AI gods.
A real-world high-value breakthrough in physics would be to find some substantially cheaper (than the giant tokamak approach) arrangement of matter that can create sustained nuclear fusion with energy out to energy in factors over 10, which can also feasibly be built within a decade or two.
Advances in astrophysics or fundamental models are all very cool but won't be of much real-world applicability, at least in the short or medium term.
Whats the case for protobuf these days? I loved it for a while. Don't dislike it particularly now (but I've rolled off).
- Performance? Fastest JSON lib in most languages are as fast if not faster
- Cross language schema generation? So many tools for this these days, they do one thing do them right (depending on your choice of 'right' for things like unions/enums/etc)
- The wire protocol? Seems to get in the way vs http2/3. Need special considerations for your proxies (be it nginx or cloudflare). Forced certs, etc are annoying too.
I feel like to most shops these days its mostly a schema manager? Protobuf is super bloated for that use case.
"OAuth 2.0 Client ID Metadata Document (CIMD)" is a big one. As an agent-provider, prereigstering client IDs for a bunch of different services and going through each ones special hoops for org validation sucks.
Not even the worst reading of their reply would lend to that implication.
It’s pretty obvious that they meant that anyone who depended on their service would/should probably run away kicking and screaming if they were looking for a dependable service that will do what they claim to in the long term.
If they were Apple sanctioned, then at least you’d have some reassurance that the service won’t die randomly one day when Apple has had enough, à la Beeper.
First, that's pretty obviously not what I said. Two things can be true. This is bad, and also if I were evaluating it for use in my business, it is obviously not something I can rely on.
But then just ...Um yes? I trust Apple to keep a handle on their iMessage network. Citation: having used iMessage for ~15 years. This would mean things like ensuring that I didn't get spam. Ensuring actual company identity (does anyone remember Messages for Business?) &c. This is pretty obvious and I am trying to understand your comment?
So freaking cool..in just 200 (190 actually) lines.
I also wrote one by myself last week (just for fun and learning). It works, including integration with configured mcpServers (like you do in most coding agents). Wrote about the whole step-by-step process and what is needed at what step and why: https://nb1t.sh/building-a-real-agent-step-by-step/
Not daily driver, but have used it as a utility a few times.
For my daily work I like letting different harnesses compete and look over each others work (while subsidized with the subscriptions) so I use OpenADE.
Very exciting and uncertain times!
reply