I think many cognitive scientists think language is a core part of human cognition, and that LLMs were a major advance in AI/cognitive science due to connecting AI algorithms with language production, but LLMs aren’t considered (or even aiming) to be accurate models of human cognition
This was the core premise behind my research during grad school and beyond. My favorite project — which ultimately became my dissertation — was a proposal to connect reinforcement learning algorithms, neuronal data, psychological behavior, and phenomenology. Specifically, the idea was the feeling of cognitive fatigue is a mathematical signal to ‘rest’, in which the value of rest is defined by offline mechanisms that contribute to decision-making. I proposed a connection to hippocampal replay, and was able to leverage fMRI and choice data to evaluate the hypothesis.
Zooming out of my specific work, the “best” success stories were connections across math/CS, neuro, and psych and the golden child is the dopamine model of reinforcement learning where firing patterns encode the TD prediction error
Is this a misunderstanding of what the double slit experiment actually means, or am I misinterpreting it? If this is based on the idea that reality changes strictly as a result of a conscious observer existing and it is somehow related to consciousness, etc, that is not accurate.
I learned this years ago from Philip Ball, one of the editors of Nature. There have been other scientists helping to clear up the confusion recently, though.
Well, Nima has shown that space-time is emergent from higher geometry like he amplituhedron and is not the fundamental basis of reality. Then Hoffman suggests that conscious agents could plausibly be the substrate through his category theoretic work. It's not a misunderstanding of the double slit experiment. (I think that was a talking point for a long time amongst hippies.) The interpretation that wave function collapse requires a conscious agent would be consistent with this idea though, and also consistent with simulation theory.
Nima is a theoretical physicist and many of them have diverged away from hard science. Hard science needs to connect and relate back to classical physics mathematically and ideally have a way of being tested. Not all theoretical physics ever gets there, probably most don't. The best adjusted theoretical physicists are aiming to expand on our understanding of classical physics which we know to be useful and true to the best of our knowledge as opposed to coming up with entirely new untestable theories of physics that are themselves based on top of untested theories.
Psychology is also a soft science, so while clinical psychology can be useful when it is grounded in real instances of human behavior, theoretical psychology is on the softer end of an already soft spectrum of science.
Simulation theory isn't very convincing and it's really just the opposite end of the spectrum of people demonstrating proof of god. Both types of arguments are almost universally logically flawed. It doesn't prove or disprove them, it's just bad logic.
My team has been working on this in the concept of Turing Test and human vs. AI discrimination: https://arxiv.org/pdf/2605.06524
Specifically, our approach is to separate classic output-based approaches (CAPTCHAs, fingerprints, etc.) and instead look at process-based traces: how are cognitive process traces and broad behavioral metrics evolving over time with continuous human/computer use
Thanks all for the discussion! Would like to highlight two parts that maybe didn't come fully through, and we'll work on making this clearer:
1. CAPTCHAs can still detect AI agents...if you know where to look. Most commercial CAPTCHAs are not doing the cognitive process tracing you see in our paper. Nor are they really doing 'behavioral biometrics' (but that is slightly tangential here). Our CAPTCHA example here is about repurposing the current paradigm with a new methodology (cognitive process tracing) in a way that is able to combat human/machine discrimination in a way that's independent on frontier AI progress.
2. There are lots of concerns about adversarial robustness, which are very fair, and we reported some fine-tuning tests in the paper. Generally, there are two mental models for me that work, both framing fraud as an economic game.
First, compare AI spoofability concerns to something like a passport or a fingerprint. The cost to mimic continuous cognitive and behavioral patterns over time seems more computationally complex. In other words, sure this method is not bulletproof with infinite resources, but nothing is. We rely on defeasible mechanisms everyday, and our job is to make that significantly securer.
Along these lines, there's a common line of criticism that suggests once fraudsters know the game, they will solve the game. The CAPTCHA presence in the 2000s didn't mobilize massive deep learning / image recognition advances from the fraud community. Nor are these same bot farms solving quantum computing despite there being immense incentives to. If anything, the real threats are stuff like JavaScript injections, not really fully simulating human cognition
I mean, their CAPTCHAs presumably have tons of data collected over the years, and they can't detect a pretty clear AI agent here: https://www.youtube.com/watch?v=UeTpCdUc4Ls
Yeah, we benchmarked against a few bot detection provides end of last year (https://research.roundtable.ai/bot-benchmarking/), and Turnstile didn't do great when it came to AI agent detection. We hypothesized that Turnstile primarily focuses on device/network characteristics, which AI agents can bypass
This is relatively close to our conclusion from the paper: unless agents are specifically trained for the task and know all the information ahead of time, they're not able to generalize from one cognitive CAPTCHA to another
My grad school research was on computational models of human/machine cognition, and I'm now commercializing it as a 'proof-of-human API' for bot detection, spam reduction, and identity verification.
One of the mistakes people assume is that AI capability means humanness. If you know exactly where to look, you can start to identify differences between improving frontier models and human cognition.
One concrete example from a forthcoming blog post of mine:
[begin]
In fact, CAPTCHAs can still be effective if you know where to look.
We ran 75 trials -- 388 total attempts -- benchmarking three frontier AI agents against reCAPTCHA v2 image challenges. We looked across two categories: static, where each image grid is an individual target, and cross-tile challenges, where an object spans multiple tiles.
On static challenges, the agents performed respectably. Claude Sonnet 4.5 solved 47%. Gemini 2.5 Pro: 56%. GPT-5: 23%.
On cross-tile challenges: Claude scored 0%. Gemini: 2%. GPT-5: 1%.
In contrast, humans find cross-tile challenges easier than static ones. If you spot one tile that matches the target, your visual system follows the object into adjacent tiles automatically.
Agents find them nearly impossible. They evaluate each tile independently, produce perfectly rectangular selections, and fail on partial occlusion and boundary-spanning objects. They process the grid as nine separate classification problems. Humans process it as one scene.
The challenges hardest for humans -- ambiguous static grids where the target is small or unclear -- are easiest for agents. The challenges easiest for humans -- follow the object across tiles -- are hardest for agents. The difficulty curves are inverted. Not because agents are dumb, but because the two systems solve the problem with fundamentally different architectures.
Faking an output means producing the right answer. Faking a process means reverse-engineering the computational dynamics of a biological brain and reproducing them in real time. The first problem can be reduced to a machine learning classifier. The second is an unsolved scientific problem.
The standard objection is that any test can be defeated with sufficient incentive. But fraudsters weren't the ones who built the visual neural networks that defeated text CAPTCHAs -- researchers were. And they aren't solving quantum computing to undermine cryptography. The cost of spoofing an iris scan is an engineering problem. The cost of reproducing human cognition is a scientific one. These are not the same category of difficulty.
>The first problem can be reduced to a machine learning classifier. The second is an unsolved scientific problem.
I can't believe people are still using this as a generic anti-AI argument even though a decade ago people were insisting that there's no way AI can have the capabilities that frontier LLMs have today. Moreover it's unclear whether the gap even exists. Even if we take the claim that the grid pattern is some sort of fundamental constraint that AI models can't surpass, it doesn't seem too hard to work around by infilling the grids pattern and presenting the 9 images to LLMs as one image.
> “…reverse-engineering the computational dynamics of a biological brain and reproducing them in real time…”
Is not an anti-AI argument, it’s an open and unsolved question. Your optimism is appreciated, but the dismissal and assumption this is already solved is foolish and naive.