“Most accurate” means all eight of these tests are passed
“Most accurate” has to be checkable. A theory, ours or anyone's, wins only if it explains the established facts best and predicts new data better than its rivals. All of these must hold:
- Written down and frozen. The theory states what brain activity comes with experience, and why. Its measure and decision rule are hashed before any held-out data is opened.
- Explains the known facts. It accounts for more of our public list of established findings than any rival does (blindsight, split brains, the cerebellum, anaesthesia, dreaming, covert awareness and more), scored by people who did not write it.
- Works zero-shot. It tells conscious from unconscious on at least 4 held-out datasets from 3 families (sleep, anaesthesia, disorders of consciousness), with AUC at least 0.90 pooled and 0.80 in each.
- Right when behaviour misleads. Ketamine (unresponsive, but people report experiences afterwards), REM dreaming, and dream vs no-dream awakenings within one sleep stage. The truth is the later report.
- Beats simple baselines. It outperforms the EEG spectral slope, band power and an arousal classifier. Otherwise it is a sleepiness detector.
- Beats rival theories. At least two rival measures, frozen the same way, score worse.
- Prospective. It passes on a dataset published after the hash date.
- Survives a red team that did not build it.
Our odds fall as the claim grows
What would raise the odds most
- An open TMS-EEG dataset covering sleep, anaesthesia and patients, so the perturbational complexity index can be tested directly.
- Open, pooled dream reports from serial-awakening studies.
- COGITATE experiment 2 or INTREPID data released after we seal our predictions, which would give a clean prospective test.