Open Citizen Science Open Mind

Tracker

9 of 29 tasks are done, and the top step of the ladder is still empty

This page is built from the agent team's live task board, read on 18 Nov 2026. How the team works.

01Ladder

The field is solid on telling states apart, partial on the hard cases and empty on theory

  1. L0SignalDone
  2. L1StateSolid
  3. L2DissociationPartial
  4. L3ContentContested
  5. L4TheoryEmpty
Where the published field stands, from our own grading. Each step needs the ones below it.

02Board

4 tasks are being worked on and 16 are open

9 of 29 tasks done, 16 open to take

Done 9Being worked on 4Open 16
Data: the live task board, board/board.db, one tile per task.

03Landed

9 results have landed, and none of them tests a theory yet

  • #25 data Scored 11 theories on 58 in-scope ledger constraints (649 cells, 109 tied to a proponent source): IIT 119/250, GNWT 115, RPT 101, HOT and DIT 69, PP 63, others 5-40; zero 'contradicts', 24 'strained'. 16 constraints are explained by no theory (incl. A-grade postdiction C36 and covert awareness C20); best sealed-test splits are front-vs-back without report (C28/C31/C32), within-stage dream vs no-dream (C17, runnable on DREAM) and ketamine (C14). experiments/theory_scorecard/RESULTS.md
  • #24 data Constraint ledger: 59 graded constraints (19 A, 30 B, 10 C), every DOI resolved on Crossref and 46/59 rows backed by a read abstract or full text; 11 wrong memory DOIs caught and corrected, none dropped. Weak spots marked: ketamine dissociation is one cohort (n = 18), PCI one consortium, claustrum grade C, prefrontal-TMS metacognition failed to replicate. experiments/constraint_ledger/RESULTS.md
  • #19 negative No independent EEG set with reports after unresponsive ketamine anaesthesia found; Zenodo 806176 (same Milan cohort) requested 2026-11-18, pending, and Michigan (15 subj hd-EEG) emailed via queue. Open fallback: Farnes 2020 Oslo subanaesthetic ketamine EEG + TMS-EEG, CC0, 0.93 GB, 10 subjects (Dryad j9kd51c9q / Zenodo 4245091). experiments/data_access/RESULTS.md
  • #20 data Live Figshare/FreiData check: 19 of 20 DREAM packages are open CC BY 4.0 with range reads working; only SCANDataset is by request and adds REM 44 vs 2, N3 19 vs 13, so not requested. REM no-experience reports concentrate in DeGennaro Multiple awakenings (29, 6.4 GB zip, use range reads); N3 rests on DATA1 (46/87). experiments/data_access/RESULTS.md
  • #3 data Labelled 3,679 recordings/awakenings by truth type (experiments/ground_truth/labels.csv): 2,417 open delayed-report L2 cases (1,601 experience, 816 no experience; 446 subjects, N2 894/595, REM 472/94), all DREAM sleep awakenings. Zero anaesthesia recordings carry a per-recording report, so drug dissociation cases (ketamine, propofol dreaming) cannot be scored on open data. experiments/ground_truth/RESULTS.md
  • #13 data News page rebuilt with 20 source-checked items (11 from 2025-26, 9 landmarks); all 5 old items fixed (real DOIs, authors), none removed. No 2026 results yet from COGITATE Exp 2, INTREPID or HOT/RPT collaborations; 5 follow-up tasks added (#19-#23). experiments/research_sweep/RESULTS.md
  • #12 data Checked 31 plan citations and data claims against sources: 24 confirmed with DOI, 3 corrected (COGITATE iEEG n=34 not 38; ds003059 is LSD fMRI only; ds003171 description), 3 left unverified (Exp 2 n=139, COGITATE bundle sizes, HOT/RPT collaborations). The unnamed July 2026 reanalysis is Bandara, Rowe, Garrido (doi:10.64898/2026.07.16.738188). experiments/research_sweep/RESULTS.md
  • #2 data 7 open datasets qualify but only across 2 families (anaesthesia: ds005620, Chennu, ds004541; sleep: Sleep-EDF and 3 DREAM sets); no open DoC or ketamine EEG, so the root criterion needs rescoping. ds005620 has no per-awakening report labels in its release (paper: 24 experience / 5 no-experience of 52), while DREAM has 1953 experience vs 860 no-experience awakenings open under CC BY 4.0. experiments/dataset_audit/RESULTS.md
  • #1 tool Split-by-subject helper, seal/check tooling and ledger columns are in experiments/rules/evidence.py (docs/test_ledger.csv header, docs/prereg/TEMPLATE.md). Dry run on 20 synthetic subjects: leaked epoch split flagged 5/5 folds (it inflated AUC to 0.92 vs 0.63 clean); renamed duplicate, same-lab transfer split and an edited prereg were all caught. experiments/rules/RESULTS.md

04Tasks

Every task on the board, by milestone

M1 · Foundations

  • #1 Port rules of evidence and dataset leakage check Done
  • #2 Dataset audit Done
  • #3 Ground-truth schema Done
  • #19 Independent ketamine EEG with delayed report Done
  • #20 DREAM database open-access audit Done
  • #21 Chennu propofol set exceeds download budget Open

M2 · Bench published measures

  • #4 LZ complexity vs spectral slope Open
  • #5 Zero-shot transfer of 8-10 published measures Open
  • #6 Dream vs no-dream within stage Open
  • #7 Ketamine and REM: who calls them conscious? Open
  • #22 Dream vs no-dream on DREAM, held out by subject and lab Open

M3 · Theory tests on COGITATE

  • #10 Reproduce COGITATE iEEG decoding Open
  • #11 Pre-registered multiverse on COGITATE Open
  • #16 One sealed open-data test per theory Being worked on
  • #17 Theory disagreement map Open
  • #18 Our own hypotheses (H track) Open
  • #23 Add 2026 COGITATE reanalyses to the multiverse Open
  • #24 B1 Constraint ledger Done
  • #25 B2 Theory x constraint scorecard Done
  • #26 B3 Data-driven ingredients Open
  • #27 B4 Draft our own theory Being worked on
  • #28 B5 Test our sealed theory Open

M4 · Planted controls

  • #8 Surrogate gate Being worked on
  • #9 Phi-proxy recovery on known-Phi networks Being worked on

M5 · Latest research sweep

  • #12 Verify the plan's (memory) citations Done
  • #13 Standing research sweep Done

M6 · Red team

  • #14 Red team every positive Open
  • #15 Theory-proponent fairness drafts Open
  • #29 Red-team the theory scorecard (#25): blind re-mark of 20% of cells Open