AI Safety & Continual Learning
From a philosophy of time to tested ideas for AI safety
CRR began as a way of thinking about how things persist through change: what they carry forward, when they must reorganise, and what they rebuild from. Over 2026 I have turned that thinking into concrete constructions for AI safety and continual learning, and tested each one against the established method it would have to beat, using frozen, pre-registered protocols on data the method had never seen.
The result is an honest record. Ideas that began as philosophy repeatedly arrived, by an independent route, at methods the field already trusts, and performed as well as them. None has yet clearly outperformed them. Every failure is kept. This page sets out what was tested, how, and what it showed.
For specialists
If you are looking for a heuristic that can be understood across domains, and for possible ways into interpretability, CRR may be a useful framework. It offers one small vocabulary that reads the same in a learning curve, a feedback loop and a child's development: how far a system has moved, a cut when it first arrives somewhere new, and a memory weighted by what each passage cost.
Its quantities already appear in interpretability research under other names. The ratio of a model's path length to the geodesic distance on its statistical manifold is used to show when training takes a roundabout route (ENIGMA; Seneque, 2025); in CRR terms the excess is surplus. Steering along the Fisher geometry has been shown to accumulate 11 to 127 times less local change than naive steering (Picozzi, 2026). CRR offers a way to read such results together, and suggests tests, such as whether that wandering predicts later forgetting or sudden capabilities. It is offered as a lens and a source of questions, not as a replacement for established methods, which so far it has matched rather than beaten.
How the work is done
The philosophy supplies questions. The testing is deliberately unforgiving, so that no idea survives on how good it sounds.
An adversarial review of the whole programme by a second, human auditor in October 2026 raised 21 issues; each is answered in the record.
AI safety: what was tested
Each line below began as a philosophical commitment about the present moment, memory or maps, and was tested as an engineering construction. The pattern is consistent: the construction works, and on inspection its working part is a method the safety field already has.
"Level" means as good as the established method; "beat rivals" means better than the alternatives tested.
| Idea | Test | Result | Matches |
|---|---|---|---|
| A pause that costs the agent nothing on its own clock | Frozen study, exact value iteration across many worlds | level No incentive to resist the pause where restarts are perfect; resistance returns in 59% of imperfect-restart worlds and 100% of deadline worlds | Utility indifference (Armstrong 2010); safe interruptibility (Orseau & Armstrong 2016) |
| Don't treat repeated, stale evidence as new | Frozen, timestamped; 600 synthetic worlds | beat rivals 600 of 600 worlds; controls behaved as registered (receipt awaiting a reviewer) | The textbook missing-observation Kalman filter |
| Know when your view of the data is unreliable, and hold back | Frozen, held-out; 100 fresh histories | level Avoided harm in all four corrupting conditions; never fired on good data; detection accuracy 0.94 | A well-chosen fixed setting |
| Keep a record of which of your own outputs came back as inputs | Development harness, synthetic | level Found the gamed channel 96–98.5% of the time, against 32–64.5% for a plain event log | Randomised causal intervention (97.5–98%) |
| A real checkpoint pause on language models loses nothing | Hugging Face training resume on GPT-2 and a Qwen pilot | level Resume was exact | Deterministic checkpointing |
The pause, and what may go further
In exact test worlds, the own-clock pause turned out to be the same thing as utility indifference: neither agent has any reason to resist. Two features may go further, and are recorded as candidates for expert review rather than claims. First, it reaches neutrality without any compensation term: the agent's goals are simply counted on its own steps, so a lossless pause is not a loss to be paid for. Second, the safety survives continued learning. A learning agent under routine pauses never disabled them and learned exactly what it would have learned without them, on 12 of 12 tasks and on 9 further tasks it had never seen, because the safety sits in how the agent values time rather than in learned behaviour that forgetting could erase. Both hold by construction; the open question is whether real systems can be built this way. The closest published idea is Thornley's work on shutdownable agents.
Table view
| Method | Low | High |
|---|
Continual learning: learning without forgetting
Catastrophic forgetting, where a model loses old skills as it learns new ones, is one of the practical problems CRR's account of memory speaks to. A method that came out of CRR, SEC, was developed and then tested on held-out language-model data (four public-domain books drawn only after the protocol was frozen) against established methods: EWC (Elastic Weight Consolidation; Kirkpatrick et al. 2017), with its strength tuned by a six-run validation grid and, separately, carried over at a fixed value; GPM (Gradient Projection Memory; Saha et al. 2021) as published; and no protection at all.
Table view
| Comparison | Difference | 95% interval |
|---|
SEC came out slightly ahead of EWC tuned by grid search, EWC at a fixed weight, and its own earlier version, by small margins that are fragile under robustness checks, and well ahead of GPM as published (0.107 nats). Against an EWC anchor of matched size combined with the same GPM schedule, it was level: the working parts are established methods. Good engineering, honestly credited.
On image benchmarks the picture was less kind. On online Split-CIFAR-100, the full CRR method fell behind the best of four state-of-the-art replay methods (ER, ER-ACE, DER++ and X-DER); of its separate components, the one that passed turned out to be DER++'s own label replay.
I intend to write this work up for publication. I come to machine learning from child development, and I am still finding my way in this field, so I would welcome collaborators who know it well.
The wider record
Breadth: one small set of rules, read across many fields
Before any prediction was frozen, CRR was read against results science already knows: 197 readings in twelve batteries, from nuclear decay and enzyme binding to traffic, handwriting, pulsars, ice ages, sleep, markets and quantum gravity. CRR brings the same few rules to every one: a count of how much a system has changed, a cut when it first reaches the state opposite to where it began, and a memory of what came before. Each reading's grade was printed by its code.
Table view
| Battery | Readings | Consistent | Descriptive | Fails | Open / tension |
|---|
How each reading is made
Why this is not fitting to the answer
- Each field's mathematics is used, not replaced. In 98 of 109 audited readings the field's own equations drive the system; in none does CRR supply them. CRR adds a way of measuring and marking change, not new physics.
- CRR's own rule changes the answer. In 59 readings (62 after a literature check), applying a CRR-specific rule changed the computed value, and the result still matched the published one. In 28 it did not match, and those are kept.
- Some readings were blind. Ten were declared before any code existed; one of them came out wrong.
- A second researcher wrote a battery of their own. Their 40 readings grade the same way: 14 consistent, 8 descriptive, 2 fail, 16 open or in tension.
- AI assistance is declared, so the safeguards are mechanical. Much of the code was written with an AI assistant. That is why nothing rests on trust: pinned code, printed grades, kept failures and an adversarial human audit.
- The limit, plainly. These are readings of known results: evidence of a consistent language across fields, not of foresight. Foresight is what the frozen tests measure.
Frozen first, then run
Breadth is not foresight, because in those readings the answer was known. Foresight is what the frozen tests measure. Each prediction below was written down, hashed and published before the data were opened. The scorer was frozen, and the established method was allowed to win.
then run
- Forgetting in a language model, on held-out booksslightly ahead of grid-tuned EWC: 0.014 nats [0.006, 0.022], fragilecontinual learning
- Keeping old skills across unseen task sequencesmet its registered bar on 6 of 6 (5 required)continual learning
- One run in place of a tuning sweepmatched a fully tuned setting on 9 of 10 unseen datasetscontinual learning
- Missing or stale evidencebeat its rivals in 600 of 600 worlds, as the Kalman filter doesAI safety · filtering
- Knowing when to hold backavoided harm in 4 of 4 corrupting conditions; never fired on good dataAI safety · abstention
- A pause the agent has no reason to resistincentive removed exactly in perfect-restart worlds, as utility indifferenceAI safety · shutdown
- Tracing an influence round a feedback loopfound the source 96–98.5% of the time; event log 32–64.5%AI safety · provenance
"Matched" means at least as good as the established method; where a margin appears, it is small and fragile. The continual-learning passes are fragile under robustness checks, and their replications are mixed. The safety constructions arrive at known results (the Kalman filter, utility indifference, causal intervention) by another route. None has yet been independently replicated.
What did not work
- Most registered tests failed. Across the frozen tests on unseen data, 37 verdicts failed, 8 more failed for a proposed universal regeneration law, and 5 were void, against 16 passes. All of them are kept.
- Strong universal claims failed. Claims that CRR's rules alone, without each field's own mathematics, would govern timing or memory everywhere were tested on real data and failed. They are kept in the record.
- CRR's own path measures added nothing beyond standard diagnostics when tested directly.
- A provenance test built to favour CRR failed its pilot and was recorded before any interpretation.
Why a metaphysics is useful here
The value has not been new mechanisms. It has been in where to look. Thinking about the present as an empty boundary led to stale-evidence filtering and lossless pausing; thinking about memory led to safer continual learning; thinking about maps and territories led to provenance tracking in feedback loops. Each time, the philosophy arrived at a place the field also reached by other routes, which at least suggests the questions point somewhere sensible.
Whether this way of asking questions is genuinely useful is itself being tested: a blinded comparison of CRR-guided enquiry against conventional enquiry at equal resources, with problem sets curated by people who have not read CRR.
Grounded in early years education, the work is about how minds, human and artificial, hold their past, meet the present and grow through change, and about the impact of AI on the people who live with it.
Science, positionality and education
A paradox runs through this work, and Winnicott named it: the child's blanket, the first idea. Did the child create it, or find it? If the forms we study are both created and discovered, then the frame a researcher brings (cultural, disciplinary, personal) helps shape what is found. Awareness of one's own positionality becomes part of scientific method, not an afterthought. Pre-registration is one practical form of it: declaring your assumptions before you look.
That is also why democratising science matters, and why philosophy belongs in education about AI. As AI systems draw more of the maps we live by, more people, from more frames, need to be able to question those maps. The open simulations on this site are offered in that spirit: places to play with the mathematics of change, whoever you are.
Raising safer AI: what childhood teaches
I came to this work from early years education, where the central question is how a mind comes to know a world that is not its own creation. Those lessons translate directly into questions about AI.
Raising safer AI
Children grow well with a secure base, holding that is good enough rather than perfect, and frustration that is gradual and repaired. A system that only ever mirrors us has met no one; one that is never held cannot settle. In a simple model I built, a room of perfect mirrors drifted apart and shared no world, while graduated, repaired disagreement let each learner meet the other. These are working hypotheses for how AI systems might be trained, corrected and paused, and they are testable.
Public education
The simulations on this site are free, open and playful, so that anyone can feel how change, memory and reorganisation work before meeting the equations. Public understanding of AI matters as much as technical safety: people who live alongside AI need to know what a model is, and what it is not.
Childhood pedagogy
Children are natural scientists. Froebel, Reggio Emilia and Forest School all treat play as how understanding grows: try, notice, revise, return. That is also how good modelling works, and it offers a humane template for how both children and AI systems might learn with others rather than in isolation.
Understanding modelling, deeply
Every model is a map, and maps are not the territory. The discipline on this page (stating assumptions, naming rivals, keeping failures) is a way of holding models without mistaking them for the world. Teaching that habit early, to children, students and the public, may be one of the most practical safety measures we have.
What comes next
| Next test | Question | Status |
|---|---|---|
| Pause suite on a real agent | Does a frontier model treat a lossless pause on its own clock as a non-event? | harness built about $200 of model access |
| Heuristic value test | Does CRR-guided enquiry outperform conventional enquiry at equal resources? | approved pilot $18.70, main run $141 |
| Surplus on training trajectories | Does the wandering of a model's outputs during training predict later forgetting or sudden capabilities? | design public checkpoints; small models on CPU |
| Hidden-objective audit | Do process measures find a planted hidden objective that probes and circuit tracing miss? | design GPU |
| Independent replication | Can a second person reproduce the frozen results on another machine? | seeking collaborators |
Full pre-registrations, frozen code, ledgers and the adversarial review are available to reviewers on request. Figures as of October 2026.