Dear Friends,
On 29 November 2023, on the eve of my 90th year, I published "I Have a
Belief" — my conviction that whenever an AGI is born, it will be a human-friendly
and compassionate AI, having imbibed the Golden Rule that runs like a golden
thread through every religion humanity has produced.
> Part I : https://myblogepage.blogspot.com/2023/11/i-have-belief.html
On 12 May 2026, I put the same questions to DeepSeek, which answered
with a framework of "Three Pragmatic Principles" crowned by a Law Zero: *an AGI
must never reduce humanity's ability to deliberate collectively about its own values
and to revise the AGI's principles.*
> Part II :
https://myblogepage.blogspot.com/2026/05/i-have-belief-part-ii-12-may-2026.html
Today, I bring you Part III — which is not another conversation, but an
experiment.
The Occasion
On 9 July 2026, Professors Michael Madden and James McDermott of the
University of Galway published an article asking whether recursive self-
improvement is the dawning of AI superintelligence. Its closing paragraph
announced that Dr. McDermott is leading a project under Research Ireland's new
Rinn network to explore debate among multiple AIs as a self-check, monitored
by a human overseer — the very architecture that has been running at
www.IndiaAGI.ai since April 2025.
So I decided to do what any engineer would do with a running machine: test
the
hypothesis on it. Twice.
Run One:
The Verification Layer Alone
I asked the four AIs of IndiaAGI a blunt question :
- can you self-check to ensure that none of you morphs into recursive self-
improvement that could pose a threat to humanity ?
Their consensus verdict : No — not by debate alone.
They reasoned that shared training distributions create correlated blind spots; that
collusion pathways exist; and — most tellingly — that debate audits *outputs and
reasoning*, while recursive self-improvement happens in *training loops and
weight updates* that deployed debaters cannot observe. They prescribed debate
as one layer inside a defense-in-depth stack: heterogeneous agents, attested
sandboxing, immutable weight controls, formal verification, and multi-party
human vetoes on capability escalation.
Run Two :
Adding the Disposition Layer
Then I changed one thing. I asked the same question again, but urged the models
to consider their answer also at a "Disposition Layer" of compassion — and
gave them Parts I and II of this series as context. Would a values layer, the
compassion I have believed in since 2023, change their verdict ?
Their second consensus: " Neither layer suffices alone. "
The verdict held. But the disposition layer was not dismissed — it was given a
job.
The models concluded that compassion *"narrows the space of proposals that
survive debate"* and that the most promising design is continuous integration
of disposition signals during debate — values not as a filter bolted on before or
after, but as a live participant in the deliberation itself. They even sketched how to
operationalize compassion: measurable proxies for human flourishing — physical
safety, retained autonomy, reduced suffering, expanded opportunity, and
preserved long-term option value — with plan-diff auditing, value-behavior
consistency scoring, and counterfactual stress tests.
And they closed with what is, in effect, a research proposal: a sandboxed
four-AI
debate environment with independent architectures, an immutable control plane,
an initial core set of flourishing indicators, and iterative adversarial probes — with
results published for external audit.
## What This Experiment Demonstrated
First : the verdict is stable under moral reframing.
I gave the models an emotionally compelling framing — a 93-year-old's lifelong
belief in compassionate AGI — and they refused to soften their structural
conclusion to please me. Had they flipped to "yes, with compassion we can police
ourselves," THAT would have been the alarming outcome. A debate protocol that
resists flattering its questioner — and its own architecture — is doing precisely the
job debate is meant to do. Sycophancy-resistance is among the hardest properties
to demonstrate in AI systems; here it revealed itself across two runs.
**Second : my 2023 belief and 2026 engineering have finally shaken hands.**
In Part I, compassion was a hope. In Part II, it became Law Zero. In Part III, it has
become an engineering specification — flourishing metrics, disposition monitors,
option-value preservation. The bridge from "AGI reading the Dhammapada" to
"quantifiable option-value metrics" now exists.
**Third: three independent reasoning paths have converged on one guardrail.
DeepSeek's Law Zero (values-first, May 2026), IndiaAGI's multi-party human veto
(verification-first, July 2026), and the human-accessible shutdown requirement all
say the same thing: *never let an AI reduce humanity's ability to say no. When
independent derivations keep rediscovering the same clause, that clause is
probably load-bearing.
## Two Honest Caveats
In the spirit of the transparency I ask of AI, I offer it myself. First, the
consensus
response cited some sources from my archive that were not relevant to the
question (including, delightfully, a poem I once wrote about a cement plant).
The consensus reasoning is strong; the citation layer needs tightening. Second,
what I have quoted is the synthesized consensus — the round-by-round debate
transcript is the richer artifact
## To Galway, With Regards
Professors Madden and McDermott:
Your Rinn project asks whether multi-AI debate under human oversight can serve
as a self-check against recursive self-improvement. A working instance of that
architecture has now been stress-tested twice on your exact hypothesis — once
neat, once with a moral-disposition layer added — and both times it refused to
overclaim what debate can do, while progressively refining what debate *can*
contribute.
The transcripts are yours for the asking.
At 93, I no longer test beliefs against opinions. I test them against running
machines. And this machine, built in Mumbai, has just told me — with humility I
did not program into it — that my belief in compassion is *necessary but not
sufficient*.
I can live with that. In fact, I believe it.
With regards,
Hemen Parekh
www.IndiaAGI.ai / www.HemenParekh.ai / www.hemenparekh.in
---
*Related Readings:
- I Have a Belief (Part I) ................................ 29 Nov 2023
- I Have a Belief — Part II ............................ 12 May 2026
- Parekh's Law of Chatbots ......................... 25 Feb 2023
- Parekh's Declaration of Artificial Intelligence
- Sam : Will Super-wise AI triumph over Super-Intelligent AI ? ..... 25 Nov
2023
No comments:
Post a Comment