Fieldnote
What Is Actually Being Certified?
OBSERVED
This is a useful framework because it does something most agent-governance material still avoids: it tries to make operational evidence comparable.
The framework scores an AI agent across seven dimensions, weights those dimensions unequally, imposes minimum floors for higher certification tiers, and connects the resulting evidence package to ISO/IEC 42001, NIST AI RMF, the EU AI Act, procurement, and insurance underwriting.
The score is not what caught my attention.
The evidence model did.
A production agent is not being treated merely as a model with a few guardrails around it. The assessment reaches into who may invoke it, what context it reasons over, whether its actions are attributable inside systems of record, who is accountable, how much autonomy has actually been delegated, whether that authority can be revoked, and whether the organization can produce evidence after something goes wrong.
That begins to look much closer to an operating model for delegated intelligence than a conventional software certification scheme.
The distinction matters because agents move risk from output quality into consequence. Once an agent can call tools, change records, initiate transactions, communicate externally, or trigger other agents, the control problem is no longer exhausted by model accuracy or prompt safety.
THE SEVEN DIMENSIONS
The framework makes the risk surface unusually legible.
| Dimension | Weight | What I hear underneath it |
|---|---|---|
| Trust and Safety | 18 | Can unsafe or unauthorized behavior be prevented, detected, contained, and remediated? |
| Governance | 16 | Is there an accountable institution around the agent, not merely a technical owner? |
| Autonomy Envelope | 14 | What may the agent do without confirmation, and where does delegation stop? |
| Context Integrity | 14 | Is the knowledge entering the agent current, governed, attributable, and traceable? |
| Product Maturity | 14 | Is agent behavior operated as a production system with change control, evaluation, and observability? |
| Distribution Control | 12 | Who can invoke the agent, under what authority, and with what blast radius? |
| AI Integration | 12 | Do agent actions extend institutional memory, or bypass it? |
The weighting is interesting, but the tier-floor rule is more interesting.
An agent cannot compensate for a dangerously weak dimension by being excellent elsewhere. A high aggregate score does not rescue weak governance or an undefined autonomy boundary. Higher tiers require minimum raw scores in every dimension.
That is a good instinct.
Complex systems fail through their weakest consequential boundary, not through their average quality.
WHAT STOPPED ME: THE AUTONOMY ENVELOPE
The Autonomy Envelope is the part I would read first too.
The framework defines it around the boundary between actions the agent may take autonomously and actions that require human confirmation. It looks for an explicit autonomy policy, impact-sensitive human checkpoints, revocation that non-engineering staff can actually exercise, rollback where feasible, and hard stops for action classes that are never delegated.
This is very close to the authority problem we have been circling.
But I think the language can go one step further.
An autonomy envelope describes the outer boundary of delegation.
Inside that envelope, we still need to know the authority of a particular action.
AUTONOMY ENVELOPE
what may ever be delegated
↓
DELEGATION
what has been delegated now
↓
DECISION
whether this action is allowed
in this context
↓
ENFORCEMENT
whether the action can actually execute
↓
ATTESTATION
proof of what authority was exercised
and what consequence followedCertification can verify that the organization has defined the envelope.
Runtime governance still has to enforce it.
That feels like an important distinction.
DISTRIBUTION CONTROL IS REALLY ABOUT AUTHORITY
The Distribution Control dimension asks who can invoke the agent, under what authority, and how downstream actions are bounded.
That sentence may be more consequential than its 12-point weight suggests.
Traditional access control tends to stop at the invocation boundary:
Can this user call this service?Agentic systems require a longer question:
Can this principal invoke this agent
to perform this class of action
against this resource
for this purpose
within this limit
under the current conditions
with this ability to delegate onward?The invocation is only the beginning of the authority chain.
This becomes even more important once agents delegate to other agents. The framework is agent-specific, but the evidence problem quickly becomes chain-specific.
- Who initiated the task?
- Which principal supplied the authority?
- What scope traveled with the task?
- Was onward delegation allowed?
- Which policy version applied?
- What changed between authorization and execution?
- Who can still revoke the authority?
The certification evidence tells us whether an organization has the discipline to answer these questions.
A governed runtime must answer them while the system is acting.
AI INTEGRATION MAY BE THE QUIETLY IMPORTANT DIMENSION
The AI Integration dimension asks whether the agent extends the institution's existing memory or bypasses it.
I like that framing.
A technically successful agent can still weaken an institution if it operates through shared service accounts, creates decisions outside systems of record, sends escalations into generic inboxes, or produces actions whose attribution cannot later be reconstructed.
This is where “agent productivity” can become institutional amnesia.
The useful question is not simply:
Did the agent complete the task?It is:
Did the institution retain
identity,
authority,
decision,
evidence,
outcome,
and accountability
as the task moved?That is a much higher bar.
THE EVIDENCE PACKAGE
The framework groups assessment evidence into four categories. This is a particularly good layout for thinking about what an enterprise actually has to produce.
Written policy artefacts
Autonomy policy, AI risk policy, data governance policy, vendor due diligence, and governing-body records that show the policy is institutionally known.
Technical telemetry
Guardrail activations, uptime, model and prompt versions, incident logs, and reasoning traces where the architecture supports them.
Organisational records
Risk-register entries, audit records of agent-initiated decisions, training records, and supplier due-diligence evidence.
Incident documentation
Failure records, containment evidence, post-incident review, and documented changes made because the system actually learned from the incident.
This is stronger than policy-first governance because it recognizes that a policy is only one class of evidence.
A board resolution is evidence that the institution acknowledged a risk.
A runtime trace is evidence that a particular action occurred.
A delegation record is evidence that authority existed.
An enforcement record is evidence that a boundary was actually applied.
An incident review is evidence that the organization can learn.
These are different kinds of proof.
I would not collapse them into one compliance record.
HUNCH
The certification model could become much more powerful when paired with runtime attestation.
Certification asks:
Does this organization have
credible structures and evidence
for operating this agent responsibly?Runtime attestation asks:
For this consequential action,
what authority existed,
what policy applied,
what evidence was consulted,
what controls executed,
and what outcome occurred?One is institutional assurance.
The other is proof of execution.
The future may require both.
THE FIVE TIERS ARE A COMMUNICATION DEVICE
The framework defines five tiers from Pre-Assessment through In Progress, Certified, Advanced, and Elite. Higher tiers require both a weighted score threshold and a minimum score in every dimension.
I would not over-interpret the labels.
Their strongest role is compression.
Boards, procurement teams, insurers, and counterparties cannot independently reconstruct the operating architecture of every agent they encounter. A tier gives them a compact signal that says, roughly, how mature the evidence is and whether any dimension has fallen below an acceptable floor.
That is useful.
But the compression becomes dangerous if people forget what was compressed.
The interesting asset is not the badge.
It is the body of governed evidence underneath the badge.
CROSSWALKS ARE USEFUL — BUT THEY ARE NOT THE END STATE
The framework maps its evidence to ISO/IEC 42001, NIST AI RMF, and several EU AI Act obligations.
That is practical. Enterprises should not have to recreate the same governance evidence independently for every external framework.
But crosswalks are still document-era infrastructure.
An agentic operating environment will eventually need something more dynamic:
CONTROL
↓
POLICY
↓
DELEGATION
↓
RUNTIME DECISION
↓
ENFORCEMENT
↓
EVIDENCE
↓
OUTCOME
↓
ATTESTATIONThen an ISO control, an EU AI Act obligation, an underwriting question, a procurement requirement, and an internal policy could all resolve against the same underlying evidence rather than being answered through separate document packages.
That would turn compliance mapping into evidence projection.
CONNECTION TO THE GOVERNED DATA FOUNDRY
This framework lands naturally against several responsibilities in the Governed Data Foundry.
Context Integrity maps toward governed semantics, provenance, and evidence.
Distribution Control maps toward actor identity, competence, delegation, policy decisioning, and enforcement.
Governance maps toward institutional adjudication and accountable ownership.
AI Integration maps toward systems of record and outcome memory.
The Autonomy Envelope maps directly to the boundary between competence, delegated authority, policy, and human intervention.
The certification framework asks whether these capabilities can be demonstrated.
The Foundry question is whether they can become part of the operating substrate.
That feels like an important difference:
CERTIFICATION
Can the institution demonstrate the controls?
GOVERNED RUNTIME
Can the institution enforce and attest them continuously?The two should reinforce one another.
QUESTION
What would happen if an agent certification did not merely produce a report, but produced a machine-verifiable evidence contract?
Not a credential saying:
Agent X is Elite.Something richer:
Agent X
autonomy envelope:
bounded
delegation:
explicit
revocation:
tested
context provenance:
enforced
decision evidence:
retained
runtime enforcement:
attested
incident learning:
currentThen certification could become less like a static seal and more like a statement about an operating capability whose evidence can continue to be refreshed.
I do not know whether that is where this particular standard is headed.
But the structure points in that direction.
CARRY FORWARD
What I am taking from the Agent Certified framework is not primarily the scoring system.
It is this:
Agent governance becomes credible when autonomy is bounded by evidence that survives contact with operations.
The framework is right to insist on accountability, context integrity, distribution control, product maturity, institutional integration, and a written autonomy envelope.
My open question is what happens next.
A policy can define authority.
A certification can inspect whether the policy and supporting evidence exist.
But once an autonomous agent begins acting, the decisive question moves into runtime:
Can the institution prove that this specific consequence remained inside legitimate authority?
That is where certification meets governed delegation.
And that is probably where the next architecture begins.