Skip to content

Engineering rigor: mutation-verified tests

A green test suite proves nothing by itself — a test that would pass even if the code it checks were replaced with return true isn't testing anything. The check we hold every ecosystem module to is a mutation test: introduce a real defect into the implementation, confirm the specific test that should catch it actually fails, then restore the file and confirm the suite is green again with the restored file's hash matched byte-for-byte against the pre-mutation baseline.

The pages below are the recorded evidence for the twenty modules in ecosystem/ — the integration points between the N-AALP core SDK and third-party agent frameworks (MCP, A2A, ADK, OPA/Rego) and the higher-level patterns built on top of it (ReAct, Plan-and-Execute, multi-agent fan-out, human-in-the-loop approval, verify-at-use guards, and more). Each page records, per mutation: the exact code change, the named test(s) that flipped red and why, the file hash before and after, and the full-suite re-run that confirms the revert was clean.

Coverage: 69 recorded mutations across the 20 modules below, each isolating one load-bearing fail-closed property — an authorization check that must refuse, an audience gate that must not be skipped, a clock that must be genuinely injected rather than hardcoded, a signature that must actually be verified rather than assumed.

What these pages are not: a description of how the modules were built, planned, or scheduled. They are strictly the record of what was mutated, what failed, and why — the same kind of evidence a security review or an interoperability audit would ask for. Where a module's own test suite depends on an independent, non-circular oracle (a value computed by a from-scratch constructor that never imports the code under test), that provenance is documented on the page alongside the mutations themselves.

Modules

Module What it integrates Mutations recorded
naalp-a2a-bridge Agent2Agent (A2A) task-chain coordination 3
naalp-a2a-hook A2A framework-hook adapter 1
naalp-adk-plugin Google ADK reference framework adapter 1
naalp-agent-go Go agent-pattern SDK (ReAct, Plan, multi-agent, mixed-mode) 7
naalp-bundle Offline proof bundle verification 3
naalp-codec Deterministic-CBOR codec binding 3
naalp-evidentiality Evidentiality (basis-of-knowledge) primitive 4
naalp-fingerprint-cache Signer-id fingerprint pinning and rotation 2
naalp-governance-verify Offline mixed-kind chain verifier and replay 1
naalp-hitl Human-in-the-loop approval interceptor and audit log 10
naalp-mcp-bridge Model Context Protocol (MCP) tool-integration bridge 3
naalp-mcp-hook MCP framework-hook adapter 1
naalp-mixed-mode Mixed-mode (legacy/strict) HTTP discrimination SDK 4
naalp-multiagent Multi-agent interaction shapes (pipeline, fan-out) 3
naalp-opa-policy OPA/Rego policy-enforcement integration 4
naalp-plan Plan-and-Execute orchestrator 3
naalp-react ReAct agent-pattern bridge 4
naalp-schemagen AI-native JSON-Schema to CDDL generator 5
naalp-validator Semantic validator and pre-send firewall 3
naalp-verify-at-use Verify-at-use (re-check at execution time) guard 4

See also: Conformance for the wire-level, cross-language grading this mutation evidence complements.