The AI SDLC / Part IV / §17
Section 17 of 44 7 min read

Cross-Cutting Domains

Four concerns that refuse to localize to a stage: agent identity, provenance, evaluation infrastructure, governance.

Four concerns refuse to localize to a stage. They are treated here at full depth rather than repeated seven times, and the crosswalk in 12.5 shows where each binds.

17.1 X1 — Agent Identity and Authorization #

Objective

Every AI participant in delivery is a distinct, governable principal whose authority is bounded, inspectable, and revocable.

This is the foundation the rest of the framework stands on, and it is the one most often skipped because agents work perfectly well without it. Attribution, revocation, scoping, review, and incident scoping all become tractable when agents have their own identities and all become guesswork when they do not.

What Level 2 requires

One identity per agent deployment, with no sharing across deployments and no agent operating under a human’s credentials. A documented lifecycle covering registration, approval, issuance, review, and deprovisioning. Inclusion in access review at the cadence applied to privileged human accounts. A registry entry naming the accountable human, the autonomy tier, the permitted scope, the tool set, the environments, and the decommission criteria.

What Level 3 adds

Task-scoped delegation, where the agent acts with authority derived from and bounded by the invoking principal rather than with standing authority of its own. Inspectable delegation chains, so that when one agent invokes another the authority passed is recorded and constrained and the second never inherits more than the first held. Ephemeral credentials issued at point of use with lifetimes in minutes. Automated deprovisioning tied to owner departure, project closure, or inactivity. Separation of the identity planes—the agent’s identity for authentication, the invoking human’s for authorization scope, the workload’s for infrastructure access—never collapsed into a single credential.

Standards position

No published standard governs this. The NCCoE concept paper on software and AI agent identity and authorization is in comment review, and NIST’s agent standards initiative names agent authentication and identity infrastructure as research pillars.11,12 The usable interim reference is the OWASP Non-Human Identities Top 10, whose leading entries—improper offboarding, secret leakage, overprivileged identities, long-lived secrets, and identity reuse—describe the observed failure pattern precisely.69

Evidence

Access review records covering agent identities, reported separately from human identities. A delegation chain trace for a representative multi-agent workflow—where the trace cannot be reconstructed, accountability is unresolvable regardless of what the policy says. Deprovisioning logs showing agents actually removed rather than marked inactive. Median credential lifetime across the agent estate.

17.2 X2 — Provenance and the Attestation Chain #

Objective

Establish a verifiable record spanning design through operations of what was built, by whom or by what, under whose authority, and subject to which verification.

The honest starting position

There is no standard for cryptographically attesting that a given code artifact was AI-generated. What exists is a social convention in the form of commit trailers, which are unsigned and unverifiable; platform-specific co-authorship metadata, which has already demonstrated it can be wrong; and source provenance attestation that records how a revision was created without a field for what generated its content.43,16,72 An enterprise framework should name this rather than paper over it.

What can be built today

The layers are individually mature even though the composition is not. Attestations follow a four-layer model of envelope, statement, predicate, and bundle, with a graduated open source project supplying the container format and a vetted predicate registry covering provenance, verification summaries, SBOMs, test results, and vulnerability data.92 The build track supplies provenance at levels 0 through 3; the source track, added in November 2025, supplies revision provenance at levels 1 through 4 with two-person review at the top level.72 Keyless signing with transparency logging is production-grade.84 Model artifacts have their own signing specification layered on the same formats.85 A graph-based query layer exists for making heterogeneous attestations answerable as questions rather than merely storable as files.93

The composition to build

Bind an organizational predicate carrying agent authorship metadata (agent identity, model and version, invoking human, session reference, autonomy tier, verification performed) into the attestation chain alongside build and source provenance. This is a custom predicate today. It is the right custom predicate to build, because the elements are stable even though the schema is not, and because a signed attestation makes claims checkable in a way that a commit trailer does not.

What to require of others

SBOM content per the reissued 2026 minimum elements, and AI component documentation per the G7-backed AI SBOM clusters where models are involved.82,83 Signature verification at consumption, not merely at production.

Evidence

A verification log showing an artifact rejected for missing or invalid provenance—a chain that has never rejected anything has not been tested. An end-to-end trace for one release, from requirement identifier through agent-authored commit, session record, verification results, signed artifact, and release manifest.

17.3 X3 — Evaluation Infrastructure #

Objective

Maintain the organizational capability to determine whether a probabilistic component or an agent is behaving acceptably, independent of any vendor’s tooling.

Evaluation appears in requirements as thresholds, in verification as gates, in release as promotion criteria, and in operations as continuous validation. Treating it as a per-stage activity produces four incompatible implementations. It is infrastructure.

What Level 2 requires

A registry of evaluation sets with owners, metric definitions, thresholds, and refresh cadence. Metric definitions owned by the organization rather than inherited from a tool, since the same metric name computes differently across frameworks and scores do not port.76 Evaluation results retained as durable artifacts.

What Level 3 adds

Contamination-resistant corpus management with rolling holdouts of never-published production cases. Statistical acceptance with reported confidence intervals and evaluations sized by power analysis for the effect being detected.74 Validated judges with chance-corrected agreement and bias reported alongside raw agreement.78 Evaluation results emitted as telemetry so that gate results and production behavior are queryable together.90 Evaluation as a merge and release gate rather than a report.

Selection posture

Choose the harness for auditability and portability rather than for metric breadth. The relevant properties are local execution without data egress, declarative test definitions in version control, first-class CI integration, sandboxed execution of untrusted model output, and the ability to export raw results. Where an evaluation harness must be defensible to a regulator, provenance of the harness itself becomes a selection criterion.

Evidence

The evaluation registry with refresh dates. A judge validation record. A merge blocked by an evaluation gate. The confidence interval reported alongside a threshold decision.

17.4 X4 — Governance, Assurance, and Workforce #

Objective

Ensure autonomy expands through decisions with owners, that control claims are independently verified, and that the organization retains the human capability the framework depends on.

Governance

A review body with authority to block deployment and to reduce autonomy tiers. Written policy covering agent registration, tier assignment, tier escalation, scope change, and decommissioning. A named accountable human for every A2-and-above deployment. Explicit governance of exceptional work (an agent given elevated credentials for a migration, extended tool access for an investigation, or reduced guardrails for a specific purpose), with a named approver, a time box, monitoring, and a defined termination condition. A review board that has never declined a request is a rubber stamp, and the absence of a single blocked or tier-reduced deployment in a year is itself the finding.

Approval design that resists fatigue

Where humans approve agent actions, instrument the approval. Batch where batching is safe, risk-weight escalation, and measure approval rate against review duration. An approval control with a very high approval rate and a very short median review time is documentation. This applies with particular force to the review integrity metric in Section 13, because that is where the volume lands.

Independent assurance

Internal audit or an external party verifies maturity claims against producible evidence rather than self-assessment. This exists specifically to catch the failure mode where platform capability is recorded as organizational maturity.

Workforce

Two obligations that are usually treated as culture and are actually risk controls. First, deliberate management of skill formation: the measured comprehension gap between delegation-style and interrogation-style usage is large, and an organization whose staffing model assumes junior engineers become senior engineers has a direct interest in which pattern it encourages.18 Second, protection of the absorption capacity itself. Senior engineering attention is the binding constraint in agentic delivery; it is also the resource most easily consumed by review volume, and the one whose depletion is least visible until it is gone.

Evidence

Review board minutes showing at least one blocked or tier-reduced deployment. Approval-rate and review-duration telemetry. The register of active exceptional-access grants with expiry dates. The most recent independent assurance report. Attrition and tenure data for senior engineers, read alongside review load.

17.5 Domain-to-Stage Crosswalk #

DomainPlanningRequirementsDesignDevelopmentVerificationReleaseOperations
X1Identity and AuthorizationTier proposedAgent scope specifiedBlast radius boundedPrimary — identity, credentials, isolationQualification before write accessDeployment authority separatedPrimary — lifecycle, review, deprovisioning
X2Provenance and AttestationObligations scopedProvenance requirements capturedAttestation architecture designedPrimary — emission at authorshipVerification recorded as attestationPrimary — release manifest, SBOM, signingRetention and forensic use
X3Evaluation InfrastructureCapability fundedPrimary — thresholds and corpora definedDesigned for observabilityHarness maintained as codePrimary — gates and validationPromotion criteriaPrimary — continuous validation
X4Governance and WorkforcePrimary — tier authority, absorption, costRequirements review authorityArchitecture review authorityReview integrity, exception registerAssurance of verification claimsRelease approval authorityPrimary — assurance, NHI reporting, skill formation

References cited in this section

17 of 243 · numbering matches the PDF

  1. 11National Institute of Standards and Technology, "AI Agent Standards Initiative," Center for AI Standards and Innovation, announced February 17, 2026.www.nist.gov/artificial-intelligence/ai-agent-standards-initiative ↗
  2. 12National Cybersecurity Center of Excellence, Accelerating the Adoption of Software and AI Agent Identity and Authorization, concept paper (Rockville, MD: NIST NCCoE, February 2026).www.nccoe.nist.gov/projects/software-and-ai-agent-identity-and-authorization ↗
  3. 69OWASP Foundation, "OWASP Non-Human Identities Top 10," 2025.owasp.org/www-project-non-human-identities-top-10 ↗
  4. 43Linux Kernel Documentation, "Coding Assistants,".docs.kernel.org/process/coding-assistants.html ↗
  5. 16Microsoft, "Visual Studio Code Release Notes, Version 1.110," March 2026. The `git.addAICoAuthor` setting offers `off`, `chatAndAgent`, and `all`, and ships defaulting to `off`.code.visualstudio.com/updates/v1_110 ↗
  6. 72SLSA Community, SLSA Specification v1.2, November 24, 2025. The Source Track was added in v1.2; Source Level 4 requires two trusted persons to review all changes to protected branches.slsa.dev/spec/v1.2 ↗
  7. 92in-toto, "in-toto Attestation Framework Specification v1.2," March 18, 2024. CNCF graduated project.github.com/in-toto/attestation ↗
  8. 84Zach Steindler, "Cosign v3 Is Now Available," Sigstore Blog, October 8, 2025; Hayden Blauzvern, "Rekor v2 GA," Sigstore Blog, October 10, 2025.
  9. 85OpenSSF, "An Introduction to the OpenSSF Model Signing (OMS) Specification," June 25, 2025. reference implementation at https://github.com/sigstore/model-transparency.openssf.org/blog/2025/06/25 ↗
  10. 93GUAC, "Graph for Understanding Artifact Composition," v1.1.0, March 13, 2026. OpenSSF incubating project.github.com/guacsec/guac ↗
  11. 82Cybersecurity and Infrastructure Security Agency et al., 2026 Minimum Elements for a Software Bill of Materials (SBOM), July 29, 2026.www.cisa.gov ↗
  12. 83Cybersecurity and Infrastructure Security Agency and G7 partners, Software Bill of Materials for AI — Minimum Elements, 2026. Voluntary and nonmandatory. Sources conflict on the exact publication date between May and June 2026; verify before citing a date.www.cisa.gov/resources-tools/resources/software-bill-materials-ai-minimum-elements ↗
  13. 76Confident AI, DeepEval Documentation. Ragas, Metrics Documentation, https://docs.ragas.io/. Cited jointly to establish that identically named metrics compute differently across frameworks and that scores are not portable.github.com/confident-ai/deepeval ↗
  14. 74Evan Miller, "Adding Error Bars to Evals: A Statistical Approach to Language Model Evaluations," arXiv:2411.00640, November 1, 2024.arxiv.org/abs/2411.00640 ↗
  15. 78Justin D. Norman, Michael U. Rivera, and D. Alex Hughes, "Reliability Without Validity: A Systematic, Large-Scale Evaluation of LLM-as-a-Judge Models Across Agreement, Consistency, and Bias," arXiv:2606.19544, June 17, 2026. Twenty-one judges, approximately 541,000 judgments. Preprint.arxiv.org/abs/2606.19544 ↗
  16. 90OpenTelemetry, GenAI Semantic Conventions. All GenAI spans, events, metrics, and `gen_ai.` attributes carry Development stability status; no tagged release as of August 2026.github.com/open-telemetry/semantic-conventions-genai ↗
  17. 18Anthropic, "How AI Assistance Impacts the Formation of Coding Skills," January 29, 2026. Randomized controlled trial, n=52; vendor-affiliated research.www.anthropic.com/research/AI-assistance-coding-skills ↗
PDF