What introspection, export, and control surfaces actually exist across…
What introspection, export, and control surfaces actually exist across production agentic Artificial Intelligence (AI) platforms: a comparative analysis of Amazon Web Services (AWS) Bedrock Agents, Microsoft 365 Copilot, Salesforce Agentforce, and ServiceNow Now Assist?
- AWS Bedrock Agents are the strongest documented Artificial Intelligence Bill of Materials (AIBOM) substrate in this comparison because AWS exposes agent configuration through the GetAgent API, immutable alias-based versions, and step-level runtime traces that include prompts, rationale, action invocations, observations, and version identifiersOWASP (n.d.)AWS (n.d.)AWS (n.d.)Amazon (n.d.)
- AWS Bedrock still appears not to provide a native AIBOM export, and its observability remains incomplete when traffic bypasses the documented `bedrock-runtime` logging path or when the enterprise needs provider-side model internals rather than customer-visible orchestration evidenceAWS (n.d.)AWS (n.d.)
- Microsoft 365 Copilot exposes strong tenant-governance evidence through Purview audit, the Microsoft 365 agent registry, and tool-approval workflows, but the standard audit schema explicitly omits model name and model version for Microsoft 365 Copilot scenarios and does not function as a full runtime traceMicrosoft (n.d.)Microsoft (n.d.)Microsoft (n.d.)
- Microsoft Copilot Studio adds real-time data-loss-prevention controls, agent export and import through solutions, and detailed authoring and usage audit events, which strengthens Microsoft’s AIBOM readiness even though its export surface remains partial because some components and properties do not transfer cleanlyMicrosoft (n.d.)Microsoft (n.d.)Microsoft (n.d.)
- Salesforce Agentforce publicly documents mission-control observability, session-level tracing, and near-real-time security telemetry, including Event Monitoring and transaction-security controls around agent activity, which makes the reviewed public material look richer on runtime observability than the standard Microsoft 365 Copilot audit surface even though some of that gap may reflect how the vendors publish their capabilitiesSalesforce (n.d.)Salesforce (n.d.)Salesforce (n.d.)Microsoft (n.d.)
- Salesforce Agentforce also appears to support session-trace export and agent version management using OpenTelemetry, the vendor-neutral observability framework, which would make automated AIBOM generation more feasible than on Microsoft 365 Copilot, but the public evidence leaves the exact export schema and version workflow under-specified and therefore reduces confidenceOpenTelemetry (n.d.)Salesforce (n.d.)Salesforce (n.d.)Salesforce (n.d.)
- ServiceNow Now Assist and AI Control Tower publicly emphasize centralized inventory, lifecycle governance, compliance mapping, drift detection, and workflow-triggered remediation, but the accessible public evidence is too high-level to show a concrete per-session trace-export or configuration-export surface comparable to AWS or SalesforceServiceNow (n.d.)ServiceNow (n.d.)ServiceNow (n.d.)
- Across all four platforms, the main opaque zones are the vendor-owned parts of orchestration, specifically hidden prompt augmentation, internal routing or planning logic, model-side reasoning internals, and platform-private policy engines that customers can observe only indirectly through summarized metadata or outcomesAWS (n.d.)Microsoft (n.d.)Salesforce (n.d.)ServiceNow (n.d.)Github (n.d.)
Research Question
What logs, traces, audit Application Programming Interfaces (APIs), Artificial Intelligence Bill of Materials (AIBOM) export capabilities, version-pinning mechanisms, allowlists, and policy hooks actually exist in production agentic AI platforms, specifically Amazon Web Services (AWS) Bedrock Agents, Microsoft 365 Copilot, Salesforce Agentforce, and ServiceNow Now Assist, and where does each platform remain opaque even with full observability enabled?
Findings
Executive Summary
AWS Bedrock Agents provide the strongest documented substrate for automated Artificial Intelligence Bill of Materials (AIBOM) generation among the four reviewed platforms because AWS exposes both a machine-readable configuration API and detailed step-level runtime traces with immutable version snapshots. Microsoft 365 Copilot provides a strong tenant-governance surface through audit, inventory, and tool-approval controls, but its main audit stream omits critical runtime detail such as model name and model version for Microsoft 365 Copilot and does not provide full transcript content in the standard audit record. Salesforce Agentforce documents extensive managed-platform runtime observability through session-level tracing and observability tooling, but the reviewed public evidence leaves export semantics and versioning detail under-specified, so confidence is lower than for AWS. ServiceNow Now Assist and AI Control Tower emphasize centralized governance, inventory, and oversight, but the accessible public evidence reviewed here is more strategic than technical, which makes detailed AIBOM automation claims the weakest of the four. The reviewed public documentation for none of the four platforms describes a native AIBOM or equivalent Bill of Materials export, so an enterprise that wants portable inventory assurance still needs an external normalization and evidence-binding layer.
Key Findings
- AWS Bedrock Agents are the strongest documented Artificial Intelligence Bill of Materials (AIBOM) substrate in this comparison because AWS exposes agent configuration through the GetAgent API, immutable alias-based versions, and step-level runtime traces that include prompts, rationale, action invocations, observations, and version identifiers.
- AWS Bedrock still appears not to provide a native AIBOM export, and its observability remains incomplete when traffic bypasses the documented
bedrock-runtimelogging path or when the enterprise needs provider-side model internals rather than customer-visible orchestration evidence. - Microsoft 365 Copilot exposes strong tenant-governance evidence through Purview audit, the Microsoft 365 agent registry, and tool-approval workflows, but the standard audit schema explicitly omits model name and model version for Microsoft 365 Copilot scenarios and does not function as a full runtime trace.
- Microsoft Copilot Studio adds real-time data-loss-prevention controls, agent export and import through solutions, and detailed authoring and usage audit events, which strengthens Microsoft’s AIBOM readiness even though its export surface remains partial because some components and properties do not transfer cleanly.
- Salesforce Agentforce publicly documents mission-control observability, session-level tracing, and near-real-time security telemetry, including Event Monitoring and transaction-security controls around agent activity, which makes the reviewed public material look richer on runtime observability than the standard Microsoft 365 Copilot audit surface even though some of that gap may reflect how the vendors publish their capabilities.
- Salesforce Agentforce also appears to support session-trace export and agent version management using OpenTelemetry, the vendor-neutral observability framework, which would make automated AIBOM generation more feasible than on Microsoft 365 Copilot, but the public evidence leaves the exact export schema and version workflow under-specified and therefore reduces confidence.
- ServiceNow Now Assist and AI Control Tower publicly emphasize centralized inventory, lifecycle governance, compliance mapping, drift detection, and workflow-triggered remediation, but the accessible public evidence is too high-level to show a concrete per-session trace-export or configuration-export surface comparable to AWS or Salesforce.
- Across all four platforms, the main opaque zones are the vendor-owned parts of orchestration, specifically hidden prompt augmentation, internal routing or planning logic, model-side reasoning internals, and platform-private policy engines that customers can observe only indirectly through summarized metadata or outcomes.
- An enterprise that wants reliable AIBOM automation across these platforms still needs an external control plane that normalizes tenant inventory, exported traces, approval records, and identity or tool-governance evidence into one portable schema rather than trusting any one platform’s native view to be complete.
Assumptions
- Assumption: The official Salesforce URLs surfaced by search reflect current product capability even though the accessible public material leaves some schema and workflow detail unspecified. Justification: the URLs are on official Salesforce domains and were corroborated by accessible Salesforce product and blog material.
- Assumption: The accessible ServiceNow community articles are materially representative of the platform’s public governance surfaces even though the public material does not expose deeper technical export detail. Justification: the articles are on official ServiceNow domains and describe the same AI Control Tower feature set consistently.
Analysis
The evidence separates into two clusters. AWS Bedrock exposes both declarative and runtime state through customer-addressable APIs and logs, which makes it the most suitable platform for building a machine-generated AIBOM from native evidence. Microsoft, Salesforce, and ServiceNow are more managed, so the relevant question is not whether they provide observability at all, but whether their observability is operationally deep enough for portable inventory reconstruction rather than only for tenant governance. Microsoft is strongest when the enterprise needs registry, approval, and policy control over agents and tools, but weaker when it needs transcript-complete and model-complete runtime evidence for the core Microsoft 365 Copilot experience. Salesforce appears to move furthest toward runtime introspection in the reviewed public materials because it explicitly frames session tracing and observability as operational products, yet the evidence still does not show a native AIBOM export or enough publicly accessible schema detail to treat it as equivalent to AWS API-level introspection. Part of the apparent Salesforce-versus-Microsoft runtime gap may reflect differences in what each vendor exposes in public documentation and product marketing, rather than a fully measured difference in underlying platform capability. ServiceNow’s public story is governance-first rather than trace-first, which is useful for enterprise oversight but insufficient by itself for proving that a portable, field-level AIBOM can be generated from native product surfaces. The main trade-off is therefore between runtime depth and platform abstraction: the more the platform centralizes orchestration on the vendor side, the more governance becomes curated metadata rather than complete customer-visible evidence. Alternative remedies such as adding more human reviewers, tightening model-quality gates, or relying only on richer tenant governance interfaces can improve oversight, but they do not by themselves create the missing portable configuration and trace exports needed for repeatable AIBOM generation.
Risks, Gaps, and Uncertainties
- Public Salesforce material reviewed here confirms observability and security surfaces, but it does not expose enough detailed schema documentation to verify the exact customer-visible mechanics of session-trace export and agent version management with high confidence.
- Public ServiceNow material reviewed here confirms governance, inventory, and remediation framing, but it does not expose enough technical detail to verify a customer-visible AI Control Tower export interface or per-session trace schema with high confidence.
- The reviewed public docs do not prove whether hidden vendor-side prompt augmentation or internal routing is never logged anywhere; they only show which surfaces are customer-visible through documented interfaces.
- Microsoft 365 Copilot’s deeper transcript access can depend on additional Purview or security products, so the standard audit stream should be treated as the default documented evidence path rather than the only possible path.
Open Questions
- What exact field schema does Salesforce’s OpenTelemetry session-trace export expose, and is it complete enough to populate a runtime AIBOM without auxiliary APIs?
- Does ServiceNow expose a programmatic AI Control Tower export or trace API in licensed documentation that is not visible from public community material?
- Can Microsoft 365 Copilot’s newer agent-registry and tools-governance surfaces be joined reliably with Purview audit and Data Security Posture Management for AI to create a tenant-wide partial AIBOM?
- What normalization schema best reconciles Bedrock trace events, Microsoft Purview audit records, Salesforce OpenTelemetry exports, and ServiceNow AI inventory records into one portable evidence model?
sources
- [x] AWS Bedrock trace events - step-level trace structure for AWS Bedrock Agents, including prompts, rationale, observations, caller chain, and agent version.
- [x] AWS Bedrock model invocation logging - request, response, metadata, export destinations, and logging limitations.
- [x] AWS Bedrock Guardrails - configurable safety and policy filters, guardrail versioning, and selective prompt evaluation.
- [x] AWS Bedrock GetAgent API - agent configuration fields exposed through the API, including foundation model, instruction, prompt overrides, memory, and guardrail configuration.
- [x] AWS Bedrock deploy-agent guide - immutable version snapshots, aliases, and pause or resume control.
- [x] AWS Bedrock agent versions view - official version-management surface for deployed agents.
- [x] Microsoft Purview audit logs for Copilot and AI applications - audit schema for Microsoft 365 Copilot, including accessed resources, agent identifiers, plugin details, and model-transparency fields.
- [x] Microsoft Graph getMicrosoft365CopilotUsageUserDetail - tenant usage export and reporting surface for Microsoft 365 Copilot.
- [x] Microsoft Copilot Studio security and governance - governance controls, audit surfaces, data protection, and admin controls for Copilot Studio.
- [x] Microsoft Copilot Studio data loss prevention - connector grouping, blocking, endpoint filtering, authentication controls, channel controls, and event-trigger controls.
- [x] Microsoft Copilot Studio audit logging - Purview logging for agent authoring and usage, transcript handling, and audit-field schema.
- [x] Microsoft Copilot Studio export and import using solutions - agent packaging, included and excluded components, and import or export constraints.
- [x] Microsoft Copilot Studio solutions overview - solution explorer and pipeline-oriented application lifecycle management surface.
- [x] Microsoft 365 agent registry - tenant-wide inventory, comma-separated values export, ownership, platform, version, instructions, and agent-package upload surfaces.
- [x] Microsoft 365 tools page for agents - Model Context Protocol (MCP) server approval, blocking, and status control in the Microsoft 365 admin center.
- [x] Microsoft Agent 365 Bring Your Own MCP server - governance flow for registering, approving, and monitoring remote Model Context Protocol (MCP) servers.
- [x] Salesforce Agentforce Observability - official observability product page covering mission control, session tracing, health monitoring, analytics, and consumption tracking.
- [x] Salesforce secure Agentforce with trusted services - official Salesforce description of Shield Event Monitoring, transaction security, Security Center, and related control surfaces for Agentforce.
- [x] Salesforce secure Agentforce implementation - official Salesforce security framing for roles, data, actions, guardrails, Trust Layer, and deployment channels.
- [x] Salesforce Agentforce session tracing export - official developer URL for OpenTelemetry session-trace export surfaced by search in this session; the detailed page was not directly retrievable here.
- [x] Salesforce Agentforce versioning - official help URL for agent version management surfaced by search in this session; the detailed page was not directly readable here.
- [x] Salesforce Agentforce observability setup and access - official help URL for observability setup surfaced by search in this session; the detailed page was not directly readable here.
- [x] ServiceNow AI Control Tower introduction - official ServiceNow community article describing inventory, drift monitoring, compliance mapping, and workflow integration.
- [x] ServiceNow AI Control Tower executive view - official ServiceNow community article on inventory, lifecycle coverage, governance, and value tracking.
- [x] ServiceNow AI Control Tower in ServiceNow for enterprise-wide AI governance - official ServiceNow community article describing centralized monitoring, governance automation, audit trails, and KPI dashboards.
- [x] Mitchell (2026) Vendor governance constraints and compensating controls - prior repository item on managed-platform governance limits.
- [x] Mitchell (2026) Observability and telemetry governance model - prior repository item on multi-stream audit evidence requirements.
- [x] Mitchell (2026) Microsoft Copilot and AWS capability model - prior repository comparison of Microsoft and AWS enterprise AI control surfaces.
- [x] Mitchell (2026) Vendor lock-in and portability in multi-platform AI - prior repository item on the value of externalized control planes and portable evidence layers.
- [x] OWASP AI Bill of Materials project - industry definition and framing of an Artificial Intelligence Bill of Materials (AIBOM).
- [x] OpenTelemetry documentation - official definition of OpenTelemetry as a vendor-neutral observability framework.
| version | date | commit | summary |
|---|---|---|---|
| 1.0 | 2026-05-06 | 232fb7e | Initial completion |