Module 15 of 16

AI Infrastructure & Future Systems

MCP architecture, AI runtime systems, agent platforms, and workload identity for AI

3 hours2 labsFree

Start here

Learning objectives

  • Understand MCP (Model Context Protocol) architecture
  • Design AI runtime systems for production
  • Secure AI agents with workload identity (SPIFFE)
  • Build future-proof AI infrastructure
AI INFRASTRUCTURE: MCP + IDENTITY + SECURITYAI AgentSPIFFE identityMCP Servertools + dataLLM Serviceinference APIVector DBknowledgeOPApolicymTLSEvery connection secured with mTLS. Every access controlled by OPA policy.This connects to the Mastering SPIFFE/SPIRE and Cloud Native Security courses.

AI infrastructure is evolving rapidly. MCP (Model Context Protocol) standardizes how agents access tools and data. Workload identity (SPIFFE) gives agents cryptographic credentials. OPA policies control what agents can access. This module connects RAG engineering with infrastructure security.

MCP: Model Context Protocol

MCP provides a standard protocol for AI agents to access external tools, data sources, and resources. Instead of building custom integrations for each tool, agents speak MCP to any MCP-compatible server.

AI Agent Identity

In production, AI agents need identity just like microservices. Who is this agent? What is it allowed to access? SPIFFE provides cryptographic identity for agents. OPA policies control access per agent role.

Building Future-Proof AI Infrastructure

  • Separation of concerns: Retrieval, generation, and tool execution as separate services
  • Identity-first: Every agent and service has cryptographic identity
  • Observable: Every request traced, every token counted, every access audited
  • Secure by default: mTLS between services, OPA at decision points

Key terms

Vocabulary used in this module

MCP

Model Context Protocol — standard for AI agent-tool communication

AI Runtime

Infrastructure for running AI agents and models in production

Agent Identity

Cryptographic identity for AI agents (via SPIFFE/SPIRE)

Labs

Hands-on labs

35 minAdvanced

MCP Server Integration

Connect your RAG system to MCP servers for tool access.

  1. Build a simple MCP server exposing document search
  2. Connect an AI agent to the MCP server
  3. Test tool discovery and execution
  4. Add authentication between agent and server
View lab on GitHub
35 minAdvanced

Secure AI Agents with Identity

Give AI agents SPIFFE identity and OPA policies.

  1. Deploy SPIRE and register AI agent workloads
  2. Configure mTLS between agent and services
  3. Add OPA policy controlling per-agent access
  4. Audit agent tool usage with verified identity
View lab on GitHub

Recap

Key takeaways

  • MCP standardizes how agents access tools — like HTTP for AI-tool communication
  • AI agents need cryptographic identity (SPIFFE) not shared API keys
  • OPA policies control what each agent can access based on its identity
  • Production AI infrastructure needs: identity + encryption + authorization + observability
  • These concepts connect directly to SPIFFE/SPIRE and Cloud Native Security courses

Related resources

Keep learning across CodersSecret