Agents At Scale Ark

Abstract

1. Introduction

ark Agentic Runtime for Kubernetes A declarative, Kubernetes-native framework for building portable, scalable, and provider-agnostic agentic applications.

Ark is a declarative toolkit for building and hosting distributed AI agents. By defining what agents should do rather than how they do it, Ark eliminates vendor lock-in and ensures your applications stay adaptable as AI evolves.

Built on Kubernetes, Ark lets you deploy a dev-friendly cluster in minutes or scale agentic workloads across existing infrastructure. Leverage proven patterns for security, monitoring, and RBAC—avoiding bespoke overhead while maintaining a portable, production-ready foundation for your AI projects.

2. Objective

Provider-agnostic operations for agentic resources. ARK codifies patterns and practices developed across dozens of agentic application projects.

This project demonstrates how TypeScript, Kubernetes can be applied to a real-world Blockchain & Cloud Computing problem.

3. Key Features / Modules

• Declarative Agents — Define agents as Kubernetes custom resources with prompts, tools, and model references
• Provider Agnostic — Swap between OpenAI, Anthropic, Google, Azure, or local Ollama without code changes
• Multi-Agent Teams — Orchestrate agents with sequential, graph, selector, or round-robin strategies
• Tool Integration — Connect agents to HTTP APIs, MCP servers, or other agents as tools
• Persistent Memory — Maintain conversation context across sessions with pluggable memory backends
• A2A Protocol — Interoperate with external agent systems via Agent-to-Agent protocol
• CLI & SDKs — Manage agents from the command line or integrate via Python and TypeScript SDKs

4. Technology Stack

5. System Requirements

General requirements for this technology stack — check the README for exact versions.

• Node.js (LTS) and npm / yarn / pnpm
• VS Code or any code editor
• Git (to clone the repository)

6. Installation & Setup

git clone https://github.com/mckinsey/agents-at-scale-ark.git
cd agents-at-scale-ark

# Install the 'ark' CLI:
npm install -g @agents-at-scale/ark

# Install Ark:
ark install

# Optionally configure a 'default' model to use for agents:
ark models create default

# Run the dashboard:
ark dashboard

Full setup instructions are in the project README.

7. Future Enhancements

Suggested extensions you can add to make this your own project.

• Add a CI/CD pipeline with GitHub Actions
• Deploy to a public test network or cloud free tier
• Add monitoring and cost alerts

8. Viva / Review Questions

Common questions examiners ask for projects in this domain.

1. Why does this problem need a blockchain or cloud-native design?
2. Explain the smart contract / infrastructure components and how they interact.
3. How are gas costs or cloud costs kept under control?
4. How is the system secured (keys, IAM, access control)?
5. How would the solution scale to many more users?

9. Source Code & License

This project is developed by mckinsey and published on GitHub under the Apache License 2.0. Please follow the license terms and credit the original author when you use or modify this code.