LIVEAI Control Plane / intelligence

Universal AI Gateway

One governed API in front of cloud and local AI providers.

Review my build

Live workload cutawayArchitecture in context

Universal AI Gateway

Signal path active2 deployment units

What this replaces

Applications become coupled to one model vendor, credentials spread across apps, and teams lose centralized visibility into spend and routing.

What your team gains

A consistent OpenAI-style API with centralized authorization, model abstraction, routing, cost controls and provider resilience.

What is inside the blueprint

100+ model/provider abstraction

OpenAI-compatible chat and Responses patterns

Embeddings, images, audio, batches and additional provider translations

Consistent response and error formats

Streaming

Retries and fallbacks

Application-level load balancing

Virtual keys

Authentication and authorization

Per-user/project spend tracking and budgets

Rate limits

Per-project logging, guardrails and caching

Admin dashboard

Observability callbacks

How it fits the platform

Applications/agents -> AI gateway -> policy/routing/budget layer -> OpenAI, Anthropic, Google, Azure, local inference endpoints and other providers.

Included services

AI Gateway, ai-stack-db

Platform requirements

AICORTEX Core PlatformThe gateway runs as a Core-managed service with Core's routing and persistence.

From prerequisites to operation

Prerequisites

Provider credentials or local model endpoints
Database for gateway state
Defined model naming/routing policy

Deployment

Deploy the AI gateway proxy
Register providers and model aliases
Create virtual keys/teams
Enable spend logging and budgets
Configure fallback chains and observability

Configuration

Model aliases
Fallback/retry policy
Budget/rate limits
Caching and guardrails
Logging callbacks
User/project keys

Operations

Provider availability
Spend drift
Rate-limit events
Schema/version compatibility
Gateway DB backups

What this unlocks with other layers

Private AI Workspace + Universal AI Gateway

Private AI + Model Freedom

Users get one interface while builders can change providers underneath it without changing the experience.

Technology behind this capability

AI GatewayRelational database