# Llm Gateway

> Compliance-first LLM gateway for enterprises. Multi-provider proxy with WORM audit, jurisdiction-aware PII detection, data-residency enforcement, multi-tenant accounts, and usage-based metered billing. Go + Postgres + embedded Vite/React admin UI. MIT.

- **Type:** MCP server
- **Install:** `agentstack add mcp-slahiri-llm-gateway`
- **Verified:** Yes — security-reviewed for prompt injection and unsafe behavior
- **Seller:** [slahiri](https://agentstack.voostack.com/s/slahiri)
- **Installs:** 0
- **Category:** [Databases](https://agentstack.voostack.com/c/databases)
- **Latest version:** 0.1.0
- **License:** MIT
- **Upstream author:** [slahiri](https://github.com/slahiri)
- **Source:** https://github.com/slahiri/llm-gateway

## Install

```sh
agentstack add mcp-slahiri-llm-gateway
```

Requires the [AgentStack CLI](https://agentstack.voostack.com/docs/cli). Works with Claude Code, Cursor, and any MCP-compatible agent.

## About

# LLM Gateway

[](https://github.com/slahiri/llm-gateway/actions/workflows/ci.yml)
[](LICENSE)
[](https://go.dev/)
[](https://www.postgresql.org/)
[](docs/features.md)

A Go-based LLM gateway platform built for enterprises with
compliance, audit, and data-sovereignty requirements. Proxy,
governance, multi-tenant accounts, metered billing, and an admin
frontend — in a single binary.

**Status:** pre-MVP. Design phase. No code yet. The architecture and
roadmap live in [`docs/features.md`](docs/features.md).

## Why

The existing LLM gateways trade off in ways enterprise buyers
cannot accept:

- The broad Python aggregator: structural perf and memory issues,
  paywalled governance, no jurisdiction-aware compliance.
- The Go performance leader: best raw latency, but enterprise audit
  / RBAC / SSO is paywalled and "designed for SOC 2" with no
  attested certifications.
- The governance-focused TypeScript player: closest on compliance,
  but hybrid VPC that phones home every 60 seconds, no WORM audit,
  no jurisdiction-specific PII detectors, closed-source control
  plane.
- The hosted SaaS aggregator: disqualifies anyone with data
  residency or audit requirements.

This project ships compliance-first OSS for any enterprise that
needs auditability, data sovereignty, and tenant isolation under
SOC 2, ISO 27001, HIPAA, GDPR, or sector-specific frameworks.

## Differentiators

- **Jurisdiction-aware PII detection out of the box** — PAN, Aadhaar,
  UPI VPA, IFSC, GSTIN, Emirates ID, NRIC, IBAN, SWIFT, US SSN, PCI
  PAN. Shipped with regression tests, not config burden on a
  third-party library. Designed for enterprises operating across
  multiple jurisdictions.
- **WORM-by-default audit log** with S3 Object Lock adapter, HMAC
  chained signatures, native SIEM / syslog export. Not paywalled.
- **Evidence packs** mapped to SOC 2, ISO 27001, HIPAA §164, GDPR,
  and sector-specific frameworks (SEBI Cybersecurity, DFSA Module
  GEN, MAS TRM / FEAT, RBI IT Framework).
- **True air-gapped deploy mode** — no telemetry, no license check,
  no config sync.
- **Data residency as enforcement** — `eu_only`, `in_only`,
  `gcc_only` modes with default-deny on cross-region.
- **MCP-scoped governance** — per-agent-run budgets, per-tool-call
  audit lines, guardrails on MCP tool inputs and outputs.

## Quick start

Once code lands:

```
docker compose up
```

This brings up the gateway and a bundled Postgres. Open
`http://localhost:8080/admin/` for the management UI.

For production, point `DATABASE_URL` at a managed Postgres
(RDS / Cloud SQL / Supabase).

## Architecture

- **Language**: Go.
- **Database**: Postgres (only). `pgx/v5` + `golang-migrate`.
- **Frontend**: Vite + React 19 + TypeScript, embedded into the Go
  binary via `embed.FS` and served from `/admin/`.
- **Cache**: in-memory (`ristretto`) single-node; Redis when
  distributed.
- **Compatibility**: OpenAI-compatible `/v1/chat/completions`,
  `/v1/embeddings`, `/v1/images/generations`. Anthropic-compatible
  `/v1/messages`.
- **Distribution**: single static binary. Hosted SaaS is the primary
  product; the same binary self-hosts for OSS adopters with the
  billing module disabled by config.

See [`docs/features.md`](docs/features.md) for the full tiered
roadmap (Tiers 0–12).

## License

MIT. See [`LICENSE`](LICENSE).

## Contributing

Contributions welcome via pull request. Issues and design discussion
are open.

## Source & license

This open-source MCP server is cataloged on AgentStack and links to its original source — we do not rehost the code.

- **Author:** [slahiri](https://github.com/slahiri)
- **Source:** [slahiri/llm-gateway](https://github.com/slahiri/llm-gateway)
- **License:** MIT

Install and usage instructions live in the source repository linked above.

## Pricing

- **Free** — Free

## Security capabilities

Automated source analysis of v0.1.0 — what this tool can access:

- **Network access:** no
- **Filesystem access:** no
- **Shell / process execution:** no
- **Environment & secrets:** no
- **Dynamic code execution:** no

*"Yes" means the capability is present in the source — more access means more to trust, not that it is unsafe.*


## Versions

- **0.1.0** — security scan: passed — Imported from the upstream source.

## Links

- Listing page: https://agentstack.voostack.com/l/mcp-slahiri-llm-gateway
- Seller: https://agentstack.voostack.com/s/slahiri
- Browse the marketplace: https://agentstack.voostack.com/browse

---
Listed on AgentStack — the marketplace for AI agent skills and MCP servers. Every listing is security-reviewed. Creators keep 70%.