Rhoai Mcp

RHOAI MCP Server

[](https://github.com/opendatahub-io/rhoai-mcp/actions/workflows/ci.yml) [](https://github.com/opendatahub-io/rhoai-mcp/actions/workflows/container-build.yml) [](https://github.com/opendatahub-io/rhoai-mcp) [](https://github.com/opendatahub-io/rhoai-mcp) [](https://www.python.org/) [](LICENSE)

An MCP (Model Context Protocol) server that enables AI agents to interact with Red Hat OpenShift AI (RHOAI) environments. This server replicates the capabilities of the OpenShift AI Dashboard through programmatic tools.

Features

• Project Management: Create, list, and manage Data Science Projects
• Workbench Operations: Create, start, stop, and delete Jupyter workbenches
• Model Serving: Deploy and manage InferenceServices with KServe
• Data Connections: Manage S3 credentials for data access
• Pipelines: Configure Data Science Pipelines infrastructure
• Storage: Create and manage persistent volume claims
• Training: Fine-tune models with Kubeflow Training Operator
• MCP Prompts: Workflow guidance for multi-step operations (18 prompts)

Technology Stack

| Component | Technology | Purpose | |-----------|------------|---------| | Runtime | Python 3.10+ | Core language | | MCP Framework | FastMCP 1.0+ | Model Context Protocol server | | Kubernetes Client | kubernetes-python 28.1+ | Cluster API interactions | | Data Validation | Pydantic 2.0+ | Type-safe models and settings | | HTTP Client | httpx 0.27+ | Async HTTP requests | | Container Base | Red Hat UBI 9 | Production container image | | Package Manager | uv | Fast Python dependency management |

Extending

Want to add your team's capabilities to rhoai-mcp? See the [contributor guide](CONTRIBUTING.md#adding-plugins) for templates, documentation, and a working example domain.

Installation

Using uv (recommended)

# Clone the repository
git clone https://github.com/admiller/rhoai-mcp-prototype.git
cd rhoai-mcp-prototype

# Install dependencies
uv sync

# Run the server
uv run rhoai-mcp

Using pip

pip install -e .
rhoai-mcp

Using Container (Podman/Docker)

# Build the image
make build

# Run with HTTP transport
make run-http

# Run with STDIO transport (interactive)
make run-stdio

# Run with debug logging
make run-dev

Or run directly without Make:

# Build
podman build -f Containerfile -t rhoai-mcp:latest .

# Run with HTTP transport
podman run -p 8000:8000 \
  -v ~/.kube/config:/opt/app-root/src/kubeconfig/config:ro \
  -e RHOAI_MCP_AUTH_MODE=kubeconfig \
  -e RHOAI_MCP_KUBECONFIG_PATH=/opt/app-root/src/kubeconfig/config \
  rhoai-mcp:latest --transport sse

# Run with STDIO transport
podman run -it \
  -v ~/.kube/config:/opt/app-root/src/kubeconfig/config:ro \
  -e RHOAI_MCP_AUTH_MODE=kubeconfig \
  -e RHOAI_MCP_KUBECONFIG_PATH=/opt/app-root/src/kubeconfig/config \
  rhoai-mcp:latest --transport stdio

Available Make targets:

| Target | Description | |--------|-------------| | make build | Build the container image | | make run-http | Run with SSE transport on port 8000 | | make run-streamable | Run with streamable-http transport | | make run-stdio | Run with STDIO transport (interactive) | | make run-dev | Run with debug logging | | make run-token | Run with token auth (requires TOKEN and API_SERVER) | | make stop | Stop the running container | | make logs | View container logs | | make clean | Remove container and image |

Kubernetes Deployment

Deploy using Kustomize with environment-specific overlays:

# KIND / local development
kustomize build deploy/kustomize/overlays/kind/ | kubectl apply -f -

# OpenShift production
kustomize build deploy/kustomize/overlays/openshift/ | oc apply -f -

The Kustomize structure uses a shared base with per-environment overlays:

deploy/kustomize/
├── base/                    # Shared resources (all environments)
│   ├── clusterrole.yaml     # RBAC for RHOAI resources
│   ├── deployment.yaml      # Hardened pod spec (non-root, read-only rootfs, probes)
│   ├── configmap.yaml       # Default config (SSE transport, INFO logging)
│   └── ...
└── overlays/
    ├── kind/                # NodePort, DEBUG logging, imagePullPolicy: Never
    └── openshift/           # GHCR image, TLS Route, OpenShift-specific RBAC, NetworkPolicy

The KIND overlay enables debug logging, dangerous operations, NodePort service type, and imagePullPolicy: Never (for kind load docker-image).

The OpenShift overlay adds a TLS-terminated Route, OpenShift-specific RBAC rules (projects, routes, templates, imagestreams, DataScienceCluster, Model Registry), and a NetworkPolicy allowing access to the model-catalog service.

To customize the namespace, set it in a downstream overlay's kustomization.yaml and include the replacements block from the base to keep the ClusterRoleBinding subject namespace in sync (see comments in base/kustomization.yaml). For the OpenShift overlay, also update the hardcoded namespace in:

• deploy/kustomize/overlays/openshift/route.yaml → metadata.namespace
• deploy/kustomize/overlays/openshift/networkpolicy.yaml → metadata.namespace and spec.ingress[].from[].namespaceSelector.matchLabels["kubernetes.io/metadata.name"]

Configuration

The server can be configured via environment variables (with RHOAI_MCP_ prefix) or a .env file.

Authentication

The server supports three authentication modes:

1. Auto (default): Tries in-cluster authentication first, falls back to kubeconfig
2. Kubeconfig: Uses a kubeconfig file
3. Token: Uses explicit API server URL and token

# Auto mode (default)
export RHOAI_MCP_AUTH_MODE=auto

# Kubeconfig mode
export RHOAI_MCP_AUTH_MODE=kubeconfig
export RHOAI_MCP_KUBECONFIG_PATH=/path/to/kubeconfig
export RHOAI_MCP_KUBECONFIG_CONTEXT=my-context

# Token mode
export RHOAI_MCP_AUTH_MODE=token
export RHOAI_MCP_API_SERVER=https://api.cluster.example.com:6443
export RHOAI_MCP_API_TOKEN=sha256~xxxxx

Transport

# stdio (default) - for Claude Desktop and similar tools
export RHOAI_MCP_TRANSPORT=stdio

# HTTP transports
export RHOAI_MCP_TRANSPORT=sse
export RHOAI_MCP_HOST=127.0.0.1
export RHOAI_MCP_PORT=8000

Safety Settings

# Enable delete operations (disabled by default)
export RHOAI_MCP_ENABLE_DANGEROUS_OPERATIONS=true

# Read-only mode (disable all write operations)
export RHOAI_MCP_READ_ONLY_MODE=true

Safety Features Summary

| Feature | Description | Default | |---------|-------------|---------| | Read-Only Mode | Disables all create/update/delete operations | Off | | Dangerous Operations Gate | Delete operations require explicit enablement | Disabled | | Confirmation Pattern | Delete tools require confirm=True parameter | Required | | Credential Masking | S3 secret keys are masked in all responses | Always | | RBAC-Aware | Uses OpenShift Projects API to respect user permissions | Always | | Auth Validation | Validates authentication configuration at startup | Always |

Workflow Tokens

Workflow tokens enforce ordering of multi-step MCP tool calls. When tools are decorated with @workflow_step, each step signs its output with an HMAC token that the next step must present and verify before executing. This prevents agents from skipping prerequisite steps.

# Set an explicit HMAC secret (recommended for production — tokens survive restarts)
export RHOAI_MCP_WORKFLOW_HMAC_SECRET=my-secret-key

# Adjust token time-to-live (default: 3600 seconds / 1 hour)
export RHOAI_MCP_WORKFLOW_TOKEN_TTL=1800

| Variable | Description | Default | |----------|-------------|---------| | RHOAI_MCP_WORKFLOW_HMAC_SECRET | HMAC secret for signing workflow tokens | Random per process | | RHOAI_MCP_WORKFLOW_TOKEN_TTL | Token time-to-live in seconds | 3600 |

If no secret is configured, a random one is generated at process startup. This means tokens are not portable across server restarts — suitable for development but not production deployments where long-running workflows may span restarts.

Model Registry

The MCP server integrates with the RHOAI Model Registry to list and query registered models. By default, it auto-discovers the Model Registry service in the cluster.

Discovery Modes

# Auto-discovery (default) - finds Model Registry in the cluster
export RHOAI_MCP_MODEL_REGISTRY_DISCOVERY_MODE=auto

# Manual - use a specific URL
export RHOAI_MCP_MODEL_REGISTRY_DISCOVERY_MODE=manual
export RHOAI_MCP_MODEL_REGISTRY_URL=https://model-registry.example.com

Authentication

When accessing the Model Registry via an external route (outside the cluster), authentication is typically required (OAuth for OAuth-proxied routes; explicit token auth is also supported):

# No authentication (default) - for in-cluster access
export RHOAI_MCP_MODEL_REGISTRY_AUTH_MODE=none

# OAuth authentication - uses your oc login token
export RHOAI_MCP_MODEL_REGISTRY_AUTH_MODE=oauth

# Explicit token authentication
export RHOAI_MCP_MODEL_REGISTRY_AUTH_MODE=token
export RHOAI_MCP_MODEL_REGISTRY_TOKEN=sha256~xxxxx

| Auth Mode | Description | Use Case | |-----------|-------------|----------| | none | No authentication headers | In-cluster access via port 8080 | | oauth | Uses OAuth token from kubeconfig | External route with OAuth proxy | | token | Uses explicit bearer token | Service accounts, CI/CD |

External Route Access

To access the Model Registry from outside the cluster via an OpenShift Route:

# 1. Log in to OpenShift (this stores the OAuth token in kubeconfig)
oc login --server=https://api.cluster.example.com:6443

# 2. Configure the MCP server to use the external route with OAuth
export RHOAI_MCP_MODEL_REGISTRY_URL=https://model-catalog.apps.cluster.example.com
export RHOAI_MCP_MODEL_REGISTRY_DISCOVERY_MODE=manual
export RHOAI_MCP_MODEL_REGISTRY_AUTH_MODE=oauth

# 3. Optional: Skip TLS verification for self-signed certificates (not recommended)
# export RHOAI_MCP_MODEL_REGISTRY_SKIP_TLS_VERIFY=true

Port-Forwarding Alternative

If no external route is available, you can use port-forwarding:

# Set up port-forwarding to the Model Registry service
kubectl port-forward -n rhoai-model-registries svc/model-catalog 8080:8443

# Configure the MCP server to use localhost
export RHOAI_MCP_MODEL_REGISTRY_URL=http://localhost:8080
export RHOAI_MCP_MODEL_REGISTRY_DISCOVERY_MODE=manual

All Model Registry Settings

| Variable | Description | Default | |----------|-------------|---------| | RHOAI_MCP_MODEL_REGISTRY_ENABLED | Enable Model Registry integration | true | | RHOAI_MCP_MODEL_REGISTRY_URL | Model Registry service URL | Auto-discovered | | RHOAI_MCP_MODEL_REGISTRY_DISCOVERY_MODE | auto or manual | auto | | RHOAI_MCP_MODEL_REGISTRY_AUTH_MODE | none, oauth, or token | none | | RHOAI_MCP_MODEL_REGISTRY_TOKEN | Explicit bearer token (when auth_mode=token) | None | | RHOAI_MCP_MODEL_REGISTRY_TIMEOUT | Request timeout in seconds | 30 | | RHOAI_MCP_MODEL_REGISTRY_SKIP_TLS_VERIFY | Skip TLS certificate verification | false |

Usage with Claude Code

Add to your project's .mcp.json file:

{
  "mcpServers": {
    "rhoai": {
      "command": "uvx",
      "args": ["--from", "git+https://github.com/opendatahub-io/rhoai-mcp", "rhoai-mcp"],
      "env": {
        "RHOAI_MCP_KUBECONFIG_PATH": "/home/user/.kube/config"
      }
    }
  }
}

Usage with Claude Desktop

Add to your Claude Desktop configuration (~/.config/claude/claude_desktop_config.json):

{
  "mcpServers": {
    "rhoai": {
      "command": "uvx",
      "args": ["--from", "git+https://github.com/opendatahub-io/rhoai-mcp", "rhoai-mcp"],
      "env": {
        "RHOAI_MCP_KUBECONFIG_PATH": "/home/user/.kube/config"
      }
    }
  }
}

Local Development

For contributors working with a local clone:

{
  "mcpServers": {
    "rhoai": {
      "command": "uv",
      "args": ["run", "--directory", "/path/to/rhoai-mcp", "rhoai-mcp"],
      "env": {
        "RHOAI_MCP_KUBECONFIG_PATH": "/home/user/.kube/config"
      }
    }
  }
}

Using Container Image (Podman/Docker)

First, build the container image:

make build

Then configure Claude Desktop with the container:

Podman:

{
  "mcpServers": {
    "rhoai": {
      "command": "podman",
      "args": [
        "run", "-i", "--rm",
        "--userns=keep-id",
        "-v", "${HOME}/.kube/config:/opt/app-root/src/kubeconfig/config:ro",
        "-e", "RHOAI_MCP_AUTH_MODE=kubeconfig",
        "-e", "RHOAI_MCP_KUBECONFIG_PATH=/opt/app-root/src/kubeconfig/config",
        "rhoai-mcp:latest"
      ]
    }
  }
}

Docker:

{
  "mcpServers": {
    "rhoai": {
      "command": "docker",
      "args": [
        "run", "-i", "--rm",
        "-v", "${HOME}/.kube/config:/opt/app-root/src/kubeconfig/config:ro",
        "-e", "RHOAI_MCP_AUTH_MODE=kubeconfig",
        "-e", "RHOAI_MCP_KUBECONFIG_PATH=/opt/app-root/src/kubeconfig/config",
        "rhoai-mcp:latest"
      ]
    }
  }
}

Note: The container uses stdio transport by default, which is required for Claude Desktop integration.

Available Tools

Project Management (6 tools)

| Tool | Description | |------|-------------| | list_data_science_projects | List all RHOAI projects | | get_project_details | Get project with resource summary | | create_data_science_project | Create new project | | delete_data_science_project | Delete project (requires confirmation) | | get_project_status | Get comprehensive project status | | set_model_serving_mode | Set single vs multi-model serving |

Workbench Management (8 tools)

| Tool | Description | |------|-------------| | list_workbenches | List workbenches in project | | get_workbench | Get workbench details | | create_workbench | Create new workbench | | start_workbench | Start a stopped workbench | | stop_workbench | Stop a running workbench | | delete_workbench | Delete workbench | | list_notebook_images | List available images | | get_workbench_url | Get OAuth-protected URL |

Model Serving (6 tools)

| Tool | Description | |------|-------------| | list_inference_services | List deployed models | | get_inference_service | Get model details | | deploy_model | Create InferenceService | | delete_inference_service | Delete deployed model | | list_serving_runtimes | List available runtimes | | get_model_endpoint | Get inference endpoint URL |

Data Connections (4 tools)

| Tool | Description | |------|-------------| | list_data_connections | List connections in project | | get_data_connection | Get connection details (masked) | | create_s3_data_connection | Create S3 connection | | delete_data_connection | Delete connection |

Pipelines (3 tools)

| Tool | Description | |------|-------------| | get_pipeline_server | Get DSPA status | | create_pipeline_server | Create DSPA | | delete_pipeline_server | Delete DSPA |

Storage (3 tools)

| Tool | Description | |------|-------------| | list_storage | List PVCs in project | | create_storage | Create PVC | | delete_storage | Delete PVC (requires confirmation) |

MCP Resources

The server also exposes read-only resources:

| Resource URI | Description | |--------------|-------------| | rhoai://cluster/status | Cluster health and RHOAI status | | rhoai://cluster/components | DataScienceCluster component status | | rhoai://cluster/accelerators | Available GPU profiles | | rhoai://projects/{name}/status | Project resource summary | | rhoai://projects/{name}/workbenches | Workbench list with status | | rhoai://projects/{name}/models | Deployed models with status |

MCP Prompts

The server provides 18 prompts that guide AI agents through multi-step workflows. Prompts are templates that provi

…

Source & license

This open-source MCP server is cataloged on AgentStack and links to its original source — we do not rehost the code.

• Author: opendatahub-io
• Source: opendatahub-io/rhoai-mcp
• License: MIT

Install and usage instructions live in the source repository linked above.