Install
$ agentstack add skill-katalon-labs-true-skills-katalon-platform-setup ✓ scanned · ✓ verified, works with Claude Code, Cursor, and more.
Security review
✓ PassedNo issues found. Passed automated security review. · v0.1.0 How review works →
- ✓ Prompt-injection patterns
- ✓ Secret / credential exfiltration
- ✓ Dangerous shell & filesystem operations
- ✓ Untrusted network calls
- ✓ Known-malicious package signatures
What it can access
- ✓ Network access No
- ✓ Filesystem access No
- ✓ Shell / process execution No
- ✓ Environment & secrets No
- ✓ Dynamic code execution No
From automated source analysis of v0.1.0. “Used” means the capability is present in the source — more access means more to trust, not that it’s unsafe.
Verified badge
Passed review? Show it. Paste this badge into your README, it links to the public security report.
Reliability & compatibility
Declared compatibility
Compatibility is declared by the source manifest. End-to-end runtime verification is coming, see below.
We're building live execution health for every listing: tool-call success rate, median latency, uptime, and last-checked timestamps, measured, not self-reported. It isn't live yet, so we don't show numbers we can't stand behind.
How agent discovery & health will work →About
Katalon Platform Setup
Use this skill for Katalon MCP installation, connection, and readiness checks. Do not use it for designing or running tests unless the setup check leads directly into katalon-create-test-cases, katalon-execute-test, or the larger katalon-trueplatform-testing skill.
This skill is agent-neutral. The Katalon MCP server is the same for every agent (Claude Code, Codex, Copilot, Cursor, Kiro, Windsurf, and others); only the config file location and format differ per agent. For the exact per-agent config path and snippet, read the repository README.md install section.
Setup Boundary
Be explicit about what can be verified from the current environment:
- Available through Katalon MCP once connected: project/repository discovery, requirement reads, test case/suite operations, manual runs, AI sessions, automated scheduling, results, metrics, and ALM-linked defects.
- Not directly available through Katalon MCP: create requirements, create a formal Test Plan entity, inspect live AUT pages, or guarantee AI execution completion.
- If no Katalon MCP tools are exposed in the current session, do not claim the platform is connected.
Read references/capability-boundaries.md when explaining available operations.
Required Setup Inputs
For setup requests, collect the minimum routing and authentication choices before writing or testing MCP config:
- Resolve the Katalon MCP endpoint:
- If the installed config still contains
https://.katalon.io/mcp, ask for the Katalon subdomain or full MCP URL before attempting a connection. - If the user or local config mentions more than one Katalon domain, list the candidate domains and ask which domain they want to work with.
- Normalize a bare subdomain such as `
tohttps://.katalon.io/mcp`.
- Ask how the user wants to authenticate when auth is required:
- Browser OAuth flow with an agent restart/reload after login.
- CLI/local
mcp-remotelogin bootstrap. - Login email/account label only for account selection.
- Never ask for passwords, API tokens, cookies, JWTs, MFA codes, or OAuth callback URLs in chat. If the user offers "login information", accept only non-secret routing details such as login email, organization, domain, project name, or repository/Test Project name.
- After authentication succeeds and Katalon tools are available, call
list_projects. If more than one project is returned, list the projects and ask which project to use before calling repository-specific tools. - After project selection, call
list_repositorieswith the selectedproject_id. If more than one repository/Test Project is returned and none is clearly implied by the user's request, list the repositories and ask which one to use.
Connection Check
Start every setup/debugging request with a non-destructive check:
- Follow "Required Setup Inputs" first when the endpoint, domain, or auth route is not already resolved.
- Search for Katalon/TestOps MCP tools using the agent's tool discovery mechanism.
- If tools exist, call
list_projects. - If multiple projects are returned, list them and ask which project to use.
- Call
list_repositorieswith the selected or onlyproject_idafter projects are available. - If multiple repositories/Test Projects are returned and no repository is clearly implied, list them and ask which repository/Test Project to use.
- Confirm at least one project and repository/Test Project can be discovered.
- If a requirement key or repo name is provided, verify access by searching or reading that target.
If Katalon tools are not exposed in the active agent session, do not stop at "reload required" yet. First try the local proxy bootstrap in "MCP Remote OAuth Bootstrap" below. A successful bootstrap proves the account and endpoint are usable even if the current agent's MCP host has not reloaded the server list.
Report the exact boundary:
- Connected and usable.
- MCP tools exposed but auth/access failed.
- MCP works through local
mcp-remoteproxy, but tools are not exposed in the current agent session. - MCP tools missing from the session and local proxy bootstrap failed or could not be attempted.
- Project exists but repository/Test Project cannot be resolved.
Install Or Configure MCP
When MCP tools are missing:
- Inspect local agent/plugin context for an existing Katalon MCP install path or configuration.
- If the config contains
https://.katalon.io/mcp, ask the user for the target Katalon subdomain or full MCP URL, then write the resolved endpoint into the agent's MCP config. Do not leave the placeholder in an active user config. - The recommended transport is the
mcp-remotewrapper, which works across every agent. The command and args are identical everywhere; only the surrounding config format changes per agent:
``sh npx -y mcp-remote https://.katalon.io/mcp --transport http-first ``
- JSON agents (Claude Code, Cursor, Kiro, Copilot/VS Code, Windsurf, Cline) declare this as an
mcpServersentry. See the bundled.mcp.jsonfor the canonical shape. - Codex declares the same command/args in TOML under
[mcp_servers.katalon-prod-mcp]. - For the exact file path per agent, read the repository
README.mdinstall section.
- If the install command, package name, or server URL is not present in local context, use official Katalon-provided setup instructions or ask the user for the MCP package/source. Do not invent install commands.
- Configure only the minimum required MCP server entry for the user's agent environment.
- Store secrets using the environment's secret mechanism or environment variables. Never write access tokens, passwords, cookies, or raw auth callback URLs into repo files, skill files, logs, or final answers.
- Re-run the connection check. Restart or reload the MCP host only if Katalon works through the local proxy but the current agent session still does not expose the tools.
If the user explicitly asks to install but the environment does not permit plugin/MCP installation from the current session, give the exact missing prerequisite and the safest next step.
MCP Remote OAuth Bootstrap
Use this when Katalon MCP tools are missing from the active session or direct remote MCP config returns 401 Invalid JWT token format.
- Ask only for non-secret information needed to target the right server or verify access, such as:
- Katalon subdomain or full MCP URL, for example
https://.katalon.io/mcp. - Project name or project ID.
- Repository/Test Project name, if the user wants a specific target verified.
- Login email, only if it helps the user choose the right account in the browser.
- Do not ask the user to paste passwords, API tokens, cookies, JWTs, or OAuth callback URLs into chat. If authentication is needed, trigger the browser-based OAuth flow and have the user complete login in the browser.
- Run the proxy with the Katalon endpoint:
``sh npx -y mcp-remote "https://.katalon.io/mcp" --transport http-first ``
If this prints an authorization URL or opens the browser, wait for the user/browser callback to complete. mcp-remote stores OAuth state under its own auth cache, such as ~/.mcp-auth, not in the workspace.
- Verify through a local MCP client, if Katalon tools are still not exposed through the agent's tool discovery:
listToolsshould includelist_projectsandlist_repositories.- Call
list_projects. - Call
list_repositorieswith the exact schema fieldproject_id.
- If local proxy verification succeeds but the agent's tool discovery still does not expose Katalon tools, report that MCP is authenticated and usable through
mcp-remote, but the active agent host needs a reload/new session/new thread to expose the tools natively.
Known working MCP server entry (JSON form; Codex uses the same command/args in TOML):
{
"mcpServers": {
"katalon-prod-mcp": {
"command": "npx",
"args": ["-y", "mcp-remote", "https://.katalon.io/mcp", "--transport", "http-first"]
}
}
}
Known verification observations:
mcp-remotemay sayInvalid JWT token formatbefore OAuth completes; treat this as an auth challenge, not proof the server is unavailable.- The valid transport strategy is
http-firstorhttp-only;httpcan be rejected bymcp-remote. list_repositoriesexpectsproject_id, notprojectId.
Authentication And Access
When tools exist but calls fail:
- Treat 401/403-style failures as auth or account-scope problems.
- Ask the user to authenticate through the platform's secure browser flow. Never ask them to paste secrets into normal chat when a secure mechanism exists.
- You may ask for non-secret account routing details, such as subdomain, project ID/name, repository name, and login email. The user should enter passwords/SSO/MFA only in the browser or secure credential flow.
- If multiple authenticated Katalon domains are available, ask which domain to use before selecting projects.
- If multiple projects are available, list the project names/IDs and ask which project to use before listing repositories.
- If multiple repositories/Test Projects are available, list them and ask which repository/Test Project to use unless the user's request clearly names one.
- For empty project/repository results, verify account membership, organization, project role, and repository/Test Project access.
- For requirement lookup failures, verify that Jira/Azure sync exists and the requirement key belongs to the connected project.
Handoff
After setup is verified:
- Use
katalon-create-test-casesfor requirement or free-text test design/import. - Use
katalon-execute-testfor running an existing case or suite. - Use
katalon-trueplatform-testingfor end-to-end flows that include requirement analysis, case creation, suite management, execution, AI polling, and result reporting.
Source & license
This open-source skill is cataloged on AgentStack and links to its original source — we do not rehost the code.
- Author: katalon-labs
- Source: katalon-labs/true-skills
- License: MIT
Install and usage instructions live in the source repository linked above.
Reviews
No reviews yet, be the first.
Write a review
Versions
- v0.1.0 Imported from the upstream source.