Video Edit

Video Edit — Pro Pack on RunComfy

runcomfy.com · Wan 2.7 Edit-Video · Kling Motion-Control Pro · Lucy Edit Restyle · GitHub

Video edit, intent-routed. This skill doesn't lock you to one model — it picks the right video-edit model in the RunComfy catalog based on what the user actually wants: general restyle, motion transfer from a reference clip, or lightweight identity-stable outfit / background swap.

npx skills add agentspace-so/runcomfy-skills --skill video-edit -g

Pick the right model for the user's intent

| User intent | Model | Why | |---|---|---| | Restyle a talking-head video — preserve face / pose / lip movement | Wan 2.7 Edit-Video | Strong identity + motion preservation; supports up to 1080p | | Swap product background, keep camera motion | Wan 2.7 Edit-Video | Camera motion preserved; one-direction edit honored | | Replace packaging design using a reference image | Wan 2.7 Edit-Video + reference_image | Reference-conditioned design transfer | | Apply cinematic color grade / commercial polish | Wan 2.7 Edit-Video | Good at single-direction global look changes | | Transfer precise motion from a reference video to a target character | Kling 2.6 Pro Motion Control | Designed for motion mapping with identity hold | | Lip-sync motion of a target character to source video's lip movement | Kling 2.6 Pro Motion Control | Built for tight temporal coherence | | Lightweight outfit / costume swap with identity preservation | Lucy Edit Restyle | Core strength is localized identity-stable edits | | Identity-stable restyle ("astronaut in desert", "warm golden-hour lighting") | Lucy Edit Restyle | Specializes in temporal consistency for restyle | | Default if unspecified | Wan 2.7 Edit-Video | Most versatile, highest resolution |

The agent reads this table, classifies the user's intent, and picks the matching subsection below.

Prerequisites

1. RunComfy CLI — npm i -g @runcomfy/cli
2. RunComfy account — runcomfy login.
3. CI / containers — set RUNCOMFY_TOKEN=.
4. A source video URL — formats and limits depend on the chosen route.

---

Route 1: Wan 2.7 Edit-Video — default for restyle / background / packaging

Model: wan-ai/wan-2-7/edit-video

Schema

| Field | Type | Required | Default | Notes | |---|---|---|---|---| | prompt | string | yes | — | Lead with preservation. One edit direction per call. | | video | string | yes | — | MP4/MOV URL, 2–10s, ≤100MB. | | reference_image | string | no | — | URL — use for direct design / appearance transfer only. | | resolution | enum | no | (input) | 720p or 1080p. | | aspect_ratio | enum | no | (input) | W:H. Defaults to input. | | duration | int | no | 0 | 0 = match input; 2–10 = truncate from start. | | audio_setting | enum | no | auto | auto or origin (preserve source audio). | | seed | int | no | — | Reproducibility. |

Invoke

Background swap, identity preserved, audio kept:

runcomfy run wan-ai/wan-2-7/edit-video \
  --input '{
    "prompt": "Preserve the speaker'\''s face, pose, and lip movement; change the background to a modern office with neutral lighting.",
    "video": "https://.../speaker.mp4",
    "audio_setting": "origin"
  }' \
  --output-dir 

Packaging swap with reference image:

runcomfy run wan-ai/wan-2-7/edit-video \
  --input '{
    "prompt": "Maintain the original framing and hand movement; replace the packaging design using the reference image.",
    "video": "https://.../hand-holding-package.mp4",
    "reference_image": "https://.../new-packaging.png",
    "audio_setting": "origin"
  }' \
  --output-dir 

Prompting tips

• Preservation goals first: "Preserve [face / pose / motion / framing / lip movement]; [then state the change]".
• One edit direction per call. Compound edits drift on motion.
• reference_image only when justified (packaging swap, costume swap with target visual). Don't pass refs for general restyle.
• audio_setting: "origin" for talking-head where you don't want soundtrack regenerated.
• Source video constraints: 2–10s, ≤100MB.

---

Route 2: Kling 2.6 Pro Motion Control — when motion FROM a reference clip is the point

Model: kling/kling-2-6/motion-control-pro

Use when the user wants to transfer the motion of a reference video onto a target character (driven by an image OR another video). This isn't restyle — it's motion mapping with identity hold.

Schema

| Field | Type | Required | Notes | |---|---|---|---| | prompt | string | yes | Describe target motion / style. | | image | string | yes (image orientation) | Reference for character / background consistency. | | video | string | yes | Motion reference. 10–30s depending on orientation. | | keep_original_sound | bool | no | Preserve audio from reference video. | | character_orientation | enum | yes | image (max 10s output) or video (max 30s output). |

Invoke

runcomfy run kling/kling-2-6/motion-control-pro \
  --input '{
    "prompt": "A young american woman dancing",
    "image": "https://.../target-character.jpg",
    "video": "https://.../motion-reference-dance.mp4",
    "character_orientation": "image",
    "keep_original_sound": true
  }' \
  --output-dir 

Prompting tips

• Subject must be > 5% of frame in the image reference for clean identity hold.
• Spatial constraints help: "character on left side, background motion right".
• Simplify if results drift between iterations — drop adjectives, keep core motion description.
• character_orientation: "image" caps output at 10s; "video" allows 30s.

---

Route 3: Lucy Edit Restyle — lightweight identity-stable restyle / outfit swap

Model: decart/lucy-edit/restyle

Use when the edit is localized style modification — outfit swap, scene relight, atmospheric restyle — and identity preservation is critical. Lighter-weight than Wan 2.7 Edit; capped at 720p.

Schema

| Field | Type | Required | Default | Notes | |---|---|---|---|---| | prompt | string | yes | — | Natural-language edit instruction. | | video_url | string | yes | — | MP4/MOV/WEBM/GIF. | | resolution | enum | no | 720p | 720p only on this tier. |

Invoke

Outfit swap:

runcomfy run decart/lucy-edit/restyle \
  --input '{
    "prompt": "Change outfit to professional business attire; preserve face and motion.",
    "video_url": "https://.../subject-walking.mp4"
  }' \
  --output-dir 

Atmospheric restyle:

runcomfy run decart/lucy-edit/restyle \
  --input '{
    "prompt": "Make lighting warm and golden hour; preserve face, pose, and motion.",
    "video_url": "https://.../subject-portrait.mp4"
  }' \
  --output-dir 

Prompting tips

• Localized change phrasing wins. "Outfit", "lighting", "background" — pick one bucket.
• Preserve identity goals — "preserve face and motion" is enough; don't over-specify.
• Avoid total replacement ("astronaut in space" works; "swap subject for a different person" doesn't). Lucy is built for localized style mods, not full character swap.
• No aspect ratio control — output matches input. Cropping happens server-side if you don't pre-match.

---

Limitations

• Each route inherits its model's limits. Wan 2.7 Edit: 2–10s, 1080p ceiling. Kling: 10s (image orientation) or 30s (video orientation). Lucy: 720p ceiling, no aspect control.
• No multi-route blending. This skill picks one model per call.
• Brand-specific overrides — if the user named a specific model, route to the corresponding brand skill (wan-2-7) for fuller treatment.

Exit codes

| code | meaning | |---|---| | 0 | success | | 64 | bad CLI args | | 65 | bad input JSON / schema mismatch | | 69 | upstream 5xx | | 75 | retryable: timeout / 429 | | 77 | not signed in or token rejected |

Full reference: docs.runcomfy.com/cli/troubleshooting.

How it works

The skill picks one of Wan 2.7 Edit-Video / Kling 2.6 Pro Motion Control / Lucy Edit Restyle based on user intent and invokes runcomfy run with the matching JSON body. The CLI POSTs to the Model API, polls the request, fetches the result, and downloads any .runcomfy.net/.runcomfy.com URL into --output-dir. Ctrl-C cancels the remote request before exit.

Security & Privacy

• Token storage: runcomfy login writes the API token to ~/.config/runcomfy/token.json with mode 0600 (owner-only read/write). Set RUNCOMFY_TOKEN env var to bypass the file entirely in CI / containers.
• Input boundary: the user prompt is passed as a JSON string to the CLI via --input. The CLI does NOT shell-expand the prompt; it transmits the JSON body directly to the Model API over HTTPS. No shell injection surface from prompt content.
• Third-party content: image / mask / video URLs you pass are fetched by the RunComfy model server, not by the CLI on your machine. Treat external URLs as untrusted; image-based prompt injection is a known risk for any image-edit / video-edit model.
• Outbound endpoints: only model-api.runcomfy.net (request submission) and *.runcomfy.net / *.runcomfy.com (download whitelist for generated outputs). No telemetry, no callbacks.
• Generated-file size cap: the CLI aborts any single download > 2 GiB to prevent disk-fill from a malicious or runaway model output.

Source & license

This open-source skill is cataloged on AgentStack and links to its original source — we do not rehost the code.

• Author: agentspace-so
• Source: agentspace-so/runcomfy-agent-skills
• License: MIT
• Homepage: https://www.runcomfy.com

Install and usage instructions live in the source repository linked above.