Whisperx

Prerequisites

Install and load these skills before generating (skip if already in context via @pruna):

| Skill | Description | Install | | --- | --- | --- | | generation-diversity | Use when writing any generative prompt — ritual seed, explicit structure, scenario axes, and quality gates before paid API calls. | npx skills add PrunaAI/pruna-skills@generation-diversity -y | | pruna-api | Use before any Pruna or Replicate HTTP call — credentials, upload/poll/download, parallel batches, and agent safety. | npx skills add PrunaAI/pruna-skills@pruna-api -y |

Or install the full suite once: npx skills add PrunaAI/pruna-skills@pruna -y

Follow each skill's Before generating / craft sections — do not restate guide content here.

Agent habit

In the first reply, name ` whisperx in backticks, confirm REPLICATEAPITOKEN (or stop with signup links from pruna-api`), then ask for required inputs. Redirect when When NOT to use fits better.

When NOT to use

Use a different skill instead:

| Skill | Description | Install | | --- | --- | --- | | music-2.5 | Use when someone wants an original AI song with vocals — sung lyrics, a style prompt track, or source audio for a music video. | npx skills add PrunaAI/pruna-skills@music-2.5 -y | | gemini-3.1-flash-tts | Use when someone needs spoken narration or voiceover — explainer tracks, documentary lines, or voice to pair with generated video. | npx skills add PrunaAI/pruna-skills@gemini-3.1-flash-tts -y | | video-editing | Use when assembling or polishing already-rendered clips with ffmpeg — concat, crossfades, burned captions and subtitles, text/logo overlays, before/after sliders, background music beds, platform export — or when composing a multi-layer HTML combination video with Hyperframes. Not for AI video generation, prompt craft, or model-based video edits. | npx skills add PrunaAI/pruna-skills@video-editing -y |

Environment

export REPLICATE_API_TOKEN=r8_...

HTTP / pipeline

Prefer the repo helpers (they upload local audio and write JSON + SRT):

# Agent: follow phase table in this SKILL.md \
  --song output/my-mv/song.mp3 \
  --out output/my-mv/whisperx_transcript.json \
  --initial-prompt "First few lyric lines help recognition"

# Agent: follow phase table in this SKILL.md \
  --cuts output/my-mv/cut_manifest.json \
  --transcript output/my-mv/whisperx_transcript.json \
  --song output/my-mv/song.mp3

In a music-video workflow, run this skill during the align phase — see music-video.

Before generating

1. Complete Prerequisites guide reading order.
2. Confirm audio_file (HTTPS URL — helpers upload local files), language, and align_output: true for word-level cut alignment. When listing inputs, name REPLICATE_API_TOKEN (Replicate — not PRUNA_API_KEY).
3. Model notes: set initial_prompt to the first lyric lines for better rap/sung recognition. Optional diarization for multi-voice battles.

Required input

• audio_file (HTTPS URL)

Common optional fields

• language — ISO code, e.g. en
• align_output — true for word-level timestamps (required for cut alignment)
• initial_prompt — first lyric lines
• diarization — speaker labels

Typical next steps

Common follow-ons after this skill:

| Skill | Description | Install | | --- | --- | --- | | music-video | Use when someone wants a full music video — original song or vocals, performance clips, B-roll, and lyric-synced edits. | npx skills add PrunaAI/pruna-skills@music-video -y | | music-2.5 | Use when someone wants an original AI song with vocals — sung lyrics, a style prompt track, or source audio for a music video. | npx skills add PrunaAI/pruna-skills@music-2.5 -y | | video-editing | Use when assembling or polishing already-rendered clips with ffmpeg — concat, crossfades, burned captions and subtitles, text/logo overlays, before/after sliders, background music beds, platform export — or when composing a multi-layer HTML combination video with Hyperframes. Not for AI video generation, prompt craft, or model-based video edits. | npx skills add PrunaAI/pruna-skills@video-editing -y |

Source & license

This open-source skill is cataloged on AgentStack and links to its original source — we do not rehost the code.

• Author: PrunaAI
• Source: PrunaAI/pruna-skills
• License: Apache-2.0
• Homepage: https://dashboard.pruna.ai

Install and usage instructions live in the source repository linked above.