设计与多媒体

video-to-screenplay

试用

Turn video/audio transcripts into original screenplays. Faster-whisper → LLM story DNA → screenplay (.md + .fountain). Supports 6 LLM providers and CPU/GPU.

它能做什么

Turn video/audio transcripts into original screenplays. Faster-whisper → LLM story DNA → screenplay (.md + .fountain). Supports 6 LLM providers and CPU/GPU.

技能文档

video-to-screenplay

Turn video/audio/transcript files into original screenplays via a two-stage LLM pipeline.

When to use

  • User wants to generate a screenplay, script, or story from a video/audio file
  • User has a podcast, interview, or narration transcript and wants to develop it into a story
  • User wants to extract story DNA (themes, characters, conflicts) from spoken content
  • User needs Fountain-format output for import into screenwriting software

When NOT to use

  • User just wants a transcript → use transcribe_to_srt.py
  • User wants to summarize a video → use web_fetch + LLM
  • User wants to generate video from script → opposite direction

Pipeline

  1. Transcribe (optional): audio/video → SRT via faster-whisper
  2. Extract: transcript → story DNA (JSON) via LLM
  3. Generate: story DNA → original screenplay (.md + .fountain)

Requirements

  • faster-whisper (pip install faster-whisper)
  • One LLM API key in openclaw.json (deepseek, kimi, zhipu, longcat, google, or agnes)

Usage

# From existing SRT
python scripts/video_to_screenplay.py --srt input.srt --out-dir ./output

# From audio/video (auto-transcribe first)
python scripts/video_to_screenplay.py --audio input.mp3 --out-dir ./output

# Specify genre and length
python scripts/video_to_screenplay.py --srt input.srt --out-dir ./output --target-minutes 15 --genre "科幻"

# Use GPU for transcription
python scripts/video_to_screenplay.py --audio input.mp3 --out-dir ./output --device cuda --compute-type float16

# Use a different LLM provider
python scripts/video_to_screenplay.py --srt input.srt --out-dir ./output --provider kimi --model kimi-k3

# Extract story DNA only (no screenplay)
python scripts/video_to_screenplay.py --srt input.srt --out-dir ./output --extract-only

Output files

  • transcript.txt — plain text transcript
  • story_dna.json — extracted story elements (themes, characters, conflicts, motifs)
  • screenplay.md — human-readable screenplay
  • screenplay.fountain — Fountain format for screenwriting software import

Provider support

ProviderDefault ModelNotes
deepseekdeepseek-v4-flashDefault, fast
kimikimi-k3temperature auto-set to 1.0
zhipuglm-5.21M context
longcatLongCat-2.0Reasoning model
googlegemini-2.0-flashMultimodal
agnesagnes-2.0-flashFree tier available

相关技能

script to video, screenplay to video, shot list to video — turn a script into a storyboarded, shot-by-shot video: break down scenes, generate shots, assemble, validate. Use when the user gives a script or scene breakdown and wants a video.

Converts articles (docx/pdf/txt/md) to narrated videos with AI-generated visuals and TTS voiceover. Invoke when user asks to convert article/document to video, mentions 文章转视频, or needs text-to-video with narration.

Generate timecoded SRT subtitles from local video or audio files. Use when a user wants a local low-cost subtitle workflow, asks to transcribe local media in...

18 次安装1 星标

article to video, text to video, news to video, essay to video — turn a written article into a narrated explainer video: outline, storyboard, voiceover, build, validate. Use when the user pastes or gives an article and wants a video.