Seedance2 Gen Video

Seedance 2.0 Video Generation Skill

Generate videos using the Volcengine Doubao Seedance 2.0 model series.

Prerequisites

1. API Key: The ARK_API_KEY environment variable is configured, or provided by the user.
2. SDK Installation: pip install 'volcengine-python-sdk[ark]'
3. Asset URLs: Reference images, videos, and audio must be publicly accessible URLs (or platform asset IDs in asset:// format).

Usage Steps

Step 1: Collect Parameters

Confirm the following information with the user:

Prompt asset referencing rules: In the prompt, use "Image N", "Video N", "Audio N" to reference corresponding assets (N is the order of assets of the same type in the content array, starting from 1).

Step 2: Install Dependencies (First Time)

pip install 'volcengine-python-sdk[ark]'

ARK_API_KEY=$ARK_API_KEY

Step 3: Run the Script

Call scripts/gen_video.py to execute the video generation task.

Basic example (text-to-video):

python3 scripts/gen_video.py \
  --prompt "A cat running on a grassy field, bright sunlight, slow motion" \
  --ratio "16:9" \
  --duration 5

Image-to-video (first frame):

python3 scripts/gen_video.py \
  --prompt "The scene in Image 1, camera slowly pushes forward" \
  --images "https://example.com/frame.jpg" \
  --image-roles "first_frame" \
  --ratio "16:9" \
  --duration 5

First and last frame image-to-video:

python3 scripts/gen_video.py \
  --prompt "Image 1 is the starting frame, Image 2 is the ending frame, camera pans from left to right" \
  --images "https://example.com/start.jpg" "https://example.com/end.jpg" \
  --image-roles "first_frame" "last_frame" \
  --ratio "16:9" \
  --duration 5

Multimodal reference-to-video:

python3 scripts/gen_video.py \
  --prompt "Mimic the camera style of Video 1, use Image 1 as the scene, with Audio 1 as background music" \
  --images "https://example.com/scene.jpg" \
  --image-roles "reference_image" \
  --videos "https://example.com/style.mp4" \
  --audios "https://example.com/music.mp3" \
  --generate-audio \
  --duration 8

Edit video:

python3 scripts/gen_video.py \
  --prompt "Replace the red car in Video 1 with a blue car, keep the camera movement unchanged" \
  --videos "https://example.com/original.mp4" \
  --duration 5

Extend video (multi-segment concatenation):

python3 scripts/gen_video.py \
  --prompt "The scene in Video 1 transitions to Video 2, then continues with Video 3" \
  --videos "https://example.com/v1.mp4" "https://example.com/v2.mp4" "https://example.com/v3.mp4" \
  --duration 10

Video with audio + web search:

python3 scripts/gen_video.py \
  --prompt "Macro shot of a glass frog, showing its beating heart through its transparent abdomen" \
  --generate-audio \
  --web-search \
  --duration 8

Step 4: Get Results

After the script succeeds, it outputs the video URL, which is valid for 24 hours. Advise the user to download or transfer to TOS promptly.

Notes

• Face policy: Directly uploading images/videos containing real human faces is not supported. Use platform-provided virtual avatars (asset://asset-xxx) or authorized real-person assets.
• Video URL validity: Generated video URLs are valid for only 24 hours; save them promptly.
• Unsupported input combinations: "Text + Audio" or "Audio only" input is not supported.
• Adaptive aspect ratio: When using first/last frame images, it is recommended to set --ratio adaptive to avoid frame jumps.

Parameter Details

See references/api-guide.md