Generate AI images and videos using top-tier models including Sora 2, Kling 2.6, Seedance 2.0, Nano Banana Pro, Veo 3.1 and more. Supports text-to-image, tex...
设计与多媒体
modellix
试用通过统一的 MaaS API 异步执行图像、视频与音频生成任务,CLI 优先。
它能做什么
Modellix 把异步的图像、视频、音频工作流收敛到一套 API 后面。该技能以官方 `modellix-cli`(model run、task wait、task download)为主执行路径,preflight 脚本在每次付费提交前解析、升级并校验 CLI 状态。内置默认模型表覆盖文生图、文生视频、图编辑、图生视频、视频转视频、语音合成、语音转写和声音克隆;指定模型时通过 `model list` 与 `model describe` 发现,请求体 schema 来自只读 Docs MCP 或模型 `.md` 文件,不从文件名臆造 slug。API Key 遵循「发现 → 申请 → 临时使用 → 可选持久化」生命周期,REST 仅在 CLI 不可用或不适用时回退。
什么时候用它
- 用文本提示走默认模型生成图像或视频
- 编辑图像或将静帧图生成为视频(I2I / I2V)
- 用视频转视频模型改造已有视频
- 合成语音、转写音频或基于参考音频克隆音色
技能文档
Modellix Skill
Modellix is a Model-as-a-Service (MaaS) platform for asynchronous image, video, and audio workflows. Prefer the official CLI (modellix-cli) so submit, wait, and download stay one coherent workflow. Host-specific persistent session guardrails also ship under rules/*.mdc.
Official Docs
- AI Onboarding: https://docs.modellix.ai/get-started.md
- REST API: https://docs.modellix.ai/ways-to-use/api.md
- Full Models Index: https://docs.modellix.ai/llms.txt
- Docs MCP (search / read docs): https://docs.modellix.ai/mcp
- CLI package (source of truth for CLI behavior): https://www.npmjs.com/package/modellix-cli
Documentation lookup policy
This plugin may expose the Modellix Docs MCP (.mcp.json → https://docs.modellix.ai/mcp). It is a read-only documentation server (search_modellix, docs filesystem query, optional feedback). It does not submit generation tasks, poll, download, or handle API keys.
When looking up product/API/install docs or request-body schema:
- Prefer Docs MCP when the host has it connected (search, then read the matching page / OpenAPI chunk).
- Else use
modellix-cli model describe --json→docs_url, or browse https://docs.modellix.ai/llms.txt and fetch the model.md. - For CLI command syntax and flags, prefer this skill,
references/cli-playbook.md, the npm README, ormodellix-cli --help— do not trust website CLI pages over the CLI package (docs can lag).
If the Docs MCP exposes a skill resource, treat this SKILL.md as the execution policy source of truth (CLI-first, defaults, paid-submit safety).
Do not rely on the website CLI guide page for command syntax.
Execution Policy (CLI-first)
Choose the path in this order:
- CLI after
scripts/preflight.py --jsonresolves it. Preflight checks public npmlatest, installs only a newer exact version before execution, and keeps an existing CLI when update infrastructure is unavailable. - REST only when CLI is not installed, unsuitable, or missing a needed capability.
- Prefer machine-readable output (
--jsonor--quiet) for automation.
Canonical single-task flow:
python3 scripts/preflight.py --json
modellix-cli doctor --json
modellix-cli model run \
--model-slug \
--body '' \
--wait --timeout 5m --json
modellix-cli task download --output-dir ./outputs --json
model invoke is a compatibility alias of model run. New commands should use model run.
Do not reinvent polling loops when CLI wait is available. Do not invent deprecated flags (for example --model-type). Use --help only when behavior is unclear.
Default Models
When the user does not name a model, use these defaults immediately (do not scan the catalog first):
| Task Type | Default Model Slug |
|---|---|
| Text-to-image (T2I) | google/nano-banana-2-lite |
| Text-to-video (T2V) | bytedance/seedance-2.0-mini-t2v |
| Image editing / I2I | google/nano-banana-2-lite-edit |
| Image-to-video / I2V | bytedance/seedance-2.0-fast-i2v |
| Video-to-video (V2V) | bytedance/seedance-2.0-fast-v2v |
| Text-to-speech (TTS) | alibaba/qwen-audio-3.0-tts-flash |
| Speech-to-text (STT) | openai/whisper-1 |
| Speech-to-speech (STS) | alibaba/cosyvoice-clone |
API Key Lifecycle Policy
Handle credentials as: discover -> request -> use-session -> (optional) persist.
1) Discover existing key first
Before asking the user:
- Session / process env
MODELLIX_API_KEY - Saved CLI profile (
modellix-cli auth status/doctor— key via--profileorMODELLIX_PROFILEorcurrentProfile) - If still missing, request a key from the user
Never ask again when a usable key is already discoverable. CLI key resolution order is: --api-key → MODELLIX_API_KEY → selected saved profile.
2) Request key only when missing
- Ask for a key from Modellix Console.
- Do not print or echo key values.
- Prefer session env for the current run.
3) Optional persistence
Default: do not persist automatically.
When the user explicitly asks to persist:
- Preferred:
modellix-cli auth loginormodellix-cli init(CLI validates and stores the profile securely). - Alternative: user-level
MODELLIX_API_KEYonly if they insist on env persistence. - Do not write system-level env or other agents' config files.
4) Key rotation
If the user provides a new key: update session first; if they requested persistence, replace via auth login/init (or user-level env). Re-check with modellix-cli doctor --json (or scripts/preflight.py --json) before continuing.
Preflight and Deterministic Execution
Required first-workflow check when Python 3 is available:
python3 scripts/preflight.py --json
Bundled helpers:
scripts/preflight.py— checks public npmlatest, safely updates a missing/older global CLI before paid work, pins newer local installs instead of downgrading, wrapsdoctor, and recommendscli,rest, ornone.scripts/invoke_and_poll.py— performs the same resolution before submission, pins the resolved executable for the workflow, usesmodel run --waiton CLI, and otherwise keeps the REST submit+poll fallback.
Set MODELLIX_CLI_AUTO_UPDATE=0 (also accepts false or off) only when the environment must keep its installed CLI version. A registry/install failure is non-destructive: use the existing CLI if it still passes doctor, or REST when no CLI is usable and a session API key exists. Never update or swap the CLI after a paid submission has started.
When preflight/doctor reports missing credentials, apply the lifecycle above.
When CLI is unavailable:
- Use REST (
references/rest-playbook.md). - Report the preflight update warning; do not repeatedly attempt installation inside the same paid workflow.
Core Workflow
1) Ready the environment
- Discover or request API key (lifecycle above).
- Run
scripts/preflight.py --json; continue only with the CLI path whose doctor check passed, or with an authenticated REST fallback. - Continue only when auth and connectivity look healthy (or REST key is set).
2) Select model
- If the user did not specify a model: use the Default Models table (do not scan the catalog first).
- If they named a model or need discovery:
modellix-cli model list/modellix-cli model describe(describe returnsdocs_url). - For request body schema: prefer Docs MCP when available; else fetch the model doc (
docs_urlor the matching link from https://docs.modellix.ai/llms.txt) and read the OpenAPI path /model_id. Do not invent slugs from filenames (decimals often matter, e.g.bytedance/seedance-2.0-mini-t2v). - If CLI is unavailable for discovery: use Docs MCP or browse
llms.txt, then fetch the target model.md.
3) Run and wait
Default (single task):
modellix-cli model run \
--model-slug google/nano-banana-2-lite \
--body '{"prompt":"A cinematic sunset over a futuristic city skyline"}' \
--wait --timeout 5m --json
Split flow when useful (pipelines, concurrency):
TASK_ID=$(modellix-cli model run --model-slug ... --body '...' --output task-id)
modellix-cli task wait "$TASK_ID" --timeout 10m --json
Batch (paid guard required): modellix-cli model batch tasks.jsonl --max-tasks N [--wait].
Manual REST: references/rest-playbook.md. Optional helper: scripts/invoke_and_poll.py.
4) Download results
modellix-cli task download --output-dir ./outputs --json
If download fails with Resource host resolves to a private or reserved network address (common when a local proxy/VPN maps CDN hosts like file.modellix.ai into 198.18.0.0/15), retry with --allow-private-network for trusted Modellix CDN hosts, or fall back to downloading the result.resources[].url with curl/wget.
Resource URLs expire in about 7 days — persist promptly. If downloading manually (REST path), name files:
modellix-{model_slug}-{timestamp}.{ext}
(replace / in the slug with -).
Examples:
modellix-google-nano-banana-2-lite-20260430-113000.pngmodellix-bytedance-seedance-2.0-mini-t2v-20260430-113500.mp4
Quick Examples
T2I (default model) — prompt required:
modellix-cli model run \
--model-slug google/nano-banana-2-lite \
--body '{"prompt":"A cinematic sunset over a futuristic city skyline"}' \
--wait --timeout 5m --json
T2V (default model) — prompt required:
modellix-cli model run \
--model-slug bytedance/seedance-2.0-mini-t2v \
--body '{"prompt":"A cat playing in a sunny garden"}' \
--wait --timeout 10m --json
I2I — prompt + image array:
modellix-cli model run \
--model-slug google/nano-banana-2-lite-edit \
--body '{"prompt":"Convert to watercolor style","image":["https://example.com/input.jpg"]}' \
--wait --timeout 5m --json
I2V — at least one image param (first_frame_image, last_frame_image, or reference_images):
modellix-cli model run \
--model-slug bytedance/seedance-2.0-fast-i2v \
--body '{"prompt":"A cat playing in the garden","first_frame_image":"https://example.com/frame.jpg"}' \
--wait --timeout 10m --json
V2V — video_urls array:
modellix-cli model run \
--model-slug bytedance/seedance-2.0-fast-v2v \
--body '{"video_urls":["https://example.com/source.mp4"]}' \
--wait --timeout 10m --json
TTS (default model) — text + voice required (verify voice against the model doc; Flash voices only):
modellix-cli model run \
--model-slug alibaba/qwen-audio-3.0-tts-flash \
--body '{"text":"There is a large garden behind my house.","voice":"longanhuan_v3.6"}' \
--wait --timeout 5m --json
STT (default model) — public audio url required:
modellix-cli model run \
--model-slug openai/whisper-1 \
--body '{"url":"https://example.com/meeting.mp3"}' \
--wait --timeout 5m --json
STS (default model) — clone reference url + synthesis text + target CosyVoice model:
modellix-cli model run \
--model-slug alibaba/cosyvoice-clone \
--body '{"model":"cosyvoice-v3.5-plus","url":"https://example.com/reference.wav","text":"There is a large garden behind my house."}' \
--wait --timeout 5m --json
5) Post-task CLI recommendation
If this session used REST because CLI was missing, suggest installing the CLI afterward.
Progressive Reference Routing
Read only what the task needs:
references/cli-playbook.md— install, auth, run/wait/download, batch, recoveryreferences/rest-playbook.md— REST submit/poll when CLI is unavailablereferences/capability-matrix.md— CLI ↔ REST mapping and fallback rules
Bundled Assets
assets/output/task-result.schema.json
Credential and Data Egress
- Primary credential:
MODELLIX_API_KEY(also via CLI profiles). - Network egress:
https://api.modellix.ai(override only with trusted--base-url/MODELLIX_BASE_URL). - User prompts and media inputs may be sent to Modellix during invocation.
- Never expose API keys in logs, screenshots, transcripts, or commits.
- Default to session-only credentials; persistent writes need explicit user approval.
Error / Retry Policy
| Situation | Action |
|---|---|
HTTP/API 400 | Do not retry. Fix parameters or body. |
401 | Do not retry. Fix key (doctor, auth login). |
402 | Do not retry. Insufficient balance. |
404 | Do not retry. Verify task_id or model slug. |
429 / read-only 5xx | CLI already retries safe GETs within deadline; do not blindly re-POST paid submits. |
| Paid submit outcome unknown | Do not immediately re-run the same model run. Check task history, console activity, and any printed task ID first. |
Exit 124 | Local wait timeout; remote task may still run — recover with task wait / task get, then task download. |
Exit 2 | Argument or safety guard (e.g. batch cost limit) — fix flags. |
Verification Checklist
- Doctor/preflight passed or REST key ready
- Model chosen (default table or user/catalog)
- Body schema checked against model doc when non-trivial
- Used
model run --wait(ortask wait) instead of hand-rolled poll loops - Results downloaded (
task downloador manual persist before 7-day expiry) - No blind retry after unknown paid submission
- REST used only when CLI path unavailable
相关技能
按意图把图像、视频、音频请求分发到合适的 dlazy CLI 模型。
Powerful video generation with Kling v3. Supports high-quality text-to-video and image-to-video. 使用可灵 (Kling) v3 强大的视频生成模型,支持高质量的文生视频与图生视频。
一条命令把一段描述变成图片、视频、配音、音乐、音效以及完整的播客节目。
通过 Wuli.art 开放平台 API,一个命令行即可调用 25+ 图像与视频生成模型。
AI video generation powered by CellCog via Seedance 2.5. Complete multi-minute videos from a single prompt: scripting, voice synthesis, lipsync, scoring, editing, with locked character consistency via 50 reference files. Full productions, not just clips, via ByteDance's Seedance model.