MiniMax H3 (ComfyUI) R2V workflow with SLA sparse attention - 0.6MP 10s in 3m12s on RTX 3080 10GB
翻译
MiniMax H3 R2V ワークフロー(SLA 疎注意つき / ComfyUI)
RTX 3080 10GB で 0.6MP・10秒の R2V が 3分12秒で回る構成です。
必要なもの
ComfyUI 0.33.0 以降(動作確認は 0.33.1 / torch 2.13+cu130)
カスタムノード
cd ComfyUI/custom_nodes
git clone https://github.com/PlagueKind/ComfyUI-PlagueKind-Nodes
H3SLAAttention を使うためのものです。MIT、Triton が必要(sageattention が入っていれば通常は入っています)。
モデル(すべて Comfy-Org/MiniMax-H3 から)
| ファイル | 置き場所 |
|---|---|
minimax_h3_ref2va_pruned_int8_convrot.safetensors | models/diffusion_models/ |
qwen3vl_32b_minimax_h3_nvfp4_awq.safetensors | models/text_encoders/ |
minimax_h3_video_vae_fp16.safetensors | models/vae/ |
minimax_h3_audio_vae_fp32.safetensors | models/vae/ |
turbo LoRA(models/loras/ に置く)
- 4step: Kijai/MiniMax-H3_comfy の
minimax_h3_fl2v_lightx2v_turbo_4step_v0.1_comfy_resized_avg_rank_21_bf16.safetensors - 8step: drbaph/MiniMax-H3-Turbo-Lora-ComfyUI の
minimax_h3_turbo_4step_ckpt850_pruned_comfyui.safetensors
起動フラグ
--vram-headroom 2.0 --use-sage-attention --disable-pinned-memory
--disable-pinned-memory は強く推奨します。無いと ComfyUI が RAM の40%をページアウト不能に固定し、バッチや構成切り替えで空きRAMが枯れて同じ設定が4倍遅くなります。GPU使用率100%・消費電力は定格のまま遅くなるので外形からは判りません。単発では10%遅くなりますが、その価値があります。
この構成の実測(RTX 3080 10GB / 0.6MP 608x1056 / 10.125秒 / 参照2枚 / 同一シード)
| 構成 | サンプリング | 総所要 |
|---|---|---|
| sage のみ・ckpt850 8step | 7分48秒 | 9分42秒 |
| sage + SLA・ckpt850 8step | 3分57秒 | 5分31秒 |
| sage + SLA + nopin・lightx2v 4step | 2分03秒 | 3分12秒 |
同梱の JSON は最後の構成(lightx2v 4step)です。
使い分け
| step | LoRA | sampler | |
|---|---|---|---|
| 静かなカット | 4 | lightx2v(strength 0.75) | er_sde |
| 動きのあるカット | 8 | ckpt850(strength 1.0) | res_multistep |
速い動きは 4step で破綻します(武器を薙ぐ、ダンス等)。8step で解消します。
SLA ノードの設定
| 項目 | 値 | 理由 |
|---|---|---|
| 配置 | チェーンの最後、Scheduler と Guider の両方に直結 | 作者の必須要件。外すと効かない |
| sparsity_ratio | 0.90 | break-even は 0.60。それ以下では密より遅い |
| block_size | 64 | 128 は台詞が robotic になる。H3 は音声を毎秒80行で詰めるため |
| protect_audio | オン | 音声は系列の約1%しかなく、切ると音だけ劣化する。コスト約7% |
| min_seq_len | 8192 | これ未満の系列は自動的に密に戻る(低解像度・短尺では効かない) |
効いているかは stderr のログで確認できます。
SLA: 400 calls | S=49826 | blocks 151/779 kept (80.6% sparse) | 0 dense fall-throughs | displaced attention_sage
displaced attention_pytorch と出たら sage が無効です。
音声の sigma shift は 12.0 / 3.0
MiniMaxH3SigmaShift の音声側は 3.0 が正です。6.0 にすると 4step で音声を踏み越えてノイズになります。turbo 使用時の音声ノイズはほぼこれが原因です。
差し替えるところ
- プロンプト(プレースホルダが入っています)
example_character.png/example_background.pngを自分の参照画像に- 出力先
H3/output
背景を固定したいカットが複数ある場合は、背景の一枚絵を2枚目の参照に入れてください。本文で空間を細かく書いても、参照が無いとカットごとに別の場所になります。
| { | |
| "id": "e3f2b845-8f2c-4b5a-9caf-eac1029d3e7e", | |
| "revision": 0, | |
| "last_node_id": 146, | |
| "last_link_id": 299, | |
| "nodes": [ | |
| { | |
| "id": 92, | |
| "type": "SaveVideo", | |
| "pos": [ | |
| 1150, | |
| 4880 | |
| ], | |
| "size": [ | |
| 1210, | |
| 126 | |
| ], | |
| "flags": {}, | |
| "order": 22, | |
| "mode": 0, | |
| "inputs": [ | |
| { | |
| "name": "video", | |
| "type": "VIDEO", | |
| "link": 260 | |
| } | |
| ], | |
| "outputs": [ | |
| { | |
| "name": "video", | |
| "type": "VIDEO", | |
| "links": null | |
| } | |
| ], | |
| "properties": {}, | |
| "widgets_values": [ | |
| "H3/output", | |
| "auto", | |
| "auto" | |
| ] | |
| }, | |
| { | |
| "id": 115, | |
| "type": "ResolutionSelector", | |
| "pos": [ | |
| -1480, | |
| 5610 | |
| ], | |
| "size": [ | |
| 270, | |
| 170 | |
| ], | |
| "flags": {}, | |
| "order": 0, | |
| "mode": 0, | |
| "showAdvanced": false, | |
| "inputs": [], | |
| "outputs": [ | |
| { | |
| "name": "width", | |
| "type": "INT", | |
| "links": [ | |
| 276 | |
| ] | |
| }, | |
| { | |
| "name": "height", | |
| "type": "INT", | |
| "links": [ | |
| 277 | |
| ] | |
| } | |
| ], | |
| "title": "Resolution Selector (Size)", | |
| "properties": { | |
| "Node name for S&R": "ResolutionSelector" | |
| }, | |
| "widgets_values": [ | |
| "9:16 (Portrait Widescreen)", | |
| 0.6, | |
| 32 | |
| ], | |
| "color": "#322", | |
| "bgcolor": "#533" | |
| }, | |
| { | |
| "id": 116, | |
| "type": "MarkdownNote", | |
| "pos": [ | |
| -2030, | |
| 4850 | |
| ], | |
| "size": [ | |
| 450, | |
| 889.6875 | |
| ], | |
| "flags": {}, | |
| "order": 1, | |
| "mode": 0, | |
| "inputs": [], | |
| "outputs": [], | |
| "title": "Note: MiniMax H3", | |
| "properties": {}, | |
| "widgets_values": [ | |
| "## MiniMax H3\n\n[MiniMax H3](https://www.minimax.io/blog/minimax-h3) is MiniMax's general-purpose, omni-modal generation model. It jointly understands text, image, video, and audio, and generates video with **native stereo audio**: voice, sound effects, and music are modeled jointly in a single forward pass, not layered on afterward. Output is up to 2K resolution, 24fps, and up to about 15 seconds.\n\n## ComfyUI links\n- [ComfyUI#15224](https://github.com/Comfy-Org/ComfyUI/pull/15224)\n- [🤗 Comfy-Org/MiniMax-H3](https://huggingface.co/Comfy-Org/MiniMax-H3)\n\n## About this workflow\n\nThis template runs the **reference-to-video (ref2va)** task using the `MiniMaxH3ReferenceToVideo` node. It takes any mix of reference images, videos, and standalone audio, and weaves them into the generation to lock in a character's identity, a style, a motion, a camera move, or a voice.\n\n**Key inputs**\n\n- **ref_images / ref_videos / ref_video_audios / ref_audios**: up to 9 reference images, 3 reference videos (each may carry its own paired soundtrack), and 3 standalone reference audio clips\n- **prompt**: reference the inputs by tag, in the exact order they were connected, for example ``, ` | |
| ], | |
| "color": "#222", | |
| "bgcolor": "#000" | |
| }, | |
| { | |
| "id": 117, | |
| "type": "MarkdownNote", | |
| "pos": [ | |
| -2500, | |
| 4850 | |
| ], | |
| "size": [ | |
| 440, | |
| 740 | |
| ], | |
| "flags": {}, | |
| "order": 2, | |
| "mode": 0, | |
| "inputs": [], | |
| "outputs": [], | |
| "title": "Note: Model Links", | |
| "properties": {}, | |
| "widgets_values": [ | |
| "## Model Links\n[🤗 Comfy-Org/MiniMax-H3](https://huggingface.co/Comfy-Org/MiniMax-H3)\n\n**vae**\n\n- [minimax_h3_video_vae_fp16.safetensors](https://huggingface.co/Comfy-Org/MiniMax-H3/resolve/main/vae/minimax_h3_video_vae_fp16.safetensors)\n- [minimax_h3_audio_vae_fp32.safetensors](https://huggingface.co/Comfy-Org/MiniMax-H3/resolve/main/vae/minimax_h3_audio_vae_fp32.safetensors)\n\n**diffusion_models**\n\n- [minimax_h3_ref2va_pruned_int8_convrot.safetensors](https://huggingface.co/Comfy-Org/MiniMax-H3/resolve/main/diffusion_models/minimax_h3_ref2va_pruned_int8_convrot.safetensors)\n\n**text_encoders**\n\n- [qwen3vl_32b_minimax_h3_nvfp4_awq.safetensors](https://huggingface.co/Comfy-Org/MiniMax-H3/resolve/main/text_encoders/qwen3vl_32b_minimax_h3_nvfp4_awq.safetensors)\n\n\n## Model Storage Location\n\n```\n📂 ComfyUI/\n├── 📂 models/\n│ ├── 📂 vae/\n│ │ ├── minimax_h3_video_vae_fp16.safetensors\n│ │ └── minimax_h3_audio_vae_fp32.safetensors\n│ ├── 📂 diffusion_models/\n│ │ └── minimax_h3_ref2va_pruned_int8_convrot.safetensors\n│ └── 📂 text_encoders/\n│ └── qwen3vl_32b_minimax_h3_nvfp4_awq.safetensors\n```\n\n## Report Issue\n\nNote: Please update ComfyUI first ([guide](https://docs.comfy.org/installation/update_comfyui)) and prepare required models. Desktop/Cloud updates follow stable releases, so some nightly-supported models may not be available yet.\n\n- Cannot run / runtime errors: [ComfyUI/issues](https://github.com/comfyanonymous/ComfyUI/issues)\n- UI / frontend issues: [ComfyUI_frontend/issues](https://github.com/Comfy-Org/ComfyUI_frontend/issues)\n- Workflow issues: [workflow_templates/issues](https://github.com/Comfy-Org/workflow_templates/issues)\n" | |
| ], | |
| "color": "#222", | |
| "bgcolor": "#000" | |
| }, | |
| { | |
| "id": 119, | |
| "type": "VAELoader", | |
| "pos": [ | |
| -1490, | |
| 5270 | |
| ], | |
| "size": [ | |
| 640, | |
| 70 | |
| ], | |
| "flags": {}, | |
| "order": 3, | |
| "mode": 0, | |
| "inputs": [], | |
| "outputs": [ | |
| { | |
| "name": "VAE", | |
| "type": "VAE", | |
| "links": [ | |
| 251, | |
| 273 | |
| ] | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "VAELoader", | |
| "models": [ | |
| { | |
| "name": "minimax_h3_video_vae_fp16.safetensors", | |
| "url": "https://huggingface.co/Comfy-Org/MiniMax-H3/resolve/main/vae/minimax_h3_video_vae_fp16.safetensors", | |
| "directory": "vae" | |
| } | |
| ] | |
| }, | |
| "widgets_values": [ | |
| "minimax_h3_video_vae_fp16.safetensors" | |
| ] | |
| }, | |
| { | |
| "id": 120, | |
| "type": "VAELoader", | |
| "pos": [ | |
| -1490, | |
| 5400 | |
| ], | |
| "size": [ | |
| 650, | |
| 70 | |
| ], | |
| "flags": {}, | |
| "order": 4, | |
| "mode": 0, | |
| "inputs": [], | |
| "outputs": [ | |
| { | |
| "name": "VAE", | |
| "type": "VAE", | |
| "links": [ | |
| 250, | |
| 274 | |
| ] | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "VAELoader", | |
| "models": [ | |
| { | |
| "name": "minimax_h3_audio_vae_fp32.safetensors", | |
| "url": "https://huggingface.co/Comfy-Org/MiniMax-H3/resolve/main/vae/minimax_h3_audio_vae_fp32.safetensors", | |
| "directory": "vae" | |
| } | |
| ] | |
| }, | |
| "widgets_values": [ | |
| "minimax_h3_audio_vae_fp32.safetensors" | |
| ] | |
| }, | |
| { | |
| "id": 121, | |
| "type": "VAEDecodeAudio", | |
| "pos": [ | |
| 480, | |
| 5180 | |
| ], | |
| "size": [ | |
| 230, | |
| 60 | |
| ], | |
| "flags": { | |
| "collapsed": false | |
| }, | |
| "order": 20, | |
| "mode": 0, | |
| "inputs": [ | |
| { | |
| "name": "samples", | |
| "type": "LATENT", | |
| "link": 281 | |
| }, | |
| { | |
| "name": "vae", | |
| "type": "VAE", | |
| "link": 250 | |
| } | |
| ], | |
| "outputs": [ | |
| { | |
| "name": "AUDIO", | |
| "type": "AUDIO", | |
| "links": [ | |
| 259 | |
| ] | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "VAEDecodeAudio" | |
| }, | |
| "widgets_values": [] | |
| }, | |
| { | |
| "id": 122, | |
| "type": "VAEDecode", | |
| "pos": [ | |
| 480, | |
| 5060 | |
| ], | |
| "size": [ | |
| 230, | |
| 60 | |
| ], | |
| "flags": { | |
| "collapsed": false | |
| }, | |
| "order": 19, | |
| "mode": 0, | |
| "inputs": [ | |
| { | |
| "name": "samples", | |
| "type": "LATENT", | |
| "link": 280 | |
| }, | |
| { | |
| "name": "vae", | |
| "type": "VAE", | |
| "link": 251 | |
| } | |
| ], | |
| "outputs": [ | |
| { | |
| "name": "IMAGE", | |
| "type": "IMAGE", | |
| "links": [ | |
| 284 | |
| ] | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "VAEDecode" | |
| }, | |
| "widgets_values": [] | |
| }, | |
| { | |
| "id": 123, | |
| "type": "KSamplerSelect", | |
| "pos": [ | |
| -260, | |
| 5190 | |
| ], | |
| "size": [ | |
| 370, | |
| 70 | |
| ], | |
| "flags": {}, | |
| "order": 5, | |
| "mode": 0, | |
| "inputs": [], | |
| "outputs": [ | |
| { | |
| "name": "SAMPLER", | |
| "type": "SAMPLER", | |
| "links": [ | |
| 255 | |
| ] | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "KSamplerSelect" | |
| }, | |
| "widgets_values": [ | |
| "er_sde" | |
| ] | |
| }, | |
| { | |
| "id": 124, | |
| "type": "BasicScheduler", | |
| "pos": [ | |
| -260, | |
| 5310 | |
| ], | |
| "size": [ | |
| 370, | |
| 130 | |
| ], | |
| "flags": {}, | |
| "order": 14, | |
| "mode": 0, | |
| "inputs": [ | |
| { | |
| "name": "model", | |
| "type": "MODEL", | |
| "link": 287 | |
| } | |
| ], | |
| "outputs": [ | |
| { | |
| "name": "SIGMAS", | |
| "type": "SIGMAS", | |
| "links": [ | |
| 256 | |
| ] | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "BasicScheduler" | |
| }, | |
| "widgets_values": [ | |
| "simple", | |
| 4, | |
| 1 | |
| ] | |
| }, | |
| { | |
| "id": 125, | |
| "type": "SamplerCustomAdvanced", | |
| "pos": [ | |
| 150, | |
| 5110 | |
| ], | |
| "size": [ | |
| 230, | |
| 140 | |
| ], | |
| "flags": {}, | |
| "order": 18, | |
| "mode": 0, | |
| "inputs": [ | |
| { | |
| "name": "noise", | |
| "type": "NOISE", | |
| "link": 253 | |
| }, | |
| { | |
| "name": "guider", | |
| "type": "GUIDER", | |
| "link": 254 | |
| }, | |
| { | |
| "name": "sampler", | |
| "type": "SAMPLER", | |
| "link": 255 | |
| }, | |
| { | |
| "name": "sigmas", | |
| "type": "SIGMAS", | |
| "link": 256 | |
| }, | |
| { | |
| "name": "latent_image", | |
| "type": "LATENT", | |
| "link": 271 | |
| } | |
| ], | |
| "outputs": [ | |
| { | |
| "name": "output", | |
| "type": "LATENT", | |
| "links": [ | |
| 280, | |
| 281 | |
| ] | |
| }, | |
| { | |
| "name": "denoised_output", | |
| "type": "LATENT", | |
| "links": [] | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "SamplerCustomAdvanced" | |
| }, | |
| "widgets_values": [] | |
| }, | |
| { | |
| "id": 126, | |
| "type": "BasicGuider", | |
| "pos": [ | |
| -260, | |
| 5080 | |
| ], | |
| "size": [ | |
| 360, | |
| 60 | |
| ], | |
| "flags": {}, | |
| "order": 17, | |
| "mode": 0, | |
| "inputs": [ | |
| { | |
| "name": "model", | |
| "type": "MODEL", | |
| "link": 288 | |
| }, | |
| { | |
| "name": "conditioning", | |
| "type": "CONDITIONING", | |
| "link": 270 | |
| } | |
| ], | |
| "outputs": [ | |
| { | |
| "name": "GUIDER", | |
| "type": "GUIDER", | |
| "links": [ | |
| 254 | |
| ] | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "BasicGuider" | |
| }, | |
| "widgets_values": [] | |
| }, | |
| { | |
| "id": 127, | |
| "type": "UNETLoader", | |
| "pos": [ | |
| -1490, | |
| 4940 | |
| ], | |
| "size": [ | |
| 640, | |
| 90 | |
| ], | |
| "flags": {}, | |
| "order": 6, | |
| "mode": 0, | |
| "inputs": [], | |
| "outputs": [ | |
| { | |
| "name": "MODEL", | |
| "type": "MODEL", | |
| "links": [ | |
| 293 | |
| ] | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "UNETLoader", | |
| "models": [ | |
| { | |
| "name": "minimax_h3_ref2va_pruned_int8_convrot.safetensors", | |
| "url": "https://huggingface.co/Comfy-Org/MiniMax-H3/resolve/main/diffusion_models/minimax_h3_ref2va_pruned_int8_convrot.safetensors", | |
| "directory": "diffusion_models" | |
| } | |
| ] | |
| }, | |
| "widgets_values": [ | |
| "minimax_h3_ref2va_pruned_int8_convrot.safetensors", | |
| "default" | |
| ] | |
| }, | |
| { | |
| "id": 128, | |
| "type": "CLIPLoader", | |
| "pos": [ | |
| -1490, | |
| 5090 | |
| ], | |
| "size": [ | |
| 640, | |
| 120 | |
| ], | |
| "flags": {}, | |
| "order": 7, | |
| "mode": 0, | |
| "inputs": [], | |
| "outputs": [ | |
| { | |
| "name": "CLIP", | |
| "type": "CLIP", | |
| "links": [ | |
| 272 | |
| ] | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "CLIPLoader", | |
| "models": [ | |
| { | |
| "name": "qwen3vl_32b_minimax_h3_nvfp4_awq.safetensors", | |
| "url": "https://huggingface.co/Comfy-Org/MiniMax-H3/resolve/main/text_encoders/qwen3vl_32b_minimax_h3_nvfp4_awq.safetensors", | |
| "directory": "text_encoders" | |
| } | |
| ] | |
| }, | |
| "widgets_values": [ | |
| "qwen3vl_32b_minimax_h3_nvfp4_awq.safetensors", | |
| "minimax", | |
| "default" | |
| ] | |
| }, | |
| { | |
| "id": 129, | |
| "type": "RandomNoise", | |
| "pos": [ | |
| -260, | |
| 4940 | |
| ], | |
| "size": [ | |
| 360, | |
| 90 | |
| ], | |
| "flags": {}, | |
| "order": 8, | |
| "mode": 0, | |
| "inputs": [], | |
| "outputs": [ | |
| { | |
| "name": "NOISE", | |
| "type": "NOISE", | |
| "links": [ | |
| 253 | |
| ] | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "RandomNoise" | |
| }, | |
| "widgets_values": [ | |
| 0, | |
| "randomize" | |
| ] | |
| }, | |
| { | |
| "id": 130, | |
| "type": "CreateVideo", | |
| "pos": [ | |
| 790, | |
| 5090 | |
| ], | |
| "size": [ | |
| 270, | |
| 110 | |
| ], | |
| "flags": {}, | |
| "order": 21, | |
| "mode": 0, | |
| "inputs": [ | |
| { | |
| "name": "images", | |
| "type": "IMAGE", | |
| "link": 290 | |
| }, | |
| { | |
| "name": "audio", | |
| "shape": 7, | |
| "type": "AUDIO", | |
| "link": 259 | |
| } | |
| ], | |
| "outputs": [ | |
| { | |
| "name": "VIDEO", | |
| "type": "VIDEO", | |
| "links": [ | |
| 260 | |
| ] | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "CreateVideo" | |
| }, | |
| "widgets_values": [ | |
| 24, | |
| 8 | |
| ] | |
| }, | |
| { | |
| "id": 131, | |
| "type": "ComfyMathExpression", | |
| "pos": [ | |
| -1450, | |
| 5940 | |
| ], | |
| "size": [ | |
| 225, | |
| 0 | |
| ], | |
| "flags": { | |
| "collapsed": true | |
| }, | |
| "order": 15, | |
| "mode": 0, | |
| "inputs": [ | |
| { | |
| "label": "a", | |
| "name": "values.a", | |
| "type": "FLOAT,INT,BOOLEAN", | |
| "link": 261 | |
| }, | |
| { | |
| "label": "b", | |
| "name": "values.b", | |
| "shape": 7, | |
| "type": "FLOAT,INT,BOOLEAN", | |
| "link": null | |
| } | |
| ], | |
| "outputs": [ | |
| { | |
| "name": "FLOAT", | |
| "type": "FLOAT", | |
| "links": [] | |
| }, | |
| { | |
| "name": "INT", | |
| "type": "INT", | |
| "links": [ | |
| 275 | |
| ] | |
| }, | |
| { | |
| "name": "BOOL", | |
| "type": "BOOLEAN", | |
| "links": [] | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "ComfyMathExpression" | |
| }, | |
| "widgets_values": [ | |
| "max(5, round(a * 24)) + (5 - (max(5, round(a * 24)) % 17)) % 17" | |
| ] | |
| }, | |
| { | |
| "id": 132, | |
| "type": "PrimitiveFloat", | |
| "pos": [ | |
| -1480, | |
| 5830 | |
| ], | |
| "size": [ | |
| 270, | |
| 70 | |
| ], | |
| "flags": {}, | |
| "order": 9, | |
| "mode": 0, | |
| "inputs": [], | |
| "outputs": [ | |
| { | |
| "name": "FLOAT", | |
| "type": "FLOAT", | |
| "links": [ | |
| 261 | |
| ] | |
| } | |
| ], | |
| "title": "Float (Duration)", | |
| "properties": { | |
| "Node name for S&R": "PrimitiveFloat" | |
| }, | |
| "widgets_values": [ | |
| 10.0 | |
| ], | |
| "color": "#322", | |
| "bgcolor": "#533" | |
| }, | |
| { | |
| "id": 136, | |
| "type": "MiniMaxH3ReferenceToVideo", | |
| "pos": [ | |
| -750, | |
| 4940 | |
| ], | |
| "size": [ | |
| 410, | |
| 530 | |
| ], | |
| "flags": {}, | |
| "order": 16, | |
| "mode": 0, | |
| "inputs": [ | |
| { | |
| "name": "clip", | |
| "type": "CLIP", | |
| "link": 272 | |
| }, | |
| { | |
| "name": "vae", | |
| "type": "VAE", | |
| "link": 273 | |
| }, | |
| { | |
| "name": "audio_vae", | |
| "type": "VAE", | |
| "link": 274 | |
| }, | |
| { | |
| "label": "ref_image_0", | |
| "name": "ref_images.ref_image_0", | |
| "shape": 7, | |
| "type": "IMAGE", | |
| "link": 278 | |
| }, | |
| { | |
| "label": "ref_image_1", | |
| "name": "ref_images.ref_image_1", | |
| "shape": 7, | |
| "type": "IMAGE", | |
| "link": 299 | |
| }, | |
| { | |
| "label": "ref_image_2", | |
| "name": "ref_images.ref_image_2", | |
| "shape": 7, | |
| "type": "IMAGE", | |
| "link": null | |
| }, | |
| { | |
| "label": "ref_video_0", | |
| "name": "ref_videos.ref_video_0", | |
| "shape": 7, | |
| "type": "IMAGE", | |
| "link": null | |
| }, | |
| { | |
| "label": "ref_video_audio_0", | |
| "name": "ref_video_audios.ref_video_audio_0", | |
| "shape": 7, | |
| "type": "AUDIO", | |
| "link": null | |
| }, | |
| { | |
| "label": "ref_audio_0", | |
| "name": "ref_audios.ref_audio_0", | |
| "shape": 7, | |
| "type": "AUDIO", | |
| "link": null | |
| }, | |
| { | |
| "name": "prompt", | |
| "type": "STRING", | |
| "widget": { | |
| "name": "prompt" | |
| }, | |
| "link": 279 | |
| }, | |
| { | |
| "name": "width", | |
| "type": "INT", | |
| "widget": { | |
| "name": "width" | |
| }, | |
| "link": 276 | |
| }, | |
| { | |
| "name": "height", | |
| "type": "INT", | |
| "widget": { | |
| "name": "height" | |
| }, | |
| "link": 277 | |
| }, | |
| { | |
| "name": "length", | |
| "type": "INT", | |
| "widget": { | |
| "name": "length" | |
| }, | |
| "link": 275 | |
| } | |
| ], | |
| "outputs": [ | |
| { | |
| "name": "positive", | |
| "type": "CONDITIONING", | |
| "links": [ | |
| 270 | |
| ] | |
| }, | |
| { | |
| "name": "LATENT", | |
| "type": "LATENT", | |
| "links": [ | |
| 271 | |
| ] | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "MiniMaxH3ReferenceToVideo" | |
| }, | |
| "widgets_values": [ | |
| "", | |
| 1344, | |
| 768, | |
| 124, | |
| "match" | |
| ] | |
| }, | |
| { | |
| "id": 137, | |
| "type": "LoadImage", | |
| "pos": [ | |
| -930, | |
| 5630 | |
| ], | |
| "size": [ | |
| 290, | |
| 330 | |
| ], | |
| "flags": {}, | |
| "order": 10, | |
| "mode": 0, | |
| "inputs": [], | |
| "outputs": [ | |
| { | |
| "name": "IMAGE", | |
| "type": "IMAGE", | |
| "links": [ | |
| 278 | |
| ] | |
| }, | |
| { | |
| "name": "MASK", | |
| "type": "MASK", | |
| "links": null | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "LoadImage" | |
| }, | |
| "widgets_values": [ | |
| "example_character.png", | |
| "image" | |
| ] | |
| }, | |
| { | |
| "id": 138, | |
| "type": "PrimitiveStringMultiline", | |
| "pos": [ | |
| -1480, | |
| 6000 | |
| ], | |
| "size": [ | |
| 370, | |
| 390 | |
| ], | |
| "flags": {}, | |
| "order": 11, | |
| "mode": 0, | |
| "inputs": [], | |
| "outputs": [ | |
| { | |
| "name": "STRING", | |
| "type": "STRING", | |
| "links": [ | |
| 279 | |
| ] | |
| } | |
| ], | |
| "title": "Input Text (Prompt)", | |
| "properties": { | |
| "Node name for S&R": "PrimitiveStringMultiline" | |
| }, | |
| "widgets_values": [ | |
| "subject_definitions:\n (source: the reference picture) — describe the character here.\n\nsummary:\n[reference generation] one or two sentences.\n\nretention_analysis:\n (appears in [Shot 1]): partially_preserved - what is kept, what is not.\n\ndetailed_description:\n[Shot 1] one continuous shot. Describe camera, framing and action here.\n\noverall_soundscape:\nDiegetic sounds only.\n\nnon_diegetic_music:\nN/A - no score, no soundtrack, no musical arrangement at any point." | |
| ], | |
| "color": "#322", | |
| "bgcolor": "#533" | |
| }, | |
| { | |
| "id": 139, | |
| "type": "LoadImage", | |
| "pos": [ | |
| -580, | |
| 5630 | |
| ], | |
| "size": [ | |
| 290, | |
| 330 | |
| ], | |
| "flags": {}, | |
| "order": 12, | |
| "mode": 0, | |
| "inputs": [], | |
| "outputs": [ | |
| { | |
| "name": "IMAGE", | |
| "type": "IMAGE", | |
| "links": [ | |
| 299 | |
| ] | |
| }, | |
| { | |
| "name": "MASK", | |
| "type": "MASK", | |
| "links": null | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "LoadImage" | |
| }, | |
| "widgets_values": [ | |
| "example_background.png", | |
| "image" | |
| ] | |
| }, | |
| { | |
| "id": 140, | |
| "type": "MarkdownNote", | |
| "pos": [ | |
| -1890, | |
| 5830 | |
| ], | |
| "size": [ | |
| 300, | |
| 520 | |
| ], | |
| "flags": {}, | |
| "order": 13, | |
| "mode": 0, | |
| "inputs": [], | |
| "outputs": [], | |
| "title": "Note: Size Settings Reference", | |
| "properties": {}, | |
| "widgets_values": [ | |
| "| megapixels | Aspect | Output (multiple=32) |\n|---|---|---|\n| 0.2 | 16:9 | 608 x 352 |\n| 0.3 | 16:9 | 736 x 416 |\n| 0.4 | 16:9 | 864 x 480 |\n| 0.5 | 16:9 | 960 x 544 |\n| 0.6 | 16:9 | 1056 x 608 |\n| 0.7 | 16:9 | 1152 x 640 |\n| 0.8 | 16:9 | 1216 x 672 |\n| 0.9 | 16:9 | 1280 x 736 |\n| 0.98 | 16:9 | 1344 x 768 |\n| 1.0 | 16:9 | 1376 x 768 |\n| 1.2 | 16:9 | 1504 x 832 |\n| 1.5 | 16:9 | 1664 x 928 |\n| 1.8 | 16:9 | 1824 x 1024 |\n| 2.0 | 16:9 | 1920 x 1088 |\n" | |
| ], | |
| "color": "#222", | |
| "bgcolor": "#000" | |
| }, | |
| { | |
| "id": 141, | |
| "type": "UpscaleModelLoader", | |
| "pos": [ | |
| 480, | |
| 5280 | |
| ], | |
| "size": [ | |
| 320, | |
| 60 | |
| ], | |
| "flags": {}, | |
| "order": 90, | |
| "mode": 4, | |
| "inputs": [], | |
| "outputs": [ | |
| { | |
| "name": "UPSCALE_MODEL", | |
| "type": "UPSCALE_MODEL", | |
| "links": [ | |
| 283 | |
| ] | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "UpscaleModelLoader" | |
| }, | |
| "widgets_values": [ | |
| "4x-UltraSharp.pth" | |
| ] | |
| }, | |
| { | |
| "id": 142, | |
| "type": "ImageUpscaleWithModel", | |
| "pos": [ | |
| 840, | |
| 5280 | |
| ], | |
| "size": [ | |
| 280, | |
| 50 | |
| ], | |
| "flags": {}, | |
| "order": 91, | |
| "mode": 4, | |
| "inputs": [ | |
| { | |
| "name": "upscale_model", | |
| "type": "UPSCALE_MODEL", | |
| "link": 283 | |
| }, | |
| { | |
| "name": "image", | |
| "type": "IMAGE", | |
| "link": 284 | |
| } | |
| ], | |
| "outputs": [ | |
| { | |
| "name": "IMAGE", | |
| "type": "IMAGE", | |
| "links": [ | |
| 289 | |
| ] | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "ImageUpscaleWithModel" | |
| }, | |
| "widgets_values": [] | |
| }, | |
| { | |
| "id": 143, | |
| "type": "EasyCache", | |
| "pos": [ | |
| -1490, | |
| 5120 | |
| ], | |
| "size": [ | |
| 300, | |
| 130 | |
| ], | |
| "flags": {}, | |
| "order": 7, | |
| "mode": 4, | |
| "inputs": [ | |
| { | |
| "name": "model", | |
| "type": "MODEL", | |
| "link": 292 | |
| } | |
| ], | |
| "outputs": [ | |
| { | |
| "name": "MODEL", | |
| "type": "MODEL", | |
| "links": [ | |
| 298 | |
| ] | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "EasyCache" | |
| }, | |
| "widgets_values": [ | |
| 0.2, | |
| 0.15, | |
| 0.95, | |
| false | |
| ] | |
| }, | |
| { | |
| "id": 144, | |
| "type": "ImageScale", | |
| "pos": [ | |
| 1200, | |
| 5280 | |
| ], | |
| "size": [ | |
| 300, | |
| 130 | |
| ], | |
| "flags": {}, | |
| "order": 92, | |
| "mode": 4, | |
| "inputs": [ | |
| { | |
| "name": "image", | |
| "type": "IMAGE", | |
| "link": 289 | |
| } | |
| ], | |
| "outputs": [ | |
| { | |
| "name": "IMAGE", | |
| "type": "IMAGE", | |
| "links": [ | |
| 290 | |
| ] | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "ImageScale" | |
| }, | |
| "widgets_values": [ | |
| "lanczos", | |
| 1920, | |
| 1088, | |
| "disabled" | |
| ] | |
| }, | |
| { | |
| "id": 145, | |
| "type": "MiniMaxH3SigmaShift", | |
| "pos": [ | |
| -1490, | |
| 5120 | |
| ], | |
| "size": [ | |
| 340, | |
| 100 | |
| ], | |
| "flags": {}, | |
| "order": 7, | |
| "mode": 0, | |
| "inputs": [ | |
| { | |
| "name": "model", | |
| "type": "MODEL", | |
| "link": 294 | |
| } | |
| ], | |
| "outputs": [ | |
| { | |
| "name": "MODEL", | |
| "type": "MODEL", | |
| "links": [ | |
| 292 | |
| ] | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "MiniMaxH3SigmaShift" | |
| }, | |
| "widgets_values": [ | |
| 12.0, | |
| 3.0 | |
| ] | |
| }, | |
| { | |
| "id": 146, | |
| "type": "LoraLoaderModelOnly", | |
| "pos": [ | |
| -1490, | |
| 5030 | |
| ], | |
| "size": [ | |
| 340, | |
| 100 | |
| ], | |
| "flags": {}, | |
| "order": 7, | |
| "mode": 0, | |
| "inputs": [ | |
| { | |
| "name": "model", | |
| "type": "MODEL", | |
| "link": 293 | |
| } | |
| ], | |
| "outputs": [ | |
| { | |
| "name": "MODEL", | |
| "type": "MODEL", | |
| "links": [ | |
| 294 | |
| ] | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "LoraLoaderModelOnly" | |
| }, | |
| "widgets_values": [ | |
| "minimax_h3_fl2v_lightx2v_turbo_4step_v0.1_comfy_resized_avg_rank_21_bf16.safetensors", | |
| 0.75 | |
| ] | |
| }, | |
| { | |
| "id": 147, | |
| "type": "H3SLAAttention", | |
| "pos": [ | |
| -1430, | |
| 5270 | |
| ], | |
| "size": [ | |
| 330, | |
| 160 | |
| ], | |
| "flags": {}, | |
| "order": 8, | |
| "mode": 0, | |
| "inputs": [ | |
| { | |
| "name": "model", | |
| "type": "MODEL", | |
| "link": 298 | |
| } | |
| ], | |
| "outputs": [ | |
| { | |
| "name": "MODEL", | |
| "type": "MODEL", | |
| "links": [ | |
| 287, | |
| 288 | |
| ], | |
| "slot_index": 0 | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "H3SLAAttention" | |
| }, | |
| "widgets_values": [ | |
| 0.9, | |
| "64", | |
| 8192, | |
| 0, | |
| true, | |
| true | |
| ] | |
| } | |
| ], | |
| "links": [ | |
| [ | |
| 250, | |
| 120, | |
| 0, | |
| 121, | |
| 1, | |
| "VAE" | |
| ], | |
| [ | |
| 251, | |
| 119, | |
| 0, | |
| 122, | |
| 1, | |
| "VAE" | |
| ], | |
| [ | |
| 253, | |
| 129, | |
| 0, | |
| 125, | |
| 0, | |
| "NOISE" | |
| ], | |
| [ | |
| 254, | |
| 126, | |
| 0, | |
| 125, | |
| 1, | |
| "GUIDER" | |
| ], | |
| [ | |
| 255, | |
| 123, | |
| 0, | |
| 125, | |
| 2, | |
| "SAMPLER" | |
| ], | |
| [ | |
| 256, | |
| 124, | |
| 0, | |
| 125, | |
| 3, | |
| "SIGMAS" | |
| ], | |
| [ | |
| 259, | |
| 121, | |
| 0, | |
| 130, | |
| 1, | |
| "AUDIO" | |
| ], | |
| [ | |
| 260, | |
| 130, | |
| 0, | |
| 92, | |
| 0, | |
| "VIDEO" | |
| ], | |
| [ | |
| 261, | |
| 132, | |
| 0, | |
| 131, | |
| 0, | |
| "FLOAT" | |
| ], | |
| [ | |
| 270, | |
| 136, | |
| 0, | |
| 126, | |
| 1, | |
| "CONDITIONING" | |
| ], | |
| [ | |
| 271, | |
| 136, | |
| 1, | |
| 125, | |
| 4, | |
| "LATENT" | |
| ], | |
| [ | |
| 272, | |
| 128, | |
| 0, | |
| 136, | |
| 0, | |
| "CLIP" | |
| ], | |
| [ | |
| 273, | |
| 119, | |
| 0, | |
| 136, | |
| 1, | |
| "VAE" | |
| ], | |
| [ | |
| 274, | |
| 120, | |
| 0, | |
| 136, | |
| 2, | |
| "VAE" | |
| ], | |
| [ | |
| 275, | |
| 131, | |
| 1, | |
| 136, | |
| 12, | |
| "INT" | |
| ], | |
| [ | |
| 276, | |
| 115, | |
| 0, | |
| 136, | |
| 10, | |
| "INT" | |
| ], | |
| [ | |
| 277, | |
| 115, | |
| 1, | |
| 136, | |
| 11, | |
| "INT" | |
| ], | |
| [ | |
| 278, | |
| 137, | |
| 0, | |
| 136, | |
| 3, | |
| "IMAGE" | |
| ], | |
| [ | |
| 279, | |
| 138, | |
| 0, | |
| 136, | |
| 9, | |
| "STRING" | |
| ], | |
| [ | |
| 280, | |
| 125, | |
| 0, | |
| 122, | |
| 0, | |
| "LATENT" | |
| ], | |
| [ | |
| 281, | |
| 125, | |
| 0, | |
| 121, | |
| 0, | |
| "LATENT" | |
| ], | |
| [ | |
| 283, | |
| 141, | |
| 0, | |
| 142, | |
| 0, | |
| "UPSCALE_MODEL" | |
| ], | |
| [ | |
| 284, | |
| 122, | |
| 0, | |
| 142, | |
| 1, | |
| "IMAGE" | |
| ], | |
| [ | |
| 287, | |
| 147, | |
| 0, | |
| 124, | |
| 0, | |
| "MODEL" | |
| ], | |
| [ | |
| 288, | |
| 147, | |
| 0, | |
| 126, | |
| 0, | |
| "MODEL" | |
| ], | |
| [ | |
| 289, | |
| 142, | |
| 0, | |
| 144, | |
| 0, | |
| "IMAGE" | |
| ], | |
| [ | |
| 290, | |
| 144, | |
| 0, | |
| 130, | |
| 0, | |
| "IMAGE" | |
| ], | |
| [ | |
| 292, | |
| 145, | |
| 0, | |
| 143, | |
| 0, | |
| "MODEL" | |
| ], | |
| [ | |
| 293, | |
| 127, | |
| 0, | |
| 146, | |
| 0, | |
| "MODEL" | |
| ], | |
| [ | |
| 294, | |
| 146, | |
| 0, | |
| 145, | |
| 0, | |
| "MODEL" | |
| ], | |
| [ | |
| 298, | |
| 143, | |
| 0, | |
| 147, | |
| 0, | |
| "MODEL" | |
| ], | |
| [ | |
| 299, | |
| 139, | |
| 0, | |
| 136, | |
| 4, | |
| "IMAGE" | |
| ] | |
| ], | |
| "groups": [ | |
| { | |
| "id": 1, | |
| "title": "Models", | |
| "bounding": [ | |
| -1520, | |
| 4840, | |
| 700, | |
| 670 | |
| ], | |
| "color": "#3f789e", | |
| "flags": {} | |
| }, | |
| { | |
| "id": 2, | |
| "title": "Sampling", | |
| "bounding": [ | |
| -280, | |
| 4840, | |
| 690, | |
| 670 | |
| ], | |
| "color": "#3f789e", | |
| "flags": {} | |
| }, | |
| { | |
| "id": 3, | |
| "title": "Conditioning", | |
| "bounding": [ | |
| -790, | |
| 4840, | |
| 480, | |
| 670 | |
| ], | |
| "color": "#3f789e", | |
| "flags": {} | |
| }, | |
| { | |
| "id": 4, | |
| "title": "Decoding and create video", | |
| "bounding": [ | |
| 440, | |
| 4840, | |
| 670, | |
| 670 | |
| ], | |
| "color": "#3f789e", | |
| "flags": {} | |
| }, | |
| { | |
| "id": 5, | |
| "title": "User Inputs", | |
| "bounding": [ | |
| -1520, | |
| 5540, | |
| 1930, | |
| 900 | |
| ], | |
| "color": "#3f789e", | |
| "flags": {} | |
| } | |
| ], | |
| "config": {}, |
评论
?
参与讨论