Instructions to use Wan-AI/Wan2.1-T2V-14B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use Wan-AI/Wan2.1-T2V-14B with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Wan-AI/Wan2.1-T2V-14B", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Inference
- Notebooks
- Google Colab
- Kaggle
Run Wan2.1 14B on Consumer GPUs (8GB VRAM) & 16GB Macs via PhobosStream
#44
by devMartianLabs - opened
Hi everyone,
For creators and developers who want to run Wan2.1 14B locally without needing 48GB/80GB enterprise GPUs, we built and open-sourced PhobosStream:
π GitHub Repository: https://github.com/martianacademy/phobos-stream
π¨ ComfyUI Node: https://github.com/martianacademy/ComfyUI-PhobosStream
Key Capabilities:
- Zero-Copy mmap DiT Streaming: Instead of allocating 28β38 GB persistent VRAM for the full DiT, weights remain memory-mapped on NVMe SSD and stream block-by-block during the denoising loop.
- Sequential Stage Offloading: T5-XXL text encoder executes in Stage 1 and is immediately evicted before DiT denoising starts.
- Live Empirical Telemetry: On Apple Silicon Metal GPU (720p HD latents), peak memory is 788.11 MB (>97% reduction from baseline).
- Universal Hardware: Works across Apple Silicon (MLX), NVIDIA CUDA, and ComfyUI.
Hope this helps community members run Wan2.1 14B on 8GB/12GB consumer GPUs and 16GB/24GB Macs!