Pose estimator output that feeds body, hand, and face poses into the animate node.
Two modes — mix mode (retain background and replace character) and move mode (replace the entire frame). For full-frame character replacement use move mode.
Pose estimator — extracts body, hand, and facial keypoints to drive the generation node, effectively performing mocap-like tracking without suits.
Local or cloud — some Wan models are cloud-only, but the Wan 2.2 template can be run locally if the machine meets the VRAM and compute requirements.
Practical workflow choices
Two real-world approaches emerged from the testing:
Use the Comfy Cloud-Wan 2.5 template for quick audio-driven, short-form animations when you have an image and dialogue but no performance capture.
Use Wan 2.2 Animate in ComfyUI for pose-driven replacements—ideal when you have a performer video and want to map that performance onto a stylized character or modified live-action reference image.
Preparing assets: reference images and performance clips
Good inputs make all the difference.
Reference image — clean, well-lit stills work best. When doing costume or background replacement, pre-edit the reference using tools like Nano Banana or Freepik's generation tools to remove distracting props and insert desired costume and set elements.
Performance video — shoot at the intended final frame rate and perspective. Wan 2.2 works better when the driving video and reference image share a similar camera angle. Vertical video works, but consistent framing helps.
Frame rate and resolution — match the source clip frame rate and resolution. Wan 2.2 workflows can default to 16 fps, which produces choppier motion; it is better to feed the original 30 fps or whatever the source uses.
Small physics details, like a dog tag swinging, can appear automatically when the pose estimator maps motion to a generated image.
Performance, hardware, and runtime expectations
Running Wan 2.2 Animate locally requires a capable GPU. In testing, an RTX 3090 handled a short 2-3 second clip in roughly 5-7 minutes at 1280x720. Cloud runs for Wan 2.5 completed in under a few minutes for short segments, with costs tied to API executions.
Precision compatibility — pick matching model and clip encoder precisions to avoid runtime mismatches.
Maximum frame window — some workflows are limited to ~81 frames per inference. For longer clips, chain inference nodes to concatenate segments while passing the last frame forward.
GPU load — expect VRAM-heavy operations; node-based UIs show active nodes as they run, which is useful for performance debugging.
The workflow exposes a global resolution parameter that propagates through the node tree.
Video extend nodes allow chaining multiple inference runs for clips longer than the model’s frame limit.
Common pitfalls and how to address them
Proportion mismatches — when mapping human motion to stylized or nonhuman characters, proportions may stretch incorrectly. Solutions include using a reference performer with closer proportions or iterating the reference image to better match the driving performer.
Face fidelity — face details can get distorted; refine the reference image and experiment with face-tracking options in the pose estimator.
Switching modes — some ComfyUI templates require deleting node connections to switch from mask (mix) to full-frame (move) mode; a simpler template built by community members can make this switch less error-prone.
Use cases and where these tools fit into production
These workflows are not yet a drop-in replacement for feature film VFX, but they are highly useful for:
Short films and proof-of-concept sequences where rapid iteration is valuable.
YouTube channels and short-form content that benefit from stylized characters with low production overhead.
Virtual production experiments and previs where quick character animation drives blocking, timing, and compositing tests.
Final takeaways
Wan 2.5 and Wan 2.2 Animate each solve different parts of the character animation puzzle. Wan 2.5 gives producers a fast route to audio-driven animation in the cloud. Wan 2.2 Animate brings pose transfer and local flexibility for mapping real performance onto new characters and frames. Together, they expand what small teams and individual creators can prototype without large mocap rigs or expensive render farms.
For filmmakers and VFX artists, the practical approach is clear: choose the model based on whether audio or motion should be the primary driver, prepare clean reference assets, and match frame rate and resolution to maintain VFX pipeline compatibility.