--- license: apache-2.0 language: - en base_model: - Wan-AI/Wan2.1-I2V-14B-480P - Wan-AI/Wan2.1-I2V-14B-480P-Diffusers pipeline_tag: image-to-video tags: - text-to-image - lora - diffusers - template:diffusion-lora - image-to-video widget: - text: >- The video starts with a portrait of a rodent. The scene then transitions to the rodent's z3n1fy zen transformation as the rodent is wearing a pink robe with a white shirt underneath, with a zen garden background. The rodent is facing the camera with a neutral expression. The background appears to be blurred and out of focus. The scene then transitions again to show the transformed rodent, in what appears to be a garden setting. The rodent is now wearing a black kimono with white floral designs and a white belt. The rodent carries a basket in one hand and a colorful fan in the other. The rodent is walking down a pathway lined with hedges and greenery. The z3n1fy zen transformation is complete. The rodent has a neutral expression, looking directly at the camera. output: url: example_videos/rodent_zen.mp4 - text: >- The video starts with a portrait of a purple Thanos from Marvel. The scene then transitions to the Thanos' z3n1fy zen transformation as he's wearing a pink robe with a white shirt underneath, with a zen garden background. Thanos is facing the camera with a neutral expression. The background appears to be blurred and out of focus. The scene then transitions again to show the transformed Thanos, in what appears to be a garden setting. He is now wearing a black kimono with white floral designs and a white belt. Thanos carries a basket in one hand and a colorful fan in the other. He is walking down a pathway lined with hedges and greenery. The z3n1fy zen transformation is complete. Thanos has a neutral expression, looking directly at the camera. output: url: example_videos/thanos_zen.mp4 - text: >- The video starts with a portrait of an old man. The scene then transitions to the man's z3n1fy zen transformation as he's wearing a pink robe with a white shirt underneath, with a zen garden background. He is facing the camera with a neutral expression. The background appears to be blurred and out of focus. The scene then transitions again to show the transformed man, in what appears to be a garden setting. He is now wearing a black kimono with white floral designs and a white belt. He carries a basket in one hand and a colorful fan in the other. He is walking down a pathway lined with hedges and greenery. The z3n1fy zen transformation is complete. The man has a neutral expression, looking directly at the camera. output: url: example_videos/man_zen.mp4 ---
This LoRA is trained on the Wan2.1 14B I2V 480p model and allows you to make any person/object in an image become a Zen version of themselves!
The key trigger phrase is: z3n1fy zen transformation
For best results, try following the structure of the prompt examples above. These worked well for me.
This LoRA works with a modified version of Kijai's Wan Video Wrapper workflow. The main modification is adding a Wan LoRA node connected to the base model.
See the Downloads section above for the modified workflow.
The model weights are available in Safetensors format. See the Downloads section above.
Training was done using Diffusion Pipe for Training
Special thanks to Kijai for the ComfyUI Wan Video Wrapper and tdrussell for the training scripts!