---
pipeline_tag: image-to-video
library_name: diffusers
license: mit
---

# VIRES_VAE model card

**Model Page**: [VIRES](https://hjzheng.net/projects/VIRES/)

This is a component of the VIRES model, as presented in [VIRES: Video Instance Repainting with Sketch and Text Guidance](https://huggingface.co/papers/2411.16199). VIRES is a video instance repainting method with sketch and text guidance, enabling video instance repainting, replacement, generation, and removal.  It leverages the generative priors of text-to-video models to maintain temporal consistency and produce visually pleasing results.


### Usage

Ref to our GitHub page: [https://github.com/suimuc/VIRES/](https://github.com/suimuc/VIRES/)

## Citation

```BibTeX
@article{vires,
      title={VIRES: Video Instance Repainting via Sketch and Text Guided Generation},
      author={Weng, Shuchen and Zheng, Haojie and Zhang, Peixuan and Hong, Yuchen and Jiang, Han and Li, Si and Shi, Boxin},
      journal={arXiv preprint arXiv:2411.16199},
      year={2024}
}
```