Spaces:

---

bytedance-research

/

RealCustom

like 8

Runtime error

RealCustom is a academic project space demo for our papers:

1. RealCustom: narrowing real text word for real-time open-domain text-to-image customization (CVPR 2024)
2. Realcustom++: Representing images as real-word for real-time customization

It aims to provide a subject image and text co-driven image generation pipeline.

Some relative links about it:

• papers: https://openaccess.thecvf.com/content/CVPR2024/papers/Huang_RealCustom_Narrowing_Real_Text_Word_for_Real-Time_Open-Domain_Text-to-Image_Customization_CVPR_2024_paper.pdf
• github: https://github.com/bytedance/RealCustom
• model weight: https://huggingface.co/bytedance-research/RealCustom

Here is the abstract of our paper:

• Existing text-to-image customization methods (i.e., subject-driven generation) face a fundamental challenge due to the entangled influence of visual and textual conditions. This inherent conflict forces a trade-off between subject fidelity and textual controllability, preventing simultaneous optimization of both objectives.We present RealCustom to disentangle subject similarity from text controllability and thereby allows both to be optimized simultaneously without conflicts. The core idea of RealCustom is to represent given subjects as real words that can be seamlessly integrated with given texts, and further leveraging the relevance between real words and image regions to disentangle visual condition from text condition.

Could someone please grant GPU and storage for our demo in this space? Thank you so much for your support!