vista/docs/ISSUES.md

Trouble Shooting

1. Out of memory during sampling.

   • Possible reason:

     • Too many high-resolution frames for parallel decoding. The default setting will request ca. 66 GB peak VARM.

   • Try this:

     • Reduce the number of jointly decoded frames en_and_decode_n_samples_a_time in inference/vista.yaml.

2. Get stuck at loading FrozenCLIPEmbedder or FrozenOpenCLIPImageEmbedder.

   • Possible reason:

     • A network failure.

   • Try this:

     1. Download openai/clip-vit-large-patch14 and laion/CLIP-ViT-H-14-laion2B-s32B-b79K in advance.
     2. Set version of FrozenCLIPEmbedder and FrozenOpenCLIPImageEmbedder in vwm/modules/encoders/modules.py to the new paths of pytorch_model.bin.

3. Datasets not yet available during training.

   • Possible reason:

     • The installed sdata is not detected.

   • Try this:

     • Reinstall in the current project directory.

       pip3 install -e git+https://github.com/Stability-AI/datapipelines.git@main#egg=sdata
       

---

<= Previous: [Sampling]