---
library_name: transformers
tags: []
---

Test version of https://huggingface.co/monsoon-nlp/dna-blockdiff using the custom bd3lms EmbeddingLayer instead of the `torch.nn.EmbeddingLayer`

- Does not seem to stop generating
- Does not fix issue with attention on inference
- Does not fix issue with torch.where in training