Hugging Face's logo

Qwen
/
Qwen2.5-VL-3B-Instruct

Image-Text-to-Text
Transformers
Safetensors
English
qwen2_5_vl
multimodal
conversational
text-generation-inference
Model card Files Community
27

tokenizer size

#19
by dsanddkjad - opened
Discussion
dsanddkjad
•
edited Mar 6

image.png

image.png

我发现Qwen2.5-VL-3B-Instruct中它的tokenizer里面的vocabsize是151643，然而在我打印大模型的token的embed层时结果显示为Embedding(151936, 2048)

请问为什么两个token的共计大小对不上呢？

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment