Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Blackroot
/
Differential-Microllama-2
like
2
llama
arxiv:
2410.05258
Model card
Files
Files and versions
Community
main
Differential-Microllama-2
/
llama_modeling
Ctrl+K
Ctrl+K
1 contributor
History:
1 commit
Blackroot
Upload 19 files
a83aa44
verified
3 months ago
__init__.py
Safe
0 Bytes
Upload 19 files
3 months ago
attention.py
Safe
4.41 kB
Upload 19 files
3 months ago
config.py
Safe
419 Bytes
Upload 19 files
3 months ago
decoder.py
Safe
1.5 kB
Upload 19 files
3 months ago
diff_attn.py
Safe
5.84 kB
Upload 19 files
3 months ago
extact.py
Safe
1.02 kB
Upload 19 files
3 months ago
front_end.py
Safe
3.12 kB
Upload 19 files
3 months ago
liger_rope.py
Safe
10.2 kB
Upload 19 files
3 months ago
mlp.py
Safe
719 Bytes
Upload 19 files
3 months ago
model.py
Safe
1.21 kB
Upload 19 files
3 months ago
rms_norm.py
Safe
614 Bytes
Upload 19 files
3 months ago
rope.py
Safe
1.44 kB
Upload 19 files
3 months ago
tensor_prod_attn.py
Safe
5.92 kB
Upload 19 files
3 months ago
