Falcon Mamba: The First Competitive Attention-free 7B Language Model Paper โข 2410.05355 โข Published Oct 7, 2024 โข 36
FalconMamba 7B Collection This collection features the FalconMamba 7B base model, the instruction-tuned version, their 4-bit and GGUF variants, and the demo. โข 15 items โข Updated Feb 13 โข 34
view article Article Welcome FalconMamba: The first strong attention-free 7B model Aug 12, 2024 โข 110