Edge RAG LLMs - a tomasmcm Collection

tomasmcm 's Collections

Edge RAG LLMs

updated 23 days ago

Lightweight LLMs specialised in RAG based on t5, bart, bert, roberta with ONNX conversion

Upvote

VMware/deberta-v3-base-mrqa

Question Answering • Updated Feb 7 • 21

Note Encoder-only - 184M
tomasmcm/vmware-deberta-v3-base-mrqa-onnx

Question Answering • Updated 23 days ago • 5

Note Score: 7/10 Q4 @ 494.2 MB
teapotai/teapotllm

Text2Text Generation • Updated 19 days ago • 2.25k • 169

Note Encoder-Decoder - 783M
tomasmcm/teapotai-teapotllm-onnx

Text2Text Generation • Updated 29 days ago • 11 • 1

Note Score: 7/10 Q4 @ 736.9 MB
deepset/tinyroberta-squad2

Question Answering • Updated Sep 26, 2024 • 14k • • 110

Note Encoder-ony - 81.5M
tomasmcm/deepset-tinyroberta-squad2-onnx

Question Answering • Updated 27 days ago • 7

Note Score: 6/10 Q4 @ 186.5 MB
nlpconnect/deberta-v3-xsmall-squad2

Question Answering • Updated Dec 6, 2022 • 20

Note Encoder-only - 22M
tomasmcm/nlpconnect-deberta-v3-xsmall-squad2-onnx

Question Answering • Updated 23 days ago • 8

Note Score: 6/10 Q4 @ 238.5 MB
deepset/roberta-base-squad2

Question Answering • Updated Sep 24, 2024 • 1.6M • • 874

Note Encoder-only - 124M
tomasmcm/deepset-roberta-base-squad2-onnx

Question Answering • Updated 27 days ago • 7

Note Score: 5.5/10 Q4 @ 213.5 MB
allenai/unifiedqa-v2-t5-large-1363200

Text2Text Generation • Updated Jan 24, 2023 • 526 • 4

Note Encoder-Decoder - 738M
tomasmcm/allenai-unifiedqa-v2-t5-large-onnx

Text2Text Generation • Updated 28 days ago • 9

Note Score: 5.5/10 Q4 @ 708.2 MB
VMware/tinyroberta-mrqa

Question Answering • Updated Aug 14, 2023 • 18 • 2

Note Encoder-only - 81.5M
tomasmcm/vmware-tinyroberta-mrqa-onnx

Question Answering • Updated 23 days ago • 9

Note Score: 5/10 Q4 @ 186.5 MB
lmqg/bart-large-tweetqa-qa

Text2Text Generation • Updated Dec 8, 2022 • 11

Note Encoder-Decoder - 400M
tomasmcm/lmqg-bart-large-tweetqa-qa-onnx

Text2Text Generation • Updated 28 days ago • 7

Note Score: 4.5/10 Q4 @ 679.4 MB
Salesforce/qaconv-unifiedqa-t5-large

Text2Text Generation • Updated Jan 14 • 28

Note Encoder-Decoder - 738M
tomasmcm/salesforce-qaconv-unifiedqa-t5-large-onnx

Text2Text Generation • Updated 28 days ago • 9

Note Score: 4.5/10 Q4 @ 708.2 MB
Intel/dynamic_tinybert

Question Answering • Updated Mar 22, 2024 • 2.2k • • 79

Note Encoder-only - 66M
tomasmcm/intel-dynamic-tinybert-onnx

Question Answering • Updated 27 days ago • 10

Note Score: 3.5/10 Q4 @ 123 MB
ansukla/task-llm

Text2Text Generation • Updated Jan 26, 2024 • 14

Note Encoder-Decoder - 400M
tomasmcm/ansukla-task-llm-onnx

Text2Text Generation • Updated 28 days ago • 11

Note Score: 3/10 Q4 @ 679.4 MB
lmqg/t5-large-tweetqa-qa

Text2Text Generation • Updated Dec 7, 2022 • 14

Note Encoder-Decoder - 738M
tomasmcm/lmqg-t5-large-tweetqa-qa-onnx

Text2Text Generation • Updated 28 days ago • 4

Note Score: 3/10 Q4 @ 708 MB
gsarti/cora_mgen

Text2Text Generation • Updated Jan 23, 2024 • 51 • 2

Note Encoder-Decoder - 580M
tomasmcm/gsarti-cora-mgen-onnx

Text2Text Generation • Updated 28 days ago • 16

Note Score: 3/10 Q4 @ 1.8 GB

Upvote