LagPixelLOL's picture

93 1

LagPixelLOL

v2ray

·

LagPixelLOL

AI & ML interests

Looking for compute sponsors, please contact me through my email [email protected]!

Recent Activity

updated a model 1 day ago

x2ray/stuffs

published a model 1 day ago

x2ray/stuffs

new activity 1 day ago

cognitivecomputations/DeepSeek-R1-AWQ:update vllm to 0.8.x and meet some trouble

View all activity

Organizations

v2ray's activity

New activity in cognitivecomputations/DeepSeek-R1-AWQ 1 day ago

update vllm to 0.8.x and meet some trouble

#34 opened 2 days ago by

HuggingLianWang

New activity in wassname/qwen-14B-codefourchan 11 days ago

Big L.O.V.E. to YOU <3

#1 opened 11 days ago by

New activity in cognitivecomputations/DeepSeek-V3-0324-AWQ 17 days ago

Stuck when run on 8xH100

#8 opened 17 days ago by

New activity in cognitivecomputations/DeepSeek-V3-0324-AWQ 25 days ago

why tokenizer_config.json changed for AWQ model.

#7 opened 25 days ago by

New activity in cognitivecomputations/DeepSeek-V3-0324-AWQ 26 days ago

Does FlashMLA support kv cache fp8 dtype and how to enable FlashMLA ?

#6 opened about 1 month ago by

New activity in cognitivecomputations/DeepSeek-R1-AWQ 27 days ago

AMD Instinct MI210 + vllm fail to run this model, any solutions please? Is there any other deepseek-r1-671b models that can run succesfully on AMD Instinct MI210 + vllm? Thanks!

#33 opened 28 days ago by

New activity in discord-community/WelcomeBot 29 days ago

test

#2 opened 2 months ago by

New activity in cognitivecomputations/DeepSeek-R1-AWQ about 1 month ago

How to Resolve "GLIBC_2.32 Not Found" Error When Deploying vLLM Environment?

#32 opened about 1 month ago by

New activity in cognitivecomputations/DeepSeek-V3-0324-AWQ about 1 month ago

Can the 4090 device run this model?

#3 opened about 1 month ago by

vllm crach with a slightly longer prompt

#4 opened about 1 month ago by

可以添加一下LICENSE文件吗？

#2 opened about 1 month ago by

New activity in cognitivecomputations/DeepSeek-R1-AWQ about 1 month ago

Are there any updates to the recommended commands?

#27 opened about 2 months ago by

Why hasn't the MTP layer of the 61st layer been quantized?

#30 opened about 1 month ago by

Is there any testing on the support for running on other memory capacities

#29 opened about 1 month ago by

New activity in cognitivecomputations/DeepSeek-R1-AWQ about 2 months ago

Any one can run this model with SGlang framework？

#13 opened 3 months ago by

DeepSeek-R1-AWQ quantized model missing one layer of experts

#28 opened about 2 months ago by

About the group size

#26 opened about 2 months ago by

New activity in cognitivecomputations/DeepSeek-R1-AWQ 2 months ago

The awq quantization model may encounter garbled characters when performing inference on long texts.

#24 opened 2 months ago by

How can I quantify my BF16 format model into AWQ?

#25 opened 2 months ago by

Support for inference with MTP module?

#23 opened 2 months ago by