wenhua cheng's picture

wenhua cheng

wenhuach

·

wenhuach21

AI & ML interests

Model Compression, CV

Recent Activity

reacted to their post with 🤗 3 days ago

AutoRound(https://github.com/intel/auto-round) has been integrated into Transformers, allowing you to run AutoRound-formatted models directly in the upcoming release. Additionally, we are actively working on supporting the GGUF double-quant format, e.g. q4_k_s, stay tuned! https://huggingface.co/blog/autoround

upvoted an article 9 days ago

Introducing AutoRound: Intel’s Advanced Quantization for LLMs and VLMs

posted an update 9 days ago

AutoRound(https://github.com/intel/auto-round) has been integrated into Transformers, allowing you to run AutoRound-formatted models directly in the upcoming release. Additionally, we are actively working on supporting the GGUF double-quant format, e.g. q4_k_s, stay tuned! https://huggingface.co/blog/autoround

View all activity

Organizations

Posts 9

Post

1862

AutoRound(https://github.com/intel/auto-round) has been integrated into Transformers, allowing you to run AutoRound-formatted models directly in the upcoming release. Additionally, we are actively working on supporting the GGUF double-quant format, e.g. q4_k_s, stay tuned!

https://huggingface.co/blog/autoround

Articles 1

Article

23

Introducing AutoRound: Intel’s Advanced Quantization for LLMs and VLMs

View all Articles

Papers 2

arxiv:2310.10944

arxiv:2309.05516

models 0

None public yet

datasets 0

None public yet