mgoin commited on
Commit
31afc66
·
verified ·
1 Parent(s): 5bc2131

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -2
README.md CHANGED
@@ -9,8 +9,9 @@ pinned: false
9
 
10
  # Software-Delivered AI Inference
11
 
12
- Neural Magic helps developers in accelerating deep learning performance using automated model sparsification technologies and a CPU inference engine.
13
- Download our sparsity-aware inference engine and open source tools for GPU-class performance on CPUs.
 
14
  * [DeepSparse](https://github.com/neuralmagic/deepsparse): Inference runtime offering GPU-class performance on CPUs and APIs to integrate ML into your application
15
  * [SparseML](https://github.com/neuralmagic/sparseml): Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models
16
  * [SparseZoo](https://sparsezoo.neuralmagic.com/): Neural network model repository for highly sparse and sparse-quantized models with matching sparsification recipes
 
9
 
10
  # Software-Delivered AI Inference
11
 
12
+ Neural Magic helps developers in accelerating deep learning performance using automated model sparsification technologies and inference engines.
13
+ Download our sparsity-aware inference engines and open source tools for fast model inference.
14
+ * [NM-vLLM](https://github.com/neuralmagic/nm-vllm): A high-throughput and memory-efficient inference engine for LLMs, incorporating the latest LLM optimizations like quantization and sparsity
15
  * [DeepSparse](https://github.com/neuralmagic/deepsparse): Inference runtime offering GPU-class performance on CPUs and APIs to integrate ML into your application
16
  * [SparseML](https://github.com/neuralmagic/sparseml): Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models
17
  * [SparseZoo](https://sparsezoo.neuralmagic.com/): Neural network model repository for highly sparse and sparse-quantized models with matching sparsification recipes