Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
vllm
AutoTrain Compatible
Inference Endpoints
text-generation-inference
custom_code
4-bit precision
8-bit precision
Misc with no match
Eval Results
Merge
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
91
Full-text search
Edit filters
Sort: Trending
Active filters:
vllm
Clear all
nm-testing/Llama-2-70b-chat-hf-FP8
Text Generation
•
Updated
Jul 16
•
4
neuralmagic/Qwen2-57B-A14B-Instruct-FP8
Text Generation
•
Updated
Jul 18
•
174
•
1
nm-testing/Meta-Llama-3-8B-Instruct-FP8-K-V
Text Generation
•
Updated
22 days ago
•
9
neuralmagic/DeepSeek-Coder-V2-Lite-Base-FP8
Text Generation
•
Updated
Jul 18
•
115
mgoin/Mistral-Nemo-Instruct-2407-FP8-Dynamic
Text Generation
•
Updated
Jul 18
•
112
mgoin/Mistral-Nemo-Instruct-2407-FP8-KV
Text Generation
•
Updated
Jul 18
•
5
neuralmagic/DeepSeek-Coder-V2-Base-FP8
Text Generation
•
Updated
Jul 22
•
308
mgoin/nemotron-3-8b-chat-4k-sft-hf
Text Generation
•
Updated
Jul 23
•
4
neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a16
Text Generation
•
Updated
Aug 13
•
4.42k
•
7
FlorianJc/ghost-8b-beta-vllm-fp8
Text Generation
•
Updated
Jul 25
•
2
FlorianJc/Meta-Llama-3.1-8B-Instruct-vllm-fp8
Text Generation
•
Updated
Jul 25
•
184
neuralmagic/Meta-Llama-3.1-8B-FP8
Text Generation
•
Updated
Aug 13
•
1.57k
•
5
neuralmagic/Meta-Llama-3.1-70B-FP8
Text Generation
•
Updated
Aug 13
•
217
neuralmagic/Meta-Llama-3.1-8B-quantized.w8a16
Text Generation
•
Updated
Aug 13
•
93
•
1
neuralmagic/Meta-Llama-3.1-8B-quantized.w8a8
Text Generation
•
Updated
29 days ago
•
157
•
1
neuralmagic/starcoder2-15b-FP8
Text Generation
•
Updated
Aug 1
•
55
neuralmagic/starcoder2-7b-FP8
Text Generation
•
Updated
Aug 1
•
6
neuralmagic/starcoder2-3b-FP8
Text Generation
•
Updated
Aug 1
•
12
neuralmagic/Meta-Llama-3.1-405B-FP8
Text Generation
•
Updated
Aug 13
•
7
bprice9/Palmyra-Medical-70B-FP8
Text Generation
•
Updated
29 days ago
•
18
neuralmagic/gemma-2-2b-quantized.w8a16
Text Generation
•
Updated
Aug 16
•
39
mradermacher/nemotron-3-8b-chat-4k-sft-hf-GGUF
Updated
Aug 16
•
247
neuralmagic/SmolLM-1.7B-Instruct-quantized.w8a16
Text Generation
•
Updated
28 days ago
•
18
neuralmagic/gemma-2-2b-it-quantized.w8a8
Text Generation
•
Updated
Aug 16
•
23
mradermacher/Nemotron-4-340B-Base-hf-GGUF
Updated
22 days ago
neuralmagic/SmolLM-360M-Instruct-quantized.w8a8
Text Generation
•
Updated
27 days ago
•
12
neuralmagic/SmolLM-135M-Instruct-quantized.w8a8
Text Generation
•
Updated
27 days ago
•
19
neuralmagic/SmolLM-1.7B-Instruct-quantized.w8a8
Text Generation
•
Updated
27 days ago
•
18
cmshin96/MN-12B-Lyra-v3-awq
Text Generation
•
Updated
12 days ago
•
35
cmshin96/MN-12B-Lyra-v1-awq
Text Generation
•
Updated
12 days ago
•
20
Previous
1
2
3
4
Next