Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
second-state
/
DeepSeek-V2.5-GGUF
like
1
GGUF
deepseek_v2
custom_code
License:
deepseek
Model card
Files
Files and versions
Community
Use this model
Edit model card
DeepSeek-V2.5-GGUF
Original Model
Run with LlamaEdge
DeepSeek-V2.5-GGUF
Original Model
deepseek-ai/DeepSeek-V2.5
Run with LlamaEdge
LlamaEdge version: coming soon
Quatized with llama.cpp b3664
Downloads last month
232
GGUF
Model size
236B params
Architecture
deepseek2
2-bit
Q2_K
3-bit
Q3_K_S
Q3_K_M
Q3_K_L
4-bit
Q4_K_S
Q4_0
Q4_K_M
5-bit
Q5_K_S
Q5_0
Q5_K_M
16-bit
F16
Inference API
Inference API (serverless) has been turned off for this model.
Model tree for
second-state/DeepSeek-V2.5-GGUF
Base model
deepseek-ai/DeepSeek-V2.5
Quantized
this model
