Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

3,980

Full-text search

Active filters: gptq

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int4

Text Generation • Updated about 16 hours ago • 431 • 8

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int8

Text Generation • Updated about 16 hours ago • 50 • 3

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int8

Text Generation • Updated about 16 hours ago • 84 • 3

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8

Text Generation • Updated about 16 hours ago • 160 • 3

ModelCloud/GRIN-MoE-gptq-4bit

Updated about 14 hours ago • 3

TheBloke/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • Updated Dec 11, 2023 • 49.9k • 47

Qwen/Qwen2-72B-Instruct-GPTQ-Int4

Text Generation • Updated 30 days ago • 11.3k • 31

Qwen/Qwen2-7B-Instruct-GPTQ-Int4

Text Generation • Updated 30 days ago • 5.26k • 22

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16

Text Generation • Updated Aug 13 • 95.8k • 17

speakleash/Bielik-11B-v2.2-Instruct-GPTQ

Text Generation • Updated 22 days ago • 586 • 3

Qwen/Qwen2.5-3B-Instruct-GPTQ-Int8

Text Generation • Updated about 16 hours ago • 9 • 2

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int8

Text Generation • Updated about 16 hours ago • 61 • 2

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int4

Text Generation • Updated about 16 hours ago • 98 • 2

TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 8.37k • 313

TheBloke/airoboros-13B-gpt4-1.4-GPTQ

Text Generation • Updated Aug 21, 2023 • 92 • 37

TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 596 • 135

TheBloke/airoboros-13b-gpt4-1.4-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 32 • 31

TheBloke/Manticore-13B-Chat-Pyg-Guanaco-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 739 • 19

TheBloke/Chronoboros-33B-GPTQ

Text Generation • Updated Sep 27, 2023 • 51 • 28

TheBloke/Llama-2-7B-GPTQ

Text Generation • Updated Sep 27, 2023 • 18.6k • 80

TheBloke/Llama-2-70B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 12.1k • 259

TheBloke/OpenAssistant-Llama2-13B-Orca-v2-8K-3166-GPTQ

Text Generation • Updated Sep 27, 2023 • 21 • 25

TheBloke/MythoMax-L2-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 6.18k • 181

TheBloke/CodeLlama-7B-Instruct-GPTQ

Text Generation • Updated Sep 27, 2023 • 148k • 44

clibrain/Llama-2-7b-ft-instruct-es-gptq-4bit

Text Generation • Updated Sep 1, 2023 • 63 • 9

TheBloke/Phind-CodeLlama-34B-v2-GPTQ

Text Generation • Updated Sep 27, 2023 • 177 • 89

TheBloke/storytime-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 383 • 26

TheBloke/Mistral-7B-OpenOrca-GPTQ

Text Generation • Updated Oct 16, 2023 • 76.9k • 100

TheBloke/AquilaChat2-34B-16K-GPTQ

Text Generation • Updated Oct 29, 2023 • 12 • 6

TheBloke/Yarn-Mistral-7B-128k-GPTQ

Text Generation • Updated Nov 2, 2023 • 51 • 13