🔮All Our Models

See the table below for all GGUF, 16-bit and 4-bit bnb uploaded models. You can also view our uploaded models on Hugging Face.

• GGUF + 4-bit

Here's a table of all our GGUF + 4-bit model uploads:

Model	GGUF	Instruct (4-bit)	Base (4-bit)
DeepSeek-R1 (new)	R1 R1 Zero Llama 3 (8B) Llama 3.3 (70B) Qwen 2.5 (14B) Qwen 2.5 (32B) Qwen 2.5 (1.5B) Qwen 2.5 (7B)	Llama 3 (8B) Llama 3.3 (70B) Qwen 2.5 (14B) Qwen 2.5 (32B) Qwen 2.5 (1.5B) Qwen 2.5 (7B)
Phi-4 (new)	Phi-4	Dynamic 4-bit BnB 4-bit
Llama 3.2	1B 3B	1B 3B 11B Vision 90B Vision	1B 3B 11B Vision 90B Vision
Llama 3.3	70B	70B
Llama 3.1		8B 70B 405B	8B 70B 405B
Mistral	NeMo 2407 (12B)	NeMo 2407 (12B) Small 2409 (22B) Large 2407 7B (v0.3) 7B (v0.2) Pixtral (12B) 2409	NeMo 2407 (12B) 7B (v0.3) 7B (v0.2) Pixtral (12B) 2409
Gemma 2	All variants	2B 9B 27B	2B 9B 27B
DeepSeek V3	2 to 8-bit
Phi-3.5		mini
Phi-3		mini medium
Llama 3		8B 70B	8B 70B
Qwen 2.5		0.5B 1.5B 3B 7B 14B 32B 72B QwQ QVQ	0.5B 1.5B 3B 7B 14B 32B 72B
Llava		1.5 (7B) 1.6 Mistral (7B)
Qwen 2.5 Coder	0.5B 1.5B 3B 7B 14B 32B	0.5B 1.5B 3B 7B 14B 32B	0.5B 1.5B 3B 7B 14B 32B
Qwen2 VL		2B 7B 72B
Llama 2		7B	7B 13B
SmolLM2	135M 360M 1.7B	135M 360M 1.7B	135M 360M 1.7B
TinyLlama		Instruct	Base
Qwen2		1.5B 7B 72B	1.5B 7B 72B
Zephyr SFT		Instruct
CodeLlama			7B 13B 34B
Yi		34B	6B (v 1.5) 6B 34B

• 16-bit original

Here's a table of all our 16-bit original model uploads:

Model	Instruct	Base
Llama 3.2	1B 3B 11B Vision 90B Vision	1B 3B 11B Vision 90B Vision
Llama 3.3	70B
Phi-4	14B
Llama 3.1	8B 70B	8B 70B
Mistral	NeMo 2407 (12B) Small 2409 (22B) 7B (v0.3) 7B (v0.2) Pixtral (12B) 2409	NeMo 2407 (12B) 7B (v0.3) 7B (v0.2) Pixtral (12B) 2409
Gemma 2	2B 9B 27B	2B 9B 27B
DeepSeek V3	bf16 original 8-bit
Phi-3.5	mini
Phi-3	mini medium
Llama 3	8B	8B
Qwen 2.5	0.5B 1.5B 3B 7B 14B 32B 72B	0.5B 1.5B 3B 7B 14B 32B 72B
Llava	1.5 (7B) 1.6 Mistral (7B)
Qwen2 VL	2B 7B 72B
Llama 2	7B	7B 13B
SmolLM2	135M 360M 1.7B	135M 360M 1.7B
TinyLlama	Instruct	Base
Qwen2	1.5B 7B	1.5B 7B
Zephyr SFT	Instruct