📚All Our Models

See the list below for all our GGUF, 16-bit and 4-bit bnb uploaded models

You can also view all our uploaded models on Hugging Face directly.

GGUF + 4-bit BnB

Here's a table of all our GGUF + 4-bit BitsandBytes model uploads:

Model	Base	Instruct	GGUF
Llama 3.2	1B 3B 11B Vision 90B Vision	1B 3B 11B Vision 90B Vision	1B 3B
Llama 3.3		70B	70B
Llama 3.1	8B 70B 405B	8B 70B 405B
Phi-3.5		mini
Mistral	NeMo 2407 (12B) 7B (v0.3) 7B (v0.2) Pixtral (12B) 2409	NeMo 2407 (12B) Small 2409 (22B) Large 2407 7B (v0.3) 7B (v0.2) Pixtral (12B) 2409	NeMo 2407 (12B)
Gemma 2	2B 9B 27B	2B 9B 27B	All variants
Phi-3		mini medium
Llama 3	8B 70B	8B 70B
Qwen 2.5	0.5B 1.5B 3B 7B 14B 32B 72B	0.5B 1.5B 3B 7B 14B 32B 72B QwQ QVQ
Llava		1.5 (7B) 1.6 Mistral (7B)
Qwen 2.5 Coder	0.5B 1.5B 3B 7B 14B 32B	0.5B 1.5B 3B 7B 14B 32B	0.5B 1.5B 3B 7B 14B 32B
Qwen2 VL		2B 7B 72B
Llama 2	7B 13B	7B
SmolLM2	135M 360M 1.7B	135M 360M 1.7B	135M 360M 1.7B
TinyLlama	Base	Instruct
Qwen2	1.5B 7B 72B	1.5B 7B 72B
Zephyr SFT		Instruct
CodeLlama	7B 13B 34B
Yi	6B (v 1.5) 6B 34B	34B

16-bit original

Here's a table of all our 16-bit original model uploads:

Model	Base	Instruct
Llama 3.2	1B 3B 11B Vision 90B Vision	1B 3B 11B Vision 90B Vision
Llama 3.3		70B
Llama 3.1	8B 70B	8B 70B
Phi-3.5		mini
Mistral	NeMo 2407 (12B) 7B (v0.3) 7B (v0.2) Pixtral (12B) 2409	NeMo 2407 (12B) Small 2409 (22B) 7B (v0.3) 7B (v0.2) Pixtral (12B) 2409
Gemma 2	2B 9B 27B	2B 9B 27B
Phi-3		mini medium
Llama 3	8B	8B
Qwen 2.5	0.5B 1.5B 3B 7B 14B 32B 72B	0.5B 1.5B 3B 7B 14B 32B 72B
Llava		1.5 (7B) 1.6 Mistral (7B)
Qwen2 VL		2B 7B 72B
Llama 2	7B 13B	7B
SmolLM2	135M 360M 1.7B	135M 360M 1.7B
TinyLlama	Base	Instruct
Qwen2	1.5B 7B	1.5B 7B
Zephyr SFT		Instruct