Back to RunThisModel

AI Models You Can Run with 20GB VRAM

108 models compatible across 9 categories

Compatible Models
108
Largest Model
Qwen 2.5 32B (32B)
Categories
9
4GB6GB8GB10GB12GB16GB20GB24GB32GB48GB64GB80GB128GB192GB
💬

Chat / LLM (46 models)

Qwen 2.5 32B

Alibaba

32B
19.0GB VRAMQ4_K_M
85%

Gemma 3 27B

Google

27B
15.9GB VRAMQ4_K_M
85%

Mistral Small 22B

Mistral AI

22B
12.9GB VRAMQ4_K_M
85%

Phi-4

Microsoft

14B
15.0GB VRAMQ8_0
98%

Qwen 2.5 14B

Alibaba

14B
15.1GB VRAMQ8_0
98%

Gemma 3 12B

Google

12B
12.2GB VRAMQ8_0
98%

Mistral Nemo 12B

Mistral AI

12B
12.6GB VRAMQ8_0
98%

Solar 10.7B

Upstage

10.7B
11.1GB VRAMQ8_0
98%

Falcon 3 10B

TII

10B
10.7GB VRAMQ8_0
98%

Gemma 2 9B Instruct

Google

9.2B
9.7GB VRAMQ8_0
98%

Yi 1.5 9B Chat

01.AI

9B
9.2GB VRAMQ8_0
98%

DeepSeek R1 Distill 8B

DeepSeek

8B
8.4GB VRAMQ8_0
98%

Llama 3.1 8B Instruct

Meta

8B
17.0GB VRAMFP16
100%

Granite 3.3 8B

IBM

8B
8.6GB VRAMQ8_0
98%

EXAONE 3.5 7.8B

LG AI

7.8B
8.2GB VRAMQ8_0
98%

InternLM 2.5 7B

Shanghai AI Lab

7.7B
8.2GB VRAMQ8_0
98%

Qwen 2.5 7B Instruct

Alibaba

7.6B
9.0GB VRAMQ8_0
98%

Mistral 7B Instruct v0.3

Mistral AI

7.3B
15.5GB VRAMFP16
100%

Falcon 3 7B

TII

7B
8.3GB VRAMQ8_0
98%

OLMo 2 7B

Allen AI

7B
7.7GB VRAMQ8_0
98%

OpenChat 3.5 7B

OpenChat

7B
7.7GB VRAMQ8_0
98%

Yi 1.5 6B Chat

01.AI

6B
6.5GB VRAMQ8_0
98%

Gemma 3 4B

Google

4B
4.3GB VRAMQ8_0
98%

Nemotron Mini 4B

NVIDIA

4B
4.7GB VRAMQ8_0
98%

Danube 3 4B

H2O.ai

4B
4.4GB VRAMQ8_0
98%

Phi-3.5 Mini 3.8B

Microsoft

3.8B
4.3GB VRAMQ8_0
98%

Phi-4 Mini 3.8B

Microsoft

3.8B
4.3GB VRAMQ8_0
98%

Llama 3.2 3B Instruct

Meta

3.2B
3.7GB VRAMQ8_0
98%

Qwen 2.5 3B

Alibaba

3B
3.9GB VRAMQ8_0
98%

Falcon 3 3B

TII

3B
3.8GB VRAMQ8_0
98%

StableLM Zephyr 3B

Stability AI

3B
3.3GB VRAMQ8_0
98%

Rocket 3B

Pansophic

3B
3.3GB VRAMQ8_0
98%

Gemma 2 2B

Google

2.6B
3.1GB VRAMQ8_0
98%

EXAONE 3.5 2.4B

LG AI

2.4B
3.1GB VRAMQ8_0
98%

Granite 3.3 2B

IBM

2B
3.0GB VRAMQ8_0
98%

SmolLM2 1.7B

HuggingFace

1.7B
2.2GB VRAMQ8_0
98%

Qwen 2.5 1.5B

Alibaba

1.5B
2.3GB VRAMQ8_0
98%

DeepSeek R1 Distill 1.5B

DeepSeek

1.5B
2.3GB VRAMQ8_0
98%

Llama 3.2 1B Instruct

Meta

1.24B
2.8GB VRAMFP16
100%

TinyLlama 1.1B

TinyLlama

1.1B
1.6GB VRAMQ8_0
98%

Gemma 3 1B

Google

1B
1.5GB VRAMQ8_0
98%

Falcon 3 1B

TII

1B
2.2GB VRAMQ8_0
98%

Qwen 2.5 0.5B

Alibaba

0.5B
1.1GB VRAMQ8_0
98%

Danube 3 500M

H2O.ai

0.5B
1.0GB VRAMQ8_0
98%

SmolLM2 360M

HuggingFace

0.36B
0.9GB VRAMQ8_0
98%

SmolLM2 135M

HuggingFace

0.135B
0.8GB VRAMFP16
100%
💻

Coding (16 models)

Qwen 2.5 Coder 14B

Alibaba

14B
15.1GB VRAMQ8_0
98%

Code Llama 13B Instruct

Meta

13B
7.8GB VRAMQ4_K_M
85%

Yi Coder 9B

01.AI

9B
9.2GB VRAMQ8_0
98%

CodeGemma 7B

Google

8.5B
8.9GB VRAMQ8_0
98%

Qwen 2.5 Coder 7B

Alibaba

7.6B
8.0GB VRAMQ8_0
98%

StarCoder2 7B

BigCode

7B
7.6GB VRAMQ8_0
98%

Code Llama 7B

Meta

7B
7.2GB VRAMQ8_0
98%

DeepSeek Coder 6.7B

DeepSeek

6.7B
7.2GB VRAMQ8_0
98%

Qwen 2.5 Coder 3B

Alibaba

3B
3.9GB VRAMQ8_0
98%

StarCoder2 3B

BigCode

3B
3.5GB VRAMQ8_0
98%

Stable Code 3B

Stability AI

3B
3.3GB VRAMQ8_0
98%

CodeGemma 2B

Google

2B
3.0GB VRAMQ8_0
98%

Qwen 2.5 Coder 1.5B

Alibaba

1.5B
2.3GB VRAMQ8_0
98%

Yi Coder 1.5B

01.AI

1.5B
2.0GB VRAMQ8_0
98%

DeepSeek Coder 1.3B

DeepSeek

1.3B
1.8GB VRAMQ8_0
98%

Qwen 2.5 Coder 0.5B

Alibaba

0.5B
1.1GB VRAMQ8_0
98%
👁

Multimodal (6 models)

LLaVA 1.6 7B

LLaVA

7B
8.5GB VRAMQ8_0
98%

Phi-3.5 Vision

Microsoft

4.2B
3.2GB VRAMQ4_K_M
85%

PaliGemma 3B

Google

3B
2.5GB VRAMQ4_K_M
85%

Qwen2-VL 2B

Alibaba

2.2B
2.0GB VRAMQ8_0
98%

MiniCPM-V 2.6

OpenBMB

2B
3.0GB VRAMQ8_0
98%

Moondream 2

Moondream

1.8B
1.5GB VRAMQ4_K_M
85%
🎨

Image Generation (9 models)

FLUX.1 Schnell (GGUF)

Black Forest Labs

12B
14.0GB VRAMQ5_0
90%

FLUX.1 Dev (GGUF)

Black Forest Labs

12B
14.0GB VRAMQ5_0
100%

Stable Diffusion XL (CoreML)

Stability AI

3.5B
3.3GB VRAMCoreML
100%

SDXL Turbo (GGUF)

Stability AI

3.5B
5.0GB VRAMQ5_0
85%

Stable Diffusion 3 Medium (GGUF)

Stability AI

2.5B
9.2GB VRAMQ8_0
95%

Stable Diffusion 2.1 Base (CoreML)

Stability AI / Apple

0.86B
1.6GB VRAMCoreML-Palettized
85%

Stable Diffusion 1.5 (CoreML)

Runway

0.86B
2.5GB VRAMCoreML-Palettized
90%

Stable Diffusion 1.5 (GGUF)

Runway / GPUStack

0.86B
2.3GB VRAMQ8_0
95%

Stable Diffusion 2.1 (GGUF)

Stability AI

0.86B
2.7GB VRAMQ8_0
95%
🎤

Speech Recognition (9 models)

Whisper Large v3

OpenAI

1.55B
3.4GB VRAMQ8_0
98%

Whisper Large v3 Turbo

OpenAI

0.81B
2.0GB VRAMQ8_0
95%

Whisper Medium

OpenAI

0.77B
1.9GB VRAMQ8_0
92%

Distil-Whisper Large v3

HuggingFace

0.76B
1.9GB VRAMQ8_0
96%

Whisper Small

OpenAI

0.24B
0.9GB VRAMQ8_0
85%

Whisper Base

OpenAI

0.074B
0.3GB VRAMQ8_0
80%

Whisper Base English

OpenAI

0.074B
0.3GB VRAMQ8_0
82%

Whisper Tiny English (Quantized)

OpenAI

0.039B
0.1GB VRAMQ5_1
65%

Whisper Tiny

OpenAI

0.039B
0.2GB VRAMQ8_0
70%
🔊

Text to Speech (14 models)

Kokoro 82M TTS

Kokoro

0.082B
0.6GB VRAMONNX-Q8F16
95%

Piper TTS - Amy (English)

Rhasspy

0.02B
0.1GB VRAMONNX
85%

Piper TTS - Lessac (English)

Rhasspy

0.02B
0.1GB VRAMONNX
85%

Piper TTS - LibriTTS-R (English)

Rhasspy

0.02B
0.6GB VRAMONNX
80%

Piper TTS - Spanish (MLS)

Rhasspy

0.02B
0.1GB VRAMONNX
80%

Piper TTS - French (Siwis)

Rhasspy

0.02B
0.5GB VRAMONNX
80%

Piper TTS - German (Thorsten)

Rhasspy

0.02B
0.1GB VRAMONNX
80%

Piper TTS - Chinese (Huayan)

Rhasspy

0.02B
0.1GB VRAMONNX
80%

Piper TTS - Japanese (Kokoro)

Rhasspy

0.02B
0.1GB VRAMONNX
80%

Piper TTS - Korean

Rhasspy

0.02B
0.1GB VRAMONNX
80%

Piper TTS - Russian (Irina)

Rhasspy

0.02B
0.1GB VRAMONNX
80%

Piper TTS - Portuguese (Faber)

Rhasspy

0.02B
0.1GB VRAMONNX
80%

Piper TTS - Italian (Riccardo)

Rhasspy

0.02B
0.5GB VRAMONNX
80%

Piper TTS - Arabic (Kareem)

Rhasspy

0.02B
0.1GB VRAMONNX
80%
🎵

Audio Generation (1 model)

MusicGen Small

Meta

0.3B
0.8GB VRAMONNX-Q4F16
80%
🧩

Embedding (5 models)

BGE Large EN v1.5

BAAI

0.335B
1.1GB VRAMFP16
100%

Nomic Embed Text v1.5

Nomic AI

0.137B
0.8GB VRAMFP16
100%

BGE Small EN v1.5

BAAI

0.033B
0.1GB VRAMQ8_0
90%

Snowflake Arctic Embed S

Snowflake

0.033B
0.1GB VRAMQ8_0
88%

all-MiniLM-L6-v2

Sentence Transformers

0.023B
0.1GB VRAMQ8_0
92%
🔄

Reranker (2 models)

BGE Reranker v2 M3

BAAI

0.568B
1.6GB VRAMFP16
98%

Jina Reranker Tiny EN

Jina AI

0.033B
0.1GB VRAMFP16
85%

Compatible GPUs (30 with 20GB+ VRAM)

AMD Radeon RX 7900 XT

20GB$899amd

Apple M3

24GBapple

Apple M2

24GBapple

AMD Radeon RX 7900 XTX

24GB$999amd

NVIDIA GeForce RTX 3090

24GB$1,499nvidia

NVIDIA GeForce RTX 4090

24GB$1,599nvidia

NVIDIA GeForce RTX 3090 Ti

24GB$1,999nvidia

NVIDIA RTX A5000

24GB$2,250nvidia

NVIDIA L4

24GB$2,500nvidia

Apple M4

32GBapple

Apple M2 Pro

32GBapple

Apple M1 Pro

32GBapple

NVIDIA GeForce RTX 5090

32GB$1,999nvidia

Apple M3 Pro

36GBapple

NVIDIA A100 40GB

40GB$10,000nvidia

Apple M4 Pro

48GBapple

NVIDIA RTX A6000

48GB$4,650nvidia

NVIDIA L40S

48GB$7,500nvidia

Apple M1 Max

64GBapple

NVIDIA A100 80GB

80GB$15,000nvidia

NVIDIA H100

80GB$30,000nvidia

Apple M2 Max

96GBapple

Apple M4 Max

128GBapple

Apple M3 Max

128GBapple

Apple M1 Ultra

128GBapple

AMD Instinct MI250X

128GB$10,000amd

Apple M4 Ultra

192GBapple

Apple M3 Ultra

192GBapple

Apple M2 Ultra

192GBapple

AMD Instinct MI300X

192GB$15,000amd

Frequently Asked Questions

What is the best AI model I can run with 20GB VRAM?
The largest model you can run with 20GB VRAM is Qwen 2.5 32B (32B parameters) using Q4_K_M quantization. There are 108 total compatible models.
Can I run Llama with 20GB VRAM?
Yes! You can run 6 Llama models with 20GB VRAM: Code Llama 13B Instruct (Q4_K_M), Llama 3.1 8B Instruct (FP16), Code Llama 7B (Q8_0), Llama 3.2 3B Instruct (Q8_0), Llama 3.2 1B Instruct (FP16), TinyLlama 1.1B (Q8_0).
What GPU has 20GB VRAM?
GPUs with 20GB or more VRAM include: AMD Radeon RX 7900 XT, Apple M3, Apple M2, AMD Radeon RX 7900 XTX, NVIDIA GeForce RTX 3090, and 25 more.

Other VRAM Tiers

4GB VRAM6GB VRAM8GB VRAM10GB VRAM12GB VRAM16GB VRAM24GB VRAM32GB VRAM48GB VRAM64GB VRAM80GB VRAM128GB VRAM192GB VRAM