Can RTX 5090 run FLUX.1 Dev (GGUF)?

Yes — runs locally

~78 tok/sec · Instant — feels like typing. No noticeable delay.

Your VRAM

32 GB

Model size

12B

Best quant

Q5_0

VRAM needed

14.0 GB

The verdict

The RTX 5090 (32 GB VRAM) handles FLUX.1 Dev (GGUF) comfortably using the Q5_0 quantization, which fits in 14.0 GB. Expected throughput is around 78 tokens/second, which feels Instant — feels like typing. No noticeable delay. in interactive use. Highest quality FLUX model. 20-50 steps. Mac with 24GB+ RAM.

How to run it

1. Install Ollama or LM Studio.
2. Pull the Q5_0 GGUF — best balance of quality and speed on 32 GB.
3. Start chatting. Expect ~78 tok/sec on first-token, faster after warmup.

See full FLUX.1 Dev (GGUF) setup →

Other models that run great on RTX 5090

FAQ (20)

What GPU do I need to run FLUX.1 Dev (GGUF)?

To run FLUX.1 Dev (GGUF), you need a GPU with at least 14.0 GB of VRAM. The model is optimized for high-end GPUs to handle its 12B parameters efficiently.

Is FLUX.1 Dev (GGUF) good for coding?

FLUX.1 Dev (GGUF) is primarily designed for image generation and may not be the best choice for coding tasks. For coding, consider models specifically trained on code datasets.

FLUX.1 Dev (GGUF) vs Llama 3.1 8B?

FLUX.1 Dev (GGUF) has 12B parameters and is optimized for high-quality image generation, while Llama 3.1 8B is smaller and more versatile, suitable for a wider range of tasks including text generation.

Can I run FLUX.1 Dev (GGUF) on a Mac?

Yes, you can run FLUX.1 Dev (GGUF) on a Mac, but it requires a Mac with at least 24GB of RAM and a compatible GPU with 14.0 GB of VRAM.

How much VRAM does FLUX.1 Dev (GGUF) need?

FLUX.1 Dev (GGUF) requires 14.0 GB of VRAM, regardless of the quantization level used.

Is FLUX.1 Dev (GGUF) censored?

FLUX.1 Dev (GGUF) is not inherently censored, but its output can be controlled or filtered based on the application and settings used.

Is FLUX.1 Dev (GGUF) commercial-use allowed?

No, FLUX.1 Dev (GGUF) is licensed under the flux-1-dev-non-commercial license, which restricts its use to non-commercial purposes only.

FLUX.1 Dev (GGUF) context length?

The context length for FLUX.1 Dev (GGUF) is currently unknown. Check the official documentation or community forums for updates.

Want personalized recommendations for your exact setup? Detect my hardware →