Can RTX 4090 run Stable Diffusion 2.1 Base (CoreML)?

Yes — runs locally

~192 tok/sec · Instant — feels like typing. No noticeable delay.

Your VRAM

24 GB

Model size

0.86B

Best quant

CoreML-Palettized

VRAM needed

1.6 GB

The verdict

The RTX 4090 (24 GB VRAM) handles Stable Diffusion 2.1 Base (CoreML) comfortably using the CoreML-Palettized quantization, which fits in 1.6 GB. Expected throughput is around 192 tokens/second, which feels Instant — feels like typing. No noticeable delay. in interactive use. Smallest CoreML image generation model. Palettized for minimal size (1.14GB). Runs on any iPhone with 6GB RAM. Default image generation model.

How to run it

1. Install Ollama or LM Studio.
2. Pull the CoreML-Palettized GGUF — best balance of quality and speed on 24 GB.
3. Start chatting. Expect ~192 tok/sec on first-token, faster after warmup.

See full Stable Diffusion 2.1 Base (CoreML) setup →

Other models that run great on RTX 4090

FAQ (20)

What GPU do I need to run Stable Diffusion 2.1 Base (CoreML)?

Stable Diffusion 2.1 Base (CoreML) is optimized for Apple devices and runs on the GPU of any iPhone with 6GB RAM or higher.

Is Stable Diffusion 2.1 Base (CoreML) good for coding?

Stable Diffusion 2.1 Base (CoreML) is primarily designed for image generation and is not suitable for coding tasks.

Stable Diffusion 2.1 Base (CoreML) vs Llama 3.1 8B?

Stable Diffusion 2.1 Base (CoreML) is an image generation model, while Llama 3.1 8B is a text generation model. They serve different purposes and are not directly comparable.

Can I run Stable Diffusion 2.1 Base (CoreML) on a Mac?

Yes, you can run Stable Diffusion 2.1 Base (CoreML) on a Mac with Apple Silicon and at least 6GB of RAM.

How much VRAM does Stable Diffusion 2.1 Base (CoreML) need?

Stable Diffusion 2.1 Base (CoreML) requires 1.6 GB of VRAM to run smoothly.

Is Stable Diffusion 2.1 Base (CoreML) censored?

The model is not inherently censored, but it adheres to the CreativeML OpenRail-M license which may include content guidelines.

Is Stable Diffusion 2.1 Base (CoreML) commercial-use allowed?

Yes, Stable Diffusion 2.1 Base (CoreML) can be used commercially under the terms of the CreativeML OpenRail-M license.

Stable Diffusion 2.1 Base (CoreML) context length?

The context length for Stable Diffusion 2.1 Base (CoreML) is not explicitly defined as it is an image generation model, not a text model.

Want personalized recommendations for your exact setup? Detect my hardware →