Can M3 Max run Nomic Embed Text v1.5?
Yes — runs locally
~102 tok/sec · Instant — feels like typing. No noticeable delay.
The verdict
The M3 Max (128 GB VRAM) handles Nomic Embed Text v1.5 comfortably using the FP16 quantization, which fits in 0.8 GB. Expected throughput is around 102 tokens/second, which feels Instant — feels like typing. No noticeable delay. in interactive use. High quality text embedding model. 137M params. Good for RAG and search.
Setup tutorial: Nomic Embed Text v1.5 on M3 Max
AI-generated, GPU-specific. Verified commands for your exact hardware.
Run Nomic Embed Text v1.5 on an Apple M3 Max with FP16 quantization for Grade S performance, achieving ~3274 tok/sec.
Prerequisites
Before starting, ensure you have at least 0.3GB of free disk space, macOS 12.3 or later, and Xcode Command Line Tools installed. You can install Xcode CLT by running `xcode-select --install`.
Expected performance
With the FP16 quantization, you can expect to achieve ~3274 tok/sec, using approximately 0.8GB of VRAM. This leaves 127.2GB of VRAM available for context, allowing for a practical context window of up to 8192 tokens.
1. Install runtimeOllama (preferred on Apple Silicon)
brew install ollama
ollama init2. Download the model
Download the FP16 quantized model (0.3GB file) from Hugging Face.
ollama pull nomic-ai/nomic-embed-text-v1.5-GGUF:nomic-embed-text-v1.5.f16.gguf3. Run it
ollama run nomic-ai/nomic-embed-text-v1.5-GGUF:nomic-embed-text-v1.5.f16.gguf
ollama interactive nomic-ai/nomic-embed-text-v1.5-GGUF:nomic-embed-text-v1.5.f16.gguf4. Optimize for M3 Max
For optimal performance on the Apple M3 Max, leverage the Metal/MLX backend to utilize the 128GB of unified memory efficiently. Ensure that MPS layers are enabled to take full advantage of the GPU's capabilities. The large VRAM allows for a significant context window without running into memory constraints.
Troubleshooting
Ollama fails to initialize with a 'command not found' error.
Ensure Homebrew is installed and run `brew install ollama` again. If the issue persists, add `/usr/local/bin` to your PATH.
The model runs but performance is suboptimal.
Check that the Metal/MLX backend is enabled. You can verify this by running `ollama config` and ensuring the `backend` setting is set to `metal`.
Out of memory errors during inference.
Reduce the batch size or context length. For example, try running `ollama run nomic-ai/nomic-embed-text-v1.5-GGUF:nomic-embed-text-v1.5.f16.gguf --context-length 4096`.
Alternative runtimes
While Ollama is the preferred runtime for Apple Silicon, alternatives like LM Studio, llama.cpp, and MLX can also be used. LM Studio offers a more graphical interface, while llama.cpp provides a lightweight, command-line option. MLX is ideal for integrating the model into custom applications. Choose based on your specific needs and preferences.
Other models that run great on M3 Max
FAQ (20)
What GPU do I need to run Nomic Embed Text v1.5?
Nomic Embed Text v1.5 requires a GPU with at least 0.3 GB of VRAM for basic operation, but 0.8 GB is recommended for optimal performance, especially with higher quantization levels.
Is Nomic Embed Text v1.5 good for coding?
Nomic Embed Text v1.5 is primarily designed for text embedding tasks, which can be useful for code search and retrieval, but it may not be as specialized for coding as models specifically trained on programming data.
Nomic Embed Text v1.5 vs Llama 3.1 8B?
Nomic Embed Text v1.5 has 0.137 billion parameters, making it significantly smaller than Llama 3.1 8B, which has 8 billion parameters. This makes Nomic Embed Text v1.5 more lightweight and easier to run on less powerful hardware, but it may not perform as well on complex tasks.
Can I run Nomic Embed Text v1.5 on a Mac?
Yes, you can run Nomic Embed Text v1.5 on a Mac, provided your Mac meets the minimum VRAM requirements of 0.3 GB and has the necessary software dependencies installed.
How much VRAM does Nomic Embed Text v1.5 need?
Nomic Embed Text v1.5 requires between 0.3 GB and 0.8 GB of VRAM, depending on the quantization level used. Lower quantization levels require less VRAM but may impact performance.
Is Nomic Embed Text v1.5 censored?
Nomic Embed Text v1.5 is not explicitly censored. However, it adheres to ethical guidelines and best practices in AI development, which may influence its training data and output.
Is Nomic Embed Text v1.5 commercial-use allowed?
Yes, Nomic Embed Text v1.5 is licensed under the Apache-2.0 license, which allows for both commercial and non-commercial use without restriction.
Nomic Embed Text v1.5 context length?
Nomic Embed Text v1.5 supports a context length of up to 8192 tokens, which is quite generous for most text embedding tasks.
Want personalized recommendations for your exact setup? Detect my hardware →