MusicGen Small, developed by Meta, is a compact yet powerful model designed for generating high-quality musical pieces from text descriptions. With only 0.3 billion parameters, this model is surprisingly efficient and capable of producing diverse and coherent audio outputs that match the textual prompts provided. It excels in creating short musical segments suitable for backgrounds, jingles, or ambient tracks, making it a valuable tool for content creators, musicians, and developers who need quick access to customizable audio without the need for extensive computational resources.
Despite its relatively small size, MusicGen Small holds its own against larger models in terms of output quality and versatility. The model's efficiency is particularly noteworthy, as it requires minimal VRAM (0.8 GB) and can run smoothly on a wide range of hardware, including older or less powerful machines. This makes it an excellent choice for users who want to experiment with AI-generated music without investing in high-end equipment. Ideal for hobbyists, small-scale projects, and those new to AI audio generation, MusicGen Small offers a balance between performance and resource consumption that is hard to beat in its size class.
| Quantization | Bits | File Size | VRAM Needed | RAM Needed | Quality |
|---|---|---|---|---|---|
| ONNX-Q4F16 | 4 | 0.282 GB | 0.78 GB | 1.28 GB | 80% |
How to run MusicGen Small
Pick a runtime — copy & paste. Commands are pre-filled with this model’s repo.
GUI. Browse → download → chat. MLX on Apple Silicon.
LM Studio home →- 1
Open LM Studio
Go to the 🔍 Search tab.
- 2
Search for
Xenova/musicgen-small - 3
Download
Pick the ONNX-Q4F16 quant — best balance of size vs. quality.
- 4
Chat
Hit ▶ Load Model and start chatting. Toggle 'Local Server' to expose an OpenAI-compatible API on :1234.
Community benchmarks
Real tokens/sec reports from people running MusicGen Small on actual hardware.
No community runs yet for this model. Be the first to submit your numbers.
how much VRAM do I need to run MusicGen Small?
MusicGen Small requires 0.78 GB VRAM minimum with ONNX-Q4F16 quantization. For full precision you need 0.78 GB.
which quant should I pick?
Q4_K_M is the best quality/VRAM balance — ~92% of FP16 quality at ~25% the footprint. Q8_0 is near-lossless if you have the headroom.