Skip to content
Voltarum Local LLM Hardware Guide

Apple · Apple silicon · 2026

Apple Mac mini (M5 Pro)

Recommended

Up to 64 GB at 307 GB/s in a quiet mini PC: 27–35B models at a comfortable pace.

Memory
24 GB–64 GB
Bandwidth
307 GB/s
Power
—
Largest popular model at 4-bit
Qwen3.6 35B A3B

from $1,699 (launch price)

Researched from manufacturer data and public sources; not tested by us.· Last reviewed Oct 11, 2026

What it can run

Estimate

Popular models at Q4_K_M with a 32K-token context. Memory needed from real model files; speed is the theoretical ceiling.

Change model size or context

Model weightsContext cache (KV)RuntimeUsable limit (colour = verdict)

ModelVerdictMemorySpeed ceiling
Qwen3 1.7BRuns
6.4 GB / 16 GB · with 24 GB
≤ 277 tok/s
Qwen3.5 9BRuns
8.3 GB / 16 GB · with 24 GB
≤ 54 tok/s
Gemma 4 12BRuns
9.5 GB / 16 GB · with 24 GB
≤ 43 tok/s
gpt-oss-20bRuns
14 GB / 16 GB · with 24 GB
≤ 153 tok/s
Qwen3.6 27BRuns
20 GB / 48 GB · with 64 GB
≤ 18 tok/s
Qwen3.6 35B A3BRuns
24 GB / 48 GB · with 64 GB
≤ 166 tok/s
Llama 3.3 70BNot enough memory
55 GB / 48 GB · with 64 GB
—
gpt-oss-120bNot enough memory
65 GB / 48 GB · with 64 GB
—
Qwen3.5 122B A10BNot enough memory
79 GB / 48 GB · with 64 GB
—
Qwen3.5 397B A17BNot enough memory
247 GB / 48 GB · with 64 GB
—

Theoretical maximum for generating text: memory bandwidth divided by the bytes read per token. Real runs usually reach about half to three quarters of it.

Where to buy

Prices are editorial references (launch price and a typical street price on the date shown), not live prices. In 2026 the memory shortage has pushed many prices well above launch.

Prices are shown only if updated in the last 24 hours and may change; the retailer’s price at checkout applies. We may earn a commission from these links at no cost to you. Affiliate disclosure

Overview

Editorial opinion

Best for: A quiet home AI server for 27–35B models and MoE models up to about 45 GB.

Editorial opinionWould we buy it today?

Yes with 48–64 GB: the easiest quiet setup for mid-size models.

Pros and cons

Editorial opinion

Pros

  • 64 GB option in a tiny, quiet box
  • Low idle power
  • Excellent MLX and llama.cpp support

Cons

  • Expensive memory upgrades
  • Prompt processing is slower than on NVIDIA GPUs

Good to know

macOS lets the GPU use about two thirds of memory on machines with up to 36 GB, and about three quarters above that. The limit can be raised (sudo sysctl iogpu.wired_limit_mb=…), leaving less for macOS and other apps; our figures use the default.

Specifications

Factual data
Manufacturer
Apple
Chip
M5 Pro
Architecture
Apple silicon
Type
Unified-memory computer
Form factor
Mini PC
Released
2026
Availability
On sale
Memory options
24 GB / 48 GB / 64 GB
Memory type
Unified LPDDR
Memory bandwidth
307 GB/s
Usable for models (default)
48 GB / 64 GB
Compute stack
Metal / MLX
Models
Any model that fits
Several units for one model
Yes

Source: Manufacturer specifications

Software support

Editorial opinion

How well the popular local-AI tools run on it today (editorial assessment).

  • llama.cppExcellent
  • OllamaExcellent
  • LM StudioExcellent
  • vLLMPoor
  • MLXExcellent

Measured speeds

Factual data

Measured results with their source. We never invent speeds.

No measured results yet. The table above shows the theoretical ceiling instead.

Alternatives

NVIDIA GPUs

NVIDIA RTX PRO 6000 Blackwell

Memory
96 GB
Bandwidth
1.79 TB/s

Largest popular model at 4-bit: Qwen3.5 122B A10B

96 GB on one card at RTX 5090 speed: gpt-oss-120b and 122B MoE models entirely in GPU memory.

from $8,565 (typical price)For advanced users

Ryzen AI

AMD Ryzen AI Max+ 395 (Strix Halo)

Memory
128 GB
Bandwidth
256 GB/s

Largest popular model at 4-bit: Qwen3.5 122B A10B

128 GB of unified memory in a mini PC for less than a Mac Studio: the homelab favourite for MoE models.

from $2,200 (typical price)Highly recommended

AMD GPUs

AMD Radeon AI PRO R9700

Memory
32 GB
Bandwidth
645 GB/s

Largest popular model at 4-bit: Qwen3.6 35B A3B

32 GB for about a third of an RTX 5090: the cheapest new 32 GB card.

from $1,550 (typical price)Recommended