Mac-Mini Setup

The model fit in memory. The conversation didn't.

Jun 18, 2026

•

2 min read

LLM Concepts

+1

The model fit in memory. The conversation didn't.

The 9B model was 6.6GB. It sat inside the Mac Mini's 16GB of memory with room to spare. So what dragged "hello" down to one word a second?

Yatharth Lakhera

For running LLMs, your RAM number is a lie. Look at the VRAM.

Jun 14, 2026

•

2 min read

LLM Concepts

+1

For running LLMs, your RAM number is a lie. Look at the VRAM.

Few day's after I had the Mac Mini running models, I found the setting half the internet argues about: n_gpu_layers. On a gaming PC it's the make-or-break dial. I'd never once touched it.

Yatharth Lakhera

I bought a Mac Mini to run a 9B model. "Hello" took a minute.

Jun 14, 2026

•

2 min read

LLM Concepts

+1

I bought a Mac Mini to run a 9B model. "Hello" took a minute.

I typed "hello" and watched the cursor blink. Sixty seconds later, one word came back.

Yatharth Lakhera