local LLMs

Large language models run on personal or on-premise hardware for privacy and control. Find guides, tools, setup advice, and performance comparisons here.

AI Agents and Tools

Bonsai 27B Reportedly Runs on an iPhone 17 Pro Max at 3.9 GB and About 11 Tokens Per Second
ByGeoff Dyers July 16, 2026

PrismML announced Bonsai 27B on July 14, 2026 as a 1-bit version of Qwen3.6 27B that it says fits and…

Read More Bonsai 27B Reportedly Runs on an iPhone 17 Pro Max at 3.9 GB and About 11 Tokens Per Second
AI Agents and Tools

Local LLMs Can Replace ChatGPT for Some Jobs
ByGeoff Dyers June 11, 2026June 23, 2026

Local LLMs can match ChatGPT for some jobs, especially privacy-sensitive, offline, low-latency, or tightly scoped work, but ChatGPT is still…

Read More Local LLMs Can Replace ChatGPT for Some Jobs