Anders Lie

@anderslie

building the local-est agent @usemagnitude

San Francisco

github.com/magnitudedev/m…

Replies Reposts Media

Pinned
Anders Lie
@anderslie
Aug 7
We've been working hard to make it easy to run fully-local agents that are actually solid. If you've been meaning to try local models but want an optimized experience that works out of the box, give magnitude a shot!
Tom Greenwald
@tomgreenwald
Aug 7
Introducing Magnitude: your actually local agent 100% private and offline. No token costs, no API keys. Open source. Today's agents are local. The model isn't. Every prompt, every file, every secret gets sent straight to Anthropic and OpenAI. Magnitude is built around local
00:00
Anders Lie
@anderslie
Sep 3
Inference engines pick between making one agent as fast as possible vs making concurrent agents faster and more memory efficient. But what if you could have both? llama.cpp prioritizes single session decode by using a fixed KV slot for each session. All the memory is always
00:00
2
Anders Lie
@anderslie
Sep 2
Got a lot of questions during our last launch about which harnesses Magnitude can run local models in. Now you can connect to any harness easily, and run offline workloads without babysitting an inference server. Your existing agent can use the Magnitude CLI to browse curated
Tom Greenwald
@tomgreenwald
Sep 2
I switched my Hermes agent to 100% free local models with Magnitude It’s running Qwen 3.6 35B-A3B at ~60 tok/s on my DGX Spark. It’s free, private, and always on running background tasks Hermes set Magnitude up itself. With the CLI it: - Profiled my hardware and found the best
00:00
1
Anders Lie
@anderslie
Aug 26
Prediction: we will have frontier AI (today's fable/sol) running efficiently on consumer hardware (<$2000) in <1 yr Previously you'd need a DGX station to run something truly frontier (GLM or better), or strapping together many GPUs. The M5 Ultra will run this at a fraction of
Tom Greenwald
@tomgreenwald
Aug 25
We compared the M5 Ultra Mac Studio 512GB with 4x DGX Spark and 4x AMD Ryzen AI Halo The prices are relatively the same ($15-20k), but the trade-offs are noticeable Compute (prompt processing speed) - Mac: one chip, all the compute is always usable. Quick on normal prompts,
3
Anders Lie
@anderslie
Aug 20
I have an itch that can only be scratched by acquiring more AI-capable hardware
Tom Greenwald
@tomgreenwald
Aug 20
Consumer Hardware Tiers for Local AI Coding (August 2026) TLDR: $1k buys the smartest model most people can run. The next $9k buys speed, context, and concurrency. The next intelligence jump starts at $10k Tier 1 ($1,000-1,500) - Used RTX 3090 running Qwen 3.8 27B at 4-bit (73

Sunbelt Computer Software

PL/B Language Development and Support

Anders Lie