gavinj.net

Thoughts on technology, infrastructure, and AI

Viewing posts tagged ai Clear filter

16 posts found

From Ollama to vLLM

From 24GB Blackwell workstation cards to one 128GB DGX Spark, then two Sparks and a QSFP cable: running DeepSeek-V4-Flash-Vision-Exp locally, understanding vLLM, and planning the next step with a 200Gb/s switch.

When Your AI Assistant Forgets Who You Are

Meta's new Muse agent is built around a curated long-term memory, and every major AI vendor is racing to solve the same problem. Meanwhile my own assistants still get sudden dementia every few days. A look at how agent memory actually works, from Hermes internals to ChatGPT, Claude, Gemini, Apple and xAI's Grok Bot.