From Ollama to vLLM
From 24GB Blackwell workstation cards to one 128GB DGX Spark, then two Sparks and a QSFP cable: running DeepSeek-V4-Flash-Vision-Exp locally, understanding vLLM, and planning the next step with a 200Gb/s switch.
Thoughts on technology, infrastructure, and AI
Viewing posts tagged networking Clear filter
3 posts found
From 24GB Blackwell workstation cards to one 128GB DGX Spark, then two Sparks and a QSFP cable: running DeepSeek-V4-Flash-Vision-Exp locally, understanding vLLM, and planning the next step with a 200Gb/s switch.
A look at PowerDNS, the excellent Poweradmin web interface, and a design for sharing centrally managed zones across several isolated security domains.
A practical guide to testing and improving Linux network performance for a three-node Elasticsearch cluster fed by two Logstash servers, including NIC bonding, iperf3, ethtool, TuneD, PCP, nmon, and RHEL-specific tooling.