All Stories
Building a High-Performance JSON Parser using Go Code Generation
Every few months someone on the team proposes “we should just use a faster JSON library” and benchmarks encoding/json against a dropped-in replacement, sees a 2x, and ships it. That’s...
eBPF-Based Telemetry for LLM Inference Endpoints: Profiling CPU/GPU Latencies
If you serve LLM inference at any real scale, your standard monitoring stack has a blind spot exactly where your tokens actually spend time: the kernel. Prometheus exporters and Datadog...
LLM Agents in Production – What Changed in 2025
The model got smarter, but the reason agents work in production in 2025 is the harness around them. We run them in customer-support triage, internal ops, and incident summarization, and...
Rails Solid Cache: Dropping Redis for Database-Backed Caching
The Redis cache bill is a weird tax. You’re paying premium RAM prices for data that is, by definition, disposable — regenerate it and nothing breaks. When our cache footprint...
Go Compiler Internals: Escape Analysis, Function Inlining, and devirtualization
The difference between a handler that does 40 allocations per request and one that does four is usually not your data structures. It is whether the compiler managed to keep...
Building Multi-modal RAG Pipelines with Llama 3.1 and Qdrant
Let me correct the framing up front: Llama 3.1 is text-only. The 8B, 70B, and 405B models released in July 2024 consume tokens, not pixels. Any pipeline that claims to...