All Stories

Real-Time Event Streaming in Rails using ActionController::Live and Server-Sent Events (SSE)

“Real-time dashboard” is the feature that silently becomes an architecture decision. The naive version polls a JSON endpoint every second: one client is nothing, but 500 dashboards at 1 req/s...

Speculative Decoding: Accelerating LLM Inference in Production

Decode is memory-bandwidth-bound, and that single fact is why speculative decoding is the cheapest throughput win an inference team can spend a week on. Every autoregressive step loads the entire...

Agent Orchestration: Comparing ReAct, Plan-and-Solve, and Reflection Patterns

Almost every agent starts as a naive while True: call_model, run_tool, call_model loop, and almost every production agent ends up as something else. The reason is that the three canonical...

Serialization Benchmarks: Go JSON vs. Protobuf vs. FlatBuffers

Why serialization keeps topping your pprof

Enterprise Text-to-SQL: Building Self-Correcting Execution Loops

Text-to-SQL looks solved in demos and falls apart in production, always in the same four ways: the model invents column names the schema never had, it emits syntax that parses...