Streaming logs are finally getting better — without the bloat

Streaming data tech is a crowded field. Every vendor wants you to pipe your logs through their cloud, pay for their SaaS, and trust their uptime. TLDR writes about a new wave of log management tools that are simpler and cheaper — most of them open source, running on your own hardware or a tiny cloud instance.

The shift is practical. Instead of sending every log to Splunk or Datadog and getting billed by the volume, these tools let you stream logs in real time, query them cheaply, and keep the data close to where it's generated. Think: structured logs with schemas, fast search, and dashboards that don't take 45 seconds to load. The kind of stuff a small shop can run without a dedicated SRE.

For the brown and Black shops, the immigrant-owned consultancies, the shops with three engineers and a full queue — this matters. You don't need enterprise tooling to keep your logs organized and readable. You need something that works, costs less, and doesn't vanish if your internet blips.

Why this matters for us: the tools that stay cheap and on our own boxes save us from the vendor lock-in that eats margins — and keeps us in control of our own data.