undefined | Better HN

0 pointsbbrazil8y ago0 comments

> I strongly disagree that metrics and logs are different toolsets, or that you would need both of them in order to properly observe your systems.

And from the link:

> Logging can be useful for some purposes. However, it’s rare that they’re the only tool for monitoring your code. And it’s even rarer that they’re the best tool.

Metrics are a tool that take a different approach to logs, once you get beyond small systems you need both. I talked about this earlier in the year: https://www.youtube.com/watch?v=hCBGyLRJ1qo

0 comments

eternalban8y ago

https://youtu.be/hCBGyLRJ1qo?t=6m45s

[edit]

So I watched a few minutes into this, Brian, and it seems to me that either an expert system, or some form of rudimentary AI, that observes the monitoring system can be the driver of an intelligent alerting system. In other words, it seems 'alerts' are, in the final analysis, the higher value proposition.

And I fully agree with you: it really is a waste of talent to have engineers glued to screens watching graphs.

chimeracoder8y ago

> Metrics are a tool that take a different approach to logs, once you get beyond small systems you need both. I talked about this earlier in the year:

Quite the opposite - the "some purposes" I'm talking about are precisely the small scale. As scale grows, the use case of logs and metrics converges, and metrics become a strictly better tool.

jrv8y ago

The question is about tracking and storing individual events (logs) with arbitrary per-item detail vs. dimensionally limited aggregations (time series / metrics). In either case, I think we agree that the data should be recorded in a structured way, and when I say "logs" I just mean a record of individual items, not of sampled/aggregated metrics.

Given that, you need both logs (individual events) and metrics. Logs give you crucial insight into individual interesting events such as single requests that bring your service down, but logs are orders of magnitude more expensive than metrics in tracking, storage, and processing. So that's why you use metrics for a much wider scope and for longer time periods.

scotch_drinker8y ago

Not for high cardinality events like what happened to a particular user during a single session. Metrics will never help with that type of problem.

1 more reply

j / k navigate · click thread line to collapse