HackerNews中文版HackerNews CN
GitHubTwitter

问HN：有没有人在进行日志的智能分层管理？

2 分•作者: didro•8 个月前•原帖
您可能对亚马逊 S3 智能分层存储有所了解： https://aws.amazon.com/s3/storage-classes/intelligent-tiering/。它会在数据一段时间未被访问后，自动将其移动到更便宜的存储层。 我在想，是否可以对可观察性数据——尤其是日志，采用类似的方法。热存储成本高，而许多数据在短时间内可能不会被查询。将未使用的日志移动到温存储或冷存储（或直接删除）可能会节省大量成本。 有没有人尝试过这种日志或指标的分层或老化策略？我很想听听您是如何处理的——使用了哪些工具、经验法则、以及所学到的教训。您的想法和推测也非常欢迎！
查看原文
You might be familiar with Amazon S3 Intelligent-Tiering: https:&#x2F;&#x2F;aws.amazon.com&#x2F;s3&#x2F;storage-classes&#x2F;intelligent-tiering&#x2F;. It automatically moves data to cheaper storage tiers when it hasn’t been accessed for a while.<p>I’m wondering if a similar approach could work for observability data — especially logs. Hot storage is expensive, and much of the data may not be queried after a short period. Moving unused logs to warm or cold storage (or dropping them) could potentially save a lot.<p>Has anyone tried this kind of tiering or aging strategy for logs or metrics? Would love to hear how you approached it — tools, heuristics, lessons learned. Thoughts and speculation are also very welcome!