Baoyuantop commented on PR #12631: URL: https://github.com/apache/apisix/pull/12631#issuecomment-3327108205
Hi @mdnfiras, do you need to use etcd as a logger? Technically speaking, etcd is not suitable for log storage. Writes to etcd must undergo Raft consensus, requiring majority node confirmation for all write operations. This results in high write latency and limited throughput (suitable for configuration/metadata but unsuitable for high-frequency writes like logs). Log systems typically require thousands to millions of writes per second, which etcd cannot handle. When etcd's data volume becomes excessively large, performance degrades sharply and may even compromise cluster stability. The official recommendation is to keep data volumes at the GB level, whereas logs routinely reach TB/PB scales. etcd only supports range queries based on keys and lacks the search, filtering, and aggregation capabilities required for log analysis. Could you elaborate on your proposal? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
