hemantkrsh commented on issue #2539: URL: https://github.com/apache/iggy/issues/2539#issuecomment-3785124190
> [@hemantkrsh](https://github.com/hemantkrsh) how's progress? It's work-in-progress. Similar to the Postgres connector, ClickHouse connector will support multiple modes for inserts: 1. Insert the payload as bytes(String type in ClickHouse), with metadata as columns and headers as JSON. 2. Parse the JSON on the client side and allow users to map fields to columns via connector configuration. 3. Insert the payload as ClickHouse's New JSON column type. Mode 1 will offer faster writes by minimizing processing. Mode 2 will shift parsing overhead to the client side but enable faster queries, as data is stored in columnar format with no runtime parsing needed. Mode 3 will offload processing to the ClickHouse server, while enabling faster queries on JSON objects. The connector will utilize the official Rust client [clickhouse-rs](https://clickhouse.com/docs/integrations/rust) rather than the standard HTTP client. The client provides built-in support for batching, connection pooling, and other features out-of-the-box. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
