mihai-cazacu-adswizz opened a new issue #7597: [materialized view] The generated specification is too big URL: https://github.com/apache/incubator-druid/issues/7597 **Affected Version** 0.13.0-incubating **Description** Processing an interval with many segments (100 - 400) throws this exception: ``` Length of raw bytes for znode[/.../indexer/tasks/server:8091/ds_2019-04-30T12:48:57.577Z] too large[655,019 > 524,288] ``` The generated JSON has `~2.5 MB` (each segment containing a lot of data, especially dimensions and metrics) and the Druid's limit is `512K` (while the Zookeeper's limit appears to be `1MB`). I have seen that we can modify the value of [druid.indexer.runner.maxZnodeBytes](https://github.com/metabase/druid/blob/master/docs/content/configuration/indexing-service.md) but is this recommended (over the time, the number of our segments could double)?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
