Hi, I noticed that the query node will send a metadata query to the historical node once new segments are published, and this will trigger an analysis method to read all segments in memory and do the analysis. I tried to do lazy cache for columns, which will read segments from disk once they are called, however, the analysis method will read all data in memory to process the metadata query. Is it a good idea to migrate this analysis process to the middlemanager and persist the result in deep storage? So the historical node can just read that file to answer metadata query.
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@druid.apache.org For additional commands, e-mail: dev-h...@druid.apache.org
