prabcs commented on issue #7099: broker metadata refresh failing URL: https://github.com/apache/druid/issues/7099#issuecomment-583051470 On a similar note, on the broker, I see these messages. What causes the time for metadata refresh to keep increasing ? and what causes the number of segments queried to cap at 15000 ? Note: This is from 0.16.incubating version ``` 2020-02-05T17:31:11,175 INFO [DruidSchema-Cache-0] org.apache.druid.sql.calcite.schema.DruidSchema - Refreshed metadata for dataSource[datasource_3] in 1,259 ms (5334 segments queried, 0 segments left). 2020-02-05T17:32:17,460 INFO [DruidSchema-Cache-0] org.apache.druid.sql.calcite.schema.DruidSchema - Refreshed metadata for dataSource[datasource_3] in 1,541 ms (5421 segments queried, 0 segments left). 2020-02-05T17:33:00,499 INFO [DruidSchema-Cache-0] org.apache.druid.sql.calcite.schema.DruidSchema - Refreshed metadata for dataSource[datasource_3] in 1,210 ms (5463 segments queried, 0 segments left). 2020-02-05T17:33:40,757 INFO [DruidSchema-Cache-0] org.apache.druid.sql.calcite.schema.DruidSchema - Refreshed metadata for dataSource[datasource_3] in 15,222 ms (15000 segments queried, 1408 segments left). 2020-02-05T17:34:21,293 INFO [DruidSchema-Cache-0] org.apache.druid.sql.calcite.schema.DruidSchema - Refreshed metadata for dataSource[datasource_3] in 6,149 ms (15000 segments queried, 40803 segments left). 2020-02-05T17:35:25,323 INFO [DruidSchema-Cache-0] org.apache.druid.sql.calcite.schema.DruidSchema - Refreshed metadata for dataSource[datasource_3] in 4,825 ms (15000 segments queried, 28963 segments left). 2020-02-05T17:36:37,499 INFO [DruidSchema-Cache-0] org.apache.druid.sql.calcite.schema.DruidSchema - Refreshed metadata for dataSource[datasource_3] in 6,553 ms (15000 segments queried, 17831 segments left). 2020-02-05T17:37:40,936 INFO [DruidSchema-Cache-0] org.apache.druid.sql.calcite.schema.DruidSchema - Refreshed metadata for dataSource[datasource_3] in 8,293 ms (15000 segments queried, 7160 segments left). 2020-02-05T17:38:49,108 INFO [DruidSchema-Cache-0] org.apache.druid.sql.calcite.schema.DruidSchema - Refreshed metadata for dataSource[datasource_3] in 4,521 ms (12381 segments queried, 0 segments left). 2020-02-05T17:39:46,943 INFO [DruidSchema-Cache-0] org.apache.druid.sql.calcite.schema.DruidSchema - Refreshed metadata for dataSource[datasource_3] in 1,287 ms (5141 segments queried, 0 segments left). 2020-02-05T17:40:55,408 INFO [DruidSchema-Cache-0] org.apache.druid.sql.calcite.schema.DruidSchema - Refreshed metadata for dataSource[datasource_3] in 1,316 ms (5212 segments queried, 0 segments left). ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
