Re: decompression time metric, ie `query/decompress/time`

2019-04-19 Thread Charles Allen
We use the gcp profiler to get this kind of info. I'm torn, because on one hand it is handy to be able to have such information in the metrics system. But on the other hand you are kind of adding in extra profiling stuff when there are other profiling tools out there. As another example would we

decompression time metric, ie `query/decompress/time`

2019-04-19 Thread Egor Ryashin
Hey, I wonder if we add a metric which shows query column decompression time, does it make sense? When a segment is loaded by the Historical node into memory the Historical has to decompress columns before filtering and aggregation, and I don't have any information about how much the

Running UNION ALL queries in parallel

2019-04-19 Thread Julian Jaffe
Hey all, Druid currently executes UNION ALL queries sequentially ( https://github.com/apache/incubator-druid/blob/master/sql/src/main/java/org/apache/druid/sql/calcite/rel/DruidUnionRel.java#L98). There's a comment in that method that restates this, but does not explain why. Is there a reason why

segment metadata query and concise/roaring bitmap

2019-04-19 Thread Egor Ryashin
Hey, *Segment Metadata* query doesn't return information about bitmap type (concise/roaring), I wonder if we would like to add it here: "author": { "type": "STRING", "hasMultipleValues": false, "size": 555, "cardinality": 2, "minValue": "",