pdeva opened a new issue #7819: regression: queries unnecessary pushed down to 
historicals
URL: https://github.com/apache/incubator-druid/issues/7819
 
 
   ### Affected Version
   druid-0.14.2-incubating
   
   ### Description
   
   
   our segments are hour long (with 1 minute granularity).
   
   However, we are noticing that queries with short time intervals (1 min to 5 
mins) that should be handled by KIS tasks on middle managers are being pushed 
down to historicals for no reason.
   
   for example, the query below covers a 5 minute time range, and is still 
pushed down to historical for no reason.  
   
   This seems to be a regression which was introduced in some recent version of 
druid, maybe 0.12 or something, since we didn't see this behavior previously.
   
   Logged query in historical logs:
   
   ```js
   {
     "queryType": "groupBy",
     "dataSource": {
       "type": "table",
       "name": "apm-minute"
     },
     "intervals": {
       "type": "segments",
       "segments": [
         {
           "itvl": "2019-06-03T02:22:00.000Z/2019-06-03T02:27:00.000Z",
           "ver": "2019-06-02T23:58:59.432Z",
           "part": 0
         }
       ]
     },
     "virtualColumns": [],
     "filter": {
       "type": "and",
       "fields": [
         {
           "type": "selector",
           "dimension": "name",
           "value": "JVM/Memory/HeapMax",
           "extractionFn": null
         },
         {
           "type": "selector",
           "dimension": "jvmid",
           "value": "xxx",
           "extractionFn": null
         }
       ]
     },
     "granularity": {
       "type": "period",
       "period": "PT129600M",
       "timeZone": "UTC",
       "origin": "2019-06-03T02:22:00.000Z"
     },
     "dimensions": [
       {
         "type": "LegacyDimensionSpec",
         "dimension": "name",
         "outputName": "name",
         "outputType": "STRING"
       }
     ],
     "aggregations": [
       {
         "type": "doubleSum",
         "name": "value",
         "fieldName": "value",
         "expression": null
       }
     ],
     "postAggregations": [],
     "having": null,
     "limitSpec": {
       "type": "NoopLimitSpec"
     },
     "context": {
       "applyLimitPushDown": false,
       "defaultTimeout": 300000,
       "finalize": false,
       "groupByOutermost": false,
       "groupByStrategy": "v2",
       "maxQueuedBytes": 0,
       "maxScatterGatherBytes": 9223372036854775807,
       "queryFailTime": 1559529245069,
       "queryId": "f1f0e693-dedb-40fb-8616-06143f4e1639",
       "timeout": 300000
     },
     "descending": false
   }
   ```

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to