nickeylawrence opened a new issue #10154:
URL: https://github.com/apache/druid/issues/10154


   Hi,
   
   I am encountering a NullPointerException from the CompactionTask. Can anyone 
please suggest a solution?
   
   To brief on the scenario, I added a new metric with aggregator type 
'doubleSum' and loaded data to Druid. Later on, the aggregator had to be 
changed to 'doubleMax', and more data was loaded. 
   
   Now, the compaction task is failing with the error:
   
   _""2020-07-08T09:49:19,241 WARN [task-runner-0-priority-0] 
org.apache.druid.query.aggregation.AggregatorFactory - failed to merge 
aggregator factories
   " org.apache.druid.query.aggregation.AggregatorFactoryNotMergeableException: 
can't merge [max_XX : 
org.apache.druid.query.aggregation.DoubleMaxAggregatorFactory] and [max_XX : 
org.apache.druid.query.aggregation.DoubleSumAggregatorFactory] , with detailed 
info [DoubleMaxAggregatorFactory{fieldName='max_XX', expression='null', 
name='max_XX'}] and [DoubleSumAggregatorFactory{fieldName='max_XX', 
expression='null', name='max_XX'}]
        at 
org.apache.druid.query.aggregation.SimpleDoubleAggregatorFactory.getMergingFactory(SimpleDoubleAggregatorFactory.java:183)
 ~[druid-processing-0.18.1.jar:0.18.1]
        at 
org.apache.druid.query.aggregation.AggregatorFactory.mergeAggregators(AggregatorFactory.java:299)
 [druid-processing-0.18.1.jar:0.18.1]
        at 
org.apache.druid.indexing.common.task.CompactionTask.createMetricsSpec(CompactionTask.java:688)
 [druid-indexing-service-0.18.1.jar:0.18.1]
        at 
org.apache.druid.indexing.common.task.CompactionTask.createDataSchema(CompactionTask.java:667)
 [druid-indexing-service-0.18.1.jar:0.18.1]
        at 
org.apache.druid.indexing.common.task.CompactionTask.createIngestionSchema(CompactionTask.java:531)
 [druid-indexing-service-0.18.1.jar:0.18.1]
        at 
org.apache.druid.indexing.common.task.CompactionTask.runTask(CompactionTask.java:374)
 [druid-indexing-service-0.18.1.jar:0.18.1]
        at 
org.apache.druid.indexing.common.task.AbstractBatchIndexTask.run(AbstractBatchIndexTask.java:123)
 [druid-indexing-service-0.18.1.jar:0.18.1]
        at 
org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner$SingleTaskBackgroundRunnerCallable.call(SingleTaskBackgroundRunner.java:421)
 [druid-indexing-service-0.18.1.jar:0.18.1]
        at 
org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner$SingleTaskBackgroundRunnerCallable.call(SingleTaskBackgroundRunner.java:393)
 [druid-indexing-service-0.18.1.jar:0.18.1]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) 
[?:1.8.0_252]
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
[?:1.8.0_252]
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
[?:1.8.0_252]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_252]
   "2020-07-08T09:49:19,246 ERROR [task-runner-0-priority-0] 
org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner - Exception while 
running task[AbstractTask{id='compact_XXX-07-08T09:49:13.044Z', 
groupId='compact_XXX-07-08T09:49:13.044Z', 
taskResource=TaskResource{availabilityGroup='compact_XXX-07-08T09:49:13.044Z', 
requiredCapacity=1}, dataSource='DataSource_XX', 
context={storeCompactionState=true, priority=25, forceTimeChunkLock=true}}]
   " java.lang.NullPointerException: null
        at 
org.apache.druid.query.aggregation.AggregatorFactory.mergeAggregators(AggregatorFactory.java:294)
 ~[druid-processing-0.18.1.jar:0.18.1]
        at 
org.apache.druid.indexing.common.task.CompactionTask.createMetricsSpec(CompactionTask.java:688)
 ~[druid-indexing-service-0.18.1.jar:0.18.1]
        at 
org.apache.druid.indexing.common.task.CompactionTask.createDataSchema(CompactionTask.java:667)
 ~[druid-indexing-service-0.18.1.jar:0.18.1]
        at 
org.apache.druid.indexing.common.task.CompactionTask.createIngestionSchema(CompactionTask.java:531)
 ~[druid-indexing-service-0.18.1.jar:0.18.1]
        at 
org.apache.druid.indexing.common.task.CompactionTask.runTask(CompactionTask.java:374)
 ~[druid-indexing-service-0.18.1.jar:0.18.1]
        at 
org.apache.druid.indexing.common.task.AbstractBatchIndexTask.run(AbstractBatchIndexTask.java:123)
 ~[druid-indexing-service-0.18.1.jar:0.18.1]
        at 
org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner$SingleTaskBackgroundRunnerCallable.call(SingleTaskBackgroundRunner.java:421)
 [druid-indexing-service-0.18.1.jar:0.18.1]
        at 
org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner$SingleTaskBackgroundRunnerCallable.call(SingleTaskBackgroundRunner.java:393)
 [druid-indexing-service-0.18.1.jar:0.18.1]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) 
[?:1.8.0_252]
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
[?:1.8.0_252]
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
[?:1.8.0_252]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_252]
   "2020-07-08T09:49:19,250 INFO [task-runner-0-priority-0] 
org.apache.druid.indexing.worker.executor.ExecutorLifecycle - Task completed 
with status: {
     "id" : "compact_XXX-07-08T09:49:13.044Z",
     "status" : "FAILED",
     "duration" : 1432,
     "errorMsg" : "java.lang.NullPointerException",
     "location" : {
       "host" : null,
       "port" : -1,
       "tlsPort" : -1
     }_
   
   
    


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to