dataedgehungary opened a new issue #9540: KILL TASK error - failed to delete .../0_descriptor.json URL: https://github.com/apache/druid/issues/9540 ### Affected Version 0.12.1 - HDP 3.1.4 install ### Description Dear All, I am trying to delete unused segment data from hdfs deep storage. I encounter a weird error and the kill task failes, with: `2020-03-19T15:39:39,737 ERROR [task-runner-0-priority-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Exception while running task[KillTask{id=kill_PONTMASTERDB.druid_vasarlas_2011068_2017-02-01T00:00:00.000Z_2017-03-01T00:00:00.000Z_2020-03-19T15:39:30.395Z, type=kill, dataSource=PONTMASTERDB.druid_vasarlas_2011068}] io.druid.segment.loading.SegmentLoadingException: Unable to kill segment, failed to delete [hdfs://namenodeha/druid/segments/PONTMASTERDB.druid_vasarlas_2011068/20170201T000000.000Z_20170301T000000.000Z/2020-03-13T10_14_25.197+01_00/0_descriptor.json] at io.druid.storage.hdfs.HdfsDataSegmentKiller.kill(HdfsDataSegmentKiller.java:93) ~[?:?] at io.druid.segment.loading.OmniDataSegmentKiller.kill(OmniDataSegmentKiller.java:46) ~[druid-server-0.12.1.3.1.4.0-315.jar:0.12.1.3.1.4.0-315] at io.druid.indexing.common.task.KillTask.run(KillTask.java:103) ~[druid-indexing-service-0.12.1.3.1.4.0-315.jar:0.12.1.3.1.4.0-315] at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:445) [druid-indexing-service-0.12.1.3.1.4.0-315.jar:0.12.1.3.1.4.0-315] at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:417) [druid-indexing-service-0.12.1.3.1.4.0-315.jar:0.12.1.3.1.4.0-315] at com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125) [guava-28.0-jre.jar:?] at com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:69) [guava-28.0-jre.jar:?] at com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78) [guava-28.0-jre.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_112] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_112] at java.lang.Thread.run(Thread.java:745) [?:1.8.0_112]` My first guess is that it is trying to delete 0_descriptor.json but it does not find the file. On my HDFS tree, inside all the segments, there are 2 file: 0_index.zip descriptor.json The kill task successfully deletes the 0_index.zip, but returns error when it tries to delete 0_descriptor.json but that does not exists... Where do I go wrong? Thanks
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
