[
https://issues.apache.org/jira/browse/HDDS-4975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sammi Chen resolved HDDS-4975.
------------------------------
Resolution: Fixed
> Refine missing delete block failure log
> ---------------------------------------
>
> Key: HDDS-4975
> URL: https://issues.apache.org/jira/browse/HDDS-4975
> Project: Apache Ozone
> Issue Type: Improvement
> Reporter: Sammi Chen
> Assignee: Sammi Chen
> Priority: Major
> Labels: pull-request-available
>
> Found a lot of block delete failure LOG in our cluster. Cann't easily tell
> which container and block are failed from the LOG.
> 2021-03-12 21:53:25,844 [BlockDeletingService#5] WARN
> org.apache.hadoop.hdds.utils.BackgroundService: Background task execution
> failed
> java.lang.NullPointerException: Block data cannot be null.
> at
> com.google.common.base.Preconditions.checkNotNull(Preconditions.java:897)
> at
> org.apache.hadoop.ozone.container.keyvalue.impl.ChunkManagerDispatcher.deleteChunks(ChunkManagerDispatcher.java:110)
> at
> org.apache.hadoop.ozone.container.keyvalue.KeyValueHandler.deleteBlock(KeyValueHandler.java:1045)
> at
> org.apache.hadoop.ozone.container.keyvalue.statemachine.background.BlockDeletingService$BlockDeletingTask.deleteTransactions(BlockDeletingService.java:445)
> at
> org.apache.hadoop.ozone.container.keyvalue.statemachine.background.BlockDeletingService$BlockDeletingTask.deleteViaSchema2(BlockDeletingService.java:401)
> at
> org.apache.hadoop.ozone.container.keyvalue.statemachine.background.BlockDeletingService$BlockDeletingTask.call(BlockDeletingService.java:268)
> at
> org.apache.hadoop.hdds.utils.BackgroundService$PeriodicalTask.lambda$run$0(BackgroundService.java:112)
> at
> java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1626)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> After patch, this is the log output,
> 2021-03-16 16:27:21,126 [BlockDeletingService#5] WARN
> org.apache.hadoop.ozone.container.keyvalue.statemachine.background.BlockDeletingService:
> Missing delete block(Container = 410375, Block = 105625340688072823
> 2021-03-16 16:27:21,126 [BlockDeletingService#7] WARN
> org.apache.hadoop.ozone.container.keyvalue.statemachine.background.BlockDeletingService:
> Missing delete block(Container = 410313, Block = 105625268260438073
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
