suryaprasanna commented on issue #5105: URL: https://github.com/apache/hudi/issues/5105#issuecomment-1087017462
@CrazyBeeline `hoodie.clustering.plan.strategy.daybased.skipfromlatest.partitions=2` config will make sure the last 2 partitions are not included as part of clustering, so partitions create_time=2021-03-09 and create_time=2021-03-10 should not be part of clustering operation. Unless a clustering plan already present in the timeline with those partitions listed, if you run clustering service async with different configs that can create clustering plan that includes all the 3 partitions. Can you check if you have any replacecommit in requested or inflight phase? I think Deltastreamer is stopped because the async operations are completed as there are no errors seen. Can you give us the state of the hoodie commit timeline? Also, can you attach more driver logs? I want to see logs starting `Enqueuing new pending` and also the clustering plans that are created. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
