[
https://issues.apache.org/jira/browse/GOBBLIN-1825?focusedWorklogId=858803&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-858803
]
ASF GitHub Bot logged work on GOBBLIN-1825:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 24/Apr/23 22:51
Start Date: 24/Apr/23 22:51
Worklog Time Spent: 10m
Work Description: meethngala commented on code in PR #3687:
URL: https://github.com/apache/gobblin/pull/3687#discussion_r1175846256
##########
gobblin-data-management/src/main/java/org/apache/gobblin/data/management/retention/version/HiveDatasetVersionCleaner.java:
##########
@@ -87,21 +87,25 @@ public void clean() throws IOException {
try (AutoReturnableObject<IMetaStoreClient> client =
cleanableHiveDataset.getClientPool().getClient()) {
Partition partition = hiveDatasetVersion.getPartition();
try {
+ if (cleanableHiveDataset.isShouldDeleteData()) {
+
cleanableHiveDataset.getFsCleanableHelper().clean(hiveDatasetVersion,
possiblyEmptyDirectories);
+ }
Review Comment:
Yeah, I thought that was the expected flow since we used to allow deleting
of the underlying files in simulation mode. Good that we identified that bug
too :)! I have pushed my changes in the latest PR
Issue Time Tracking
-------------------
Worklog Id: (was: 858803)
Time Spent: 40m (was: 0.5h)
> Hive retention job should fail if deleting underlying files fail
> ----------------------------------------------------------------
>
> Key: GOBBLIN-1825
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1825
> Project: Apache Gobblin
> Issue Type: New Feature
> Reporter: Meeth Gala
> Priority: Major
> Time Spent: 40m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
