abhisheksahani91 commented on issue #11745:
URL: https://github.com/apache/hudi/issues/11745#issuecomment-2277238378
post adding above mentioned configs, There is still logs printed on Driver
regarding Async Compaction
LOG
24/08/09 06:01:56 INFO AsyncCompactService: Starting Compaction for instant
[==>20240808163855558__compaction__REQUESTED]
Source code that print above log
```
@Override
protected Pair<CompletableFuture, ExecutorService> startService() {
ExecutorService executor =
Executors.newFixedThreadPool(maxConcurrentCompaction,
new CustomizedThreadFactory("async_compact_thread",
isRunInDaemonMode()));
return Pair.of(CompletableFuture.allOf(IntStream.range(0,
maxConcurrentCompaction).mapToObj(i -> CompletableFuture.supplyAsync(() -> {
try {
// Set Compactor Pool Name for allowing users to prioritize
compaction
LOG.info("Setting pool name for compaction to " + COMPACT_POOL_NAME);
context.setProperty(EngineProperty.COMPACTION_POOL_NAME,
COMPACT_POOL_NAME);
while (!isShutdownRequested()) {
final HoodieInstant instant = fetchNextAsyncServiceInstant();
if (null != instant) {
LOG.info("Starting Compaction for instant " + instant);
compactor.compact(instant);
LOG.info("Finished Compaction for instant " + instant);
}
}
LOG.info("Compactor shutting down properly!!");
} catch (InterruptedException ie) {
hasError = true;
LOG.warn("Compactor executor thread got interrupted exception.
Stopping", ie);
} catch (IOException e) {
hasError = true;
LOG.error("Compactor executor failed due to IOException", e);
throw new HoodieIOException(e.getMessage(), e);
} catch (Exception e) {
hasError = true;
LOG.error("Compactor executor failed", e);
throw e;
}
return true;
}, executor)).toArray(CompletableFuture[]::new)), executor);
}
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
