vinothchandar commented on a change in pull request #1289: [HUDI-92] Provide
reasonable names for Spark DAG stages in Hudi.
URL: https://github.com/apache/incubator-hudi/pull/1289#discussion_r375668006
##########
File path:
hudi-client/src/main/java/org/apache/hudi/table/HoodieCopyOnWriteTable.java
##########
@@ -298,6 +298,7 @@ public HoodieCleanerPlan scheduleClean(JavaSparkContext
jsc) {
int cleanerParallelism = Math.min(partitionsToClean.size(),
config.getCleanerParallelism());
LOG.info("Using cleanerParallelism: " + cleanerParallelism);
+ jsc.setJobGroup(this.getClass().getSimpleName(), "Generates List of
files to be cleaned");
Review comment:
I know the comments say `files` and you are just using that. but would be
nice to stick to our terminologies as much as possible.
https://cwiki.apache.org/confluence/display/HUDI/Design+And+Architecture
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
