[
https://issues.apache.org/jira/browse/HUDI-118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986039#comment-16986039
]
Pratyaksh Sharma commented on HUDI-118:
---------------------------------------
[~vbalaji] Thank you for the explanation. As I checked, CleansCommand.java
class right now does not invoke the cleaning script touched in
[https://github.com/apache/incubator-hudi/pull/691]. This is because
SparkMain.java does not support CLEAN action right now. I got your point, I
will add the support for CLEAN action in SparkMain class along with taking care
of what you explained in the previous comment. Will be sending the PR soon.
> Hudi CLI : Provide options for passing properties to Compactor, Cleaner and
> ParquetImporter
> --------------------------------------------------------------------------------------------
>
> Key: HUDI-118
> URL: https://issues.apache.org/jira/browse/HUDI-118
> Project: Apache Hudi (incubating)
> Issue Type: Improvement
> Components: CLI, newbie
> Reporter: Balaji Varadarajan
> Assignee: Pratyaksh Sharma
> Priority: Minor
>
> For non-trivial CLI operations, we have a standalone script in hudi-utilities
> that users can call directly using spark-submit (usually). We also have
> commands in hudi-cli to invoke the commands directly from hudi-cli shell.
> There was an earlier effort to allow users to pass properties directly to the
> scripts in hudi-utilities but we still need to give the same functionality to
> the corresponding commands in hudi-cli.
> In hudi-cli, Compaction (schedule/compact), Cleaner and HDFSParquetImporter
> command does not have option to pass DFS properties file. This is a followup
> to PR [https://github.com/apache/incubator-hudi/pull/691]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
