[
https://issues.apache.org/jira/browse/HUDI-118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16983461#comment-16983461
]
Pratyaksh Sharma commented on HUDI-118:
---------------------------------------
[~vbalaji] Yes the description is now clear. I am trying to understand the flow
of the concerned commands (CleansCommand, CompactionCommand,
HDFSParquetImporterCommand). IIUC, DFS properties file is needed to initiate
HoodieTableMetaClient in CleansCommand and CompactionCommand since in these
two, it is never getting initialised.
However I am not able to understand the use case of adding the same in
HDFSParquetImporterCommand. Would be great if you could help me here with your
valuable inputs.
> Hudi CLI : Provide options for passing properties to Compactor, Cleaner and
> ParquetImporter
> --------------------------------------------------------------------------------------------
>
> Key: HUDI-118
> URL: https://issues.apache.org/jira/browse/HUDI-118
> Project: Apache Hudi (incubating)
> Issue Type: Improvement
> Components: CLI, newbie
> Reporter: Balaji Varadarajan
> Assignee: Pratyaksh Sharma
> Priority: Minor
>
> For non-trivial CLI operations, we have a standalone script in hudi-utilities
> that users can call directly using spark-submit (usually). We also have
> commands in hudi-cli to invoke the commands directly from hudi-cli shell.
> There was an earlier effort to allow users to pass properties directly to the
> scripts in hudi-utilities but we still need to give the same functionality to
> the corresponding commands in hudi-cli.
> In hudi-cli, Compaction (schedule/compact), Cleaner and HDFSParquetImporter
> command does not have option to pass DFS properties file. This is a followup
> to PR [https://github.com/apache/incubator-hudi/pull/691]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
