n3nash commented on a change in pull request #691: Allow users to set hoodie
configs figs for Compactor, Cleaner and HDFSParquetImporter utility scripts
URL: https://github.com/apache/incubator-hudi/pull/691#discussion_r287180315
##########
File path:
hoodie-utilities/src/main/java/com/uber/hoodie/utilities/HDFSParquetImporter.java
##########
@@ -57,14 +59,22 @@
* Loads data from Parquet Sources
*/
public class HDFSParquetImporter implements Serializable {
+ private static volatile Logger log =
LogManager.getLogger(HDFSParquetImporter.class);
public static final SimpleDateFormat PARTITION_FORMATTER = new
SimpleDateFormat("yyyy/MM/dd");
private static volatile Logger logger =
LogManager.getLogger(HDFSParquetImporter.class);
private final Config cfg;
private transient FileSystem fs;
+ /**
+ * Bag of properties with source, hoodie client, key generator etc.
+ */
+ private TypedProperties props;
public HDFSParquetImporter(Config cfg) throws IOException {
this.cfg = cfg;
+ this.props = cfg.propsFilePath == null ?
UtilHelpers.buildProperties(cfg.configs) :
Review comment:
what is cfg.configs ?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
