[GitHub] [incubator-hudi] afeldman1 commented on issue #933: Support for multiple level partitioning in Hudi

2020-05-21 Thread GitBox
afeldman1 commented on issue #933: URL: https://github.com/apache/incubator-hudi/issues/933#issuecomment-632436139 @vinothchandar Yes, I can do that. When you say the "`writing_data` page", are you referring to adding them to the wiki, to the DataSourceWriteOptions object, or to both? I'm

[GitHub] [incubator-hudi] afeldman1 commented on issue #933: Support for multiple level partitioning in Hudi

2020-05-15 Thread GitBox
afeldman1 commented on issue #933: URL: https://github.com/apache/incubator-hudi/issues/933#issuecomment-629478392 Similarly on whether we should add for the hive configuration, val HIVE_PARTITION_EXTRACTOR_CLASS_OPT_KEY = "hoodie.datasource.hive_sync.partition_extractor_class"

[GitHub] [incubator-hudi] afeldman1 commented on issue #933: Support for multiple level partitioning in Hudi

2020-05-15 Thread GitBox
afeldman1 commented on issue #933: URL: https://github.com/apache/incubator-hudi/issues/933#issuecomment-629455257 Thank you! That works. Should this be added to the org.apache.hudi DataSourceOptions.scala? Right now it has: /** * Key generator class, that implements will e

[GitHub] [incubator-hudi] afeldman1 commented on issue #933: Support for multiple level partitioning in Hudi

2020-05-15 Thread GitBox
afeldman1 commented on issue #933: URL: https://github.com/apache/incubator-hudi/issues/933#issuecomment-629409990 It looks like org.apache.hudi.ComplexKeyGenerator no longer exists. How can multiple columns be used as the partition columns now? ---