Build failed in Jenkins: hudi-snapshot-deployment-0.5 #43

2019-09-19 Thread Apache Jenkins Server
See -- [...truncated 2.25 KB...] mvnDebug.cmd mvnyjp /home/jenkins/tools/maven/apache-maven-3.5.4/boot: plexus-classworlds-2.5.2.jar

[GitHub] [incubator-hudi] cdmikechen opened a new issue #910: hoodie.*.consume.mode should be set whitelist in hive-site.xml

2019-09-19 Thread GitBox
cdmikechen opened a new issue #910: hoodie.*.consume.mode should be set whitelist in hive-site.xml URL: https://github.com/apache/incubator-hudi/issues/910 If user use `INCREMENTAL` mode to get increment data, we may need to let users know that we need to configure the whitelist in

[jira] [Commented] (HUDI-83) Support for timestamp datatype in Hudi

2019-09-19 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933882#comment-16933882 ] cdmikechen commented on HUDI-83: This problem is not only related to spark-avro, but also to the parquet

[GitHub] [incubator-hudi] bhasudha commented on issue #896: Updating site to reflect recent doc changes

2019-09-19 Thread GitBox
bhasudha commented on issue #896: Updating site to reflect recent doc changes URL: https://github.com/apache/incubator-hudi/pull/896#issuecomment-533349046 @yanghua Thanks for getting back on this. I am okay with your proposal. As we are uncertain about if this is a real issue and also

[jira] [Assigned] (HUDI-137) Hudi cleaning state changes should be consistent with commit actions

2019-09-19 Thread BALAJI VARADARAJAN (Jira)
[ https://issues.apache.org/jira/browse/HUDI-137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN reassigned HUDI-137: --- Assignee: BALAJI VARADARAJAN (was: Vinoth Chandar) > Hudi cleaning state changes

[jira] [Created] (HUDI-266) Utility Script to restore Hudi dataset to previous instant

2019-09-19 Thread BALAJI VARADARAJAN (Jira)
BALAJI VARADARAJAN created HUDI-266: --- Summary: Utility Script to restore Hudi dataset to previous instant Key: HUDI-266 URL: https://issues.apache.org/jira/browse/HUDI-266 Project: Apache Hudi

[jira] [Commented] (HUDI-260) Hudi Spark Bundle does not work when passed in extraClassPath option

2019-09-19 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933672#comment-16933672 ] Udit Mehrotra commented on HUDI-260: Can you give the following a shot: spark.driver.extraClassPath

[jira] [Commented] (HUDI-83) Support for timestamp datatype in Hudi

2019-09-19 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933660#comment-16933660 ] Udit Mehrotra commented on HUDI-83: --- Ack. Will we focusing on

[GitHub] [incubator-hudi] yanghua commented on issue #896: Updating site to reflect recent doc changes

2019-09-19 Thread GitBox
yanghua commented on issue #896: Updating site to reflect recent doc changes URL: https://github.com/apache/incubator-hudi/pull/896#issuecomment-533190448 @bhasudha Maybe the current state is right. We should not remove the first '/'. Please consider a similar example in Flink

[jira] [Updated] (HUDI-264) Ensure website for both english and chinese is rendered properly with styling scripts and images

2019-09-19 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-264: -- Attachment: Screen Shot 2019-09-19 at 11.14.09 PM.png > Ensure website for both english and chinese is rendered

[jira] [Commented] (HUDI-251) JDBC incremental load to HUDI with DeltaStreamer

2019-09-19 Thread Taher Koitawala (Jira)
[ https://issues.apache.org/jira/browse/HUDI-251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933493#comment-16933493 ] Taher Koitawala commented on HUDI-251: -- Agree [~vinoth] , let's kick this off. Pulsar can be seen

[jira] [Commented] (HUDI-251) JDBC incremental load to HUDI with DeltaStreamer

2019-09-19 Thread Taher Koitawala (Jira)
[ https://issues.apache.org/jira/browse/HUDI-251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933486#comment-16933486 ] Taher Koitawala commented on HUDI-251: -- Yes. Interval means how frequently DeltaStreamer runs to check

[jira] [Commented] (HUDI-251) JDBC incremental load to HUDI with DeltaStreamer

2019-09-19 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933481#comment-16933481 ] Vinoth Chandar commented on HUDI-251: - Interval is determined by how frequently we run the

[jira] [Commented] (HUDI-246) Apache Pulsar data source for Hudi

2019-09-19 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933473#comment-16933473 ] Vinoth Chandar commented on HUDI-246: - Yeah it was easy to reuse the streaming connector for kafka in

[jira] [Commented] (HUDI-265) Failed to delete tmp dirs created in unit tests

2019-09-19 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933471#comment-16933471 ] Vinoth Chandar commented on HUDI-265: - Sg. Thanks! Tests do need love. Cc @vinoyang as well > Failed

[GitHub] [incubator-hudi] firecast edited a comment on issue #894: Getting java.lang.NoSuchMethodError while doing Hive sync

2019-09-19 Thread GitBox
firecast edited a comment on issue #894: Getting java.lang.NoSuchMethodError while doing Hive sync URL: https://github.com/apache/incubator-hudi/issues/894#issuecomment-533140792 > Cant understand where Hive 2.3.2-amzn-2 comes from still from what you shared So the Job connects to

[GitHub] [incubator-hudi] firecast edited a comment on issue #894: Getting java.lang.NoSuchMethodError while doing Hive sync

2019-09-19 Thread GitBox
firecast edited a comment on issue #894: Getting java.lang.NoSuchMethodError while doing Hive sync URL: https://github.com/apache/incubator-hudi/issues/894#issuecomment-533140792 > Cant understand where Hive 2.3.2-amzn-2 comes from still from what you shared So the Job connects to

[GitHub] [incubator-hudi] firecast commented on issue #894: Getting java.lang.NoSuchMethodError while doing Hive sync

2019-09-19 Thread GitBox
firecast commented on issue #894: Getting java.lang.NoSuchMethodError while doing Hive sync URL: https://github.com/apache/incubator-hudi/issues/894#issuecomment-533140792 > Cant understand where Hive 2.3.2-amzn-2 comes from still from what you shared So the Job connects to a

[jira] [Updated] (HUDI-265) Failed to delete tmp dirs created in unit tests

2019-09-19 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-265: --- Fix Version/s: 0.5.1 Issue Type: Test (was: Bug) > Failed to delete tmp dirs created in unit tests >

[jira] [Created] (HUDI-265) Failed to delete tmp dirs created in unit tests

2019-09-19 Thread leesf (Jira)
leesf created HUDI-265: -- Summary: Failed to delete tmp dirs created in unit tests Key: HUDI-265 URL: https://issues.apache.org/jira/browse/HUDI-265 Project: Apache Hudi (incubating) Issue Type: Bug

[jira] [Commented] (HUDI-246) Apache Pulsar data source for Hudi

2019-09-19 Thread Taher Koitawala (Jira)
[ https://issues.apache.org/jira/browse/HUDI-246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933328#comment-16933328 ] Taher Koitawala commented on HUDI-246: -- Hi [~vinoth] explored a little on this. AFAIK Pulsar only has

[jira] [Commented] (HUDI-259) Hadoop 3 support for Hudi writing

2019-09-19 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933324#comment-16933324 ] Vinoth Chandar commented on HUDI-259: - [~Pratyaksh] awesome. if its a lot of changes to poms, can we

[GitHub] [incubator-hudi] jaimin-shah commented on a change in pull request #862: Add support for composite key

2019-09-19 Thread GitBox
jaimin-shah commented on a change in pull request #862: Add support for composite key URL: https://github.com/apache/incubator-hudi/pull/862#discussion_r326138793 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/keygen/TimestampBasedKeyGenerator.java

[jira] [Commented] (HUDI-251) JDBC incremental load to HUDI with DeltaStreamer

2019-09-19 Thread Taher Koitawala (Jira)
[ https://issues.apache.org/jira/browse/HUDI-251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933215#comment-16933215 ] Taher Koitawala commented on HUDI-251: -- Hi [~vinoth], According to me we should do 2 options under

[jira] [Commented] (HUDI-251) JDBC incremental load to HUDI with DeltaStreamer

2019-09-19 Thread Taher Koitawala (Jira)
[ https://issues.apache.org/jira/browse/HUDI-251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933199#comment-16933199 ] Taher Koitawala commented on HUDI-251: -- [~vinoth], I have assigned the ticket to myself. WIP > JDBC

[jira] [Assigned] (HUDI-251) JDBC incremental load to HUDI with DeltaStreamer

2019-09-19 Thread Taher Koitawala (Jira)
[ https://issues.apache.org/jira/browse/HUDI-251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Taher Koitawala reassigned HUDI-251: Assignee: Taher Koitawala > JDBC incremental load to HUDI with DeltaStreamer >

[GitHub] [incubator-hudi] Panxing4game opened a new issue #909: Can't have config file and hudi base path in different S3 bucket.

2019-09-19 Thread GitBox
Panxing4game opened a new issue #909: Can't have config file and hudi base path in different S3 bucket. URL: https://github.com/apache/incubator-hudi/issues/909 Hi, I found for delta streamer, if I have `--props` and `--target-base-path` in different aws S3 bucket, it will cause a file

[jira] [Commented] (HUDI-259) Hadoop 3 support for Hudi writing

2019-09-19 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933126#comment-16933126 ] Pratyaksh Sharma commented on HUDI-259: --- With Hadoop 3.1.0, few Hoodie Test classes are not compiling

[incubator-hudi] branch master updated: Fix mailmap to allow mapping of defunct emailIds to active emailIds

2019-09-19 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 69ca45b Fix mailmap to allow mapping

[GitHub] [incubator-hudi] bvaradar merged pull request #908: Fix mailmap to allow mapping of defunct emailIds to active emailIds

2019-09-19 Thread GitBox
bvaradar merged pull request #908: Fix mailmap to allow mapping of defunct emailIds to active emailIds URL: https://github.com/apache/incubator-hudi/pull/908 This is an automated message from the Apache Git Service. To

[GitHub] [incubator-hudi] bvaradar opened a new pull request #908: Fix mailmap to allow mapping of defunct emailIds to active emailIds

2019-09-19 Thread GitBox
bvaradar opened a new pull request #908: Fix mailmap to allow mapping of defunct emailIds to active emailIds URL: https://github.com/apache/incubator-hudi/pull/908 This is an automated message from the Apache Git Service.

[incubator-hudi] branch master updated: Adding mailmap to allow mapping of defunct emailIds to active emailIds

2019-09-19 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 2e75a69 Adding mailmap to allow

[GitHub] [incubator-hudi] bvaradar merged pull request #907: Adding mailmap to allow mapping of defunct emailIds to active emailIds

2019-09-19 Thread GitBox
bvaradar merged pull request #907: Adding mailmap to allow mapping of defunct emailIds to active emailIds URL: https://github.com/apache/incubator-hudi/pull/907 This is an automated message from the Apache Git Service. To

[GitHub] [incubator-hudi] bvaradar opened a new pull request #907: Adding mailmap to allow mapping of defunct emailIds to active emailIds

2019-09-19 Thread GitBox
bvaradar opened a new pull request #907: Adding mailmap to allow mapping of defunct emailIds to active emailIds URL: https://github.com/apache/incubator-hudi/pull/907 @vinothchandar @bhasudha : Going to try this out to see if the contribution is reflected correctly

[GitHub] [incubator-hudi] pratyakshsharma commented on issue #899: [HUDI-228] Contributing page updated to include JIRA guidelines

2019-09-19 Thread GitBox
pratyakshsharma commented on issue #899: [HUDI-228] Contributing page updated to include JIRA guidelines URL: https://github.com/apache/incubator-hudi/pull/899#issuecomment-532984919 Yes, even I checked in asf-site branch, #900 changes are not there.