[jira] [Commented] (HUDI-312) Investigate recent flaky CI runs

2019-10-30 Thread Balaji Varadarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963663#comment-16963663 ] Balaji Varadarajan commented on HUDI-312: - I am able to consistently reproduce the

[jira] [Updated] (HUDI-312) Investigate recent flaky CI runs

2019-10-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-312: Labels: pull-request-available (was: ) > Investigate recent flaky CI runs >

[GitHub] [incubator-hudi] bvaradar opened a new pull request #989: [HUDI-312] Disable embedded timeline server to mitigate integration test hanging issue

2019-10-30 Thread GitBox
bvaradar opened a new pull request #989: [HUDI-312] Disable embedded timeline server to mitigate integration test hanging issue URL: https://github.com/apache/incubator-hudi/pull/989 [HUDI-312] Disable embedded timeline server to mitigate integration test hanging issue Also explicitly c

[jira] [Commented] (HUDI-289) Implement a long running test for Hudi writing and querying end-end

2019-10-30 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963621#comment-16963621 ] vinoyang commented on HUDI-289: --- [~vinoth] OK, let's work together and keep in touch quickly.

[jira] [Commented] (HUDI-289) Implement a long running test for Hudi writing and querying end-end

2019-10-30 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963620#comment-16963620 ] Vinoth Chandar commented on HUDI-289: - Please feel free to pick and choose :). Next cou

[jira] [Commented] (HUDI-289) Implement a long running test for Hudi writing and querying end-end

2019-10-30 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963619#comment-16963619 ] vinoyang commented on HUDI-289: --- [~vinoth] Yes, I think some part of that PR could be reused.

[jira] [Commented] (HUDI-289) Implement a long running test for Hudi writing and querying end-end

2019-10-30 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963611#comment-16963611 ] Vinoth Chandar commented on HUDI-289: - Sg. Seems like you are reworking [~nishith29] ‘s

[jira] [Commented] (HUDI-312) Investigate recent flaky CI runs

2019-10-30 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963610#comment-16963610 ] Vinoth Chandar commented on HUDI-312: - I am surprised that you are unable to reproduce.

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #84

2019-10-30 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.16 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/bin: m2.conf mvn mvn.cmd mvnDebug mvnDebug.cmd mvnyjp /home/jenkins/tools/maven/apache

[GitHub] [incubator-hudi] taherk77 commented on a change in pull request #969: [HUDI-251] JDBC incremental load to HUDI DeltaStreamer

2019-10-30 Thread GitBox
taherk77 commented on a change in pull request #969: [HUDI-251] JDBC incremental load to HUDI DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/969#discussion_r340931795 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/JDBCSource.java ###

[jira] [Closed] (HUDI-299) Refactoring Hoodie#getFileName

2019-10-30 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-299. -- Resolution: Not A Problem > Refactoring Hoodie#getFileName > -- > > Key: HUDI

[jira] [Commented] (HUDI-299) Refactoring Hoodie#getFileName

2019-10-30 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963558#comment-16963558 ] leesf commented on HUDI-299: Close the issue for no other views. > Refactoring Hoodie#getFileN

[GitHub] [incubator-hudi] umehrot2 commented on a change in pull request #972: [HUDI-313] Fix select count star error when querying a realtime table

2019-10-30 Thread GitBox
umehrot2 commented on a change in pull request #972: [HUDI-313] Fix select count star error when querying a realtime table URL: https://github.com/apache/incubator-hudi/pull/972#discussion_r340926632 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/realtime/HoodieP

[GitHub] [incubator-hudi] leesf commented on issue #977: [HUDI-221] Translate concept page

2019-10-30 Thread GitBox
leesf commented on issue #977: [HUDI-221] Translate concept page URL: https://github.com/apache/incubator-hudi/pull/977#issuecomment-548146731 @vinothchandar The PR is ready. Please merge it when you have time. Thanks This is

[GitHub] [incubator-hudi] umehrot2 commented on issue #961: [HUDI-306] Support Glue catalog and other hive metastore implementations

2019-10-30 Thread GitBox
umehrot2 commented on issue #961: [HUDI-306] Support Glue catalog and other hive metastore implementations URL: https://github.com/apache/incubator-hudi/pull/961#issuecomment-548137606 > @umehrot2 did not respond here since there was a mailing list thread on the same. Seems like the jetty

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter

2019-10-30 Thread GitBox
vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter URL: https://github.com/apache/incubator-hudi/pull/976#discussion_r340826913 ## File path: hudi-common/src/main/java/org/apache/hudi/common/BloomFilterFactory.java ##

[GitHub] [incubator-hudi] n3nash commented on issue #972: [HUDI-313] Fix select count star error when querying a realtime table

2019-10-30 Thread GitBox
n3nash commented on issue #972: [HUDI-313] Fix select count star error when querying a realtime table URL: https://github.com/apache/incubator-hudi/pull/972#issuecomment-548058348 @zhedoubushishi Like @bvaradar mentioned, please synchronize on jobConf object after which this is good to go.

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #978: [HUDI-314] Fix multi partition keys error when querying a realtime table

2019-10-30 Thread GitBox
n3nash commented on a change in pull request #978: [HUDI-314] Fix multi partition keys error when querying a realtime table URL: https://github.com/apache/incubator-hudi/pull/978#discussion_r340796747 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/realtime/Abstra

[GitHub] [incubator-hudi] garyli1019 commented on issue #987: Support bulkinsert in HDFSParquetImporter

2019-10-30 Thread GitBox
garyli1019 commented on issue #987: Support bulkinsert in HDFSParquetImporter URL: https://github.com/apache/incubator-hudi/pull/987#issuecomment-548036351 @xushiyan Thanks for the PR! Parquet support was recently added to the delta streamer in https://github.com/apache/incubator-hudi/p

[GitHub] [incubator-hudi] yihua commented on issue #985: [HUDI-275] Translate the Querying Data page into Chinese documentation

2019-10-30 Thread GitBox
yihua commented on issue #985: [HUDI-275] Translate the Querying Data page into Chinese documentation URL: https://github.com/apache/incubator-hudi/pull/985#issuecomment-548023655 @leesf Thanks for your review. Addressed your comments in the latest commit.

[GitHub] [incubator-hudi] yihua commented on a change in pull request #985: [HUDI-275] Translate the Querying Data page into Chinese documentation

2019-10-30 Thread GitBox
yihua commented on a change in pull request #985: [HUDI-275] Translate the Querying Data page into Chinese documentation URL: https://github.com/apache/incubator-hudi/pull/985#discussion_r340756611 ## File path: docs/querying_data.cn.md ## @@ -1,122 +1,122 @@ --- -title:

[GitHub] [incubator-hudi] yihua commented on a change in pull request #986: [HUDI-317] change quickstart page spark-shell command

2019-10-30 Thread GitBox
yihua commented on a change in pull request #986: [HUDI-317] change quickstart page spark-shell command URL: https://github.com/apache/incubator-hudi/pull/986#discussion_r340750660 ## File path: docs/quickstart.md ## @@ -12,29 +12,14 @@ code snippets that allows you to in

[GitHub] [incubator-hudi] yihua commented on a change in pull request #986: [HUDI-317] change quickstart page spark-shell command

2019-10-30 Thread GitBox
yihua commented on a change in pull request #986: [HUDI-317] change quickstart page spark-shell command URL: https://github.com/apache/incubator-hudi/pull/986#discussion_r340752501 ## File path: docs/quickstart.md ## @@ -12,29 +12,14 @@ code snippets that allows you to in

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #978: [HUDI-314] Fix multi partition keys error when querying a realtime table

2019-10-30 Thread GitBox
bvaradar commented on a change in pull request #978: [HUDI-314] Fix multi partition keys error when querying a realtime table URL: https://github.com/apache/incubator-hudi/pull/978#discussion_r340753430 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/realtime/Abst

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #972: [HUDI-313] Fix select count star error when querying a realtime table

2019-10-30 Thread GitBox
bvaradar commented on a change in pull request #972: [HUDI-313] Fix select count star error when querying a realtime table URL: https://github.com/apache/incubator-hudi/pull/972#discussion_r340751836 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/realtime/HoodieP

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #972: [HUDI-313] Fix select count star error when querying a realtime table

2019-10-30 Thread GitBox
bvaradar commented on a change in pull request #972: [HUDI-313] Fix select count star error when querying a realtime table URL: https://github.com/apache/incubator-hudi/pull/972#discussion_r340751698 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/realtime/HoodieP

[GitHub] [incubator-hudi] xushiyan commented on a change in pull request #987: Support bulkinsert in HDFSParquetImporter

2019-10-30 Thread GitBox
xushiyan commented on a change in pull request #987: Support bulkinsert in HDFSParquetImporter URL: https://github.com/apache/incubator-hudi/pull/987#discussion_r340688445 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/HDFSParquetImporter.java ## @@

[GitHub] [incubator-hudi] xushiyan commented on a change in pull request #987: Support bulkinsert in HDFSParquetImporter

2019-10-30 Thread GitBox
xushiyan commented on a change in pull request #987: Support bulkinsert in HDFSParquetImporter URL: https://github.com/apache/incubator-hudi/pull/987#discussion_r340687862 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/HDFSParquetImporter.java ## @@

[GitHub] [incubator-hudi] xushiyan commented on a change in pull request #987: Support bulkinsert in HDFSParquetImporter

2019-10-30 Thread GitBox
xushiyan commented on a change in pull request #987: Support bulkinsert in HDFSParquetImporter URL: https://github.com/apache/incubator-hudi/pull/987#discussion_r340687490 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/HDFSParquetImporter.java ## @@

[GitHub] [incubator-hudi] smdahmed commented on issue #764: Hoodie 0.4.7: Error upserting bucketType UPDATE for partition #, No value present

2019-10-30 Thread GitBox
smdahmed commented on issue #764: Hoodie 0.4.7: Error upserting bucketType UPDATE for partition #, No value present URL: https://github.com/apache/incubator-hudi/issues/764#issuecomment-547950214 @bvaradar Balaji - sincere apologies for not getting back earlier. The fact is that t

[GitHub] [incubator-hudi] taherk77 commented on issue #969: [HUDI-251] JDBC incremental load to HUDI DeltaStreamer

2019-10-30 Thread GitBox
taherk77 commented on issue #969: [HUDI-251] JDBC incremental load to HUDI DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/969#issuecomment-547947730 @vinothchandar @leesf Changes addressed This is an automa

[GitHub] [incubator-hudi] taherk77 commented on a change in pull request #969: [HUDI-251] JDBC incremental load to HUDI DeltaStreamer

2019-10-30 Thread GitBox
taherk77 commented on a change in pull request #969: [HUDI-251] JDBC incremental load to HUDI DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/969#discussion_r340638091 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/JDBCSource.java ###

[GitHub] [incubator-hudi] taherk77 commented on a change in pull request #969: [HUDI-251] JDBC incremental load to HUDI DeltaStreamer

2019-10-30 Thread GitBox
taherk77 commented on a change in pull request #969: [HUDI-251] JDBC incremental load to HUDI DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/969#discussion_r340638357 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/JDBCSource.java ###

[GitHub] [incubator-hudi] taherk77 commented on a change in pull request #969: [HUDI-251] JDBC incremental load to HUDI DeltaStreamer

2019-10-30 Thread GitBox
taherk77 commented on a change in pull request #969: [HUDI-251] JDBC incremental load to HUDI DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/969#discussion_r340633807 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/JDBCSource.java ###

[GitHub] [incubator-hudi] leesf commented on issue #985: [HUDI-275] Translate the Querying Data page into Chinese documentation

2019-10-30 Thread GitBox
leesf commented on issue #985: [HUDI-275] Translate the Querying Data page into Chinese documentation URL: https://github.com/apache/incubator-hudi/pull/985#issuecomment-547891416 Thanks for opening this PR @yihua ! Looks good overall, only left some minor comments. --

[GitHub] [incubator-hudi] leesf commented on a change in pull request #985: [HUDI-275] Translate the Querying Data page into Chinese documentation

2019-10-30 Thread GitBox
leesf commented on a change in pull request #985: [HUDI-275] Translate the Querying Data page into Chinese documentation URL: https://github.com/apache/incubator-hudi/pull/985#discussion_r340597981 ## File path: docs/querying_data.cn.md ## @@ -1,122 +1,122 @@ --- -title:

[GitHub] [incubator-hudi] leesf commented on a change in pull request #985: [HUDI-275] Translate the Querying Data page into Chinese documentation

2019-10-30 Thread GitBox
leesf commented on a change in pull request #985: [HUDI-275] Translate the Querying Data page into Chinese documentation URL: https://github.com/apache/incubator-hudi/pull/985#discussion_r340597838 ## File path: docs/querying_data.cn.md ## @@ -1,122 +1,122 @@ --- -title:

[GitHub] [incubator-hudi] leesf commented on a change in pull request #985: [HUDI-275] Translate the Querying Data page into Chinese documentation

2019-10-30 Thread GitBox
leesf commented on a change in pull request #985: [HUDI-275] Translate the Querying Data page into Chinese documentation URL: https://github.com/apache/incubator-hudi/pull/985#discussion_r340595739 ## File path: docs/querying_data.cn.md ## @@ -1,122 +1,122 @@ --- -title:

[jira] [Commented] (HUDI-289) Implement a long running test for Hudi writing and querying end-end

2019-10-30 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16962861#comment-16962861 ] vinoyang commented on HUDI-289: --- [~vinoth] Report my progress: I am refactoring the dag packa

[GitHub] [incubator-hudi] Guru107 opened a new pull request #988: [MINOR] Fix avro schema warnings in builds

2019-10-30 Thread GitBox
Guru107 opened a new pull request #988: [MINOR] Fix avro schema warnings in builds URL: https://github.com/apache/incubator-hudi/pull/988 Add proper default values to avro schemas This is an automated message from the Apache