[GitHub] [incubator-hudi] wojustme commented on issue #1104: [HUDI-404] fix the error of compiling project.

2019-12-16 Thread GitBox
wojustme commented on issue #1104: [HUDI-404] fix the error of compiling project. URL: https://github.com/apache/incubator-hudi/pull/1104#issuecomment-566319717 @lamber-ken @leesf I am sorry for replying so late. But, In my dev's development environment, It doesn't work.

[GitHub] [incubator-hudi] nbalajee commented on a change in pull request #1077: [HUDI-335] : Improvements to DiskbasedMap

2019-12-16 Thread GitBox
nbalajee commented on a change in pull request #1077: [HUDI-335] : Improvements to DiskbasedMap URL: https://github.com/apache/incubator-hudi/pull/1077#discussion_r358524668 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/BufferedRandomAccessFile.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1077: [HUDI-335] : Improvements to DiskbasedMap

2019-12-16 Thread GitBox
vinothchandar commented on a change in pull request #1077: [HUDI-335] : Improvements to DiskbasedMap URL: https://github.com/apache/incubator-hudi/pull/1077#discussion_r358592257 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/BufferedRandomAccessFile.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1105: [HUDI-405] Fix sync no hive partition at first time

2019-12-16 Thread GitBox
vinothchandar commented on a change in pull request #1105: [HUDI-405] Fix sync no hive partition at first time URL: https://github.com/apache/incubator-hudi/pull/1105#discussion_r358599122 ## File path: hudi-hive/src/main/java/org/apache/hudi/hive/HoodieHiveClient.java ##

[GitHub] [incubator-hudi] nbalajee opened a new pull request #1077: [HUDI-335] : Improvements to DiskbasedMap

2019-12-16 Thread GitBox
nbalajee opened a new pull request #1077: [HUDI-335] : Improvements to DiskbasedMap URL: https://github.com/apache/incubator-hudi/pull/1077 ## What is the purpose of the pull request DiskBasedMap is used by ExternalSpillableMap for writing (K,V) pair to a file, keeping the (K,

[GitHub] [incubator-hudi] nbalajee commented on issue #1077: [HUDI-335] : Improvements to DiskbasedMap

2019-12-16 Thread GitBox
nbalajee commented on issue #1077: [HUDI-335] : Improvements to DiskbasedMap URL: https://github.com/apache/incubator-hudi/pull/1077#issuecomment-566301347 > Is there a JIRA for this work? https://issues.apache.org/jira/browse/HUDI-335

[jira] [Commented] (HUDI-331) Fix java docs for all public apis (HoodieWriteClient)

2019-12-16 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997800#comment-16997800 ] leesf commented on HUDI-331: [~hongdongdong] Thanks. > Fix java docs for all public apis (HoodieWriteClient) >

[GitHub] [incubator-hudi] leesf opened a new pull request #1107: [MINOR] add committers info

2019-12-16 Thread GitBox
leesf opened a new pull request #1107: [MINOR] add committers info URL: https://github.com/apache/incubator-hudi/pull/1107 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.*

[jira] [Created] (HUDI-415) HoodieSparkSqlWriter Commit time not representing the Spark job starting time

2019-12-16 Thread Yanjia Gary Li (Jira)
Yanjia Gary Li created HUDI-415: --- Summary: HoodieSparkSqlWriter Commit time not representing the Spark job starting time Key: HUDI-415 URL: https://issues.apache.org/jira/browse/HUDI-415 Project:

[jira] [Commented] (HUDI-331) Fix java docs for all public apis (HoodieWriteClient)

2019-12-16 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997780#comment-16997780 ] hong dongdong commented on HUDI-331: I will working on it. [~xleesf] > Fix java docs for all public

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #131

2019-12-16 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.21 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/bin: m2.conf mvn mvn.cmd mvnDebug mvnDebug.cmd mvnyjp

[jira] [Commented] (HUDI-259) Hadoop 3 support for Hudi writing

2019-12-16 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997899#comment-16997899 ] Vinoth Chandar commented on HUDI-259: - I believe we will get some eyes on this after the holidays :) >

[GitHub] [incubator-hudi] lamber-ken commented on issue #1104: [HUDI-404] fix the error of compiling project.

2019-12-16 Thread GitBox
lamber-ken commented on issue #1104: [HUDI-404] fix the error of compiling project. URL: https://github.com/apache/incubator-hudi/pull/1104#issuecomment-566323965 > @lamber-ken @leesf > I am sorry for replying so late. > But, In my dev's development environment, It doesn't work.

[GitHub] [incubator-hudi] nbalajee commented on issue #1077: [HUDI-335] : Improvements to DiskbasedMap

2019-12-16 Thread GitBox
nbalajee commented on issue #1077: [HUDI-335] : Improvements to DiskbasedMap URL: https://github.com/apache/incubator-hudi/pull/1077#issuecomment-566294609 > Is there a JIRA for this work? Sorry. Missed your comment. Updated header with JIRA id.

[jira] [Updated] (HUDI-335) Improvements to DiskBasedMap

2019-12-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-335: Labels: Hoodie pull-request-available (was: Hoodie) > Improvements to DiskBasedMap >

[GitHub] [incubator-hudi] nbalajee closed pull request #1077: [HUDI-335] : Improvements to DiskbasedMap

2019-12-16 Thread GitBox
nbalajee closed pull request #1077: [HUDI-335] : Improvements to DiskbasedMap URL: https://github.com/apache/incubator-hudi/pull/1077 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [incubator-hudi] n3nash commented on issue #1100: [HUDI-289] Implement a test suite to support long running test for Hudi writing and querying end-end

2019-12-16 Thread GitBox
n3nash commented on issue #1100: [HUDI-289] Implement a test suite to support long running test for Hudi writing and querying end-end URL: https://github.com/apache/incubator-hudi/pull/1100#issuecomment-566306717 @yanghua great, thanks. Can you please take a pass at the current PR and

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1100: [HUDI-289] Implement a test suite to support long running test for Hudi writing and querying end-end

2019-12-16 Thread GitBox
yanghua commented on a change in pull request #1100: [HUDI-289] Implement a test suite to support long running test for Hudi writing and querying end-end URL: https://github.com/apache/incubator-hudi/pull/1100#discussion_r358569570 ## File path:

[jira] [Created] (HUDI-416) Improve hint information for Cli

2019-12-16 Thread hong dongdong (Jira)
hong dongdong created HUDI-416: -- Summary: Improve hint information for Cli Key: HUDI-416 URL: https://issues.apache.org/jira/browse/HUDI-416 Project: Apache Hudi (incubating) Issue Type:

[GitHub] [incubator-hudi] leesf commented on issue #1095: [HUDI-210] Implement prometheus metrics reporter

2019-12-16 Thread GitBox
leesf commented on issue #1095: [HUDI-210] Implement prometheus metrics reporter URL: https://github.com/apache/incubator-hudi/pull/1095#issuecomment-566389322 @lamber-ken @XuQianJin-Stars. Is it ready? This is an automated

[GitHub] [incubator-hudi] leesf merged pull request #1107: [MINOR] add committers info

2019-12-16 Thread GitBox
leesf merged pull request #1107: [MINOR] add committers info URL: https://github.com/apache/incubator-hudi/pull/1107 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[incubator-hudi] branch asf-site updated: [MINOR] add committers info (#1107)

2019-12-16 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new e3bce1f [MINOR] add committers info

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom

2019-12-16 Thread GitBox
nsivabalan commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom URL: https://github.com/apache/incubator-hudi/pull/1091#discussion_r358621923 ## File path:

[GitHub] [incubator-hudi] nsivabalan commented on issue #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom

2019-12-16 Thread GitBox
nsivabalan commented on issue #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom URL: https://github.com/apache/incubator-hudi/pull/1091#issuecomment-566403318 @vinothchandar : have addressed all feedback so far. waiting

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1105: [HUDI-405] Fix sync no hive partition at first time

2019-12-16 Thread GitBox
lamber-ken edited a comment on issue #1105: [HUDI-405] Fix sync no hive partition at first time URL: https://github.com/apache/incubator-hudi/pull/1105#issuecomment-566390544 > Don't follow why the partitions are not visible after the commit? Can we first layout the root cause for that?

[GitHub] [incubator-hudi] lamber-ken commented on a change in pull request #1105: [HUDI-405] Fix sync no hive partition at first time

2019-12-16 Thread GitBox
lamber-ken commented on a change in pull request #1105: [HUDI-405] Fix sync no hive partition at first time URL: https://github.com/apache/incubator-hudi/pull/1105#discussion_r358614326 ## File path: hudi-hive/src/main/java/org/apache/hudi/hive/HoodieHiveClient.java ## @@

[GitHub] [incubator-hudi] lamber-ken commented on issue #1095: [HUDI-210] Implement prometheus metrics reporter

2019-12-16 Thread GitBox
lamber-ken commented on issue #1095: [HUDI-210] Implement prometheus metrics reporter URL: https://github.com/apache/incubator-hudi/pull/1095#issuecomment-566414155 > @lamber-ken @XuQianJin-Stars. Is it ready? Not yet.

[incubator-hudi] branch master updated (9a1f698 -> 7498ca7)

2019-12-16 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from 9a1f698 [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset add 7498ca7

[GitHub] [incubator-hudi] hddong opened a new pull request #1110: [HUDI-416]improve hint information for cli

2019-12-16 Thread GitBox
hddong opened a new pull request #1110: [HUDI-416]improve hint information for cli URL: https://github.com/apache/incubator-hudi/pull/1110 ## What is the purpose of the pull request Right now, cli always give error information: `Command 'desc' was found but is not currently

[jira] [Updated] (HUDI-416) Improve hint information for Cli

2019-12-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-416: Labels: pull-request-available (was: ) > Improve hint information for Cli >

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom

2019-12-16 Thread GitBox
leesf commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom URL: https://github.com/apache/incubator-hudi/pull/1091#discussion_r358643404 ## File path:

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter

2019-12-16 Thread GitBox
nsivabalan commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter URL: https://github.com/apache/incubator-hudi/pull/976#discussion_r358621679 ## File path:

[GitHub] [incubator-hudi] lamber-ken commented on a change in pull request #1105: [HUDI-405] Fix sync no hive partition at first time

2019-12-16 Thread GitBox
lamber-ken commented on a change in pull request #1105: [HUDI-405] Fix sync no hive partition at first time URL: https://github.com/apache/incubator-hudi/pull/1105#discussion_r358611033 ## File path: hudi-hive/src/main/java/org/apache/hudi/hive/HoodieHiveClient.java ## @@

[jira] [Commented] (HUDI-251) JDBC incremental load to HUDI with DeltaStreamer

2019-12-16 Thread Purushotham Pushpavanthar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997914#comment-16997914 ] Purushotham Pushpavanthar commented on HUDI-251: Thanks. [~vinoth] how do I create RFC? I'm

[GitHub] [incubator-hudi] ezhux opened a new pull request #1109: [HUDI-238] - Migrating to Scala 2.12

2019-12-16 Thread GitBox
ezhux opened a new pull request #1109: [HUDI-238] - Migrating to Scala 2.12 URL: https://github.com/apache/incubator-hudi/pull/1109 Summary: - Migrating to Scala 2.12 - Migrating to spark-streaming-kafka-0-10 - Adapting Kafka and Zookeeper This includes some changes that are

[jira] [Updated] (HUDI-238) Make separate release for hudi spark/scala based packages for scala 2.12

2019-12-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-238: Labels: pull-request-available (was: ) > Make separate release for hudi spark/scala based packages

[GitHub] [incubator-hudi] lamber-ken commented on issue #1105: [HUDI-405] Fix sync no hive partition at first time

2019-12-16 Thread GitBox
lamber-ken commented on issue #1105: [HUDI-405] Fix sync no hive partition at first time URL: https://github.com/apache/incubator-hudi/pull/1105#issuecomment-566390544 > Don't follow why the partitions are not visible after the commit? Can we first layout the root cause for that?

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1105: [HUDI-405] Fix sync no hive partition at first time

2019-12-16 Thread GitBox
lamber-ken edited a comment on issue #1105: [HUDI-405] Fix sync no hive partition at first time URL: https://github.com/apache/incubator-hudi/pull/1105#issuecomment-566390544 > Don't follow why the partitions are not visible after the commit? Can we first layout the root cause for that?

[GitHub] [incubator-hudi] lamber-ken opened a new pull request #1108: [MINOR] Add slack invite icon on README

2019-12-16 Thread GitBox
lamber-ken opened a new pull request #1108: [MINOR] Add slack invite icon on README URL: https://github.com/apache/incubator-hudi/pull/1108 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a

[jira] [Closed] (HUDI-394) Provide a basic implementation of test suite

2019-12-16 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-394. - Resolution: Implemented > Provide a basic implementation of test suite >

[jira] [Assigned] (HUDI-251) JDBC incremental load to HUDI with DeltaStreamer

2019-12-16 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned HUDI-251: --- Assignee: Purushotham Pushpavanthar > JDBC incremental load to HUDI with DeltaStreamer >

[GitHub] [incubator-hudi] vinothchandar closed issue #857: http://hudi.apache.org/comparison.html# should mention Iceberg and DeltaLake

2019-12-16 Thread GitBox
vinothchandar closed issue #857: http://hudi.apache.org/comparison.html# should mention Iceberg and DeltaLake URL: https://github.com/apache/incubator-hudi/issues/857 This is an automated message from the Apache Git

[jira] [Commented] (HUDI-392) Introduce DIstributedTestDataSource to generate test data

2019-12-16 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997254#comment-16997254 ] vinoyang commented on HUDI-392: --- Working on this issue. [~vinoth]  [~nishith29] FYI > Introduce

[jira] [Commented] (HUDI-251) JDBC incremental load to HUDI with DeltaStreamer

2019-12-16 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997317#comment-16997317 ] Vinoth Chandar commented on HUDI-251: - [~pushpavanthar] you have the ticket now > JDBC incremental