[jira] [Updated] (HUDI-405) Fix sync no hive partition at first time

2019-12-12 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-405: Summary: Fix sync no hive partition at first time (was: Fix syncronizing no hive partition at first time)

[jira] [Created] (HUDI-405) Fix syncronizing no hive partition at first time

2019-12-12 Thread lamber-ken (Jira)
lamber-ken created HUDI-405: --- Summary: Fix syncronizing no hive partition at first time Key: HUDI-405 URL: https://issues.apache.org/jira/browse/HUDI-405 Project: Apache Hudi (incubating) Issue

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom

2019-12-12 Thread GitBox
nsivabalan commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom URL: https://github.com/apache/incubator-hudi/pull/1091#discussion_r357505855 ## File path:

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #127

2019-12-12 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.13 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/bin: m2.conf mvn mvn.cmd mvnDebug mvnDebug.cmd mvnyjp

[jira] [Assigned] (HUDI-405) Fix sync no hive partition at first time

2019-12-12 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken reassigned HUDI-405: --- Assignee: lamber-ken > Fix sync no hive partition at first time >

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom

2019-12-12 Thread GitBox
nsivabalan commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom URL: https://github.com/apache/incubator-hudi/pull/1091#discussion_r357500105 ## File path:

[GitHub] [incubator-hudi] hddong commented on issue #1096: [HUDI-398]Add set env for spark launcher

2019-12-12 Thread GitBox
hddong commented on issue #1096: [HUDI-398]Add set env for spark launcher URL: https://github.com/apache/incubator-hudi/pull/1096#issuecomment-565282623 @leesf thanks, all be updated. This is an automated message from the

[GitHub] [incubator-hudi] Akshay2Agarwal commented on issue #143: Tracking ticket for folks to be added to slack group

2019-12-12 Thread GitBox
Akshay2Agarwal commented on issue #143: Tracking ticket for folks to be added to slack group URL: https://github.com/apache/incubator-hudi/issues/143#issuecomment-565288931 Please add me to the group: akshay.agar...@grofers.com. Thanks in advance !

[GitHub] [incubator-hudi] wojustme opened a new pull request #1104: [HUDI-404] fix the error of compiling project.

2019-12-12 Thread GitBox
wojustme opened a new pull request #1104: [HUDI-404] fix the error of compiling project. URL: https://github.com/apache/incubator-hudi/pull/1104 When I compile the current project, but it throws some error, as [jira](https://issues.apache.org/jira/projects/HUDI/issues/HUDI-404) described

[jira] [Updated] (HUDI-404) Compile Master's Source Code Error

2019-12-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-404: Labels: pull-request-available (was: ) > Compile Master's Source Code Error >

[GitHub] [incubator-hudi] vinothchandar merged pull request #1103: [MINOR] Unify Lists import

2019-12-12 Thread GitBox
vinothchandar merged pull request #1103: [MINOR] Unify Lists import URL: https://github.com/apache/incubator-hudi/pull/1103 This is an automated message from the Apache Git Service. To respond to the message, please log on

[incubator-hudi] branch master updated: [MINOR] Unify Lists import (#1103)

2019-12-12 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new f324057 [MINOR] Unify Lists import

[jira] [Commented] (HUDI-259) Hadoop 3 support for Hudi writing

2019-12-12 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995398#comment-16995398 ] Pratyaksh Sharma commented on HUDI-259: --- [~garyli1019] This is still under progress and the work is

[GitHub] [incubator-hudi] yanghua commented on issue #1102: [HUDI-391] Rename module name from hudi-bench to hudi-test-suite

2019-12-12 Thread GitBox
yanghua commented on issue #1102: [HUDI-391] Rename module name from hudi-bench to hudi-test-suite URL: https://github.com/apache/incubator-hudi/pull/1102#issuecomment-565288187 @n3nash > LGTM to me, couple of things to do before merging : > > 1. Can you do a search of

[GitHub] [incubator-hudi] n3nash commented on issue #1102: [HUDI-391] Rename module name from hudi-bench to hudi-test-suite

2019-12-12 Thread GitBox
n3nash commented on issue #1102: [HUDI-391] Rename module name from hudi-bench to hudi-test-suite URL: https://github.com/apache/incubator-hudi/pull/1102#issuecomment-565275253 LGTM to me, couple of things to do before merging : 1) Can you do a search of `hudi-bench` string in the

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset

2019-12-12 Thread GitBox
n3nash commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset URL: https://github.com/apache/incubator-hudi/pull/1009#discussion_r357463167 ## File path:

[jira] [Updated] (HUDI-404) Compile Master's Source Code Error

2019-12-12 Thread Xurenhe (Jira)
[ https://issues.apache.org/jira/browse/HUDI-404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xurenhe updated HUDI-404: - Attachment: hudi-compile-error.png > Compile Master's Source Code Error > --- > >

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom

2019-12-12 Thread GitBox
nsivabalan commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom URL: https://github.com/apache/incubator-hudi/pull/1091#discussion_r357501268 ## File path:

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom

2019-12-12 Thread GitBox
nsivabalan commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom URL: https://github.com/apache/incubator-hudi/pull/1091#discussion_r357501183 ## File path:

[jira] [Created] (HUDI-404) Compile Master's Source Code Error

2019-12-12 Thread Xurenhe (Jira)
Xurenhe created HUDI-404: Summary: Compile Master's Source Code Error Key: HUDI-404 URL: https://issues.apache.org/jira/browse/HUDI-404 Project: Apache Hudi (incubating) Issue Type: Bug

[GitHub] [incubator-hudi] lamber-ken commented on issue #1098: [HUDI-401]Remove unnecessary use of spark in savepoint timeline

2019-12-12 Thread GitBox
lamber-ken commented on issue #1098: [HUDI-401]Remove unnecessary use of spark in savepoint timeline URL: https://github.com/apache/incubator-hudi/pull/1098#issuecomment-564895376 +1, from my side. This is an automated

[jira] [Created] (HUDI-403) Publish a deployment guide talking about deployment options, upgrading etc

2019-12-12 Thread Vinoth Chandar (Jira)
Vinoth Chandar created HUDI-403: --- Summary: Publish a deployment guide talking about deployment options, upgrading etc Key: HUDI-403 URL: https://issues.apache.org/jira/browse/HUDI-403 Project: Apache

[incubator-hudi] branch hudi_test_suite_refactor created (now c2c9347)

2019-12-12 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a change to branch hudi_test_suite_refactor in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. at c2c9347 [HUDI-394] Provide a basic implementation of test suite No new revisions were

[GitHub] [incubator-hudi] yanghua closed pull request #1057: Hudi Test Suite

2019-12-12 Thread GitBox
yanghua closed pull request #1057: Hudi Test Suite URL: https://github.com/apache/incubator-hudi/pull/1057 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Closed] (HUDI-399) Fix conflicts of test suite basic implementation based on master branch and fix checkstyle issues

2019-12-12 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-399. - Resolution: Won't Fix I have rebased HUDI-394 and fixed checkstyle error in that stage.  > Fix conflicts of test

[jira] [Commented] (HUDI-233) Redo log statements using SLF4J

2019-12-12 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994668#comment-16994668 ] lamber-ken commented on HUDI-233: - Hi, [~xleesf] [~vinoth], I think we can use `maven-shade-plugin` to

[incubator-hudi] branch hudi_test_suite created (now 4ac72f4)

2019-12-12 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a change to branch hudi_test_suite in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. at 4ac72f4 Rename module name from hudi-bench to hudi-end-to-end-tests This branch includes the

[incubator-hudi] 01/01: Rename module name from hudi-bench to hudi-end-to-end-tests

2019-12-12 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch hudi_test_suite in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git commit 4ac72f4f62800725a469b9a8bc8110acb0b18fb1 Author: yanghua AuthorDate: Tue Dec 3 19:44:15 2019 +0800

[incubator-hudi] branch feature_hudi_test_suite created (now eaaf3f6)

2019-12-12 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a change to branch feature_hudi_test_suite in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. at eaaf3f6 [HUDI-394] Provide a basic implementation of test suite This branch includes

[jira] [Updated] (HUDI-394) Provide a basic implementation of test suite

2019-12-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-394: Labels: pull-request-available (was: ) > Provide a basic implementation of test suite >

[GitHub] [incubator-hudi] yanghua opened a new pull request #1100: [HUDI-394] Provide a basic implementation of test suite

2019-12-12 Thread GitBox
yanghua opened a new pull request #1100: [HUDI-394] Provide a basic implementation of test suite URL: https://github.com/apache/incubator-hudi/pull/1100 - Flexible schema payload generation - Different types of workload generation such as inserts, upserts etc - Post process actions

[GitHub] [incubator-hudi] Akshay2Agarwal opened a new issue #1101: [SUPPORT] Does Hudi support incremental changes view in HoodieReadClient

2019-12-12 Thread GitBox
Akshay2Agarwal opened a new issue #1101: [SUPPORT] Does Hudi support incremental changes view in HoodieReadClient URL: https://github.com/apache/incubator-hudi/issues/1101 **I am not seeing any support for begin time for incremental view in HoodieReadClient. Does it support the

[jira] [Comment Edited] (HUDI-394) Provide a basic implementation of test suite

2019-12-12 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993472#comment-16993472 ] vinoyang edited comment on HUDI-394 at 12/12/19 1:05 PM: - Implemented via

[jira] [Reopened] (HUDI-394) Provide a basic implementation of test suite

2019-12-12 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reopened HUDI-394: --- > Provide a basic implementation of test suite > > >

[GitHub] [incubator-hudi] yanghua commented on issue #1100: [HUDI-289] Implement a test suite to support long running test for Hudi writing and querying end-end

2019-12-12 Thread GitBox
yanghua commented on issue #1100: [HUDI-289] Implement a test suite to support long running test for Hudi writing and querying end-end URL: https://github.com/apache/incubator-hudi/pull/1100#issuecomment-565001918 I have rebased the old `hudi_test_suite_refactor` branch based on master

[jira] [Updated] (HUDI-399) Fix conflicts of test suite basic implementation based on master branch and fix checkstyle issues

2019-12-12 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-399: -- Summary: Fix conflicts of test suite basic implementation based on master branch and fix checkstyle issues

[GitHub] [incubator-hudi] lamber-ken opened a new pull request #1099: [HUDI-386] Refactor hudi scala checkstyle rules

2019-12-12 Thread GitBox
lamber-ken opened a new pull request #1099: [HUDI-386] Refactor hudi scala checkstyle rules URL: https://github.com/apache/incubator-hudi/pull/1099 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before

[jira] [Updated] (HUDI-386) Refactor hudi scala checkstyle rules

2019-12-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-386: Labels: pull-request-available (was: ) > Refactor hudi scala checkstyle rules >

[jira] [Commented] (HUDI-322) DeltaSteamer should pick checkpoints off only deltacommits for MOR tables

2019-12-12 Thread Shahida Khan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994635#comment-16994635 ] Shahida Khan commented on HUDI-322: --- Thank you both, will keep you posted regarding the progress. :) >

[jira] [Updated] (HUDI-322) DeltaSteamer should pick checkpoints off only deltacommits for MOR tables

2019-12-12 Thread Shahida Khan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shahida Khan updated HUDI-322: -- Status: In Progress (was: Open) > DeltaSteamer should pick checkpoints off only deltacommits for MOR

[jira] [Comment Edited] (HUDI-233) Redo log statements using SLF4J

2019-12-12 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994668#comment-16994668 ] lamber-ken edited comment on HUDI-233 at 12/12/19 1:35 PM: --- Hi, [~xleesf]

[incubator-hudi] branch hudi_test_suite_refactor created (now c2c9347)

2019-12-12 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a change to branch hudi_test_suite_refactor in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. at c2c9347 [HUDI-394] Provide a basic implementation of test suite No new revisions were

[jira] [Updated] (HUDI-233) Redo log statements using SLF4J

2019-12-12 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-233: Component/s: (was: Performance) > Redo log statements using SLF4J >

[incubator-hudi] branch hudi_test_suite_refactor created (now eaaf3f6)

2019-12-12 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a change to branch hudi_test_suite_refactor in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. at eaaf3f6 [HUDI-394] Provide a basic implementation of test suite No new revisions were

[jira] [Comment Edited] (HUDI-233) Redo log statements using SLF4J

2019-12-12 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994668#comment-16994668 ] lamber-ken edited comment on HUDI-233 at 12/12/19 1:50 PM: --- Hi, [~xleesf]

[GitHub] [incubator-hudi] yanghua opened a new pull request #1102: [HUDI-391] Rename module name from hudi-bench to hudi-test-suite

2019-12-12 Thread GitBox
yanghua opened a new pull request #1102: [HUDI-391] Rename module name from hudi-bench to hudi-test-suite URL: https://github.com/apache/incubator-hudi/pull/1102 ## What is the purpose of the pull request *Rename module name from hudi-bench to hudi-test-suite* ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom

2019-12-12 Thread GitBox
vinothchandar commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom URL: https://github.com/apache/incubator-hudi/pull/1091#discussion_r357202270 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom

2019-12-12 Thread GitBox
vinothchandar commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom URL: https://github.com/apache/incubator-hudi/pull/1091#discussion_r357212983 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom

2019-12-12 Thread GitBox
vinothchandar commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom URL: https://github.com/apache/incubator-hudi/pull/1091#discussion_r357201740 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom

2019-12-12 Thread GitBox
vinothchandar commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom URL: https://github.com/apache/incubator-hudi/pull/1091#discussion_r357202347 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom

2019-12-12 Thread GitBox
vinothchandar commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom URL: https://github.com/apache/incubator-hudi/pull/1091#discussion_r357210650 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom

2019-12-12 Thread GitBox
vinothchandar commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom URL: https://github.com/apache/incubator-hudi/pull/1091#discussion_r357207910 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom

2019-12-12 Thread GitBox
vinothchandar commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom URL: https://github.com/apache/incubator-hudi/pull/1091#discussion_r357208499 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on issue #976: [HUDI-106] Adding support for DynamicBloomFilter

2019-12-12 Thread GitBox
vinothchandar commented on issue #976: [HUDI-106] Adding support for DynamicBloomFilter URL: https://github.com/apache/incubator-hudi/pull/976#issuecomment-565048509 We can merge once these are addressed.. Lets get this across the line! :)

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter

2019-12-12 Thread GitBox
vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter URL: https://github.com/apache/incubator-hudi/pull/976#discussion_r357194820 ## File path: hudi-common/src/main/java/org/apache/hudi/common/bloom/filter/BloomFilter.java

[jira] [Updated] (HUDI-391) Rename module name from hudi-bench to hudi-test-suite

2019-12-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-391: Labels: pull-request-available (was: ) > Rename module name from hudi-bench to hudi-test-suite >

[GitHub] [incubator-hudi] yanghua commented on issue #1102: [HUDI-391] Rename module name from hudi-bench to hudi-test-suite

2019-12-12 Thread GitBox
yanghua commented on issue #1102: [HUDI-391] Rename module name from hudi-bench to hudi-test-suite URL: https://github.com/apache/incubator-hudi/pull/1102#issuecomment-565020884 @n3nash Can you review this PR? This is an

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset

2019-12-12 Thread GitBox
vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset URL: https://github.com/apache/incubator-hudi/pull/1009#discussion_r357117901 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset

2019-12-12 Thread GitBox
vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset URL: https://github.com/apache/incubator-hudi/pull/1009#discussion_r357127905 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset

2019-12-12 Thread GitBox
vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset URL: https://github.com/apache/incubator-hudi/pull/1009#discussion_r357132086 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset

2019-12-12 Thread GitBox
vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset URL: https://github.com/apache/incubator-hudi/pull/1009#discussion_r357130581 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset

2019-12-12 Thread GitBox
vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset URL: https://github.com/apache/incubator-hudi/pull/1009#discussion_r357160890 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset

2019-12-12 Thread GitBox
vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset URL: https://github.com/apache/incubator-hudi/pull/1009#discussion_r357125859 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset

2019-12-12 Thread GitBox
vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset URL: https://github.com/apache/incubator-hudi/pull/1009#discussion_r357181681 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset

2019-12-12 Thread GitBox
vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset URL: https://github.com/apache/incubator-hudi/pull/1009#discussion_r357160119 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset

2019-12-12 Thread GitBox
vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset URL: https://github.com/apache/incubator-hudi/pull/1009#discussion_r357181383 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset

2019-12-12 Thread GitBox
vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset URL: https://github.com/apache/incubator-hudi/pull/1009#discussion_r357162132 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset

2019-12-12 Thread GitBox
vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset URL: https://github.com/apache/incubator-hudi/pull/1009#discussion_r357130439 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset

2019-12-12 Thread GitBox
vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset URL: https://github.com/apache/incubator-hudi/pull/1009#discussion_r357158027 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset

2019-12-12 Thread GitBox
vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset URL: https://github.com/apache/incubator-hudi/pull/1009#discussion_r357177698 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset

2019-12-12 Thread GitBox
vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset URL: https://github.com/apache/incubator-hudi/pull/1009#discussion_r357131724 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset

2019-12-12 Thread GitBox
vinothchandar commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset URL: https://github.com/apache/incubator-hudi/pull/1009#discussion_r357157168 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter

2019-12-12 Thread GitBox
vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter URL: https://github.com/apache/incubator-hudi/pull/976#discussion_r357197955 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/CleanerUtils.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter

2019-12-12 Thread GitBox
vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter URL: https://github.com/apache/incubator-hudi/pull/976#discussion_r357197035 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter

2019-12-12 Thread GitBox
vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter URL: https://github.com/apache/incubator-hudi/pull/976#discussion_r357195468 ## File path:

[GitHub] [incubator-hudi] lamber-ken opened a new pull request #1103: [MINOR] Unify Lists import

2019-12-12 Thread GitBox
lamber-ken opened a new pull request #1103: [MINOR] Unify Lists import URL: https://github.com/apache/incubator-hudi/pull/1103 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.*

[jira] [Updated] (HUDI-242) Support Seamless bootstrap of legacy datasets to Hudi

2019-12-12 Thread Balaji Varadarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Varadarajan updated HUDI-242: Description:  Support Efficient bootstrap of large parquet tables (was: Build support to

[jira] [Assigned] (HUDI-242) Support Seamless bootstrap of legacy datasets to Hudi

2019-12-12 Thread Balaji Varadarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Varadarajan reassigned HUDI-242: --- Assignee: Balaji Varadarajan > Support Seamless bootstrap of legacy datasets to Hudi

[jira] [Updated] (HUDI-242) Support Efficient bootstrap of large parquet datasets to Hudi

2019-12-12 Thread Balaji Varadarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Varadarajan updated HUDI-242: Summary: Support Efficient bootstrap of large parquet datasets to Hudi (was: Support

[jira] [Updated] (HUDI-242) Support Efficient bootstrap of large parquet datasets to Hudi

2019-12-12 Thread Balaji Varadarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Varadarajan updated HUDI-242: Fix Version/s: 0.5.1 > Support Efficient bootstrap of large parquet datasets to Hudi >

[GitHub] [incubator-hudi] bschell commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom

2019-12-12 Thread GitBox
bschell commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom URL: https://github.com/apache/incubator-hudi/pull/1091#discussion_r357343158 ## File path:

[GitHub] [incubator-hudi] bschell commented on issue #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom

2019-12-12 Thread GitBox
bschell commented on issue #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom URL: https://github.com/apache/incubator-hudi/pull/1091#issuecomment-565170220 Added a workaround for collectAsMap. Will continue review today.

[GitHub] [incubator-hudi] bschell commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom

2019-12-12 Thread GitBox
bschell commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom URL: https://github.com/apache/incubator-hudi/pull/1091#discussion_r357366421 ## File path:

[GitHub] [incubator-hudi] bschell commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom

2019-12-12 Thread GitBox
bschell commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom URL: https://github.com/apache/incubator-hudi/pull/1091#discussion_r357365653 ## File path:

[GitHub] [incubator-hudi] bschell commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom

2019-12-12 Thread GitBox
bschell commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom URL: https://github.com/apache/incubator-hudi/pull/1091#discussion_r357363234 ## File path:

[GitHub] [incubator-hudi] bschell commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom

2019-12-12 Thread GitBox
bschell commented on a change in pull request #1091: [HUDI-389] Fixing Index look up to return right partitions for a given key along with fileId with Global Bloom URL: https://github.com/apache/incubator-hudi/pull/1091#discussion_r357361788 ## File path:

[jira] [Commented] (HUDI-259) Hadoop 3 support for Hudi writing

2019-12-12 Thread Yanjia Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995153#comment-16995153 ] Yanjia Gary Li commented on HUDI-259: - Hello, I recently started using Hadoop 3 and Spark 2.4. 

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1096: [HUDI-398]Add set env for spark launcher

2019-12-12 Thread GitBox
leesf commented on a change in pull request #1096: [HUDI-398]Add set env for spark launcher URL: https://github.com/apache/incubator-hudi/pull/1096#discussion_r357401784 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/commands/SetSparkEnvCommand.java ## @@ -0,0

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1096: [HUDI-398]Add set env for spark launcher

2019-12-12 Thread GitBox
leesf commented on a change in pull request #1096: [HUDI-398]Add set env for spark launcher URL: https://github.com/apache/incubator-hudi/pull/1096#discussion_r357399619 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/commands/SetSparkEnvCommand.java ## @@ -0,0