[jira] [Commented] (HUDI-554) Restructure code/packages to move more code back into hudi-writer-common

2020-02-09 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033417#comment-17033417 ] Vinoth Chandar commented on HUDI-554: - No.. I am going to just organize a bit better and remove spark

[jira] [Commented] (HUDI-85) Improve bloom index speed using interval trees for range pruning

2020-02-09 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-85?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033412#comment-17033412 ] Vinoth Chandar commented on HUDI-85: Don't recall...  :/  > Improve bloom index speed using interval

[GitHub] [incubator-hudi] lamber-ken commented on a change in pull request #1317: [HUDI-605] Avoid calculating the size of schema redundantly

2020-02-09 Thread GitBox
lamber-ken commented on a change in pull request #1317: [HUDI-605] Avoid calculating the size of schema redundantly URL: https://github.com/apache/incubator-hudi/pull/1317#discussion_r376899375 ## File path:

[GitHub] [incubator-hudi] lamber-ken commented on a change in pull request #1317: [HUDI-605] Avoid calculating the size of schema redundantly

2020-02-09 Thread GitBox
lamber-ken commented on a change in pull request #1317: [HUDI-605] Avoid calculating the size of schema redundantly URL: https://github.com/apache/incubator-hudi/pull/1317#discussion_r376898473 ## File path:

[GitHub] [incubator-hudi] lamber-ken commented on a change in pull request #1317: [HUDI-605] Avoid calculating the size of schema redundantly

2020-02-09 Thread GitBox
lamber-ken commented on a change in pull request #1317: [HUDI-605] Avoid calculating the size of schema redundantly URL: https://github.com/apache/incubator-hudi/pull/1317#discussion_r376897263 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1106: [HUDI-209] Implement JMX metrics reporter

2020-02-09 Thread GitBox
vinothchandar commented on a change in pull request #1106: [HUDI-209] Implement JMX metrics reporter URL: https://github.com/apache/incubator-hudi/pull/1106#discussion_r376895998 ## File path: hudi-client/src/main/java/org/apache/hudi/metrics/JmxMetricsReporter.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1317: [HUDI-605] Avoid calculating the size of schema redundantly

2020-02-09 Thread GitBox
vinothchandar commented on a change in pull request #1317: [HUDI-605] Avoid calculating the size of schema redundantly URL: https://github.com/apache/incubator-hudi/pull/1317#discussion_r376894610 ## File path:

[jira] [Updated] (HUDI-604) Update docker page

2020-02-09 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-604: Summary: Update docker page (was: Update docker pages) > Update docker page > -- > >

[jira] [Updated] (HUDI-604) Update docker pages

2020-02-09 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-604: Summary: Update docker pages (was: Update docker pages ) > Update docker pages > --- > >

[jira] [Assigned] (HUDI-604) Update docker pages

2020-02-09 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken reassigned HUDI-604: --- Assignee: lamber-ken > Update docker pages > > > Key: HUDI-604

[GitHub] [incubator-hudi] vinothchandar commented on issue #1314: [HUDI-542] Introduce a new pom module named hudi-writer-common

2020-02-09 Thread GitBox
vinothchandar commented on issue #1314: [HUDI-542] Introduce a new pom module named hudi-writer-common URL: https://github.com/apache/incubator-hudi/pull/1314#issuecomment-583975092 @yanghua ack. Do we need a feature branch for this work? can't we do this on master with incremental

[jira] [Updated] (HUDI-605) Avoid calculating the size of schema redundantly

2020-02-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-605: Labels: pull-request-available (was: ) > Avoid calculating the size of schema redundantly >

[GitHub] [incubator-hudi] lamber-ken opened a new pull request #1317: [HUDI-605] Avoid calculating the size of schema redundantly

2020-02-09 Thread GitBox
lamber-ken opened a new pull request #1317: [HUDI-605] Avoid calculating the size of schema redundantly URL: https://github.com/apache/incubator-hudi/pull/1317 ## What is the purpose of the pull request The same schema object is shared amongst all records in the JVM. ## Brief

[jira] [Updated] (HUDI-605) Avoid calculating the size of schema redundantly

2020-02-09 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-605: Status: Open (was: New) > Avoid calculating the size of schema redundantly >

[jira] [Created] (HUDI-605) Avoid calculating the size of schema redundantly

2020-02-09 Thread lamber-ken (Jira)
lamber-ken created HUDI-605: --- Summary: Avoid calculating the size of schema redundantly Key: HUDI-605 URL: https://issues.apache.org/jira/browse/HUDI-605 Project: Apache Hudi (incubating) Issue

[jira] [Updated] (HUDI-604) Update docker pages

2020-02-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-604: Labels: pull-request-available (was: ) > Update docker pages > > >

[GitHub] [incubator-hudi] lamber-ken opened a new pull request #1316: [HUDI-604] Update docker pages

2020-02-09 Thread GitBox
lamber-ken opened a new pull request #1316: [HUDI-604] Update docker pages URL: https://github.com/apache/incubator-hudi/pull/1316 ## What is the purpose of the pull request 1. Change one line command to multi line 2. Modify sub title ## Verify this pull request

[jira] [Created] (HUDI-604) Update docker pages

2020-02-09 Thread lamber-ken (Jira)
lamber-ken created HUDI-604: --- Summary: Update docker pages Key: HUDI-604 URL: https://issues.apache.org/jira/browse/HUDI-604 Project: Apache Hudi (incubating) Issue Type: Improvement

[jira] [Updated] (HUDI-604) Update docker pages

2020-02-09 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-604: Status: Open (was: New) > Update docker pages > > > Key: HUDI-604 >

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #184

2020-02-09 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.28 KB...] plexus-classworlds-2.5.2.jar /home/jenkins/tools/maven/apache-maven-3.5.4/conf: logging settings.xml toolchains.xml

[GitHub] [incubator-hudi] lamber-ken commented on issue #1306: [HUDI-598] Update quick start page

2020-02-09 Thread GitBox
lamber-ken commented on issue #1306: [HUDI-598] Update quick start page URL: https://github.com/apache/incubator-hudi/pull/1306#issuecomment-583936293 hi @bhasudha, all review comments are addressed and fixed. :) This is

[jira] [Resolved] (HUDI-560) Remove legacy IdentityTransformer

2020-02-09 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang resolved HUDI-560. --- Resolution: Fixed Done via master branch: 91f47802ebead2259f1d05fc9dc3323a46b4be56 > Remove legacy

[GitHub] [incubator-hudi] yanghua merged pull request #1264: [HUDI-560] Remove legacy IdentityTransformer

2020-02-09 Thread GitBox
yanghua merged pull request #1264: [HUDI-560] Remove legacy IdentityTransformer URL: https://github.com/apache/incubator-hudi/pull/1264 This is an automated message from the Apache Git Service. To respond to the message,

[incubator-hudi] branch master updated: [HUDI-560] Remove legacy IdentityTransformer (#1264)

2020-02-09 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 5fdf5a1 [HUDI-560] Remove legacy

[GitHub] [incubator-hudi] wangxianghu commented on issue #1224: [HUDI-397] Normalize log print statement

2020-02-09 Thread GitBox
wangxianghu commented on issue #1224: [HUDI-397] Normalize log print statement URL: https://github.com/apache/incubator-hudi/pull/1224#issuecomment-583918838 Hi @n3nash, Sorry for the delay, I'll fix it soon. This is an

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1106: [HUDI-209] Implement JMX metrics reporter

2020-02-09 Thread GitBox
leesf commented on a change in pull request #1106: [HUDI-209] Implement JMX metrics reporter URL: https://github.com/apache/incubator-hudi/pull/1106#discussion_r376786221 ## File path: hudi-client/src/main/java/org/apache/hudi/metrics/JmxMetricsReporter.java ## @@ -82,6

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1253: [HUDI-558] Introduce ability to compress bloom filters while storing in parquet

2020-02-09 Thread GitBox
leesf commented on a change in pull request #1253: [HUDI-558] Introduce ability to compress bloom filters while storing in parquet URL: https://github.com/apache/incubator-hudi/pull/1253#discussion_r376785421 ## File path:

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1253: [HUDI-558] Introduce ability to compress bloom filters while storing in parquet

2020-02-09 Thread GitBox
leesf commented on a change in pull request #1253: [HUDI-558] Introduce ability to compress bloom filters while storing in parquet URL: https://github.com/apache/incubator-hudi/pull/1253#discussion_r376785469 ## File path:

[GitHub] [incubator-hudi] leesf commented on issue #1200: [HUDI-514] A schema provider to get metadata through Jdbc

2020-02-09 Thread GitBox
leesf commented on issue #1200: [HUDI-514] A schema provider to get metadata through Jdbc URL: https://github.com/apache/incubator-hudi/pull/1200#issuecomment-583846298 @OpenOpened Only left some minor comments, otherwise looks good to me.

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1200: [HUDI-514] A schema provider to get metadata through Jdbc

2020-02-09 Thread GitBox
leesf commented on a change in pull request #1200: [HUDI-514] A schema provider to get metadata through Jdbc URL: https://github.com/apache/incubator-hudi/pull/1200#discussion_r376784592 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/UtilHelpers.java

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1200: [HUDI-514] A schema provider to get metadata through Jdbc

2020-02-09 Thread GitBox
leesf commented on a change in pull request #1200: [HUDI-514] A schema provider to get metadata through Jdbc URL: https://github.com/apache/incubator-hudi/pull/1200#discussion_r376784460 ## File path:

[GitHub] [incubator-hudi] leesf commented on issue #1315: [Hudi-108] Removing 2GB spark partition limitations in HoodieBloomIndex with spark 2.4.4

2020-02-09 Thread GitBox
leesf commented on issue #1315: [Hudi-108] Removing 2GB spark partition limitations in HoodieBloomIndex with spark 2.4.4 URL: https://github.com/apache/incubator-hudi/pull/1315#issuecomment-583845543 Looks much cleaner after change, @nsivabalan would you also please take a look at the

[jira] [Resolved] (HUDI-585) Optimize the steps of building with scala-2.12

2020-02-09 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-585. Fix Version/s: 0.5.2 Resolution: Fixed Fixed via master: 425e3e6c78b9be00fc3fecfc335c94e05a1c70e5 > Optimize

[jira] [Resolved] (HUDI-596) KafkaConsumer need to be closed

2020-02-09 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-596. Fix Version/s: 0.5.2 Resolution: Fixed Fixed via master: 347e297ac19ed55172e84e13075e19ce060954c6 >

[jira] [Updated] (HUDI-596) KafkaConsumer need to be closed

2020-02-09 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-596: --- Status: Open (was: New) > KafkaConsumer need to be closed > --- > > Key: