[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #626: Adding documentation for hudi test suite

2019-11-07 Thread GitBox
bvaradar commented on a change in pull request #626: Adding documentation for hudi test suite URL: https://github.com/apache/incubator-hudi/pull/626#discussion_r344022479 ## File path: docs/docker_demo.md ## @@ -1081,6 +1081,34 @@ presto:default> This brings the demo to

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #626: Adding documentation for hudi test suite

2019-11-07 Thread GitBox
bvaradar commented on a change in pull request #626: Adding documentation for hudi test suite URL: https://github.com/apache/incubator-hudi/pull/626#discussion_r344021615 ## File path: docs/test_suite.md ## @@ -0,0 +1,155 @@ +--- +title: Test Suite +keywords: test suite +s

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #626: Adding documentation for hudi test suite

2019-11-07 Thread GitBox
bvaradar commented on a change in pull request #626: Adding documentation for hudi test suite URL: https://github.com/apache/incubator-hudi/pull/626#discussion_r344020491 ## File path: docs/docker_demo.md ## @@ -1081,6 +1081,34 @@ presto:default> This brings the demo to

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #626: Adding documentation for hudi test suite

2019-11-07 Thread GitBox
bvaradar commented on a change in pull request #626: Adding documentation for hudi test suite URL: https://github.com/apache/incubator-hudi/pull/626#discussion_r344023332 ## File path: docs/test_suite.md ## @@ -0,0 +1,155 @@ +--- +title: Test Suite +keywords: test suite +s

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #626: Adding documentation for hudi test suite

2019-11-07 Thread GitBox
bvaradar commented on a change in pull request #626: Adding documentation for hudi test suite URL: https://github.com/apache/incubator-hudi/pull/626#discussion_r344020142 ## File path: docs/docker_demo.md ## @@ -1081,6 +1081,34 @@ presto:default> This brings the demo to

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #626: Adding documentation for hudi test suite

2019-11-07 Thread GitBox
bvaradar commented on a change in pull request #626: Adding documentation for hudi test suite URL: https://github.com/apache/incubator-hudi/pull/626#discussion_r344021879 ## File path: docs/docker_demo.md ## @@ -1081,6 +1081,34 @@ presto:default> This brings the demo to

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #626: Adding documentation for hudi test suite

2019-11-07 Thread GitBox
bvaradar commented on a change in pull request #626: Adding documentation for hudi test suite URL: https://github.com/apache/incubator-hudi/pull/626#discussion_r344022879 ## File path: docs/test_suite.md ## @@ -0,0 +1,155 @@ +--- +title: Test Suite +keywords: test suite +s

[jira] [Issue Comment Deleted] (HUDI-114) Allow for clients to overwrite the payload implementation in hoodie.properties

2019-11-07 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma updated HUDI-114: -- Comment: was deleted (was: [~nishith29] yeah I would like to have some more clarification before

[jira] [Commented] (HUDI-64) Estimation of compression ratio & other dynamic storage knobs based on historical stats

2019-11-07 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16969874#comment-16969874 ] vinoyang commented on HUDI-64: -- Start thinking and understand the details of the implementation

[GitHub] [incubator-hudi] n3nash commented on issue #998: Incremental view not implemented yet, for merge-on-read datasets

2019-11-07 Thread GitBox
n3nash commented on issue #998: Incremental view not implemented yet, for merge-on-read datasets URL: https://github.com/apache/incubator-hudi/issues/998#issuecomment-551393282 @HariprasadAllaka1612 This is still not implemented for Spark datasource but we plan to implement it soon. @bhasu

[GitHub] [incubator-hudi] n3nash commented on issue #626: Adding documentation for hudi test suite

2019-11-07 Thread GitBox
n3nash commented on issue #626: Adding documentation for hudi test suite URL: https://github.com/apache/incubator-hudi/pull/626#issuecomment-551392836 @bvaradar please review this as well This is an automated message from the

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #92

2019-11-07 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.23 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/bin: m2.conf mvn mvn.cmd mvnDebug mvnDebug.cmd mvnyjp /home/jenkins/tools/maven/apache

[jira] [Closed] (HUDI-245) Refactor code references that call HoodieTimeline.getInstants() and reverse to directly use method HoodieTimeline.getReverseOrderedInstants

2019-11-07 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-245. -- Fix Version/s: 0.5.1 Resolution: Fixed Fixed via master: 0863b1cfd947402c66221afa8d1f18fd2bd8273b > Refactor code

[GitHub] [incubator-hudi] leesf commented on a change in pull request #999: Update to align with original Uber whitepaper

2019-11-07 Thread GitBox
leesf commented on a change in pull request #999: Update to align with original Uber whitepaper URL: https://github.com/apache/incubator-hudi/pull/999#discussion_r343955616 ## File path: README.md ## @@ -16,7 +16,7 @@ --> # Hudi -Apache Hudi (Incubating) (pronounced Ho

[jira] [Created] (HUDI-327) Introduce "null" supporting ComplexKeyGenerator

2019-11-07 Thread Brandon Scheller (Jira)
Brandon Scheller created HUDI-327: - Summary: Introduce "null" supporting ComplexKeyGenerator Key: HUDI-327 URL: https://issues.apache.org/jira/browse/HUDI-327 Project: Apache Hudi (incubating)

[jira] [Updated] (HUDI-327) Introduce "null" supporting KeyGenerator

2019-11-07 Thread Brandon Scheller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Scheller updated HUDI-327: -- Summary: Introduce "null" supporting KeyGenerator (was: Introduce "null" supporting ComplexKeyGe

[jira] [Commented] (HUDI-326) Support deleting records with only record_key

2019-11-07 Thread Brandon Scheller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16969684#comment-16969684 ] Brandon Scheller commented on HUDI-326: --- Additionally, does anyone have some context

[GitHub] [incubator-hudi] umehrot2 commented on a change in pull request #1001: [HUDI-325] Fix Hive partition error for updated HDFS Hudi table

2019-11-07 Thread GitBox
umehrot2 commented on a change in pull request #1001: [HUDI-325] Fix Hive partition error for updated HDFS Hudi table URL: https://github.com/apache/incubator-hudi/pull/1001#discussion_r343943359 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/FSUtils.java #

[GitHub] [incubator-hudi] umehrot2 commented on a change in pull request #1001: [HUDI-325] Fix Hive partition error for updated HDFS Hudi table

2019-11-07 Thread GitBox
umehrot2 commented on a change in pull request #1001: [HUDI-325] Fix Hive partition error for updated HDFS Hudi table URL: https://github.com/apache/incubator-hudi/pull/1001#discussion_r343943582 ## File path: hudi-hive/src/main/java/org/apache/hudi/hive/HoodieHiveClient.java #

[jira] [Created] (HUDI-326) Support deleting records with only record_key

2019-11-07 Thread Brandon Scheller (Jira)
Brandon Scheller created HUDI-326: - Summary: Support deleting records with only record_key Key: HUDI-326 URL: https://issues.apache.org/jira/browse/HUDI-326 Project: Apache Hudi (incubating)

[jira] [Updated] (HUDI-325) Unable to query by Hive after updating HDFS Hudi table

2019-11-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-325: Labels: pull-request-available (was: ) > Unable to query by Hive after updating HDFS Hudi table > --

[jira] [Updated] (HUDI-325) Unable to query by Hive after updating HDFS Hudi table

2019-11-07 Thread Wenning Ding (Jira)
[ https://issues.apache.org/jira/browse/HUDI-325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenning Ding updated HUDI-325: -- Description: h3. Description While doing internal testing in EMR, we found that if Hudi table path follo

[GitHub] [incubator-hudi] zhedoubushishi opened a new pull request #1001: [HUDI-325] Fix Hive partition error for updated HDFS Hudi table

2019-11-07 Thread GitBox
zhedoubushishi opened a new pull request #1001: [HUDI-325] Fix Hive partition error for updated HDFS Hudi table URL: https://github.com/apache/incubator-hudi/pull/1001 Jira: https://jira.apache.org/jira/browse/HUDI-325 This i

[jira] [Updated] (HUDI-325) Unable to query by Hive after updating HDFS Hudi table

2019-11-07 Thread Wenning Ding (Jira)
[ https://issues.apache.org/jira/browse/HUDI-325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenning Ding updated HUDI-325: -- Description: h3. Description While doing internal testing in EMR, we found that if Hudi table path follo

[jira] [Updated] (HUDI-325) Unable to query by Hive after updating HDFS Hudi table

2019-11-07 Thread Wenning Ding (Jira)
[ https://issues.apache.org/jira/browse/HUDI-325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenning Ding updated HUDI-325: -- Description: h3. Description While doing internal testing in EMR, we found that if Hudi table path follo

[jira] [Updated] (HUDI-325) Unable to query by Hive after updating HDFS Hudi table

2019-11-07 Thread Wenning Ding (Jira)
[ https://issues.apache.org/jira/browse/HUDI-325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenning Ding updated HUDI-325: -- Description: h3. Description While doing internal testing in EMR, we found that if Hudi table path follo

[jira] [Created] (HUDI-325) Unable to query by Hive after updating HDFS Hudi table

2019-11-07 Thread Wenning Ding (Jira)
Wenning Ding created HUDI-325: - Summary: Unable to query by Hive after updating HDFS Hudi table Key: HUDI-325 URL: https://issues.apache.org/jira/browse/HUDI-325 Project: Apache Hudi (incubating)

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #996: Fixes to ensure MOR incr pull provides consistent results

2019-11-07 Thread GitBox
bvaradar commented on a change in pull request #996: Fixes to ensure MOR incr pull provides consistent results URL: https://github.com/apache/incubator-hudi/pull/996#discussion_r343814975 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieActiveTime

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #996: Fixes to ensure MOR incr pull provides consistent results

2019-11-07 Thread GitBox
bvaradar commented on a change in pull request #996: Fixes to ensure MOR incr pull provides consistent results URL: https://github.com/apache/incubator-hudi/pull/996#discussion_r343815022 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieActiveTime

[GitHub] [incubator-hudi] vinothchandar merged pull request #1000: [HUDI-245]: replaced instances of getInstants() and reverse() with getReverseOrderedInstants()

2019-11-07 Thread GitBox
vinothchandar merged pull request #1000: [HUDI-245]: replaced instances of getInstants() and reverse() with getReverseOrderedInstants() URL: https://github.com/apache/incubator-hudi/pull/1000 This is an automated message fro

[incubator-hudi] branch master updated: [HUDI-245]: replaced instances of getInstants() and reverse() with getReverseOrderedInstants() (#1000)

2019-11-07 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 0863b1c [HUDI-245]: replaced instances

[GitHub] [incubator-hudi] bhasudha commented on issue #1000: [HUDI-245]: replaced instances of getInstants() and reverse() with getReverseOrderedInstants()

2019-11-07 Thread GitBox
bhasudha commented on issue #1000: [HUDI-245]: replaced instances of getInstants() and reverse() with getReverseOrderedInstants() URL: https://github.com/apache/incubator-hudi/pull/1000#issuecomment-551068937 LGTM. Thanks @pratyakshsharma --

[jira] [Commented] (HUDI-114) Allow for clients to overwrite the payload implementation in hoodie.properties

2019-11-07 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16969206#comment-16969206 ] Pratyaksh Sharma commented on HUDI-114: --- [~nishith29] yeah I would like to have some

[jira] [Updated] (HUDI-245) Refactor code references that call HoodieTimeline.getInstants() and reverse to directly use method HoodieTimeline.getReverseOrderedInstants

2019-11-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-245: Labels: pull-request-available (was: ) > Refactor code references that call HoodieTimeline.getInstan

[GitHub] [incubator-hudi] pratyakshsharma opened a new pull request #1000: [HUDI-245]: replaced instances of getInstants() and reverse() with getReverseOrderedInstants()

2019-11-07 Thread GitBox
pratyakshsharma opened a new pull request #1000: [HUDI-245]: replaced instances of getInstants() and reverse() with getReverseOrderedInstants() URL: https://github.com/apache/incubator-hudi/pull/1000 Small code refactoring to remove redundant code. -