[incubator-hudi] branch asf-site updated: [HUDI-403] Adds guidelines on deployment/upgrading

2020-01-20 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 39db1ae [HUDI-403] Adds

[GitHub] [incubator-hudi] bvaradar merged pull request #1261: [HUDI-403] Adds guidelines on deployment/upgrading

2020-01-20 Thread GitBox
bvaradar merged pull request #1261: [HUDI-403] Adds guidelines on deployment/upgrading URL: https://github.com/apache/incubator-hudi/pull/1261 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-hudi] leesf commented on issue #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki

2020-01-20 Thread GitBox
leesf commented on issue #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki URL: https://github.com/apache/incubator-hudi/pull/1260#issuecomment-576524810 > @leesf / @yanghua can you please help review this PR. Also, this might be needed in the corresponding cn pages

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1261: [HUDI-403] Adds guidelines on deployment/upgrading

2020-01-20 Thread GitBox
bvaradar commented on a change in pull request #1261: [HUDI-403] Adds guidelines on deployment/upgrading URL: https://github.com/apache/incubator-hudi/pull/1261#discussion_r368812781 ## File path: docs/_docs/2_6_deployment.md ## @@ -1,51 +1,87 @@ --- -title:

[GitHub] [incubator-hudi] lamber-ken commented on a change in pull request #1261: [HUDI-403] Adds guidelines on deployment/upgrading

2020-01-20 Thread GitBox
lamber-ken commented on a change in pull request #1261: [HUDI-403] Adds guidelines on deployment/upgrading URL: https://github.com/apache/incubator-hudi/pull/1261#discussion_r368818614 ## File path: docs/_docs/2_6_deployment.md ## @@ -1,51 +1,87 @@ --- -title:

[incubator-hudi] branch master updated (7087e7d -> ba54a7e)

2020-01-20 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from 7087e7d [HUDI-556] Add lisence for PR#1233 add ba54a7e [HUDI-559] : Make the timeline layout version

[GitHub] [incubator-hudi] leesf opened a new pull request #1256: [MINOR] Add KEYS

2020-01-20 Thread GitBox
leesf opened a new pull request #1256: [MINOR] Add KEYS URL: https://github.com/apache/incubator-hudi/pull/1256 Add KEYS This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [incubator-hudi] lamber-ken commented on a change in pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki

2020-01-20 Thread GitBox
lamber-ken commented on a change in pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki URL: https://github.com/apache/incubator-hudi/pull/1260#discussion_r368818803 ## File path: docs/_docs/1_3_use_cases.md ## @@ -20,7 +20,7 @@ or

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1151: [WIP] [HUDI-476] Add hudi-examples module

2020-01-20 Thread GitBox
pratyakshsharma commented on a change in pull request #1151: [WIP] [HUDI-476] Add hudi-examples module URL: https://github.com/apache/incubator-hudi/pull/1151#discussion_r368608157 ## File path:

[GitHub] [incubator-hudi] dengziming removed a comment on issue #1151: [WIP] [HUDI-476] Add hudi-examples module

2020-01-20 Thread GitBox
dengziming removed a comment on issue #1151: [WIP] [HUDI-476] Add hudi-examples module URL: https://github.com/apache/incubator-hudi/pull/1151#issuecomment-576130421 @vinothchandar hi, vinoth, I have added the DeltaStreamExample. And I run `mvn test -B` successful locally, but the

[GitHub] [incubator-hudi] wangxianghu commented on a change in pull request #1263: [MINOR] Update the javadoc of HoodieTableMetaClient#scanFiles

2020-01-20 Thread GitBox
wangxianghu commented on a change in pull request #1263: [MINOR] Update the javadoc of HoodieTableMetaClient#scanFiles URL: https://github.com/apache/incubator-hudi/pull/1263#discussion_r368824428 ## File path:

[jira] [Commented] (HUDI-560) Remove legacy IdentityTransformer

2020-01-20 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019871#comment-17019871 ] wangxianghu commented on HUDI-560: -- [~yanghua] copy that. > Remove legacy IdentityTransformer >

[jira] [Updated] (HUDI-560) Remove legacy IdentityTransformer

2020-01-20 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-560: - Status: Open (was: New) > Remove legacy IdentityTransformer > - > >

[jira] [Updated] (HUDI-560) Remove legacy IdentityTransformer

2020-01-20 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-560: - Status: In Progress (was: Open) > Remove legacy IdentityTransformer > - >

[jira] [Updated] (HUDI-531) Add java doc for hudi test suite general classes

2020-01-20 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-531: - Status: Open (was: New) > Add java doc for hudi test suite general classes >

[jira] [Updated] (HUDI-532) Add java doc for hudi test suite test classes

2020-01-20 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-532: - Status: Open (was: New) > Add java doc for hudi test suite test classes >

[jira] [Updated] (HUDI-560) Remove legacy IdentityTransformer

2020-01-20 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-560: - Issue Type: Improvement (was: Wish) > Remove legacy IdentityTransformer >

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1263: [MINOR] Update the javadoc of HoodieTableMetaClient#scanFiles

2020-01-20 Thread GitBox
yanghua commented on a change in pull request #1263: [MINOR] Update the javadoc of HoodieTableMetaClient#scanFiles URL: https://github.com/apache/incubator-hudi/pull/1263#discussion_r368827950 ## File path:

[GitHub] [incubator-hudi] wangxianghu commented on a change in pull request #1263: [MINOR] Update the javadoc of HoodieTableMetaClient#scanFiles

2020-01-20 Thread GitBox
wangxianghu commented on a change in pull request #1263: [MINOR] Update the javadoc of HoodieTableMetaClient#scanFiles URL: https://github.com/apache/incubator-hudi/pull/1263#discussion_r368829172 ## File path:

[jira] [Commented] (HUDI-561) hudi partition path config

2020-01-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019882#comment-17019882 ] vinoyang commented on HUDI-561: --- [~liujinhui] Sounds Reasonable. Although we can use customized

[GitHub] [incubator-hudi] wangxianghu commented on a change in pull request #1263: [MINOR] Update the javadoc of HoodieTableMetaClient#scanFiles

2020-01-20 Thread GitBox
wangxianghu commented on a change in pull request #1263: [MINOR] Update the javadoc of HoodieTableMetaClient#scanFiles URL: https://github.com/apache/incubator-hudi/pull/1263#discussion_r368829172 ## File path:

[jira] [Updated] (HUDI-561) hudi partition path config

2020-01-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-561: -- Description: The current hudi partition is in accordance with hoodie.datasource.write.partitionpath.field =

[jira] [Commented] (HUDI-561) hudi partition path config

2020-01-20 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019886#comment-17019886 ] liujinhui commented on HUDI-561: There is also a problem with using the transformer, it will modify the

[GitHub] [incubator-hudi] lamber-ken closed pull request #1245: [MINOR] Replace Collection.size > 0 with Collection.isEmpty()

2020-01-20 Thread GitBox
lamber-ken closed pull request #1245: [MINOR] Replace Collection.size > 0 with Collection.isEmpty() URL: https://github.com/apache/incubator-hudi/pull/1245 This is an automated message from the Apache Git Service. To

[GitHub] [incubator-hudi] wangxianghu commented on issue #1263: [MINOR] Update the javadoc of HoodieTableMetaClient#scanFiles

2020-01-20 Thread GitBox
wangxianghu commented on issue #1263: [MINOR] Update the javadoc of HoodieTableMetaClient#scanFiles URL: https://github.com/apache/incubator-hudi/pull/1263#issuecomment-576540719 @yanghua OK, Thanks. This is an automated

[GitHub] [incubator-hudi] wangxianghu opened a new pull request #1264: [HUDI-560] Remove legacy IdentityTransformer

2020-01-20 Thread GitBox
wangxianghu opened a new pull request #1264: [HUDI-560] Remove legacy IdentityTransformer URL: https://github.com/apache/incubator-hudi/pull/1264 ## What is the purpose of the pull request *Remove legacy IdentityTransformer* ## Brief change log *Remove legacy

[jira] [Updated] (HUDI-560) Remove legacy IdentityTransformer

2020-01-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-560: Labels: pull-request-available (was: ) > Remove legacy IdentityTransformer >

[incubator-hudi] branch master updated (924bf51 -> b6e2993)

2020-01-20 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from 924bf51 [MINOR] Download KEYS file when validating release candidate (#1259) add b6e2993 [MINOR]

[GitHub] [incubator-hudi] yanghua merged pull request #1263: [MINOR] Update the javadoc of HoodieTableMetaClient#scanFiles

2020-01-20 Thread GitBox
yanghua merged pull request #1263: [MINOR] Update the javadoc of HoodieTableMetaClient#scanFiles URL: https://github.com/apache/incubator-hudi/pull/1263 This is an automated message from the Apache Git Service. To respond

[GitHub] [incubator-hudi] HariprasadAllaka1612 edited a comment on issue #1243: [SUPPORT]Caused by: org.apache.hudi.exception.HoodieException: java.util.concurrent.ExecutionException: java.lang.NoSuch

2020-01-20 Thread GitBox
HariprasadAllaka1612 edited a comment on issue #1243: [SUPPORT]Caused by: org.apache.hudi.exception.HoodieException: java.util.concurrent.ExecutionException: java.lang.NoSuchMethodError:

[incubator-hudi] branch release-0.5.1 created (now ba54a7e)

2020-01-20 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch release-0.5.1 in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. at ba54a7e [HUDI-559] : Make the timeline layout version default to be null version No new revisions

[GitHub] [incubator-hudi] leesf opened a new pull request #1258: Preparing for Release 0.5.1-incubating-rc1

2020-01-20 Thread GitBox
leesf opened a new pull request #1258: Preparing for Release 0.5.1-incubating-rc1 URL: https://github.com/apache/incubator-hudi/pull/1258 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a

[jira] [Resolved] (HUDI-559) Make the timeline layout version default to be null version

2020-01-20 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-559. Resolution: Fixed Fixed via master: ba54a7e9731a8371a8a85e04570d2c951a74ce53 > Make the timeline layout version

[GitHub] [incubator-hudi] leesf opened a new pull request #1257: Moving to 0.5.2-SNAPSHOT on master branch.

2020-01-20 Thread GitBox
leesf opened a new pull request #1257: Moving to 0.5.2-SNAPSHOT on master branch. URL: https://github.com/apache/incubator-hudi/pull/1257 ## What is the purpose of the pull request Update version to 0.5.2-SNAPSHOT. ## Brief change log update pom files. ## Verify

[GitHub] [incubator-hudi] HariprasadAllaka1612 commented on issue #1243: [SUPPORT]Caused by: org.apache.hudi.exception.HoodieException: java.util.concurrent.ExecutionException: java.lang.NoSuchMethodE

2020-01-20 Thread GitBox
HariprasadAllaka1612 commented on issue #1243: [SUPPORT]Caused by: org.apache.hudi.exception.HoodieException: java.util.concurrent.ExecutionException: java.lang.NoSuchMethodError:

svn commit: r37683 - /release/incubator/hudi/KEYS

2020-01-20 Thread vbalaji
Author: vbalaji Date: Mon Jan 20 08:15:45 2020 New Revision: 37683 Log: Adding leesf keys to hudi KEYS file Modified: release/incubator/hudi/KEYS Modified: release/incubator/hudi/KEYS == ---

[jira] [Resolved] (HUDI-441) Rename WorkflowDagGenerator and some class names in test package

2020-01-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang resolved HUDI-441. --- Resolution: Done Done via hudi-test-suite-refactor branch: d68e911414986bc8df075ee72e6a7dfce29f6e8f > Rename

[GitHub] [incubator-hudi] rongyousu closed issue #1254: mvn clean package -DskipTests -DskipITs -Dhadoop.version=2.4.0 -Dhive.version=2.1.1

2020-01-20 Thread GitBox
rongyousu closed issue #1254: mvn clean package -DskipTests -DskipITs -Dhadoop.version=2.4.0 -Dhive.version=2.1.1 URL: https://github.com/apache/incubator-hudi/issues/1254 This is an automated message from the Apache Git

[GitHub] [incubator-hudi] rongyousu commented on issue #1254: mvn clean package -DskipTests -DskipITs -Dhadoop.version=2.4.0 -Dhive.version=2.1.1

2020-01-20 Thread GitBox
rongyousu commented on issue #1254: mvn clean package -DskipTests -DskipITs -Dhadoop.version=2.4.0 -Dhive.version=2.1.1 URL: https://github.com/apache/incubator-hudi/issues/1254#issuecomment-576244269 ok ,thanks This is

svn commit: r37682 - /dev/incubator/hudi/KEYS

2020-01-20 Thread vbalaji
Author: vbalaji Date: Mon Jan 20 08:14:57 2020 New Revision: 37682 Log: Adding leesf keys to hudi KEYS file Modified: dev/incubator/hudi/KEYS Modified: dev/incubator/hudi/KEYS == --- dev/incubator/hudi/KEYS

[GitHub] [incubator-hudi] leesf closed pull request #1256: [MINOR] Add KEYS

2020-01-20 Thread GitBox
leesf closed pull request #1256: [MINOR] Add KEYS URL: https://github.com/apache/incubator-hudi/pull/1256 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Commented] (HUDI-560) Remove legacy IdentityTransformer

2020-01-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019314#comment-17019314 ] vinoyang commented on HUDI-560: --- [~vinoth] WDYT? > Remove legacy IdentityTransformer >

[jira] [Created] (HUDI-560) Remove legacy IdentityTransformer

2020-01-20 Thread vinoyang (Jira)
vinoyang created HUDI-560: - Summary: Remove legacy IdentityTransformer Key: HUDI-560 URL: https://issues.apache.org/jira/browse/HUDI-560 Project: Apache Hudi (incubating) Issue Type: Wish

[jira] [Reopened] (HUDI-404) Compile Master's Source Code Error

2020-01-20 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reopened HUDI-404: > Compile Master's Source Code Error > --- > > Key: HUDI-404 >

[jira] [Closed] (HUDI-404) Compile Master's Source Code Error

2020-01-20 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-404. -- Resolution: Not A Problem > Compile Master's Source Code Error > --- > >

[incubator-hudi] branch release-0.5.1 updated: Preparing for Release 0.5.1-incubating-rc1

2020-01-20 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch release-0.5.1 in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/release-0.5.1 by this push: new 94ed9b9 Preparing for

[GitHub] [incubator-hudi] bvaradar merged pull request #1258: Preparing for Release 0.5.1-incubating-rc1

2020-01-20 Thread GitBox
bvaradar merged pull request #1258: Preparing for Release 0.5.1-incubating-rc1 URL: https://github.com/apache/incubator-hudi/pull/1258 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [incubator-hudi] smarthi commented on a change in pull request #1253: [HUDI-558] Introduce ability to compress bloom filters while storing in parquet

2020-01-20 Thread GitBox
smarthi commented on a change in pull request #1253: [HUDI-558] Introduce ability to compress bloom filters while storing in parquet URL: https://github.com/apache/incubator-hudi/pull/1253#discussion_r368711264 ## File path:

[GitHub] [incubator-hudi] smarthi commented on a change in pull request #1253: [HUDI-558] Introduce ability to compress bloom filters while storing in parquet

2020-01-20 Thread GitBox
smarthi commented on a change in pull request #1253: [HUDI-558] Introduce ability to compress bloom filters while storing in parquet URL: https://github.com/apache/incubator-hudi/pull/1253#discussion_r368711970 ## File path:

[GitHub] [incubator-hudi] smarthi commented on a change in pull request #1253: [HUDI-558] Introduce ability to compress bloom filters while storing in parquet

2020-01-20 Thread GitBox
smarthi commented on a change in pull request #1253: [HUDI-558] Introduce ability to compress bloom filters while storing in parquet URL: https://github.com/apache/incubator-hudi/pull/1253#discussion_r368710257 ## File path:

[GitHub] [incubator-hudi] bvaradar commented on issue #1259: [MINOR] Download KEYS file when validating release candidate

2020-01-20 Thread GitBox
bvaradar commented on issue #1259: [MINOR] Download KEYS file when validating release candidate URL: https://github.com/apache/incubator-hudi/pull/1259#issuecomment-576419074 @leesf : You would need this fix before you send the email to dev@ for voting. Kindly check if release validation

[incubator-hudi] branch master updated: Moving to 0.5.2-SNAPSHOT on master branch.

2020-01-20 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 6e59c1c Moving to 0.5.2-SNAPSHOT on

[GitHub] [incubator-hudi] bvaradar merged pull request #1257: Moving to 0.5.2-SNAPSHOT on master branch.

2020-01-20 Thread GitBox
bvaradar merged pull request #1257: Moving to 0.5.2-SNAPSHOT on master branch. URL: https://github.com/apache/incubator-hudi/pull/1257 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Updated] (HUDI-76) CSV Source support for Hudi Delta Streamer

2020-01-20 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-76?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-76: -- Fix Version/s: (was: 0.5.1) 0.6.0 > CSV Source support for Hudi Delta Streamer >

[jira] [Updated] (HUDI-76) CSV Source support for Hudi Delta Streamer

2020-01-20 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-76?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-76: -- Fix Version/s: (was: 0.6.0) 0.5.2 > CSV Source support for Hudi Delta Streamer >

[jira] [Updated] (HUDI-76) CSV Source support for Hudi Delta Streamer

2020-01-20 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-76?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-76: -- Priority: Major (was: Minor) > CSV Source support for Hudi Delta Streamer >

[jira] [Assigned] (HUDI-539) No FileSystem for scheme: abfss

2020-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned HUDI-539: --- Assignee: Vinoth Chandar > No FileSystem for scheme: abfss > ---

[jira] [Updated] (HUDI-539) No FileSystem for scheme: abfss

2020-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-539: Fix Version/s: 0.6.0 > No FileSystem for scheme: abfss > --- > >

[GitHub] [incubator-hudi] vinothchandar commented on issue #1149: [WIP] [HUDI-472] Introduce configurations and new modes of sorting for bulk_insert

2020-01-20 Thread GitBox
vinothchandar commented on issue #1149: [WIP] [HUDI-472] Introduce configurations and new modes of sorting for bulk_insert URL: https://github.com/apache/incubator-hudi/pull/1149#issuecomment-576387868 @umehrot2 fyi This is

[GitHub] [incubator-hudi] smarthi commented on a change in pull request #1253: [HUDI-558] Introduce ability to compress bloom filters while storing in parquet

2020-01-20 Thread GitBox
smarthi commented on a change in pull request #1253: [HUDI-558] Introduce ability to compress bloom filters while storing in parquet URL: https://github.com/apache/incubator-hudi/pull/1253#discussion_r368708574 ## File path:

[GitHub] [incubator-hudi] bvaradar opened a new pull request #1259: [MINOR] Download KEYS file when validating release candidate

2020-01-20 Thread GitBox
bvaradar opened a new pull request #1259: [MINOR] Download KEYS file when validating release candidate URL: https://github.com/apache/incubator-hudi/pull/1259 As KEYS file is no longer present in repo, here is the change in release validation script to download it

[GitHub] [incubator-hudi] nbalajee commented on a change in pull request #1233: [HUDI-335] Improvements to DiskBasedMap used by ExternalSpillableMap,…

2020-01-20 Thread GitBox
nbalajee commented on a change in pull request #1233: [HUDI-335] Improvements to DiskBasedMap used by ExternalSpillableMap,… URL: https://github.com/apache/incubator-hudi/pull/1233#discussion_r368729156 ## File path:

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1151: [WIP] [HUDI-476] Add hudi-examples module

2020-01-20 Thread GitBox
pratyakshsharma commented on a change in pull request #1151: [WIP] [HUDI-476] Add hudi-examples module URL: https://github.com/apache/incubator-hudi/pull/1151#discussion_r368602223 ## File path:

[GitHub] [incubator-hudi] pratyakshsharma commented on issue #1243: [SUPPORT]Caused by: org.apache.hudi.exception.HoodieException: java.util.concurrent.ExecutionException: java.lang.NoSuchMethodError:

2020-01-20 Thread GitBox
pratyakshsharma commented on issue #1243: [SUPPORT]Caused by: org.apache.hudi.exception.HoodieException: java.util.concurrent.ExecutionException: java.lang.NoSuchMethodError: org.apache.parquet.avro.AvroSchemaConverter.convert(Lorg/apache/avro/Schema;)Lorg/apache/parquet/schema/MessageType;

[GitHub] [incubator-hudi] ssomuah commented on issue #1228: No FileSystem for scheme: abfss

2020-01-20 Thread GitBox
ssomuah commented on issue #1228: No FileSystem for scheme: abfss URL: https://github.com/apache/incubator-hudi/issues/1228#issuecomment-576302888 Thank you for looking into this @vinothchandar. I opened a JIRA ticket like leesf said.

[jira] [Commented] (HUDI-539) No FileSystem for scheme: abfss

2020-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019551#comment-17019551 ] Vinoth Chandar commented on HUDI-539: - [~ssomuah] you are right.. the problem is that , for this

[jira] [Commented] (HUDI-538) Restructuring hudi client module for multi engine support

2020-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019555#comment-17019555 ] Vinoth Chandar commented on HUDI-538: - [~yanghua] the sources in hudi-utilities are simply Hoodie's own

[GitHub] [incubator-hudi] leesf merged pull request #1259: [MINOR] Download KEYS file when validating release candidate

2020-01-20 Thread GitBox
leesf merged pull request #1259: [MINOR] Download KEYS file when validating release candidate URL: https://github.com/apache/incubator-hudi/pull/1259 This is an automated message from the Apache Git Service. To respond to

[incubator-hudi] branch release-0.5.1 updated: [MINOR] Download KEYS file when validating release candidate (#1259)

2020-01-20 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch release-0.5.1 in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/release-0.5.1 by this push: new bb58be1 [MINOR] Download

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki

2020-01-20 Thread GitBox
vinothchandar commented on a change in pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki URL: https://github.com/apache/incubator-hudi/pull/1260#discussion_r368784217 ## File path: docs/_docs/2_2_writing_data.md ## @@ -156,41 +157,31 @@

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki

2020-01-20 Thread GitBox
vinothchandar commented on a change in pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki URL: https://github.com/apache/incubator-hudi/pull/1260#discussion_r368784404 ## File path: docs/_docs/2_3_querying_data.md ## @@ -1,47 +1,52 @@ ---

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki

2020-01-20 Thread GitBox
vinothchandar commented on a change in pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki URL: https://github.com/apache/incubator-hudi/pull/1260#discussion_r368784018 ## File path: docs/_docs/2_1_concepts.md ## @@ -53,69 +53,70 @@ With the

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki

2020-01-20 Thread GitBox
vinothchandar commented on a change in pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki URL: https://github.com/apache/incubator-hudi/pull/1260#discussion_r368783683 ## File path: docs/_docs/1_2_structure.md ## @@ -6,16 +6,16 @@ summary:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki

2020-01-20 Thread GitBox
vinothchandar commented on a change in pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki URL: https://github.com/apache/incubator-hudi/pull/1260#discussion_r368783925 ## File path: docs/_docs/2_1_concepts.md ## @@ -1,37 +1,37 @@ ---

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki

2020-01-20 Thread GitBox
vinothchandar commented on a change in pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki URL: https://github.com/apache/incubator-hudi/pull/1260#discussion_r368783760 ## File path: docs/_docs/1_3_use_cases.md ## @@ -20,7 +20,7 @@ or

[jira] [Commented] (HUDI-538) Restructuring hudi client module for multi engine support

2020-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019818#comment-17019818 ] Vinoth Chandar commented on HUDI-538: - >Otherwise, where the records wait to be writen come from?

[GitHub] [incubator-hudi] lamber-ken commented on issue #1261: [HUDI-403] Adds guidelines on deployment/upgrading

2020-01-20 Thread GitBox
lamber-ken commented on issue #1261: [HUDI-403] Adds guidelines on deployment/upgrading URL: https://github.com/apache/incubator-hudi/pull/1261#issuecomment-576493665 Hello, I synced changes to https://lamber-ken.github.io/docs/deployment.html, it's helpful for reviewing.

[GitHub] [incubator-hudi] lamber-ken commented on a change in pull request #1261: [HUDI-403] Adds guidelines on deployment/upgrading

2020-01-20 Thread GitBox
lamber-ken commented on a change in pull request #1261: [HUDI-403] Adds guidelines on deployment/upgrading URL: https://github.com/apache/incubator-hudi/pull/1261#discussion_r368789255 ## File path: docs/_docs/2_6_deployment.md ## @@ -1,51 +1,87 @@ --- -title:

[GitHub] [incubator-hudi] lamber-ken commented on a change in pull request #1261: [HUDI-403] Adds guidelines on deployment/upgrading

2020-01-20 Thread GitBox
lamber-ken commented on a change in pull request #1261: [HUDI-403] Adds guidelines on deployment/upgrading URL: https://github.com/apache/incubator-hudi/pull/1261#discussion_r368789212 ## File path: docs/_docs/2_6_deployment.md ## @@ -1,51 +1,87 @@ --- -title:

[GitHub] [incubator-hudi] lamber-ken commented on issue #1261: [HUDI-403] Adds guidelines on deployment/upgrading

2020-01-20 Thread GitBox
lamber-ken commented on issue #1261: [HUDI-403] Adds guidelines on deployment/upgrading URL: https://github.com/apache/incubator-hudi/pull/1261#issuecomment-576500540 Hello, I synced changes to https://lamber-ken.github.io/docs/deployment.html , it's helpful for reviewing.

[GitHub] [incubator-hudi] lamber-ken removed a comment on issue #1261: [HUDI-403] Adds guidelines on deployment/upgrading

2020-01-20 Thread GitBox
lamber-ken removed a comment on issue #1261: [HUDI-403] Adds guidelines on deployment/upgrading URL: https://github.com/apache/incubator-hudi/pull/1261#issuecomment-576493665 Hello, I synced changes to https://lamber-ken.github.io/docs/deployment.html , it's helpful for reviewing.

[jira] [Comment Edited] (HUDI-84) Benchmark write/read paths on Hudi vs non-Hudi datasets

2020-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-84?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019830#comment-17019830 ] Vinoth Chandar edited comment on HUDI-84 at 1/21/20 3:16 AM: - Simple command to

[jira] [Comment Edited] (HUDI-84) Benchmark write/read paths on Hudi vs non-Hudi datasets

2020-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-84?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019830#comment-17019830 ] Vinoth Chandar edited comment on HUDI-84 at 1/21/20 3:16 AM: - Simple command to

[jira] [Updated] (HUDI-84) Benchmark write/read paths on Hudi vs non-Hudi datasets

2020-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-84?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-84: --- Attachment: df-write-stage.pdf df-toRdd-write.pdf > Benchmark write/read paths on Hudi

[GitHub] [incubator-hudi] lamber-ken opened a new pull request #1262: [MINOR] Upper toc_label

2020-01-20 Thread GitBox
lamber-ken opened a new pull request #1262: [MINOR] Upper toc_label URL: https://github.com/apache/incubator-hudi/pull/1262 ## What is the purpose of the pull request Upper toc_label. ## Brief change log - *Upper toc_label.* ## Verify this pull request

[jira] [Commented] (HUDI-560) Remove legacy IdentityTransformer

2020-01-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019839#comment-17019839 ] vinoyang commented on HUDI-560: --- [~vbalaji] OK, thanks. Now [~wangxianghu] you can start this work. Please go

[incubator-hudi] branch asf-site updated (4c3cf71 -> 5a23459)

2020-01-20 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from 4c3cf71 [HUDI-557] Additional work for supporting multiple version docs (#1250) add 5a23459

[GitHub] [incubator-hudi] vinothchandar merged pull request #1262: [MINOR] Upper toc_label

2020-01-20 Thread GitBox
vinothchandar merged pull request #1262: [MINOR] Upper toc_label URL: https://github.com/apache/incubator-hudi/pull/1262 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1233: [HUDI-335] Improvements to DiskBasedMap used by ExternalSpillableMap,…

2020-01-20 Thread GitBox
vinothchandar commented on a change in pull request #1233: [HUDI-335] Improvements to DiskBasedMap used by ExternalSpillableMap,… URL: https://github.com/apache/incubator-hudi/pull/1233#discussion_r368751754 ## File path:

[jira] [Updated] (HUDI-510) Update site documentation in sync with cWiki

2020-01-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-510: Labels: pull-request-available (was: ) > Update site documentation in sync with cWiki >

[GitHub] [incubator-hudi] bhasudha opened a new pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki

2020-01-20 Thread GitBox
bhasudha opened a new pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki URL: https://github.com/apache/incubator-hudi/pull/1260 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1233: [HUDI-335] Improvements to DiskBasedMap used by ExternalSpillableMap,…

2020-01-20 Thread GitBox
bvaradar commented on a change in pull request #1233: [HUDI-335] Improvements to DiskBasedMap used by ExternalSpillableMap,… URL: https://github.com/apache/incubator-hudi/pull/1233#discussion_r368775609 ## File path:

[jira] [Commented] (HUDI-403) Publish a deployment guide talking about deployment options, upgrading etc

2020-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019805#comment-17019805 ] Vinoth Chandar commented on HUDI-403: - [~vbalaji] I have covered everything except deltastreamer and

[GitHub] [incubator-hudi] vinothchandar commented on issue #1261: [HUDI-403] Adds guidelines on deployment/upgrading

2020-01-20 Thread GitBox
vinothchandar commented on issue #1261: [HUDI-403] Adds guidelines on deployment/upgrading URL: https://github.com/apache/incubator-hudi/pull/1261#issuecomment-576488099 @bvaradar can you please review and merge? This is an

[jira] [Assigned] (HUDI-403) Publish a deployment guide talking about deployment options, upgrading etc

2020-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned HUDI-403: --- Assignee: Balaji Varadarajan (was: Vinoth Chandar) > Publish a deployment guide talking

[GitHub] [incubator-hudi] yihua commented on a change in pull request #1246: [HUDI-552] Fix the schema mismatch in Row-to-Avro conversion

2020-01-20 Thread GitBox
yihua commented on a change in pull request #1246: [HUDI-552] Fix the schema mismatch in Row-to-Avro conversion URL: https://github.com/apache/incubator-hudi/pull/1246#discussion_r368785363 ## File path:

[jira] [Commented] (HUDI-560) Remove legacy IdentityTransformer

2020-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019816#comment-17019816 ] Vinoth Chandar commented on HUDI-560: - [~vbalaji] may have more context on this actually  > Remove

[GitHub] [incubator-hudi] lamber-ken commented on a change in pull request #1261: [HUDI-403] Adds guidelines on deployment/upgrading

2020-01-20 Thread GitBox
lamber-ken commented on a change in pull request #1261: [HUDI-403] Adds guidelines on deployment/upgrading URL: https://github.com/apache/incubator-hudi/pull/1261#discussion_r368786695 ## File path: docs/_docs/2_6_deployment.md ## @@ -1,51 +1,87 @@ --- -title:

[jira] [Commented] (HUDI-561) hudi partition path config

2020-01-20 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019841#comment-17019841 ] liujinhui commented on HUDI-561: [~yanghua] [~vinoth] > hudi partition path config >

[jira] [Created] (HUDI-561) hudi partition path config

2020-01-20 Thread liujinhui (Jira)
liujinhui created HUDI-561: -- Summary: hudi partition path config Key: HUDI-561 URL: https://issues.apache.org/jira/browse/HUDI-561 Project: Apache Hudi (incubating) Issue Type: Improvement

  1   2   >