[jira] [Updated] (HUDI-711) Exporter copy method gets passed wrong file list

2020-03-25 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-711: Status: Closed (was: Patch Available) > Exporter copy method gets passed wrong file list >

[jira] [Closed] (HUDI-711) Exporter copy method gets passed wrong file list

2020-03-25 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-711. --- > Exporter copy method gets passed wrong file list > > >

[jira] [Resolved] (HUDI-711) Exporter copy method gets passed wrong file list

2020-03-25 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-711. - Resolution: Fixed > Exporter copy method gets passed wrong file list >

[jira] [Reopened] (HUDI-711) Exporter copy method gets passed wrong file list

2020-03-25 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reopened HUDI-711: - > Exporter copy method gets passed wrong file list > > >

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1418: [HUDI-678] Make config package spark free

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1418: [HUDI-678] Make config package spark free URL: https://github.com/apache/incubator-hudi/pull/1418#discussion_r398217268 ## File path: hudi-client/src/main/java/org/apache/hudi/config/HoodieMemoryConfig.java ## @@

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1418: [HUDI-678] Make config package spark free

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1418: [HUDI-678] Make config package spark free URL: https://github.com/apache/incubator-hudi/pull/1418#discussion_r398216438 ## File path: hudi-client/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java ## @@

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1418: [HUDI-678] Make config package spark free

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1418: [HUDI-678] Make config package spark free URL: https://github.com/apache/incubator-hudi/pull/1418#discussion_r398216210 ## File path: hudi-client/src/main/java/org/apache/hudi/client/utils/ConfigUtils.java ## @@

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1418: [HUDI-678] Make config package spark free

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1418: [HUDI-678] Make config package spark free URL: https://github.com/apache/incubator-hudi/pull/1418#discussion_r398215708 ## File path: hudi-client/src/main/java/org/apache/hudi/index/bloom/HoodieBloomIndex.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index URL: https://github.com/apache/incubator-hudi/pull/1402#discussion_r398222054 ## File path: hudi-client/src/main/java/org/apache/hudi/index/bloom/HoodieSimpleIndex.java ## @@

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index URL: https://github.com/apache/incubator-hudi/pull/1402#discussion_r398221409 ## File path: hudi-client/src/main/java/org/apache/hudi/config/HoodieIndexConfig.java ## @@ -58,6

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index URL: https://github.com/apache/incubator-hudi/pull/1402#discussion_r398223341 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/ParquetUtils.java ## @@ -103,6

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index URL: https://github.com/apache/incubator-hudi/pull/1402#discussion_r398222688 ## File path: hudi-client/src/main/java/org/apache/hudi/index/bloom/HoodieSimpleIndex.java ## @@

[incubator-hudi] branch asf-site updated: [MINOR] Add link for yields.io usage (#1446)

2020-03-25 Thread smarthi
This is an automated email from the ASF dual-hosted git repository. smarthi pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 770ea3f [MINOR] Add link for

[GitHub] [incubator-hudi] smarthi merged pull request #1446: [MINOR] Add link for yields.io usage

2020-03-25 Thread GitBox
smarthi merged pull request #1446: [MINOR] Add link for yields.io usage URL: https://github.com/apache/incubator-hudi/pull/1446 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [incubator-hudi] smarthi commented on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
smarthi commented on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#issuecomment-604166428 > @smarthi is this ready for final review? Have we eliminated Guava at this point? @vinothchandar please review

[GitHub] [incubator-hudi] vinothchandar commented on issue #1406: [HUDI-713] Fix conversion of Spark array of struct type to Avro schema

2020-03-25 Thread GitBox
vinothchandar commented on issue #1406: [HUDI-713] Fix conversion of Spark array of struct type to Avro schema URL: https://github.com/apache/incubator-hudi/pull/1406#issuecomment-604128720 Sorry did not mean to hijack this fix.. Just trying to understand how it ll break compatibility

[incubator-hudi] branch asf-site updated: Travis CI build asf-site

2020-03-25 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 3353180 Travis CI build asf-site

[GitHub] [incubator-hudi] leesf commented on issue #1418: [HUDI-678] Make config package spark free

2020-03-25 Thread GitBox
leesf commented on issue #1418: [HUDI-678] Make config package spark free URL: https://github.com/apache/incubator-hudi/pull/1418#issuecomment-604155771 @vinothchandar Updated the PR to address your comments, PTAL, thanks.

[GitHub] [incubator-hudi] umehrot2 commented on issue #1406: [HUDI-713] Fix conversion of Spark array of struct type to Avro schema

2020-03-25 Thread GitBox
umehrot2 commented on issue #1406: [HUDI-713] Fix conversion of Spark array of struct type to Avro schema URL: https://github.com/apache/incubator-hudi/pull/1406#issuecomment-604137304 > Sorry did not mean to hijack this fix.. Just trying to understand how it ll break compatibility while

[GitHub] [incubator-hudi] vinothchandar opened a new pull request #1446: [MINOR] Add link for yields.io usage

2020-03-25 Thread GitBox
vinothchandar opened a new pull request #1446: [MINOR] Add link for yields.io usage URL: https://github.com/apache/incubator-hudi/pull/1446 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a

[GitHub] [incubator-hudi] lamber-ken commented on issue #1446: [MINOR] Add link for yields.io usage

2020-03-25 Thread GitBox
lamber-ken commented on issue #1446: [MINOR] Add link for yields.io usage URL: https://github.com/apache/incubator-hudi/pull/1446#issuecomment-604169166 hi @vinothchandar, it may have been delayed, it worked finally. https://travis-ci.org/github/apache/incubator-hudi/builds/667011979

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1446: [MINOR] Add link for yields.io usage

2020-03-25 Thread GitBox
lamber-ken edited a comment on issue #1446: [MINOR] Add link for yields.io usage URL: https://github.com/apache/incubator-hudi/pull/1446#issuecomment-604169166 hi @vinothchandar, when you submit the pr, the travis build fail. from its stacktrace, we may met some bug

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
codecov-io edited a comment on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#issuecomment-596089314 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1159?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] yanghua opened a new pull request #1447: [MINOR] Update the release note url for 0.5.2

2020-03-25 Thread GitBox
yanghua opened a new pull request #1447: [MINOR] Update the release note url for 0.5.2 URL: https://github.com/apache/incubator-hudi/pull/1447 ## What is the purpose of the pull request *This pull request UpdateS the release note url for 0.5.2* ## Brief change log

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
codecov-io edited a comment on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#issuecomment-596089314 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1159?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
codecov-io edited a comment on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#issuecomment-596089314 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1159?src=pr=h1) Report > Merging

[jira] [Created] (HUDI-735) Improve deltastreamer error message when case mismatch of commandline arguments.

2020-03-25 Thread Vinoth Chandar (Jira)
Vinoth Chandar created HUDI-735: --- Summary: Improve deltastreamer error message when case mismatch of commandline arguments. Key: HUDI-735 URL: https://issues.apache.org/jira/browse/HUDI-735 Project:

[GitHub] [incubator-hudi] lamber-ken commented on issue #1446: [MINOR] Add link for yields.io usage

2020-03-25 Thread GitBox
lamber-ken commented on issue #1446: [MINOR] Add link for yields.io usage URL: https://github.com/apache/incubator-hudi/pull/1446#issuecomment-604243812 > @lamber-ken can you please update the README on asf-site with some details on the automation and tips like these.. ? There is a section

[incubator-hudi] annotated tag release-0.5.2-incubating updated (41202da -> 8c4a620)

2020-03-25 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a change to annotated tag release-0.5.2-incubating in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. *** WARNING: tag release-0.5.2-incubating was modified! *** from 41202da (commit)

[incubator-hudi] branch asf-site updated: Update the release note url for 0.5.2 (#1447)

2020-03-25 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new f33188a Update the release note

[GitHub] [incubator-hudi] yanghua merged pull request #1447: [MINOR] Update the release note url for 0.5.2

2020-03-25 Thread GitBox
yanghua merged pull request #1447: [MINOR] Update the release note url for 0.5.2 URL: https://github.com/apache/incubator-hudi/pull/1447 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
codecov-io edited a comment on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#issuecomment-596089314 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1159?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] vinothchandar commented on issue #1443: [SUPPORT] Spark-Hudi consumes too much space in a temp folder while upsert

2020-03-25 Thread GitBox
vinothchandar commented on issue #1443: [SUPPORT] Spark-Hudi consumes too much space in a temp folder while upsert URL: https://github.com/apache/incubator-hudi/issues/1443#issuecomment-604226504 good idea @lamber-ken ! This

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1448: [MINOR] Update DOAP with 0.5.2 Release

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1448: [MINOR] Update DOAP with 0.5.2 Release URL: https://github.com/apache/incubator-hudi/pull/1448#discussion_r398315198 ## File path: doap_HUDI.rdf ## @@ -46,6 +46,11 @@ 2020-01-31 0.5.1 +

[GitHub] [incubator-hudi] vinothchandar commented on issue #1446: [MINOR] Add link for yields.io usage

2020-03-25 Thread GitBox
vinothchandar commented on issue #1446: [MINOR] Add link for yields.io usage URL: https://github.com/apache/incubator-hudi/pull/1446#issuecomment-604238808 @lamber-ken can you please update the README on asf-site with some details on the automation and tips like these.. ? There is a

[GitHub] [incubator-hudi] smarthi merged pull request #1448: [MINOR] Update DOAP with 0.5.2 Release

2020-03-25 Thread GitBox
smarthi merged pull request #1448: [MINOR] Update DOAP with 0.5.2 Release URL: https://github.com/apache/incubator-hudi/pull/1448 This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [incubator-hudi] lamber-ken commented on issue #1443: [SUPPORT] Spark-Hudi consumes too much space in a temp folder while upsert

2020-03-25 Thread GitBox
lamber-ken commented on issue #1443: [SUPPORT] Spark-Hudi consumes too much space in a temp folder while upsert URL: https://github.com/apache/incubator-hudi/issues/1443#issuecomment-604171160 > @lamber-ken this has come up in various tickets already.. > @n3nash should we bump up the

[incubator-hudi] branch asf-site updated: Travis CI build asf-site

2020-03-25 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 6712fb2 Travis CI build asf-site

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #228

2020-03-25 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.35 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/conf: logging settings.xml toolchains.xml

[incubator-hudi] branch master updated: [MINOR] Update DOAP with 0.5.2 Release (#1448)

2020-03-25 Thread smarthi
This is an automated email from the ASF dual-hosted git repository. smarthi pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new e101ea9 [MINOR] Update DOAP with

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1418: [HUDI-678] Make config package spark free

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1418: [HUDI-678] Make config package spark free URL: https://github.com/apache/incubator-hudi/pull/1418#discussion_r398316910 ## File path: hudi-client/src/main/java/org/apache/hudi/config/HoodieMemoryConfig.java ## @@

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1418: [HUDI-678] Make config package spark free

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1418: [HUDI-678] Make config package spark free URL: https://github.com/apache/incubator-hudi/pull/1418#discussion_r398317120 ## File path: hudi-client/src/main/java/org/apache/hudi/config/HoodieMemoryConfig.java ## @@

[GitHub] [incubator-hudi] smarthi commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
smarthi commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398332715 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/CollectionUtils.java

[GitHub] [incubator-hudi] lamber-ken commented on issue #1446: [MINOR] Add link for yields.io usage

2020-03-25 Thread GitBox
lamber-ken commented on issue #1446: [MINOR] Add link for yields.io usage URL: https://github.com/apache/incubator-hudi/pull/1446#issuecomment-604174107 btw, if the ci build fail, you can use following command to trigger rebuild. @vinothchandar ``` git commit --allow-empty -m

[GitHub] [incubator-hudi] smarthi opened a new pull request #1448: [MINOR] Update DOAP with 0.5.2 Release

2020-03-25 Thread GitBox
smarthi opened a new pull request #1448: [MINOR] Update DOAP with 0.5.2 Release URL: https://github.com/apache/incubator-hudi/pull/1448 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398321209 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398323808 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/FileIOUtils.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398318223 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398320467 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/CleanerUtils.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398323238 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/FileIOUtils.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398321039 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398322800 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398322962 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/FileIOUtils.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398325200 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398321995 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398323935 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398318223 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r39816 ## File path:

[GitHub] [incubator-hudi] smarthi commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
smarthi commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398333676 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/ReflectionUtils.java

[GitHub] [incubator-hudi] tverdokhlebd closed issue #1443: [SUPPORT] Spark-Hudi consumes too much space in a temp folder while upsert

2020-03-25 Thread GitBox
tverdokhlebd closed issue #1443: [SUPPORT] Spark-Hudi consumes too much space in a temp folder while upsert URL: https://github.com/apache/incubator-hudi/issues/1443 This is an automated message from the Apache Git Service.

[GitHub] [incubator-hudi] tverdokhlebd commented on issue #1443: [SUPPORT] Spark-Hudi consumes too much space in a temp folder while upsert

2020-03-25 Thread GitBox
tverdokhlebd commented on issue #1443: [SUPPORT] Spark-Hudi consumes too much space in a temp folder while upsert URL: https://github.com/apache/incubator-hudi/issues/1443#issuecomment-603846771 @lamber-ken , thanks, the problem is solved.

[GitHub] [incubator-hudi] vinothchandar commented on issue #1440: [HUDI-731] Add ChainedTransformer

2020-03-25 Thread GitBox
vinothchandar commented on issue #1440: [HUDI-731] Add ChainedTransformer URL: https://github.com/apache/incubator-hudi/pull/1440#issuecomment-603901546 sorry for dropping off.. crazy times :/ I agree with the tradeoffs and points discussed here.. Even though users can subclass the

[GitHub] [incubator-hudi] yanghua merged pull request #1445: [MINOR] Fix javadoc of InsertBucket

2020-03-25 Thread GitBox
yanghua merged pull request #1445: [MINOR] Fix javadoc of InsertBucket URL: https://github.com/apache/incubator-hudi/pull/1445 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [incubator-hudi] vinothchandar commented on issue #1418: [HUDI-678] Make config package spark free

2020-03-25 Thread GitBox
vinothchandar commented on issue #1418: [HUDI-678] Make config package spark free URL: https://github.com/apache/incubator-hudi/pull/1418#issuecomment-603869397 @leesf sorry behind on reviews.. Will get stuff ready for you by your day time

[GitHub] [incubator-hudi] vinothchandar commented on issue #1443: [SUPPORT] Spark-Hudi consumes too much space in a temp folder while upsert

2020-03-25 Thread GitBox
vinothchandar commented on issue #1443: [SUPPORT] Spark-Hudi consumes too much space in a temp folder while upsert URL: https://github.com/apache/incubator-hudi/issues/1443#issuecomment-603869842 @lamber-ken this has come up in various tickets already.. @n3nash should we bump up the

[incubator-hudi] branch master updated: [MINOR] Fix javadoc of InsertBucket (#1445)

2020-03-25 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 5eed6c9 [MINOR] Fix javadoc of

[GitHub] [incubator-hudi] vinothchandar commented on issue #1396: [HUDI-687] Stop incremental reader on RO table before a pending compaction

2020-03-25 Thread GitBox
vinothchandar commented on issue #1396: [HUDI-687] Stop incremental reader on RO table before a pending compaction URL: https://github.com/apache/incubator-hudi/pull/1396#issuecomment-603902158 if @bvaradar approves, it should be sufficient.. I will take another pass at it today

[GitHub] [incubator-hudi] leesf commented on issue #1418: [HUDI-678] Make config package spark free

2020-03-25 Thread GitBox
leesf commented on issue #1418: [HUDI-678] Make config package spark free URL: https://github.com/apache/incubator-hudi/pull/1418#issuecomment-603850989 @vinothchandar Any concerns here? This is an automated message from the

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1444: [MINOR] Update web site for 0.5.2 doc

2020-03-25 Thread GitBox
yanghua commented on a change in pull request #1444: [MINOR] Update web site for 0.5.2 doc URL: https://github.com/apache/incubator-hudi/pull/1444#discussion_r397893404 ## File path: content/sitemap.xml ## @@ -265,6 +265,138 @@ 2019-12-30T14:59:57-05:00

[GitHub] [incubator-hudi] wangxianghu commented on issue #1445: [MINOR] Fix javadoc of InsertBucket

2020-03-25 Thread GitBox
wangxianghu commented on issue #1445: [MINOR] Fix javadoc of InsertBucket URL: https://github.com/apache/incubator-hudi/pull/1445#issuecomment-603862058 @yanghua could you please take a look This is an automated message from

[GitHub] [incubator-hudi] wangxianghu opened a new pull request #1445: [MINOR] Fix javadoc of InsertBucket

2020-03-25 Thread GitBox
wangxianghu opened a new pull request #1445: [MINOR] Fix javadoc of InsertBucket URL: https://github.com/apache/incubator-hudi/pull/1445 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull

[GitHub] [incubator-hudi] leesf commented on issue #1418: [HUDI-678] Make config package spark free

2020-03-25 Thread GitBox
leesf commented on issue #1418: [HUDI-678] Make config package spark free URL: https://github.com/apache/incubator-hudi/pull/1418#issuecomment-603873115 > @leesf sorry behind on reviews.. Will get stuff ready for you by your day time No worries..

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1444: [MINOR] Update web site for 0.5.2 doc

2020-03-25 Thread GitBox
leesf commented on a change in pull request #1444: [MINOR] Update web site for 0.5.2 doc URL: https://github.com/apache/incubator-hudi/pull/1444#discussion_r397838610 ## File path: content/sitemap.xml ## @@ -265,6 +265,138 @@ 2019-12-30T14:59:57-05:00

[GitHub] [incubator-hudi] yanghua merged pull request #1444: [MINOR] Update web site for 0.5.2 doc

2020-03-25 Thread GitBox
yanghua merged pull request #1444: [MINOR] Update web site for 0.5.2 doc URL: https://github.com/apache/incubator-hudi/pull/1444 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [incubator-hudi] yanghua commented on issue #1444: [MINOR] Update web site for 0.5.2 doc

2020-03-25 Thread GitBox
yanghua commented on issue #1444: [MINOR] Update web site for 0.5.2 doc URL: https://github.com/apache/incubator-hudi/pull/1444#issuecomment-603870415 > LGTM, as long as you have tested once localluy Yes, I viewed doc of 0.5.2 and some other pages in my local.

[jira] [Commented] (HUDI-733) presto query data error

2020-03-25 Thread jing (Jira)
[ https://issues.apache.org/jira/browse/HUDI-733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066417#comment-17066417 ] jing commented on HUDI-733: --- [~bhasudha]   help me  > presto query data error > --- > >

[jira] [Created] (HUDI-733) presto query data error

2020-03-25 Thread jing (Jira)
jing created HUDI-733: - Summary: presto query data error Key: HUDI-733 URL: https://issues.apache.org/jira/browse/HUDI-733 Project: Apache Hudi (incubating) Issue Type: Bug Components: Presto

[GitHub] [incubator-hudi] umehrot2 commented on a change in pull request #1427: [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema

2020-03-25 Thread GitBox
umehrot2 commented on a change in pull request #1427: [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema URL: https://github.com/apache/incubator-hudi/pull/1427#discussion_r397699488 ## File path:

[GitHub] [incubator-hudi] lamber-ken commented on issue #1443: [SUPPORT] Spark-Hudi consumes too much space in a temp folder while upsert

2020-03-25 Thread GitBox
lamber-ken commented on issue #1443: [SUPPORT] Spark-Hudi consumes too much space in a temp folder while upsert URL: https://github.com/apache/incubator-hudi/issues/1443#issuecomment-603738602 btw, when upsert large input data, hudi will spills part of input data to disk when reach the

[incubator-hudi] branch asf-site updated: Travis CI build asf-site

2020-03-25 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new cfb5b00 Travis CI build asf-site

[GitHub] [incubator-hudi] tverdokhlebd opened a new issue #1443: [SUPPORT] Spark-Hudi consumes too much space in a temp folder while upsert

2020-03-25 Thread GitBox
tverdokhlebd opened a new issue #1443: [SUPPORT] Spark-Hudi consumes too much space in a temp folder while upsert URL: https://github.com/apache/incubator-hudi/issues/1443 We have a Vertica database which has around 25 million rows (~9GB) and S3 storage for them. I try to move data from

[incubator-hudi] branch release-0.5.2 updated: Change version from 0.5.2-incubating-rc2 to 0.5.2-incubating

2020-03-25 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch release-0.5.2 in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/release-0.5.2 by this push: new 41202da Change version

svn commit: r38617 - in /release/incubator/hudi/hudi-0.5.2-incubating: ./ hudi-0.5.2-incubating.src.tgz hudi-0.5.2-incubating.src.tgz.asc hudi-0.5.2-incubating.src.tgz.sha512

2020-03-25 Thread vinoyang
Author: vinoyang Date: Wed Mar 25 09:30:11 2020 New Revision: 38617 Log: Upload source code for hudi-0.5.2-incubating Added: release/incubator/hudi/hudi-0.5.2-incubating/ release/incubator/hudi/hudi-0.5.2-incubating/hudi-0.5.2-incubating.src.tgz (with props)

[GitHub] [incubator-hudi] lamber-ken commented on issue #1443: [SUPPORT] Spark-Hudi consumes too much space in a temp folder while upsert

2020-03-25 Thread GitBox
lamber-ken commented on issue #1443: [SUPPORT] Spark-Hudi consumes too much space in a temp folder while upsert URL: https://github.com/apache/incubator-hudi/issues/1443#issuecomment-603735853 hello, @tverdokhlebd, from your above code, I guess you want do a bulk insert operation. by

svn commit: r38618 - in /release/incubator/hudi: 0.5.2-incubating/ hudi-0.5.2-incubating/

2020-03-25 Thread vinoyang
Author: vinoyang Date: Wed Mar 25 09:39:42 2020 New Revision: 38618 Log: rename hudi-0.5.2-incubating to 0.5.2-incubating Added: release/incubator/hudi/0.5.2-incubating/ - copied from r38617, release/incubator/hudi/hudi-0.5.2-incubating/ Removed:

[jira] [Resolved] (HUDI-734) Fix error: cannot create directory ‘test-content’: File exists

2020-03-25 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken resolved HUDI-734. - Resolution: Fixed > Fix error: cannot create directory ‘test-content’: File exists >

[jira] [Updated] (HUDI-734) Fix error: cannot create directory ‘test-content’: File exists

2020-03-25 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-734: Status: Open (was: New) > Fix error: cannot create directory ‘test-content’: File exists >

[jira] [Assigned] (HUDI-734) Fix error: cannot create directory ‘test-content’: File exists

2020-03-25 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken reassigned HUDI-734: --- Assignee: lamber-ken > Fix error: cannot create directory ‘test-content’: File exists >

[jira] [Created] (HUDI-734) Fix error: cannot create directory ‘test-content’: File exists

2020-03-25 Thread lamber-ken (Jira)
lamber-ken created HUDI-734: --- Summary: Fix error: cannot create directory ‘test-content’: File exists Key: HUDI-734 URL: https://issues.apache.org/jira/browse/HUDI-734 Project: Apache Hudi (incubating)

[GitHub] [incubator-hudi] lamber-ken commented on issue #1442: [HUDI-734] Fix error: cannot create directory ‘test-content’: File exists

2020-03-25 Thread GitBox
lamber-ken commented on issue #1442: [HUDI-734] Fix error: cannot create directory ‘test-content’: File exists URL: https://github.com/apache/incubator-hudi/pull/1442#issuecomment-603673964 hi @leesf, this bug causes travis didn't push build content to `test-content`.

[jira] [Updated] (HUDI-734) Fix error: cannot create directory ‘test-content’: File exists

2020-03-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-734: Labels: pull-request-available (was: ) > Fix error: cannot create directory ‘test-content’: File

[incubator-hudi] branch asf-site updated: [HUDI-734] Fix error: cannot create directory ‘test-content’: File exists (#1442)

2020-03-25 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 3ecde42 [HUDI-734] Fix error:

[GitHub] [incubator-hudi] leesf merged pull request #1442: [HUDI-734] Fix error: cannot create directory ‘test-content’: File exists

2020-03-25 Thread GitBox
leesf merged pull request #1442: [HUDI-734] Fix error: cannot create directory ‘test-content’: File exists URL: https://github.com/apache/incubator-hudi/pull/1442 This is an automated message from the Apache Git Service. To

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1442: [HUDI-734] Fix error: cannot create directory ‘test-content’: File exists

2020-03-25 Thread GitBox
lamber-ken edited a comment on issue #1442: [HUDI-734] Fix error: cannot create directory ‘test-content’: File exists URL: https://github.com/apache/incubator-hudi/pull/1442#issuecomment-603673964 hi @leesf, this bug causes travis didn't push build content to `test-content`.

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1427: [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema

2020-03-25 Thread GitBox
pratyakshsharma commented on a change in pull request #1427: [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema URL: https://github.com/apache/incubator-hudi/pull/1427#discussion_r397658217 ## File path:

[GitHub] [incubator-hudi] lamber-ken opened a new pull request #1442: [HUDI-734] Fix error: cannot create directory ‘test-content’: File exists

2020-03-25 Thread GitBox
lamber-ken opened a new pull request #1442: [HUDI-734] Fix error: cannot create directory ‘test-content’: File exists URL: https://github.com/apache/incubator-hudi/pull/1442 ## What is the purpose of the pull request The `mkdir: cannot create directory ‘test-content’: File exists`

[GitHub] [incubator-hudi] leesf merged pull request #1436: [HUDI-711] Refactor exporter main logic

2020-03-25 Thread GitBox
leesf merged pull request #1436: [HUDI-711] Refactor exporter main logic URL: https://github.com/apache/incubator-hudi/pull/1436 This is an automated message from the Apache Git Service. To respond to the message, please log

[incubator-hudi] branch master updated: [HUDI-711] Refactor exporter main logic (#1436)

2020-03-25 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new bc82e2b [HUDI-711] Refactor exporter

[jira] [Closed] (HUDI-604) Update docker page

2020-03-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-604. - > Update docker page > -- > > Key: HUDI-604 > URL:

[jira] [Closed] (HUDI-297) [Presto] Reuse table metadata listing and reduce namenode RPCs for Presto RO View queries

2020-03-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-297. - > [Presto] Reuse table metadata listing and reduce namenode RPCs for Presto RO > View queries >

  1   2   >