[GitHub] [incubator-hudi] smarthi commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
smarthi commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398333676 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/ReflectionUtils.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r39816 ## File path:

[GitHub] [incubator-hudi] smarthi commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
smarthi commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398332715 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/CollectionUtils.java

[GitHub] [incubator-hudi] lamber-ken commented on issue #1446: [MINOR] Add link for yields.io usage

2020-03-25 Thread GitBox
lamber-ken commented on issue #1446: [MINOR] Add link for yields.io usage URL: https://github.com/apache/incubator-hudi/pull/1446#issuecomment-604243812 > @lamber-ken can you please update the README on asf-site with some details on the automation and tips like these.. ? There is a section

[GitHub] [incubator-hudi] vinothchandar commented on issue #1446: [MINOR] Add link for yields.io usage

2020-03-25 Thread GitBox
vinothchandar commented on issue #1446: [MINOR] Add link for yields.io usage URL: https://github.com/apache/incubator-hudi/pull/1446#issuecomment-604238808 @lamber-ken can you please update the README on asf-site with some details on the automation and tips like these.. ? There is a

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398323808 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/FileIOUtils.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398318223 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398320467 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/CleanerUtils.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398321039 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398321209 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398323238 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/FileIOUtils.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398322800 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398322962 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/FileIOUtils.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398325200 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398321995 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398323935 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398318223 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1418: [HUDI-678] Make config package spark free

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1418: [HUDI-678] Make config package spark free URL: https://github.com/apache/incubator-hudi/pull/1418#discussion_r398317120 ## File path: hudi-client/src/main/java/org/apache/hudi/config/HoodieMemoryConfig.java ## @@

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1418: [HUDI-678] Make config package spark free

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1418: [HUDI-678] Make config package spark free URL: https://github.com/apache/incubator-hudi/pull/1418#discussion_r398316910 ## File path: hudi-client/src/main/java/org/apache/hudi/config/HoodieMemoryConfig.java ## @@

[jira] [Created] (HUDI-735) Improve deltastreamer error message when case mismatch of commandline arguments.

2020-03-25 Thread Vinoth Chandar (Jira)
Vinoth Chandar created HUDI-735: --- Summary: Improve deltastreamer error message when case mismatch of commandline arguments. Key: HUDI-735 URL: https://issues.apache.org/jira/browse/HUDI-735 Project:

[GitHub] [incubator-hudi] vinothchandar commented on issue #1443: [SUPPORT] Spark-Hudi consumes too much space in a temp folder while upsert

2020-03-25 Thread GitBox
vinothchandar commented on issue #1443: [SUPPORT] Spark-Hudi consumes too much space in a temp folder while upsert URL: https://github.com/apache/incubator-hudi/issues/1443#issuecomment-604226504 good idea @lamber-ken ! This

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1448: [MINOR] Update DOAP with 0.5.2 Release

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1448: [MINOR] Update DOAP with 0.5.2 Release URL: https://github.com/apache/incubator-hudi/pull/1448#discussion_r398315198 ## File path: doap_HUDI.rdf ## @@ -46,6 +46,11 @@ 2020-01-31 0.5.1 +

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
codecov-io edited a comment on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#issuecomment-596089314 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1159?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
codecov-io edited a comment on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#issuecomment-596089314 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1159?src=pr=h1) Report > Merging

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #228

2020-03-25 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.35 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/conf: logging settings.xml toolchains.xml

[incubator-hudi] branch master updated: [MINOR] Update DOAP with 0.5.2 Release (#1448)

2020-03-25 Thread smarthi
This is an automated email from the ASF dual-hosted git repository. smarthi pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new e101ea9 [MINOR] Update DOAP with

[GitHub] [incubator-hudi] smarthi merged pull request #1448: [MINOR] Update DOAP with 0.5.2 Release

2020-03-25 Thread GitBox
smarthi merged pull request #1448: [MINOR] Update DOAP with 0.5.2 Release URL: https://github.com/apache/incubator-hudi/pull/1448 This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [incubator-hudi] smarthi opened a new pull request #1448: [MINOR] Update DOAP with 0.5.2 Release

2020-03-25 Thread GitBox
smarthi opened a new pull request #1448: [MINOR] Update DOAP with 0.5.2 Release URL: https://github.com/apache/incubator-hudi/pull/1448 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull

[incubator-hudi] branch asf-site updated: Travis CI build asf-site

2020-03-25 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 6712fb2 Travis CI build asf-site

[incubator-hudi] branch asf-site updated: Update the release note url for 0.5.2 (#1447)

2020-03-25 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new f33188a Update the release note

[GitHub] [incubator-hudi] yanghua merged pull request #1447: [MINOR] Update the release note url for 0.5.2

2020-03-25 Thread GitBox
yanghua merged pull request #1447: [MINOR] Update the release note url for 0.5.2 URL: https://github.com/apache/incubator-hudi/pull/1447 This is an automated message from the Apache Git Service. To respond to the message,

[incubator-hudi] annotated tag release-0.5.2-incubating updated (41202da -> 8c4a620)

2020-03-25 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a change to annotated tag release-0.5.2-incubating in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. *** WARNING: tag release-0.5.2-incubating was modified! *** from 41202da (commit)

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
codecov-io edited a comment on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#issuecomment-596089314 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1159?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
codecov-io edited a comment on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#issuecomment-596089314 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1159?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] yanghua opened a new pull request #1447: [MINOR] Update the release note url for 0.5.2

2020-03-25 Thread GitBox
yanghua opened a new pull request #1447: [MINOR] Update the release note url for 0.5.2 URL: https://github.com/apache/incubator-hudi/pull/1447 ## What is the purpose of the pull request *This pull request UpdateS the release note url for 0.5.2* ## Brief change log

[GitHub] [incubator-hudi] lamber-ken commented on issue #1446: [MINOR] Add link for yields.io usage

2020-03-25 Thread GitBox
lamber-ken commented on issue #1446: [MINOR] Add link for yields.io usage URL: https://github.com/apache/incubator-hudi/pull/1446#issuecomment-604174107 btw, if the ci build fail, you can use following command to trigger rebuild. @vinothchandar ``` git commit --allow-empty -m

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1446: [MINOR] Add link for yields.io usage

2020-03-25 Thread GitBox
lamber-ken edited a comment on issue #1446: [MINOR] Add link for yields.io usage URL: https://github.com/apache/incubator-hudi/pull/1446#issuecomment-604169166 hi @vinothchandar, when you submit the pr, the travis build fail. from its stacktrace, we may met some bug

[GitHub] [incubator-hudi] lamber-ken commented on issue #1443: [SUPPORT] Spark-Hudi consumes too much space in a temp folder while upsert

2020-03-25 Thread GitBox
lamber-ken commented on issue #1443: [SUPPORT] Spark-Hudi consumes too much space in a temp folder while upsert URL: https://github.com/apache/incubator-hudi/issues/1443#issuecomment-604171160 > @lamber-ken this has come up in various tickets already.. > @n3nash should we bump up the

[GitHub] [incubator-hudi] lamber-ken commented on issue #1446: [MINOR] Add link for yields.io usage

2020-03-25 Thread GitBox
lamber-ken commented on issue #1446: [MINOR] Add link for yields.io usage URL: https://github.com/apache/incubator-hudi/pull/1446#issuecomment-604169166 hi @vinothchandar, it may have been delayed, it worked finally. https://travis-ci.org/github/apache/incubator-hudi/builds/667011979

[GitHub] [incubator-hudi] smarthi commented on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-25 Thread GitBox
smarthi commented on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#issuecomment-604166428 > @smarthi is this ready for final review? Have we eliminated Guava at this point? @vinothchandar please review

[GitHub] [incubator-hudi] leesf commented on issue #1418: [HUDI-678] Make config package spark free

2020-03-25 Thread GitBox
leesf commented on issue #1418: [HUDI-678] Make config package spark free URL: https://github.com/apache/incubator-hudi/pull/1418#issuecomment-604155771 @vinothchandar Updated the PR to address your comments, PTAL, thanks.

[incubator-hudi] branch asf-site updated: Travis CI build asf-site

2020-03-25 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 3353180 Travis CI build asf-site

[GitHub] [incubator-hudi] umehrot2 commented on issue #1406: [HUDI-713] Fix conversion of Spark array of struct type to Avro schema

2020-03-25 Thread GitBox
umehrot2 commented on issue #1406: [HUDI-713] Fix conversion of Spark array of struct type to Avro schema URL: https://github.com/apache/incubator-hudi/pull/1406#issuecomment-604137304 > Sorry did not mean to hijack this fix.. Just trying to understand how it ll break compatibility while

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index URL: https://github.com/apache/incubator-hudi/pull/1402#discussion_r398223341 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/ParquetUtils.java ## @@ -103,6

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index URL: https://github.com/apache/incubator-hudi/pull/1402#discussion_r398222054 ## File path: hudi-client/src/main/java/org/apache/hudi/index/bloom/HoodieSimpleIndex.java ## @@

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index URL: https://github.com/apache/incubator-hudi/pull/1402#discussion_r398221409 ## File path: hudi-client/src/main/java/org/apache/hudi/config/HoodieIndexConfig.java ## @@ -58,6

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index URL: https://github.com/apache/incubator-hudi/pull/1402#discussion_r398222688 ## File path: hudi-client/src/main/java/org/apache/hudi/index/bloom/HoodieSimpleIndex.java ## @@

[GitHub] [incubator-hudi] vinothchandar commented on issue #1406: [HUDI-713] Fix conversion of Spark array of struct type to Avro schema

2020-03-25 Thread GitBox
vinothchandar commented on issue #1406: [HUDI-713] Fix conversion of Spark array of struct type to Avro schema URL: https://github.com/apache/incubator-hudi/pull/1406#issuecomment-604128720 Sorry did not mean to hijack this fix.. Just trying to understand how it ll break compatibility

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1418: [HUDI-678] Make config package spark free

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1418: [HUDI-678] Make config package spark free URL: https://github.com/apache/incubator-hudi/pull/1418#discussion_r398216210 ## File path: hudi-client/src/main/java/org/apache/hudi/client/utils/ConfigUtils.java ## @@

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1418: [HUDI-678] Make config package spark free

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1418: [HUDI-678] Make config package spark free URL: https://github.com/apache/incubator-hudi/pull/1418#discussion_r398217268 ## File path: hudi-client/src/main/java/org/apache/hudi/config/HoodieMemoryConfig.java ## @@

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1418: [HUDI-678] Make config package spark free

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1418: [HUDI-678] Make config package spark free URL: https://github.com/apache/incubator-hudi/pull/1418#discussion_r398216438 ## File path: hudi-client/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java ## @@

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1418: [HUDI-678] Make config package spark free

2020-03-25 Thread GitBox
vinothchandar commented on a change in pull request #1418: [HUDI-678] Make config package spark free URL: https://github.com/apache/incubator-hudi/pull/1418#discussion_r398215708 ## File path: hudi-client/src/main/java/org/apache/hudi/index/bloom/HoodieBloomIndex.java ##

[incubator-hudi] branch asf-site updated: [MINOR] Add link for yields.io usage (#1446)

2020-03-25 Thread smarthi
This is an automated email from the ASF dual-hosted git repository. smarthi pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 770ea3f [MINOR] Add link for

[GitHub] [incubator-hudi] smarthi merged pull request #1446: [MINOR] Add link for yields.io usage

2020-03-25 Thread GitBox
smarthi merged pull request #1446: [MINOR] Add link for yields.io usage URL: https://github.com/apache/incubator-hudi/pull/1446 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [incubator-hudi] vinothchandar opened a new pull request #1446: [MINOR] Add link for yields.io usage

2020-03-25 Thread GitBox
vinothchandar opened a new pull request #1446: [MINOR] Add link for yields.io usage URL: https://github.com/apache/incubator-hudi/pull/1446 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a

[jira] [Closed] (HUDI-711) Exporter copy method gets passed wrong file list

2020-03-25 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-711. --- > Exporter copy method gets passed wrong file list > > >

[jira] [Resolved] (HUDI-711) Exporter copy method gets passed wrong file list

2020-03-25 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-711. - Resolution: Fixed > Exporter copy method gets passed wrong file list >

[jira] [Reopened] (HUDI-711) Exporter copy method gets passed wrong file list

2020-03-25 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reopened HUDI-711: - > Exporter copy method gets passed wrong file list > > >

[jira] [Updated] (HUDI-711) Exporter copy method gets passed wrong file list

2020-03-25 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-711: Status: Closed (was: Patch Available) > Exporter copy method gets passed wrong file list >

[GitHub] [incubator-hudi] vinothchandar commented on issue #1396: [HUDI-687] Stop incremental reader on RO table before a pending compaction

2020-03-25 Thread GitBox
vinothchandar commented on issue #1396: [HUDI-687] Stop incremental reader on RO table before a pending compaction URL: https://github.com/apache/incubator-hudi/pull/1396#issuecomment-603902158 if @bvaradar approves, it should be sufficient.. I will take another pass at it today

[GitHub] [incubator-hudi] vinothchandar commented on issue #1440: [HUDI-731] Add ChainedTransformer

2020-03-25 Thread GitBox
vinothchandar commented on issue #1440: [HUDI-731] Add ChainedTransformer URL: https://github.com/apache/incubator-hudi/pull/1440#issuecomment-603901546 sorry for dropping off.. crazy times :/ I agree with the tradeoffs and points discussed here.. Even though users can subclass the

[GitHub] [incubator-hudi] leesf commented on issue #1418: [HUDI-678] Make config package spark free

2020-03-25 Thread GitBox
leesf commented on issue #1418: [HUDI-678] Make config package spark free URL: https://github.com/apache/incubator-hudi/pull/1418#issuecomment-603873115 > @leesf sorry behind on reviews.. Will get stuff ready for you by your day time No worries..

[GitHub] [incubator-hudi] yanghua merged pull request #1444: [MINOR] Update web site for 0.5.2 doc

2020-03-25 Thread GitBox
yanghua merged pull request #1444: [MINOR] Update web site for 0.5.2 doc URL: https://github.com/apache/incubator-hudi/pull/1444 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [incubator-hudi] yanghua commented on issue #1444: [MINOR] Update web site for 0.5.2 doc

2020-03-25 Thread GitBox
yanghua commented on issue #1444: [MINOR] Update web site for 0.5.2 doc URL: https://github.com/apache/incubator-hudi/pull/1444#issuecomment-603870415 > LGTM, as long as you have tested once localluy Yes, I viewed doc of 0.5.2 and some other pages in my local.

[GitHub] [incubator-hudi] vinothchandar commented on issue #1443: [SUPPORT] Spark-Hudi consumes too much space in a temp folder while upsert

2020-03-25 Thread GitBox
vinothchandar commented on issue #1443: [SUPPORT] Spark-Hudi consumes too much space in a temp folder while upsert URL: https://github.com/apache/incubator-hudi/issues/1443#issuecomment-603869842 @lamber-ken this has come up in various tickets already.. @n3nash should we bump up the

[GitHub] [incubator-hudi] vinothchandar commented on issue #1418: [HUDI-678] Make config package spark free

2020-03-25 Thread GitBox
vinothchandar commented on issue #1418: [HUDI-678] Make config package spark free URL: https://github.com/apache/incubator-hudi/pull/1418#issuecomment-603869397 @leesf sorry behind on reviews.. Will get stuff ready for you by your day time

[GitHub] [incubator-hudi] yanghua merged pull request #1445: [MINOR] Fix javadoc of InsertBucket

2020-03-25 Thread GitBox
yanghua merged pull request #1445: [MINOR] Fix javadoc of InsertBucket URL: https://github.com/apache/incubator-hudi/pull/1445 This is an automated message from the Apache Git Service. To respond to the message, please log

[incubator-hudi] branch master updated: [MINOR] Fix javadoc of InsertBucket (#1445)

2020-03-25 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 5eed6c9 [MINOR] Fix javadoc of

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1444: [MINOR] Update web site for 0.5.2 doc

2020-03-25 Thread GitBox
yanghua commented on a change in pull request #1444: [MINOR] Update web site for 0.5.2 doc URL: https://github.com/apache/incubator-hudi/pull/1444#discussion_r397893404 ## File path: content/sitemap.xml ## @@ -265,6 +265,138 @@ 2019-12-30T14:59:57-05:00

[GitHub] [incubator-hudi] wangxianghu commented on issue #1445: [MINOR] Fix javadoc of InsertBucket

2020-03-25 Thread GitBox
wangxianghu commented on issue #1445: [MINOR] Fix javadoc of InsertBucket URL: https://github.com/apache/incubator-hudi/pull/1445#issuecomment-603862058 @yanghua could you please take a look This is an automated message from

[GitHub] [incubator-hudi] wangxianghu opened a new pull request #1445: [MINOR] Fix javadoc of InsertBucket

2020-03-25 Thread GitBox
wangxianghu opened a new pull request #1445: [MINOR] Fix javadoc of InsertBucket URL: https://github.com/apache/incubator-hudi/pull/1445 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull

[GitHub] [incubator-hudi] leesf commented on issue #1418: [HUDI-678] Make config package spark free

2020-03-25 Thread GitBox
leesf commented on issue #1418: [HUDI-678] Make config package spark free URL: https://github.com/apache/incubator-hudi/pull/1418#issuecomment-603850989 @vinothchandar Any concerns here? This is an automated message from the

[GitHub] [incubator-hudi] tverdokhlebd closed issue #1443: [SUPPORT] Spark-Hudi consumes too much space in a temp folder while upsert

2020-03-25 Thread GitBox
tverdokhlebd closed issue #1443: [SUPPORT] Spark-Hudi consumes too much space in a temp folder while upsert URL: https://github.com/apache/incubator-hudi/issues/1443 This is an automated message from the Apache Git Service.

[GitHub] [incubator-hudi] tverdokhlebd commented on issue #1443: [SUPPORT] Spark-Hudi consumes too much space in a temp folder while upsert

2020-03-25 Thread GitBox
tverdokhlebd commented on issue #1443: [SUPPORT] Spark-Hudi consumes too much space in a temp folder while upsert URL: https://github.com/apache/incubator-hudi/issues/1443#issuecomment-603846771 @lamber-ken , thanks, the problem is solved.

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1444: [MINOR] Update web site for 0.5.2 doc

2020-03-25 Thread GitBox
leesf commented on a change in pull request #1444: [MINOR] Update web site for 0.5.2 doc URL: https://github.com/apache/incubator-hudi/pull/1444#discussion_r397838610 ## File path: content/sitemap.xml ## @@ -265,6 +265,138 @@ 2019-12-30T14:59:57-05:00

[jira] [Updated] (HUDI-733) presto query data error

2020-03-25 Thread jing (Jira)
[ https://issues.apache.org/jira/browse/HUDI-733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jing updated HUDI-733: -- Description: We found a data sequence issue in Hudi when we use API to import data(use spark.read.json("filename") read

[GitHub] [incubator-hudi] yanghua opened a new pull request #1444: [MINOR] Update web site for 0.5.2 doc

2020-03-25 Thread GitBox
yanghua opened a new pull request #1444: [MINOR] Update web site for 0.5.2 doc URL: https://github.com/apache/incubator-hudi/pull/1444 ## What is the purpose of the pull request *This pull request updates web site for 0.5.2 doc* ## Brief change log - *Update

[jira] [Updated] (HUDI-615) Add Test cases for StringUtils.

2020-03-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-615: -- Fix Version/s: (was: 0.5.2) 0.6.0 > Add Test cases for StringUtils. >

[jira] [Updated] (HUDI-590) Cut a new Doc version 0.5.1 explicitly

2020-03-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-590: -- Fix Version/s: (was: 0.5.2) 0.6.0 > Cut a new Doc version 0.5.1 explicitly >

[jira] [Updated] (HUDI-624) Split some of the code from PR for HUDI-479

2020-03-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-624: -- Fix Version/s: (was: 0.5.2) 0.6.0 > Split some of the code from PR for HUDI-479 >

[jira] [Updated] (HUDI-114) Allow for clients to overwrite the payload implementation in hoodie.properties

2020-03-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-114: -- Fix Version/s: (was: 0.5.2) 0.6.0 > Allow for clients to overwrite the payload

[jira] [Updated] (HUDI-571) Modify Hudi CLI to show archived commits

2020-03-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-571: -- Fix Version/s: (was: 0.5.2) 0.6.0 > Modify Hudi CLI to show archived commits >

[jira] [Closed] (HUDI-597) Enable incremental pulling from defined partitions

2020-03-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-597. - > Enable incremental pulling from defined partitions > -- > >

[jira] [Closed] (HUDI-554) Restructure code/packages to move more code back into hudi-writer-common

2020-03-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-554. - > Restructure code/packages to move more code back into hudi-writer-common >

[jira] [Closed] (HUDI-570) Improve unit test coverage FSUtils.java

2020-03-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-570. - > Improve unit test coverage FSUtils.java > --- > > Key: HUDI-570

[jira] [Closed] (HUDI-617) Add support for data types convertible to String in TimestampBasedKeyGenerator

2020-03-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-617. - > Add support for data types convertible to String in TimestampBasedKeyGenerator >

[jira] [Closed] (HUDI-585) Optimize the steps of building with scala-2.12

2020-03-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-585. - > Optimize the steps of building with scala-2.12 > --- > >

[jira] [Closed] (HUDI-587) Jacoco coverage report is not generated

2020-03-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-587. - > Jacoco coverage report is not generated > --- > > Key: HUDI-587

[jira] [Closed] (HUDI-604) Update docker page

2020-03-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-604. - > Update docker page > -- > > Key: HUDI-604 > URL:

[jira] [Closed] (HUDI-297) [Presto] Reuse table metadata listing and reduce namenode RPCs for Presto RO View queries

2020-03-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-297. - > [Presto] Reuse table metadata listing and reduce namenode RPCs for Presto RO > View queries >

[jira] [Closed] (HUDI-499) Allow partition path to be updated with GLOBAL_BLOOM index

2020-03-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-499. - > Allow partition path to be updated with GLOBAL_BLOOM index >

[jira] [Closed] (HUDI-596) KafkaConsumer need to be closed

2020-03-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-596. - > KafkaConsumer need to be closed > --- > > Key: HUDI-596 >

[jira] [Closed] (HUDI-647) Change community.html page with new PPMC/committers

2020-03-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-647. - > Change community.html page with new PPMC/committers > --- > >

[jira] [Closed] (HUDI-574) CLI counts small file inserts as updates

2020-03-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-574. - > CLI counts small file inserts as updates > > > Key:

[jira] [Closed] (HUDI-514) A schema provider to get metadata through Jdbc

2020-03-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-514. - > A schema provider to get metadata through Jdbc > -- > >

[jira] [Closed] (HUDI-582) NOTICE year is incorrect

2020-03-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-582. - > NOTICE year is incorrect > > > Key: HUDI-582 > URL:

[incubator-hudi] branch master updated: [HUDI-711] Refactor exporter main logic (#1436)

2020-03-25 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new bc82e2b [HUDI-711] Refactor exporter

[GitHub] [incubator-hudi] leesf merged pull request #1436: [HUDI-711] Refactor exporter main logic

2020-03-25 Thread GitBox
leesf merged pull request #1436: [HUDI-711] Refactor exporter main logic URL: https://github.com/apache/incubator-hudi/pull/1436 This is an automated message from the Apache Git Service. To respond to the message, please log

svn commit: r38618 - in /release/incubator/hudi: 0.5.2-incubating/ hudi-0.5.2-incubating/

2020-03-25 Thread vinoyang
Author: vinoyang Date: Wed Mar 25 09:39:42 2020 New Revision: 38618 Log: rename hudi-0.5.2-incubating to 0.5.2-incubating Added: release/incubator/hudi/0.5.2-incubating/ - copied from r38617, release/incubator/hudi/hudi-0.5.2-incubating/ Removed:

[jira] [Resolved] (HUDI-734) Fix error: cannot create directory ‘test-content’: File exists

2020-03-25 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken resolved HUDI-734. - Resolution: Fixed > Fix error: cannot create directory ‘test-content’: File exists >

  1   2   >