[GitHub] [incubator-hudi] zhaomin1423 commented on issue #1431: [HUDI-65]commitTime rename to instantTime

2020-03-20 Thread GitBox
zhaomin1423 commented on issue #1431: [HUDI-65]commitTime rename to instantTime URL: https://github.com/apache/incubator-hudi/pull/1431#issuecomment-601999146 I have modified all the above mentioned. This is an automated

[GitHub] [incubator-hudi] zhaomin1423 commented on a change in pull request #1431: [HUDI-65]commitTime rename to instantTime

2020-03-20 Thread GitBox
zhaomin1423 commented on a change in pull request #1431: [HUDI-65]commitTime rename to instantTime URL: https://github.com/apache/incubator-hudi/pull/1431#discussion_r395964258 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/commands/SavepointsCommand.java ## @@

[GitHub] [incubator-hudi] leesf commented on issue #1430: [hotfix] Improve code quality of HoodieAvroWriteSupport

2020-03-20 Thread GitBox
leesf commented on issue #1430: [hotfix] Improve code quality of HoodieAvroWriteSupport URL: https://github.com/apache/incubator-hudi/pull/1430#issuecomment-601998600 Warm welcome for your contributing @TisonKun . FYI: http://hudi.apache.org/contributing.html#contributing-code

[jira] [Commented] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

2020-03-20 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063775#comment-17063775 ] lamber-ken commented on HUDI-716: - The life cycle of *.clean files: (base on hudi-0.5.0) 

[jira] [Updated] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

2020-03-20 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-716: Attachment: image-2020-03-21-13-37-17-039.png > Exception: Not an Avro data file when running

[GitHub] [incubator-hudi] TisonKun closed pull request #1430: [hotfix] Improve code quality of HoodieAvroWriteSupport

2020-03-20 Thread GitBox
TisonKun closed pull request #1430: [hotfix] Improve code quality of HoodieAvroWriteSupport URL: https://github.com/apache/incubator-hudi/pull/1430 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-hudi] TisonKun commented on issue #1430: [hotfix] Improve code quality of HoodieAvroWriteSupport

2020-03-20 Thread GitBox
TisonKun commented on issue #1430: [hotfix] Improve code quality of HoodieAvroWriteSupport URL: https://github.com/apache/incubator-hudi/pull/1430#issuecomment-601997962 @yanghua it seems travis under maintenance so that offline and cannot give a result. @vinothchandar Thanks for

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1431: [HUDI-65]commitTime rename to instantTime

2020-03-20 Thread GitBox
vinothchandar commented on a change in pull request #1431: [HUDI-65]commitTime rename to instantTime URL: https://github.com/apache/incubator-hudi/pull/1431#discussion_r395962069 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/commands/SavepointsCommand.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1431: [HUDI-65]commitTime rename to instantTime

2020-03-20 Thread GitBox
vinothchandar commented on a change in pull request #1431: [HUDI-65]commitTime rename to instantTime URL: https://github.com/apache/incubator-hudi/pull/1431#discussion_r395962699 ## File path: hudi-client/src/test/java/org/apache/hudi/common/HoodieTestDataGenerator.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1431: [HUDI-65]commitTime rename to instantTime

2020-03-20 Thread GitBox
vinothchandar commented on a change in pull request #1431: [HUDI-65]commitTime rename to instantTime URL: https://github.com/apache/incubator-hudi/pull/1431#discussion_r395962585 ## File path: hudi-client/src/test/java/org/apache/hudi/common/HoodieTestDataGenerator.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1431: [HUDI-65]commitTime rename to instantTime

2020-03-20 Thread GitBox
vinothchandar commented on a change in pull request #1431: [HUDI-65]commitTime rename to instantTime URL: https://github.com/apache/incubator-hudi/pull/1431#discussion_r395962682 ## File path: hudi-client/src/test/java/org/apache/hudi/common/HoodieTestDataGenerator.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1431: [HUDI-65]commitTime rename to instantTime

2020-03-20 Thread GitBox
vinothchandar commented on a change in pull request #1431: [HUDI-65]commitTime rename to instantTime URL: https://github.com/apache/incubator-hudi/pull/1431#discussion_r395962757 ## File path: hudi-common/src/main/java/org/apache/hudi/common/model/HoodieFileGroup.java ##

[GitHub] [incubator-hudi] Rajpratik71 commented on issue #1400: optimization debian package manager tweaks

2020-03-20 Thread GitBox
Rajpratik71 commented on issue #1400: optimization debian package manager tweaks URL: https://github.com/apache/incubator-hudi/pull/1400#issuecomment-601996115 > @Rajpratik71 : Just pinging to see if you are planning to work on this PR. will do , currently occupied.

[GitHub] [incubator-hudi] vinothchandar commented on issue #1430: [hotfix] Improve code quality of HoodieAvroWriteSupport

2020-03-20 Thread GitBox
vinothchandar commented on issue #1430: [hotfix] Improve code quality of HoodieAvroWriteSupport URL: https://github.com/apache/incubator-hudi/pull/1430#issuecomment-601993412 @TisonKun can you please follow the contribution guide where we suggest filing a JIRA and getting this signed off

[GitHub] [incubator-hudi] yanghua commented on issue #1430: [hotfix] Improve code quality of HoodieAvroWriteSupport

2020-03-20 Thread GitBox
yanghua commented on issue #1430: [hotfix] Improve code quality of HoodieAvroWriteSupport URL: https://github.com/apache/incubator-hudi/pull/1430#issuecomment-601993124 Thanks for your contribution @TisonKun . The Travis is red, can you please have a look?

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #223

2020-03-20 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.42 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/conf: logging settings.xml toolchains.xml

[jira] [Updated] (HUDI-720) NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles

2020-03-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-720: -- Fix Version/s: 0.5.2 > NOTICE file needs to add more content based on the NOTICE files of the ASF > projects

[jira] [Updated] (HUDI-720) NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles

2020-03-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-720: -- Status: Open (was: New) > NOTICE file needs to add more content based on the NOTICE files of the ASF >

[jira] [Closed] (HUDI-720) NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles

2020-03-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-720. - Resolution: Fixed Fixed via master branch: c5030f77a0e63f609ed2c674bea00201b97d8bb6 > NOTICE file needs to add

[GitHub] [incubator-hudi] yanghua merged pull request #1417: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles

2020-03-20 Thread GitBox
yanghua merged pull request #1417: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles URL: https://github.com/apache/incubator-hudi/pull/1417 This is an

[incubator-hudi] branch master updated: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles (#1417)

2020-03-20 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new c5030f7 [HUDI-720] NOTICE file needs

[GitHub] [incubator-hudi] yanghua commented on issue #1417: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles

2020-03-20 Thread GitBox
yanghua commented on issue #1417: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles URL: https://github.com/apache/incubator-hudi/pull/1417#issuecomment-601983292 Thanks everyone, merging this PR!

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1431: [HUDI-65]commitTime rename to instantTime

2020-03-20 Thread GitBox
codecov-io edited a comment on issue #1431: [HUDI-65]commitTime rename to instantTime URL: https://github.com/apache/incubator-hudi/pull/1431#issuecomment-601980537 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1431?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] codecov-io commented on issue #1431: [HUDI-65]commitTime rename to instantTime

2020-03-20 Thread GitBox
codecov-io commented on issue #1431: [HUDI-65]commitTime rename to instantTime URL: https://github.com/apache/incubator-hudi/pull/1431#issuecomment-601980537 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1431?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] zhaomin1423 opened a new pull request #1431: [HUDI-65]commitTime rename to instantTime

2020-03-20 Thread GitBox
zhaomin1423 opened a new pull request #1431: [HUDI-65]commitTime rename to instantTime URL: https://github.com/apache/incubator-hudi/pull/1431 What is the purpose of the pull request Cleanup nomenclature around commitTime and instantTime Brief change log commtTime rename to

[GitHub] [incubator-hudi] TisonKun opened a new pull request #1430: [hotfix] Improve code quality of HoodieAvroWriteSupport

2020-03-20 Thread GitBox
TisonKun opened a new pull request #1430: [hotfix] Improve code quality of HoodieAvroWriteSupport URL: https://github.com/apache/incubator-hudi/pull/1430 ## Brief change log - Reduce raw use of parameterized class(AvroWriteSupport) - Replace deprecated method call with successor

[jira] [Commented] (HUDI-724) Parallelize GetSmallFiles For Partitions

2020-03-20 Thread Feichi Feng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063697#comment-17063697 ] Feichi Feng commented on HUDI-724: -- Hi [~vbalaji], partition touched depends on our data, the screenshot I

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1421: [HUDI-724] Parallelize getSmallFiles for partitions

2020-03-20 Thread GitBox
codecov-io edited a comment on issue #1421: [HUDI-724] Parallelize getSmallFiles for partitions URL: https://github.com/apache/incubator-hudi/pull/1421#issuecomment-601964769 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1421?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] codecov-io commented on issue #1421: [HUDI-724] Parallelize getSmallFiles for partitions

2020-03-20 Thread GitBox
codecov-io commented on issue #1421: [HUDI-724] Parallelize getSmallFiles for partitions URL: https://github.com/apache/incubator-hudi/pull/1421#issuecomment-601964769 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1421?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] ffcchi commented on issue #1421: [HUDI-724] Parallelize getSmallFiles for partitions

2020-03-20 Thread GitBox
ffcchi commented on issue #1421: [HUDI-724] Parallelize getSmallFiles for partitions URL: https://github.com/apache/incubator-hudi/pull/1421#issuecomment-601958868 * removed more unnecessary JavaSparkContext passing. * rebased against master

[GitHub] [incubator-hudi] bwu2 commented on issue #1128: [HUDI-453] Fix throw failed to archive commits error when writing data to MOR/COW table

2020-03-20 Thread GitBox
bwu2 commented on issue #1128: [HUDI-453] Fix throw failed to archive commits error when writing data to MOR/COW table URL: https://github.com/apache/incubator-hudi/pull/1128#issuecomment-601916430 That is because i copied and pasted the folder to a new location for troubleshooting. The

[jira] [Updated] (HUDI-728) Support for complex record keys with TimestampBasedKeyGenerator

2020-03-20 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma updated HUDI-728: -- Status: Open (was: New) > Support for complex record keys with TimestampBasedKeyGenerator >

[GitHub] [incubator-hudi] ffcchi opened a new pull request #1421: [HUDI-724] Parallelize getSmallFiles for partitions

2020-03-20 Thread GitBox
ffcchi opened a new pull request #1421: [HUDI-724] Parallelize getSmallFiles for partitions URL: https://github.com/apache/incubator-hudi/pull/1421 ## What is the purpose of the pull request *parallelizing the operation of getting small files for partitions when constructing

[GitHub] [incubator-hudi] ffcchi closed pull request #1421: [HUDI-724] Parallelize getSmallFiles for partitions

2020-03-20 Thread GitBox
ffcchi closed pull request #1421: [HUDI-724] Parallelize getSmallFiles for partitions URL: https://github.com/apache/incubator-hudi/pull/1421 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-hudi] lamber-ken commented on issue #1128: [HUDI-453] Fix throw failed to archive commits error when writing data to MOR/COW table

2020-03-20 Thread GitBox
lamber-ken commented on issue #1128: [HUDI-453] Fix throw failed to archive commits error when writing data to MOR/COW table URL: https://github.com/apache/incubator-hudi/pull/1128#issuecomment-601864480 I can not understand these create time similar?

[jira] [Comment Edited] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

2020-03-20 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063573#comment-17063573 ] lamber-ken edited comment on HUDI-716 at 3/20/20, 6:51 PM: --- Hi [~vbalaji], I

[jira] [Commented] (HUDI-724) Parallelize GetSmallFiles For Partitions

2020-03-20 Thread Balaji Varadarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063574#comment-17063574 ] Balaji Varadarajan commented on HUDI-724: - Thanks [~Feichi Feng] for the information. This makes

[jira] [Commented] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

2020-03-20 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063573#comment-17063573 ] lamber-ken commented on HUDI-716: - Hi [~vbalaji], I agree with your point. from code we can see that create

[jira] [Updated] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

2020-03-20 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-716: Attachment: image-2020-03-21-02-45-25-099.png > Exception: Not an Avro data file when running

[GitHub] [incubator-hudi] ffcchi commented on issue #1421: [HUDI-724] Parallelize getSmallFiles for partitions

2020-03-20 Thread GitBox
ffcchi commented on issue #1421: [HUDI-724] Parallelize getSmallFiles for partitions URL: https://github.com/apache/incubator-hudi/pull/1421#issuecomment-601843072 integration testing failed after the update. looking. This

[GitHub] [incubator-hudi] ffcchi commented on issue #1421: [HUDI-724] Parallelize getSmallFiles for partitions

2020-03-20 Thread GitBox
ffcchi commented on issue #1421: [HUDI-724] Parallelize getSmallFiles for partitions URL: https://github.com/apache/incubator-hudi/pull/1421#issuecomment-601835210 PR updated based on comments. This is an automated message

[GitHub] [incubator-hudi] zhaomin1423 closed pull request #1429: [HUDI-65]commitTime rename to instantTime

2020-03-20 Thread GitBox
zhaomin1423 closed pull request #1429: [HUDI-65]commitTime rename to instantTime URL: https://github.com/apache/incubator-hudi/pull/1429 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [incubator-hudi] zhedoubushishi commented on a change in pull request #1406: [HUDI-713] Fix conversion of Spark array of struct type to Avro schema

2020-03-20 Thread GitBox
zhedoubushishi commented on a change in pull request #1406: [HUDI-713] Fix conversion of Spark array of struct type to Avro schema URL: https://github.com/apache/incubator-hudi/pull/1406#discussion_r395789120 ## File path:

[jira] [Commented] (HUDI-724) Parallelize GetSmallFiles For Partitions

2020-03-20 Thread Feichi Feng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063537#comment-17063537 ] Feichi Feng commented on HUDI-724: -- Hi all, regarding to the question why timeline server is not helping:

[GitHub] [incubator-hudi] zhaomin1423 closed pull request #1428: [HUDI-65]commitTime rename to instantTime

2020-03-20 Thread GitBox
zhaomin1423 closed pull request #1428: [HUDI-65]commitTime rename to instantTime URL: https://github.com/apache/incubator-hudi/pull/1428 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [incubator-hudi] zhaomin1423 commented on issue #1428: [HUDI-65]commitTime rename to instantTime

2020-03-20 Thread GitBox
zhaomin1423 commented on issue #1428: [HUDI-65]commitTime rename to instantTime URL: https://github.com/apache/incubator-hudi/pull/1428#issuecomment-601811435 sorry. there are a problem. This is an automated message from the

[GitHub] [incubator-hudi] zhaomin1423 opened a new pull request #1429: [HUDI-65]commitTime rename to instantTime

2020-03-20 Thread GitBox
zhaomin1423 opened a new pull request #1429: [HUDI-65]commitTime rename to instantTime URL: https://github.com/apache/incubator-hudi/pull/1429 What is the purpose of the pull request Cleanup nomenclature around commitTime and instantTime Brief change log commtTime rename to

[jira] [Commented] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

2020-03-20 Thread Balaji Varadarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063493#comment-17063493 ] Balaji Varadarajan commented on HUDI-716: - [~lamber-ken]: My understanding is that this is due to

[jira] [Commented] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

2020-03-20 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063476#comment-17063476 ] lamber-ken commented on HUDI-716: - Also, we need to figure it out what jobs created these zero bytes files

[jira] [Commented] (HUDI-723) SqlTransformer's schema sometimes is not registered.

2020-03-20 Thread Alexander Filipchik (Jira)
[ https://issues.apache.org/jira/browse/HUDI-723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063474#comment-17063474 ] Alexander Filipchik commented on HUDI-723: -- {code:java} at

[GitHub] [incubator-hudi] bvaradar commented on issue #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

2020-03-20 Thread GitBox
bvaradar commented on issue #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment URL: https://github.com/apache/incubator-hudi/pull/1150#issuecomment-601773835 @pratyakshsharma : Per your previous comment, was waiting for you to give a

[jira] [Commented] (HUDI-721) AvroConversionUtils is broken for complex types in 0.6

2020-03-20 Thread Alexander Filipchik (Jira)
[ https://issues.apache.org/jira/browse/HUDI-721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063471#comment-17063471 ] Alexander Filipchik commented on HUDI-721: -- Serializations works on staging with the fixed. But

[jira] [Commented] (HUDI-724) Parallelize GetSmallFiles For Partitions

2020-03-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063470#comment-17063470 ] Vinoth Chandar commented on HUDI-724: - +1 Given we have a reproducible setup, let's get to the bottom

[incubator-hudi] branch master updated (eeab532 -> 83fb965)

2020-03-20 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from eeab532 [HUDI-725] Remove init log in the constructor of DeltaSync (#1425) add 83fb965 [HUDI-650]

[GitHub] [incubator-hudi] bvaradar merged pull request #1368: [HUDI-650] Modify handleUpdate path to validate partitionPath

2020-03-20 Thread GitBox
bvaradar merged pull request #1368: [HUDI-650] Modify handleUpdate path to validate partitionPath URL: https://github.com/apache/incubator-hudi/pull/1368 This is an automated message from the Apache Git Service. To respond

[jira] [Commented] (HUDI-724) Parallelize GetSmallFiles For Partitions

2020-03-20 Thread Balaji Varadarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063454#comment-17063454 ] Balaji Varadarajan commented on HUDI-724: - [~uditme] : The PR also looks good to me too. Regarding

[jira] [Resolved] (HUDI-400) Add more checks to TestCompactionUtils#testUpgradeDowngrade

2020-03-20 Thread jerry (Jira)
[ https://issues.apache.org/jira/browse/HUDI-400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jerry resolved HUDI-400. Resolution: Fixed > Add more checks to TestCompactionUtils#testUpgradeDowngrade >

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1424: [HUDI-697]Add unit test for ArchivedCommitsCommand

2020-03-20 Thread GitBox
yanghua commented on a change in pull request #1424: [HUDI-697]Add unit test for ArchivedCommitsCommand URL: https://github.com/apache/incubator-hudi/pull/1424#discussion_r395688239 ## File path: hudi-cli/src/test/java/org/apache/hudi/cli/common/HoodieTestCommitOperate.java

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1424: [HUDI-697]Add unit test for ArchivedCommitsCommand

2020-03-20 Thread GitBox
yanghua commented on a change in pull request #1424: [HUDI-697]Add unit test for ArchivedCommitsCommand URL: https://github.com/apache/incubator-hudi/pull/1424#discussion_r395699029 ## File path: hudi-cli/src/test/java/org/apache/hudi/cli/common/HoodieTestCommandDataGenerator.java

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1424: [HUDI-697]Add unit test for ArchivedCommitsCommand

2020-03-20 Thread GitBox
yanghua commented on a change in pull request #1424: [HUDI-697]Add unit test for ArchivedCommitsCommand URL: https://github.com/apache/incubator-hudi/pull/1424#discussion_r395692451 ## File path: hudi-cli/src/test/java/org/apache/hudi/cli/common/HoodieTestCommitOperate.java

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1424: [HUDI-697]Add unit test for ArchivedCommitsCommand

2020-03-20 Thread GitBox
yanghua commented on a change in pull request #1424: [HUDI-697]Add unit test for ArchivedCommitsCommand URL: https://github.com/apache/incubator-hudi/pull/1424#discussion_r395700713 ## File path: hudi-cli/src/test/java/org/apache/hudi/cli/common/HoodieTestCommandDataGenerator.java

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1424: [HUDI-697]Add unit test for ArchivedCommitsCommand

2020-03-20 Thread GitBox
yanghua commented on a change in pull request #1424: [HUDI-697]Add unit test for ArchivedCommitsCommand URL: https://github.com/apache/incubator-hudi/pull/1424#discussion_r395704673 ## File path: hudi-cli/src/test/java/org/apache/hudi/cli/commands/TestArchivedCommitsCommand.java

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1424: [HUDI-697]Add unit test for ArchivedCommitsCommand

2020-03-20 Thread GitBox
yanghua commented on a change in pull request #1424: [HUDI-697]Add unit test for ArchivedCommitsCommand URL: https://github.com/apache/incubator-hudi/pull/1424#discussion_r395692986 ## File path: hudi-cli/src/test/java/org/apache/hudi/cli/common/HoodieTestCommitOperate.java

[jira] [Updated] (HUDI-65) Cleanup nomenclature around commitTime and instantTime #256

2020-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-65?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-65: --- Labels: pull-request-available (was: ) > Cleanup nomenclature around commitTime and instantTime #256 >

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1421: [HUDI-724] Parallelize getSmallFiles for partitions

2020-03-20 Thread GitBox
bvaradar commented on a change in pull request #1421: [HUDI-724] Parallelize getSmallFiles for partitions URL: https://github.com/apache/incubator-hudi/pull/1421#discussion_r395694178 ## File path: hudi-client/src/main/java/org/apache/hudi/client/HoodieWriteClient.java ##

[GitHub] [incubator-hudi] zhaomin1423 opened a new pull request #1428: [HUDI-65]commitTime rename to instantTime

2020-03-20 Thread GitBox
zhaomin1423 opened a new pull request #1428: [HUDI-65]commitTime rename to instantTime URL: https://github.com/apache/incubator-hudi/pull/1428 ## What is the purpose of the pull request Cleanup nomenclature around commitTime and instantTime ## Brief change log

[GitHub] [incubator-hudi] ffcchi commented on a change in pull request #1421: [HUDI-724] Parallelize getSmallFiles for partitions

2020-03-20 Thread GitBox
ffcchi commented on a change in pull request #1421: [HUDI-724] Parallelize getSmallFiles for partitions URL: https://github.com/apache/incubator-hudi/pull/1421#discussion_r395664211 ## File path: hudi-client/src/main/java/org/apache/hudi/client/HoodieWriteClient.java ##

[GitHub] [incubator-hudi] pratyakshsharma commented on issue #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

2020-03-20 Thread GitBox
pratyakshsharma commented on issue #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment URL: https://github.com/apache/incubator-hudi/pull/1150#issuecomment-601717380 @bvaradar got chance to take a pass?

[jira] [Created] (HUDI-728) Support for complex record keys with TimestampBasedKeyGenerator

2020-03-20 Thread Pratyaksh Sharma (Jira)
Pratyaksh Sharma created HUDI-728: - Summary: Support for complex record keys with TimestampBasedKeyGenerator Key: HUDI-728 URL: https://issues.apache.org/jira/browse/HUDI-728 Project: Apache Hudi

[jira] [Assigned] (HUDI-65) Cleanup nomenclature around commitTime and instantTime #256

2020-03-20 Thread jerry (Jira)
[ https://issues.apache.org/jira/browse/HUDI-65?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jerry reassigned HUDI-65: - Assignee: jerry > Cleanup nomenclature around commitTime and instantTime #256 >

[jira] [Updated] (HUDI-65) Cleanup nomenclature around commitTime and instantTime #256

2020-03-20 Thread jerry (Jira)
[ https://issues.apache.org/jira/browse/HUDI-65?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jerry updated HUDI-65: -- Status: In Progress (was: Open) > Cleanup nomenclature around commitTime and instantTime #256 >

[jira] [Updated] (HUDI-727) Copy default values of fields if not present when rewriting incoming record with new schema

2020-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-727: Labels: pull-request-available (was: ) > Copy default values of fields if not present when

[GitHub] [incubator-hudi] nsivabalan commented on issue #1176: [HUDI-430] Adding InlineFileSystem to support embedding any file format as an InlineFile

2020-03-20 Thread GitBox
nsivabalan commented on issue #1176: [HUDI-430] Adding InlineFileSystem to support embedding any file format as an InlineFile URL: https://github.com/apache/incubator-hudi/pull/1176#issuecomment-601649921 @vinothchandar : have addressed your comments for the most part. I will wait for 2

[GitHub] [incubator-hudi] umehrot2 commented on a change in pull request #1421: [HUDI-724] Parallelize getSmallFiles for partitions

2020-03-20 Thread GitBox
umehrot2 commented on a change in pull request #1421: [HUDI-724] Parallelize getSmallFiles for partitions URL: https://github.com/apache/incubator-hudi/pull/1421#discussion_r395545539 ## File path: hudi-client/src/main/java/org/apache/hudi/client/HoodieWriteClient.java ##

[GitHub] [incubator-hudi] umehrot2 commented on a change in pull request #1421: [HUDI-724] Parallelize getSmallFiles for partitions

2020-03-20 Thread GitBox
umehrot2 commented on a change in pull request #1421: [HUDI-724] Parallelize getSmallFiles for partitions URL: https://github.com/apache/incubator-hudi/pull/1421#discussion_r395553703 ## File path: hudi-client/src/main/java/org/apache/hudi/table/HoodieCopyOnWriteTable.java

[GitHub] [incubator-hudi] umehrot2 commented on a change in pull request #1421: [HUDI-724] Parallelize getSmallFiles for partitions

2020-03-20 Thread GitBox
umehrot2 commented on a change in pull request #1421: [HUDI-724] Parallelize getSmallFiles for partitions URL: https://github.com/apache/incubator-hudi/pull/1421#discussion_r395562779 ## File path: hudi-client/src/main/java/org/apache/hudi/table/HoodieCopyOnWriteTable.java

[jira] [Commented] (HUDI-723) SqlTransformer's schema sometimes is not registered.

2020-03-20 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063261#comment-17063261 ] Pratyaksh Sharma commented on HUDI-723: --- Can you please share the stacktrace?  > SqlTransformer's

[jira] [Updated] (HUDI-727) Copy default values of fields if not present when rewriting incoming record with new schema

2020-03-20 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma updated HUDI-727: -- Status: In Progress (was: Open) > Copy default values of fields if not present when rewriting

[jira] [Closed] (HUDI-725) Remove or rewrite init log in the constructor of DeltaSync

2020-03-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-725. - Fix Version/s: 0.6.0 Resolution: Done Done via master branch: eeab532d794426115f839e6ee11a9fc1314698fe >

[incubator-hudi] branch master updated: [HUDI-725] Remove init log in the constructor of DeltaSync (#1425)

2020-03-20 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new eeab532 [HUDI-725] Remove init log

[GitHub] [incubator-hudi] yanghua merged pull request #1425: [HUDI-725] Remove init log in the constructor of DeltaSync

2020-03-20 Thread GitBox
yanghua merged pull request #1425: [HUDI-725] Remove init log in the constructor of DeltaSync URL: https://github.com/apache/incubator-hudi/pull/1425 This is an automated message from the Apache Git Service. To respond to

[jira] [Closed] (HUDI-726) Delete unused method in HoodieDeltaStreamer

2020-03-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-726. - Fix Version/s: 0.6.0 Resolution: Done Done via master branch: 21c45e1051b593f0e1023a84cb96658320046dae >

[incubator-hudi] branch master updated: [HUDI-726]Delete unused method in HoodieDeltaStreamer (#1426)

2020-03-20 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 21c45e1 [HUDI-726]Delete unused

[GitHub] [incubator-hudi] yanghua merged pull request #1426: [HUDI-726]Delete unused method in HoodieDeltaStreamer

2020-03-20 Thread GitBox
yanghua merged pull request #1426: [HUDI-726]Delete unused method in HoodieDeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1426 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-hudi] hddong edited a comment on issue #1420: Broken Maven dependencies.

2020-03-20 Thread GitBox
hddong edited a comment on issue #1420: Broken Maven dependencies. URL: https://github.com/apache/incubator-hudi/issues/1420#issuecomment-601610004 @deabreu this is a dev version, you can use `mvn clean package -DskipTests -DskipITs -Pspark-shade-unbundle-avro` in root of hudi project to

[GitHub] [incubator-hudi] hddong commented on issue #1420: Broken Maven dependencies.

2020-03-20 Thread GitBox
hddong commented on issue #1420: Broken Maven dependencies. URL: https://github.com/apache/incubator-hudi/issues/1420#issuecomment-601610004 @deabreu this is a dev branch, you can use `mvn clean package -DskipTests -DskipITs -Pspark-shade-unbundle-avro` in root of hudi project to generate

[GitHub] [incubator-hudi] hddong commented on issue #1424: [HUDI-697]Add unit test for ArchivedCommitsCommand

2020-03-20 Thread GitBox
hddong commented on issue #1424: [HUDI-697]Add unit test for ArchivedCommitsCommand URL: https://github.com/apache/incubator-hudi/pull/1424#issuecomment-601607599 @yanghua @vinothchandar please have a review when free. This

[jira] [Commented] (HUDI-723) SqlTransformer's schema sometimes is not registered.

2020-03-20 Thread Alexander Filipchik (Jira)
[ https://issues.apache.org/jira/browse/HUDI-723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063214#comment-17063214 ] Alexander Filipchik commented on HUDI-723: -- current implementation just doesn't work for this

[jira] [Comment Edited] (HUDI-721) AvroConversionUtils is broken for complex types in 0.6

2020-03-20 Thread Alexander Filipchik (Jira)
[ https://issues.apache.org/jira/browse/HUDI-721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063208#comment-17063208 ] Alexander Filipchik edited comment on HUDI-721 at 3/20/20, 9:11 AM:

[jira] [Commented] (HUDI-721) AvroConversionUtils is broken for complex types in 0.6

2020-03-20 Thread Alexander Filipchik (Jira)
[ https://issues.apache.org/jira/browse/HUDI-721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063208#comment-17063208 ] Alexander Filipchik commented on HUDI-721: -- looks like it fixed the issue. > AvroConversionUtils

[jira] [Created] (HUDI-727) Copy default values of fields if not present when rewriting incoming record with new schema

2020-03-20 Thread Pratyaksh Sharma (Jira)
Pratyaksh Sharma created HUDI-727: - Summary: Copy default values of fields if not present when rewriting incoming record with new schema Key: HUDI-727 URL: https://issues.apache.org/jira/browse/HUDI-727

[jira] [Updated] (HUDI-727) Copy default values of fields if not present when rewriting incoming record with new schema

2020-03-20 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma updated HUDI-727: -- Status: Open (was: New) > Copy default values of fields if not present when rewriting incoming

[GitHub] [incubator-hudi] wangxianghu commented on issue #1425: [HUDI-725] Remove init log in the constructor of DeltaSync

2020-03-20 Thread GitBox
wangxianghu commented on issue #1425: [HUDI-725] Remove init log in the constructor of DeltaSync URL: https://github.com/apache/incubator-hudi/pull/1425#issuecomment-601590371 @yanghua would you please take a look This is

[GitHub] [incubator-hudi] wangxianghu commented on issue #1426: [HUDI-726]Delete unused method in HoodieDeltaStreamer

2020-03-20 Thread GitBox
wangxianghu commented on issue #1426: [HUDI-726]Delete unused method in HoodieDeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1426#issuecomment-601589598 @yanghua would you please take a look This is an

[jira] [Updated] (HUDI-726) Delete unused method in HoodieDeltaStreamer

2020-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-726: Labels: pull-request-available (was: ) > Delete unused method in HoodieDeltaStreamer >

[GitHub] [incubator-hudi] wangxianghu opened a new pull request #1426: [HUDI-726]Delete unused method in HoodieDeltaStreamer

2020-03-20 Thread GitBox
wangxianghu opened a new pull request #1426: [HUDI-726]Delete unused method in HoodieDeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1426 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html

[jira] [Updated] (HUDI-725) Remove or rewrite init log in the constructor of DeltaSync

2020-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-725: Labels: pull-request-available (was: ) > Remove or rewrite init log in the constructor of

[GitHub] [incubator-hudi] wangxianghu opened a new pull request #1425: [HUDI-725] Remove init log in the constructor of DeltaSync

2020-03-20 Thread GitBox
wangxianghu opened a new pull request #1425: [HUDI-725] Remove init log in the constructor of DeltaSync URL: https://github.com/apache/incubator-hudi/pull/1425 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review

[GitHub] [incubator-hudi] codecov-io commented on issue #1424: [HUDI-697]Add unit test for ArchivedCommitsCommand

2020-03-20 Thread GitBox
codecov-io commented on issue #1424: [HUDI-697]Add unit test for ArchivedCommitsCommand URL: https://github.com/apache/incubator-hudi/pull/1424#issuecomment-601586198 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1424?src=pr=h1) Report > Merging

[jira] [Commented] (HUDI-723) SqlTransformer's schema sometimes is not registered.

2020-03-20 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063166#comment-17063166 ] Pratyaksh Sharma commented on HUDI-723: --- Are you facing any specific error because of this? Otherwise

  1   2   >