[incubator-hudi] branch master updated: [HUDI-344] Add partitioner param to Exporter (#1405)

This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 779edc0 [HUDI-344] Add partitioner

[GitHub] [incubator-hudi] leesf merged pull request #1405: [HUDI-344] Add partitioner param to Exporter

leesf merged pull request #1405: [HUDI-344] Add partitioner param to Exporter URL: https://github.com/apache/incubator-hudi/pull/1405 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [incubator-hudi] leesf commented on issue #1106: [HUDI-209] Implement JMX metrics reporter

leesf commented on issue #1106: [HUDI-209] Implement JMX metrics reporter URL: https://github.com/apache/incubator-hudi/pull/1106#issuecomment-600569126 @XuQianJin-Stars Please rebase to the master and I think we would be home

[GitHub] [incubator-hudi] s-sanjay commented on a change in pull request #1350: [HUDI-629]: Replace Guava's Hashing with an equivalent in NumericUtils.java

s-sanjay commented on a change in pull request #1350: [HUDI-629]: Replace Guava's Hashing with an equivalent in NumericUtils.java URL: https://github.com/apache/incubator-hudi/pull/1350#discussion_r392642073 ## File path:

[GitHub] [incubator-hudi] yanghua commented on issue #1417: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles

yanghua commented on issue #1417: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles URL: https://github.com/apache/incubator-hudi/pull/1417#issuecomment-600659531 @shaofengshi Can you help to review this PR? thanks.

[GitHub] [incubator-hudi] s-sanjay commented on a change in pull request #1350: [HUDI-629]: Replace Guava's Hashing with an equivalent in NumericUtils.java

s-sanjay commented on a change in pull request #1350: [HUDI-629]: Replace Guava's Hashing with an equivalent in NumericUtils.java URL: https://github.com/apache/incubator-hudi/pull/1350#discussion_r394359235 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on issue #1417: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles

vinothchandar commented on issue #1417: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles URL: https://github.com/apache/incubator-hudi/pull/1417#issuecomment-600685735 are we just collecting the NOTICE files for all

[GitHub] [incubator-hudi] yanghua commented on issue #1417: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles

yanghua commented on issue #1417: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles URL: https://github.com/apache/incubator-hudi/pull/1417#issuecomment-600692484 > are we just collecting the NOTICE files for all dependencies?

[GitHub] [incubator-hudi] yanghua edited a comment on issue #1417: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles

yanghua edited a comment on issue #1417: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles URL: https://github.com/apache/incubator-hudi/pull/1417#issuecomment-600692484 > are we just collecting the NOTICE files for all

[jira] [Comment Edited] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061925#comment-17061925 ] lamber-ken edited comment on HUDI-716 at 3/18/20, 5:29 PM: --- I tried to reproduce

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1412: [HUDI-504] Restructuring and auto-generation of docs

vinothchandar commented on a change in pull request #1412: [HUDI-504] Restructuring and auto-generation of docs URL: https://github.com/apache/incubator-hudi/pull/1412#discussion_r394529953 ## File path: .travis.yml ## @@ -0,0 +1,40 @@ +language: ruby +rvm: + - 2.6.3 +

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1412: [HUDI-504] Restructuring and auto-generation of docs

vinothchandar commented on a change in pull request #1412: [HUDI-504] Restructuring and auto-generation of docs URL: https://github.com/apache/incubator-hudi/pull/1412#discussion_r394530282 ## File path: docs/_includes/nav_list ## @@ -18,20 +18,19 @@ {%

[jira] [Updated] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-716: Status: Open (was: New) > Exception: Not an Avro data file when running HoodieCleanClient.runClean >

[jira] [Comment Edited] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061925#comment-17061925 ] lamber-ken edited comment on HUDI-716 at 3/18/20, 5:21 PM: --- I tried to reproduce

[jira] [Commented] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061933#comment-17061933 ] Vinoth Chandar commented on HUDI-716: - I think it happens only when there is an inflight .clean file

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1106: [HUDI-209] Implement JMX metrics reporter

codecov-io edited a comment on issue #1106: [HUDI-209] Implement JMX metrics reporter URL: https://github.com/apache/incubator-hudi/pull/1106#issuecomment-593074963 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1106?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1106: [HUDI-209] Implement JMX metrics reporter

codecov-io edited a comment on issue #1106: [HUDI-209] Implement JMX metrics reporter URL: https://github.com/apache/incubator-hudi/pull/1106#issuecomment-593074963 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1106?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] vinothchandar commented on issue #1412: [HUDI-504] Restructuring and auto-generation of docs

vinothchandar commented on issue #1412: [HUDI-504] Restructuring and auto-generation of docs URL: https://github.com/apache/incubator-hudi/pull/1412#issuecomment-600770553 @lamber-ken neat. so it will build and not push, for PRs. Once landed, it will build again and republish?

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1412: [HUDI-504] Restructuring and auto-generation of docs

vinothchandar commented on a change in pull request #1412: [HUDI-504] Restructuring and auto-generation of docs URL: https://github.com/apache/incubator-hudi/pull/1412#discussion_r394553164 ## File path: .travis.yml ## @@ -0,0 +1,40 @@ +language: ruby +rvm: + - 2.6.3 +

[GitHub] [incubator-hudi] vinothchandar commented on issue #1417: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles

vinothchandar commented on issue #1417: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles URL: https://github.com/apache/incubator-hudi/pull/1417#issuecomment-600719966 Please see my response on the mailing list.. I think we

[jira] [Commented] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061925#comment-17061925 ] lamber-ken commented on HUDI-716: - I tried to reproduce it, but it works ok. *Step1: Use hudi 0.5.0

[jira] [Comment Edited] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061925#comment-17061925 ] lamber-ken edited comment on HUDI-716 at 3/18/20, 5:18 PM: --- I tried to reproduce

[jira] [Comment Edited] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061925#comment-17061925 ] lamber-ken edited comment on HUDI-716 at 3/18/20, 5:18 PM: --- I tried to reproduce

[GitHub] [incubator-hudi] lamber-ken commented on issue #1412: [HUDI-504] Restructuring and auto-generation of docs

lamber-ken commented on issue #1412: [HUDI-504] Restructuring and auto-generation of docs URL: https://github.com/apache/incubator-hudi/pull/1412#issuecomment-600773995 > @lamber-ken neat. so it will build and not push, for PRs. > > Once landed, it will build again and republish?

[GitHub] [incubator-hudi] lamber-ken commented on a change in pull request #1412: [HUDI-504] Restructuring and auto-generation of docs

lamber-ken commented on a change in pull request #1412: [HUDI-504] Restructuring and auto-generation of docs URL: https://github.com/apache/incubator-hudi/pull/1412#discussion_r394555849 ## File path: .travis.yml ## @@ -0,0 +1,40 @@ +language: ruby +rvm: + - 2.6.3 +

[jira] [Commented] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061888#comment-17061888 ] lamber-ken commented on HUDI-716: - [~vinoth] willing to take it. :)    Hi [~afilipchik], waiting for you,

[GitHub] [incubator-hudi] lamber-ken commented on a change in pull request #1412: [HUDI-504] Restructuring and auto-generation of docs

lamber-ken commented on a change in pull request #1412: [HUDI-504] Restructuring and auto-generation of docs URL: https://github.com/apache/incubator-hudi/pull/1412#discussion_r394536044 ## File path: docs/_includes/nav_list ## @@ -18,20 +18,19 @@ {% assign

[jira] [Commented] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061977#comment-17061977 ] Balaji Varadarajan commented on HUDI-716: - Spoke with Alex to debug this issue. It has to do with

[jira] [Resolved] (HUDI-344) Hudi Dataset Snapshot Exporter

[ https://issues.apache.org/jira/browse/HUDI-344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-344. - Resolution: Implemented The main features were implemented. Some future improvements or fix are linked in

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1414: [HUDI-437] Add user-defined index config

vinothchandar commented on a change in pull request #1414: [HUDI-437] Add user-defined index config URL: https://github.com/apache/incubator-hudi/pull/1414#discussion_r394524721 ## File path: docs/configurations.cn.md ## @@ -223,7 +223,11 @@ Following configs control

[GitHub] [incubator-hudi] lamber-ken commented on a change in pull request #1412: [HUDI-504] Restructuring and auto-generation of docs

lamber-ken commented on a change in pull request #1412: [HUDI-504] Restructuring and auto-generation of docs URL: https://github.com/apache/incubator-hudi/pull/1412#discussion_r394540086 ## File path: .travis.yml ## @@ -0,0 +1,40 @@ +language: ruby +rvm: + - 2.6.3 +

[GitHub] [incubator-hudi] vinothchandar commented on issue #1412: [HUDI-504] Restructuring and auto-generation of docs

vinothchandar commented on issue #1412: [HUDI-504] Restructuring and auto-generation of docs URL: https://github.com/apache/incubator-hudi/pull/1412#issuecomment-600772516 Minor comments only. This approach seems safe to me.. cc @yanghua , since we are in the middle of 0.5.2.. if we

[jira] [Created] (HUDI-721) AvroConversionUtils is broken for complex types in 0.6

Alexander Filipchik created HUDI-721: Summary: AvroConversionUtils is broken for complex types in 0.6 Key: HUDI-721 URL: https://issues.apache.org/jira/browse/HUDI-721 Project: Apache Hudi

[jira] [Comment Edited] (HUDI-721) AvroConversionUtils is broken for complex types in 0.6

[ https://issues.apache.org/jira/browse/HUDI-721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17062025#comment-17062025 ] Alexander Filipchik edited comment on HUDI-721 at 3/18/20, 8:11 PM:

[jira] [Comment Edited] (HUDI-721) AvroConversionUtils is broken for complex types in 0.6

[ https://issues.apache.org/jira/browse/HUDI-721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17062025#comment-17062025 ] Alexander Filipchik edited comment on HUDI-721 at 3/18/20, 8:27 PM:

[GitHub] [incubator-hudi] yanghua commented on issue #1417: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles

yanghua commented on issue #1417: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles URL: https://github.com/apache/incubator-hudi/pull/1417#issuecomment-600900820 @vinothchandar Replied you on the ML.

[jira] [Commented] (HUDI-721) AvroConversionUtils is broken for complex types in 0.6

[ https://issues.apache.org/jira/browse/HUDI-721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17062144#comment-17062144 ] Alexander Filipchik commented on HUDI-721: -- [~vbalaji] ^^^ > AvroConversionUtils is broken for

[jira] [Commented] (HUDI-721) AvroConversionUtils is broken for complex types in 0.6

[ https://issues.apache.org/jira/browse/HUDI-721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17062025#comment-17062025 ] Alexander Filipchik commented on HUDI-721: -- Also, putting old code in AvroConversionHelper solves

[GitHub] [incubator-hudi] yanghua commented on issue #1412: [HUDI-504] Restructuring and auto-generation of docs

yanghua commented on issue #1412: [HUDI-504] Restructuring and auto-generation of docs URL: https://github.com/apache/incubator-hudi/pull/1412#issuecomment-600890300 > May be we add a small note somewhere that 0.5.2 is unreleased? +1 to have this note

[GitHub] [incubator-hudi] vinothchandar commented on issue #1412: [HUDI-504] Restructuring and auto-generation of docs

vinothchandar commented on issue #1412: [HUDI-504] Restructuring and auto-generation of docs URL: https://github.com/apache/incubator-hudi/pull/1412#issuecomment-600912161 @lamber-ken lets then add the note in a separate PR first.. then proceed to merge this?

[jira] [Updated] (HUDI-721) AvroConversionUtils is broken for complex types in 0.6

[ https://issues.apache.org/jira/browse/HUDI-721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Filipchik updated HUDI-721: - Description: hi, was working on the upgrade from 0.5 to 0.6 and hit a bug in

[jira] [Commented] (HUDI-721) AvroConversionUtils is broken for complex types in 0.6

[ https://issues.apache.org/jira/browse/HUDI-721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17062247#comment-17062247 ] Udit Mehrotra commented on HUDI-721: This could be related to

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1417: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles

codecov-io edited a comment on issue #1417: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles URL: https://github.com/apache/incubator-hudi/pull/1417#issuecomment-600535972 #

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1417: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles

codecov-io edited a comment on issue #1417: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles URL: https://github.com/apache/incubator-hudi/pull/1417#issuecomment-600535972 #

[jira] [Updated] (HUDI-719) Exception during clean phase: Found org.apache.hudi.avro.model.HoodieCleanMetadata, expecting org.apache.hudi.avro.model.HoodieCleanerPlan

[ https://issues.apache.org/jira/browse/HUDI-719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Filipchik updated HUDI-719: - Fix Version/s: 0.6.0 > Exception during clean phase: Found >

[jira] [Updated] (HUDI-721) AvroConversionUtils is broken for complex types in 0.6

[ https://issues.apache.org/jira/browse/HUDI-721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Filipchik updated HUDI-721: - Component/s: Common Core > AvroConversionUtils is broken for complex types in 0.6 >

[jira] [Created] (HUDI-722) IndexOutOfBoundsException in MessageColumnIORecordConsumer.addBinary when writing parquet

Alexander Filipchik created HUDI-722: Summary: IndexOutOfBoundsException in MessageColumnIORecordConsumer.addBinary when writing parquet Key: HUDI-722 URL: https://issues.apache.org/jira/browse/HUDI-722

[jira] [Commented] (HUDI-648) Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

[ https://issues.apache.org/jira/browse/HUDI-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17062242#comment-17062242 ] liujinhui commented on HUDI-648: Hello, I also encountered this problem recently. Occasionally the kafka

[jira] [Updated] (HUDI-722) IndexOutOfBoundsException in MessageColumnIORecordConsumer.addBinary when writing parquet

[ https://issues.apache.org/jira/browse/HUDI-722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Filipchik updated HUDI-722: - Description: Some writes fail with java.lang.IndexOutOfBoundsException : Invalid array

[GitHub] [incubator-hudi] lamber-ken commented on a change in pull request #1412: [HUDI-504] Restructuring and auto-generation of docs

lamber-ken commented on a change in pull request #1412: [HUDI-504] Restructuring and auto-generation of docs URL: https://github.com/apache/incubator-hudi/pull/1412#discussion_r394767796 ## File path: .travis.yml ## @@ -0,0 +1,40 @@ +language: ruby +rvm: + - 2.6.3 +

[jira] [Updated] (HUDI-718) java.lang.ClassCastException during upsert

[ https://issues.apache.org/jira/browse/HUDI-718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Filipchik updated HUDI-718: - Fix Version/s: 0.6.0 > java.lang.ClassCastException during upsert >

[GitHub] [incubator-hudi] lamber-ken commented on issue #1412: [HUDI-504] Restructuring and auto-generation of docs

lamber-ken commented on issue #1412: [HUDI-504] Restructuring and auto-generation of docs URL: https://github.com/apache/incubator-hudi/pull/1412#issuecomment-600954141 > @lamber-ken lets then add the note in a separate PR first.. then proceed to merge this? Hi, during testing

[jira] [Created] (HUDI-723) SqlTransformer's schema sometimes is not registered.

Alexander Filipchik created HUDI-723: Summary: SqlTransformer's schema sometimes is not registered. Key: HUDI-723 URL: https://issues.apache.org/jira/browse/HUDI-723 Project: Apache Hudi

[jira] [Commented] (HUDI-721) AvroConversionUtils is broken for complex types in 0.6

[ https://issues.apache.org/jira/browse/HUDI-721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17062237#comment-17062237 ] Vinoth Chandar commented on HUDI-721: - cc [~uditme] love to get your thoughts on this also.. >

[jira] [Updated] (HUDI-721) AvroConversionUtils is broken for complex types in 0.6

[ https://issues.apache.org/jira/browse/HUDI-721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-721: Fix Version/s: 0.6.0 > AvroConversionUtils is broken for complex types in 0.6 >

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #221

See Changes: -- [...truncated 2.35 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/conf: logging settings.xml toolchains.xml

[jira] [Commented] (HUDI-83) Map Timestamp type in spark to corresponding Timestamp type in Hive during Hive sync

[ https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061447#comment-17061447 ] cdmikechen commented on HUDI-83: [~vinoth] Sorry for delay. I recently was busy on doing some other thins. 

[jira] [Updated] (HUDI-720) NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles

[ https://issues.apache.org/jira/browse/HUDI-720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-720: Labels: pull-request-available (was: ) > NOTICE file needs to add more content based on the NOTICE

[GitHub] [incubator-hudi] yanghua opened a new pull request #1417: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles

yanghua opened a new pull request #1417: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles URL: https://github.com/apache/incubator-hudi/pull/1417 ## What is the purpose of the pull request *This pull request

[GitHub] [incubator-hudi] yanghua commented on issue #1417: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles

yanghua commented on issue #1417: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles URL: https://github.com/apache/incubator-hudi/pull/1417#issuecomment-600522459 It would be better to have @steveblackmon to review this PR.

[jira] [Created] (HUDI-720) NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles

vinoyang created HUDI-720: - Summary: NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles Key: HUDI-720 URL: https://issues.apache.org/jira/browse/HUDI-720

[GitHub] [incubator-hudi] codecov-io commented on issue #1417: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles

codecov-io commented on issue #1417: [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles URL: https://github.com/apache/incubator-hudi/pull/1417#issuecomment-600535972 #