[jira] [Updated] (HUDI-751) Fix some coding issues reported by FindBugs

2020-03-30 Thread Shao Feng Shi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shao Feng Shi updated HUDI-751: --- Description: When I go through the code base, the FindBugs plugin in my IDEA reports several issues,

[jira] [Created] (HUDI-751) Fix some coding issues reported by FindBugs

2020-03-30 Thread Shao Feng Shi (Jira)
Shao Feng Shi created HUDI-751: -- Summary: Fix some coding issues reported by FindBugs Key: HUDI-751 URL: https://issues.apache.org/jira/browse/HUDI-751 Project: Apache Hudi (incubating) Issue

[GitHub] [incubator-hudi] leesf merged pull request #1466: [HUDI-742] Fix Java Math Exception

2020-03-30 Thread GitBox
leesf merged pull request #1466: [HUDI-742] Fix Java Math Exception URL: https://github.com/apache/incubator-hudi/pull/1466 This is an automated message from the Apache Git Service. To respond to the message, please log on

[incubator-hudi] branch master updated: [HUDI-742] Fix Java Math Exception (#1466)

2020-03-30 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 9ecf0cc [HUDI-742] Fix Java Math

[jira] [Created] (HUDI-750) Make AbstractHoodieClient spark-free

2020-03-30 Thread hong dongdong (Jira)
hong dongdong created HUDI-750: -- Summary: Make AbstractHoodieClient spark-free Key: HUDI-750 URL: https://issues.apache.org/jira/browse/HUDI-750 Project: Apache Hudi (incubating) Issue Type:

[jira] [Created] (HUDI-749) packaging/hudi-timeline-server-bundle./run_server.sh start error

2020-03-30 Thread leesf (Jira)
leesf created HUDI-749: -- Summary: packaging/hudi-timeline-server-bundle./run_server.sh start error Key: HUDI-749 URL: https://issues.apache.org/jira/browse/HUDI-749 Project: Apache Hudi (incubating)

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1466: [HUDI-742] Fix Java Math Exception

2020-03-30 Thread GitBox
codecov-io edited a comment on issue #1466: [HUDI-742] Fix Java Math Exception URL: https://github.com/apache/incubator-hudi/pull/1466#issuecomment-605739120 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1466?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1466: [HUDI-742] Fix Java Math Exception

2020-03-30 Thread GitBox
codecov-io edited a comment on issue #1466: [HUDI-742] Fix Java Math Exception URL: https://github.com/apache/incubator-hudi/pull/1466#issuecomment-605739120 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1466?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] EdwinGuo commented on a change in pull request #1466: [HUDI-742] Fix Java Math Exception

2020-03-30 Thread GitBox
EdwinGuo commented on a change in pull request #1466: [HUDI-742] Fix Java Math Exception URL: https://github.com/apache/incubator-hudi/pull/1466#discussion_r400598791 ## File path: hudi-client/src/test/java/org/apache/hudi/index/bloom/TestBucketizedBloomCheckPartitioner.java

[GitHub] [incubator-hudi] lamber-ken opened a new pull request #1469: [WIP] [HUDI-686] Implement BloomIndexV2 that does not depend on memory caching

2020-03-30 Thread GitBox
lamber-ken opened a new pull request #1469: [WIP] [HUDI-686] Implement BloomIndexV2 that does not depend on memory caching URL: https://github.com/apache/incubator-hudi/pull/1469 ## What is the purpose of the pull request Main goals here is to provide a much simpler index, without

[jira] [Updated] (HUDI-686) Implement BloomIndexV2 that does not depend on memory caching

2020-03-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-686: Labels: pull-request-available (was: ) > Implement BloomIndexV2 that does not depend on memory

[GitHub] [incubator-hudi] lamber-ken commented on issue #1466: [HUDI-742] Fix Java Math Exception

2020-03-30 Thread GitBox
lamber-ken commented on issue #1466: [HUDI-742] Fix Java Math Exception URL: https://github.com/apache/incubator-hudi/pull/1466#issuecomment-606326879  going to let @vinothchandar / @leesf make the final call here : ) This

[GitHub] [incubator-hudi] EdwinGuo commented on issue #1466: [HUDI-742] Fix Java Math Exception

2020-03-30 Thread GitBox
EdwinGuo commented on issue #1466: [HUDI-742] Fix Java Math Exception URL: https://github.com/apache/incubator-hudi/pull/1466#issuecomment-606326207 > > @Iamber-ken, yes, I was using my company git config to commit the code. Do I need to recommit the code using my personal github account?

[jira] [Updated] (HUDI-519) Document the need for Avro dependency shading/relocation for custom payloads, need for spark-avro

2020-03-30 Thread Suneel Marthi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi updated HUDI-519: --- Fix Version/s: (was: 0.5.1) 0.6.0 > Document the need for Avro dependency

[GitHub] [incubator-hudi] xushiyan commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer

2020-03-30 Thread GitBox
xushiyan commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer URL: https://github.com/apache/incubator-hudi/pull/1440#discussion_r400558170 ## File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/TestUtilHelpers.java ## @@ -0,0

[GitHub] [incubator-hudi] xushiyan commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer

2020-03-30 Thread GitBox
xushiyan commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer URL: https://github.com/apache/incubator-hudi/pull/1440#discussion_r400554146 ## File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/TestUtilHelpers.java ## @@ -0,0

[GitHub] [incubator-hudi] lamber-ken commented on issue #1466: [HUDI-742] Fix Java Math Exception

2020-03-30 Thread GitBox
lamber-ken commented on issue #1466: [HUDI-742] Fix Java Math Exception URL: https://github.com/apache/incubator-hudi/pull/1466#issuecomment-606296693 > @Iamber-ken, yes, I was using my company git config to commit the code. Do I need to recommit the code using my personal github account?

[GitHub] [incubator-hudi] lamber-ken commented on issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload

2020-03-30 Thread GitBox
lamber-ken commented on issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload URL: https://github.com/apache/incubator-hudi/issues/1458#issuecomment-606295246 > @lamber-ken we should file a JIRA and get this ironed out in the next

[GitHub] [incubator-hudi] vinothchandar merged pull request #1406: [HUDI-713] Fix conversion of Spark array of struct type to Avro schema

2020-03-30 Thread GitBox
vinothchandar merged pull request #1406: [HUDI-713] Fix conversion of Spark array of struct type to Avro schema URL: https://github.com/apache/incubator-hudi/pull/1406 This is an automated message from the Apache Git

[GitHub] [incubator-hudi] vinothchandar commented on issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload

2020-03-30 Thread GitBox
vinothchandar commented on issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload URL: https://github.com/apache/incubator-hudi/issues/1458#issuecomment-606293347 @lamber-ken we should file a JIRA and get this ironed out in the next

[incubator-hudi] branch master updated (dbc9acd -> ce0a4c6)

2020-03-30 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from dbc9acd [HUDI-716] Exception: Not an Avro data file when running HoodieCleanClient.runClean (#1432)

[GitHub] [incubator-hudi] vinothchandar commented on issue #1468: [HUDI-748] Adding .codecov.yml to set exclusions for code coverage reports.

2020-03-30 Thread GitBox
vinothchandar commented on issue #1468: [HUDI-748] Adding .codecov.yml to set exclusions for code coverage reports. URL: https://github.com/apache/incubator-hudi/pull/1468#issuecomment-606292819 @prashantwason I am going to let @bvaradar make the final call here

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1406: [HUDI-713] Fix conversion of Spark array of struct type to Avro schema

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1406: [HUDI-713] Fix conversion of Spark array of struct type to Avro schema URL: https://github.com/apache/incubator-hudi/pull/1406#discussion_r400537729 ## File path:

[jira] [Resolved] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

2020-03-30 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken resolved HUDI-716. - Resolution: Fixed hi [~afilipchik] fixed at master branch now > Exception: Not an Avro data file when

[GitHub] [incubator-hudi] EdwinGuo commented on issue #1466: [HUDI-742] Fix Java Math Exception

2020-03-30 Thread GitBox
EdwinGuo commented on issue #1466: [HUDI-742] Fix Java Math Exception URL: https://github.com/apache/incubator-hudi/pull/1466#issuecomment-606292147 @Iamber-ken, yes, I was using my company git config to commit the code. Do I need to recommit the code using my personal github account?

[GitHub] [incubator-hudi] vinothchandar commented on issue #1406: [HUDI-713] Fix conversion of Spark array of struct type to Avro schema

2020-03-30 Thread GitBox
vinothchandar commented on issue #1406: [HUDI-713] Fix conversion of Spark array of struct type to Avro schema URL: https://github.com/apache/incubator-hudi/pull/1406#issuecomment-606288517 >And then I used Hudi 0.5.1 (uses spark-avro) to update the values of these two types and it works.

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1468: [HUDI-748] Adding .codecov.yml to set exclusions for code coverage reports.

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1468: [HUDI-748] Adding .codecov.yml to set exclusions for code coverage reports. URL: https://github.com/apache/incubator-hudi/pull/1468#discussion_r400534345 ## File path: .codecov.yml ## @@ -0,0 +1,46 @@ +# Licensed

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1468: [HUDI-748] Adding .codecov.yml to set exclusions for code coverage reports.

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1468: [HUDI-748] Adding .codecov.yml to set exclusions for code coverage reports. URL: https://github.com/apache/incubator-hudi/pull/1468#discussion_r400534897 ## File path: .codecov.yml ## @@ -0,0 +1,46 @@ +# Licensed

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1468: [HUDI-748] Adding .codecov.yml to set exclusions for code coverage reports.

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1468: [HUDI-748] Adding .codecov.yml to set exclusions for code coverage reports. URL: https://github.com/apache/incubator-hudi/pull/1468#discussion_r400534760 ## File path: .codecov.yml ## @@ -0,0 +1,46 @@ +# Licensed

[GitHub] [incubator-hudi] prashantwason commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-03-30 Thread GitBox
prashantwason commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#discussion_r400527532 ## File path:

[GitHub] [incubator-hudi] prashantwason commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-03-30 Thread GitBox
prashantwason commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#discussion_r400527107 ## File path:

[GitHub] [incubator-hudi] prashantwason commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-03-30 Thread GitBox
prashantwason commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#discussion_r400527428 ## File path:

[GitHub] [incubator-hudi] prashantwason commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-03-30 Thread GitBox
prashantwason commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#discussion_r400527249 ## File path:

[GitHub] [incubator-hudi] prashantwason commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-03-30 Thread GitBox
prashantwason commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#discussion_r400527391 ## File path:

[GitHub] [incubator-hudi] prashantwason commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-03-30 Thread GitBox
prashantwason commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#discussion_r400527359 ## File path:

[GitHub] [incubator-hudi] prashantwason commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-03-30 Thread GitBox
prashantwason commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#discussion_r400527316 ## File path:

[GitHub] [incubator-hudi] prashantwason commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-03-30 Thread GitBox
prashantwason commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#discussion_r400527168 ## File path:

[GitHub] [incubator-hudi] nsivabalan commented on issue #1433: [HUDI-728]: Implement custom key generator

2020-03-30 Thread GitBox
nsivabalan commented on issue #1433: [HUDI-728]: Implement custom key generator URL: https://github.com/apache/incubator-hudi/pull/1433#issuecomment-606275930 @vinothchandar : my bad. I have taken a look. You can review once my feedback is addressed. Will keep you posted.

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1433: [HUDI-728]: Implement custom key generator

2020-03-30 Thread GitBox
nsivabalan commented on a change in pull request #1433: [HUDI-728]: Implement custom key generator URL: https://github.com/apache/incubator-hudi/pull/1433#discussion_r400521746 ## File path: hudi-spark/src/main/java/org/apache/hudi/keygen/CustomKeyGenerator.java ## @@

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1433: [HUDI-728]: Implement custom key generator

2020-03-30 Thread GitBox
nsivabalan commented on a change in pull request #1433: [HUDI-728]: Implement custom key generator URL: https://github.com/apache/incubator-hudi/pull/1433#discussion_r400521994 ## File path: hudi-spark/src/main/java/org/apache/hudi/keygen/CustomKeyGenerator.java ## @@

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1433: [HUDI-728]: Implement custom key generator

2020-03-30 Thread GitBox
nsivabalan commented on a change in pull request #1433: [HUDI-728]: Implement custom key generator URL: https://github.com/apache/incubator-hudi/pull/1433#discussion_r400521890 ## File path: hudi-spark/src/main/java/org/apache/hudi/keygen/CustomKeyGenerator.java ## @@

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1433: [HUDI-728]: Implement custom key generator

2020-03-30 Thread GitBox
nsivabalan commented on a change in pull request #1433: [HUDI-728]: Implement custom key generator URL: https://github.com/apache/incubator-hudi/pull/1433#discussion_r400516294 ## File path: hudi-spark/src/main/java/org/apache/hudi/keygen/CustomKeyGenerator.java ## @@

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1433: [HUDI-728]: Implement custom key generator

2020-03-30 Thread GitBox
nsivabalan commented on a change in pull request #1433: [HUDI-728]: Implement custom key generator URL: https://github.com/apache/incubator-hudi/pull/1433#discussion_r400516907 ## File path: hudi-spark/src/main/java/org/apache/hudi/keygen/CustomKeyGenerator.java ## @@

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1466: [HUDI-742] Fix Java Math Exception

2020-03-30 Thread GitBox
lamber-ken edited a comment on issue #1466: [HUDI-742] Fix Java Math Exception URL: https://github.com/apache/incubator-hudi/pull/1466#issuecomment-606273609 hi @EdwinGuo I guess your email may be wrong, use `git config --list | grep email` to check.

[GitHub] [incubator-hudi] lamber-ken commented on issue #1466: [HUDI-742] Fix Java Math Exception

2020-03-30 Thread GitBox
lamber-ken commented on issue #1466: [HUDI-742] Fix Java Math Exception URL: https://github.com/apache/incubator-hudi/pull/1466#issuecomment-606273609 I guess your git email doesn't match, you can use `git config --list | grep email` to check

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1466: [HUDI-742] Fix Java Math Exception

2020-03-30 Thread GitBox
lamber-ken edited a comment on issue #1466: [HUDI-742] Fix Java Math Exception URL: https://github.com/apache/incubator-hudi/pull/1466#issuecomment-606271560 hi, @vinothchandar let me summarize the analysis process 1. The exception stackstrace ``` Caused by:

[GitHub] [incubator-hudi] lamber-ken commented on issue #1466: [HUDI-742] Fix Java Math Exception

2020-03-30 Thread GitBox
lamber-ken commented on issue #1466: [HUDI-742] Fix Java Math Exception URL: https://github.com/apache/incubator-hudi/pull/1466#issuecomment-606271560 hi, @vinothchandar Let me summarize the analysis process 1. The exception stackstrace ``` Caused by:

[GitHub] [incubator-hudi] zhedoubushishi commented on issue #1406: [HUDI-713] Fix conversion of Spark array of struct type to Avro schema

2020-03-30 Thread GitBox
zhedoubushishi commented on issue #1406: [HUDI-713] Fix conversion of Spark array of struct type to Avro schema URL: https://github.com/apache/incubator-hudi/pull/1406#issuecomment-606240326 > @zhedoubushishi any thoughts? I will timeout and review land this if this sounds good.. we can

[GitHub] [incubator-hudi] vinothchandar commented on issue #1433: [HUDI-728]: Implement custom key generator

2020-03-30 Thread GitBox
vinothchandar commented on issue #1433: [HUDI-728]: Implement custom key generator URL: https://github.com/apache/incubator-hudi/pull/1433#issuecomment-606229228 @pratyakshsharma thanks for your patience.. I will review this myself and get back in a day.

[GitHub] [incubator-hudi] prashantwason commented on issue #1450: [MINOR] Adding .codecov.yml to set exclusions for code coverage reports.

2020-03-30 Thread GitBox
prashantwason commented on issue #1450: [MINOR] Adding .codecov.yml to set exclusions for code coverage reports. URL: https://github.com/apache/incubator-hudi/pull/1450#issuecomment-606207697 Filed a separate PR. https://github.com/apache/incubator-hudi/pull/1468

[jira] [Updated] (HUDI-748) Add exclusions for code coverage reports

2020-03-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-748: Labels: pull-request-available (was: ) > Add exclusions for code coverage reports >

[GitHub] [incubator-hudi] prashantwason closed pull request #1450: [MINOR] Adding .codecov.yml to set exclusions for code coverage reports.

2020-03-30 Thread GitBox
prashantwason closed pull request #1450: [MINOR] Adding .codecov.yml to set exclusions for code coverage reports. URL: https://github.com/apache/incubator-hudi/pull/1450 This is an automated message from the Apache Git

[GitHub] [incubator-hudi] prashantwason opened a new pull request #1468: [HUDI-748] Adding .codecov.yml to set exclusions for code coverage reports.

2020-03-30 Thread GitBox
prashantwason opened a new pull request #1468: [HUDI-748] Adding .codecov.yml to set exclusions for code coverage reports. URL: https://github.com/apache/incubator-hudi/pull/1468 ## What is the purpose of the pull request Adding some exclusions for code coverage reports. ##

[jira] [Created] (HUDI-748) Add exclusions for code coverage reports

2020-03-30 Thread Prashant Wason (Jira)
Prashant Wason created HUDI-748: --- Summary: Add exclusions for code coverage reports Key: HUDI-748 URL: https://issues.apache.org/jira/browse/HUDI-748 Project: Apache Hudi (incubating) Issue

[GitHub] [incubator-hudi] prashantwason commented on issue #1450: [MINOR] Adding .codecov.yml to set exclusions for code coverage reports.

2020-03-30 Thread GitBox
prashantwason commented on issue #1450: [MINOR] Adding .codecov.yml to set exclusions for code coverage reports. URL: https://github.com/apache/incubator-hudi/pull/1450#issuecomment-606200998 Sure, I will file a JIRA. I think you misunderstood my comments so let me clarify.

[GitHub] [incubator-hudi] prashantwason edited a comment on issue #1416: [HUDI-717] Fixed usage of HiveDriver for DDL statements for Hive 2.x

2020-03-30 Thread GitBox
prashantwason edited a comment on issue #1416: [HUDI-717] Fixed usage of HiveDriver for DDL statements for Hive 2.x URL: https://github.com/apache/incubator-hudi/pull/1416#issuecomment-606190739 I have addressed all review comments and resolved merge conflict. Ready to review/merge.

[GitHub] [incubator-hudi] prashantwason commented on issue #1416: [HUDI-717] Fixed usage of HiveDriver for DDL statements for Hive 2.x

2020-03-30 Thread GitBox
prashantwason commented on issue #1416: [HUDI-717] Fixed usage of HiveDriver for DDL statements for Hive 2.x URL: https://github.com/apache/incubator-hudi/pull/1416#issuecomment-606190739 Addresses all review comments and resolved merge conflict. Ready to review/merge.

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index URL: https://github.com/apache/incubator-hudi/pull/1402#discussion_r400430648 ## File path: hudi-client/src/main/java/org/apache/hudi/index/bloom/HoodieSimpleIndex.java ## @@

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index URL: https://github.com/apache/incubator-hudi/pull/1402#discussion_r400429741 ## File path: hudi-client/src/main/java/org/apache/hudi/index/bloom/HoodieSimpleIndex.java ## @@

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index URL: https://github.com/apache/incubator-hudi/pull/1402#discussion_r400425128 ## File path: hudi-client/src/main/java/org/apache/hudi/index/bloom/HoodieSimpleIndex.java ## @@

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index URL: https://github.com/apache/incubator-hudi/pull/1402#discussion_r400427139 ## File path: hudi-client/src/test/java/org/apache/hudi/TestHoodieClientOnCopyOnWriteStorage.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index URL: https://github.com/apache/incubator-hudi/pull/1402#discussion_r400426536 ## File path: hudi-client/src/main/java/org/apache/hudi/index/bloom/HoodieSimpleIndex.java ## @@

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index URL: https://github.com/apache/incubator-hudi/pull/1402#discussion_r400425599 ## File path: hudi-client/src/main/java/org/apache/hudi/index/bloom/HoodieSimpleIndex.java ## @@

[GitHub] [incubator-hudi] prashantwason commented on a change in pull request #1416: [HUDI-717] Fixed usage of HiveDriver for DDL statements for Hive 2.x

2020-03-30 Thread GitBox
prashantwason commented on a change in pull request #1416: [HUDI-717] Fixed usage of HiveDriver for DDL statements for Hive 2.x URL: https://github.com/apache/incubator-hudi/pull/1416#discussion_r400426836 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on issue #1406: [HUDI-713] Fix conversion of Spark array of struct type to Avro schema

2020-03-30 Thread GitBox
vinothchandar commented on issue #1406: [HUDI-713] Fix conversion of Spark array of struct type to Avro schema URL: https://github.com/apache/incubator-hudi/pull/1406#issuecomment-606181565 @zhedoubushishi any thoughts? I will timeout and review land this if this sounds good.. we can add

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1427: [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1427: [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema URL: https://github.com/apache/incubator-hudi/pull/1427#discussion_r400418287 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1427: [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1427: [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema URL: https://github.com/apache/incubator-hudi/pull/1427#discussion_r400422483 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1427: [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1427: [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema URL: https://github.com/apache/incubator-hudi/pull/1427#discussion_r400420126 ## File path:

[GitHub] [incubator-hudi] prashantwason commented on a change in pull request #1416: [HUDI-717] Fixed usage of HiveDriver for DDL statements for Hive 2.x

2020-03-30 Thread GitBox
prashantwason commented on a change in pull request #1416: [HUDI-717] Fixed usage of HiveDriver for DDL statements for Hive 2.x URL: https://github.com/apache/incubator-hudi/pull/1416#discussion_r400410732 ## File path:

[GitHub] [incubator-hudi] garyli1019 commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider

2020-03-30 Thread GitBox
garyli1019 commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider URL: https://github.com/apache/incubator-hudi/pull/1453#discussion_r400409352 ## File path:

[GitHub] [incubator-hudi] prashantwason commented on issue #1289: [HUDI-92] Provide reasonable names for Spark DAG stages in Hudi.

2020-03-30 Thread GitBox
prashantwason commented on issue #1289: [HUDI-92] Provide reasonable names for Spark DAG stages in Hudi. URL: https://github.com/apache/incubator-hudi/pull/1289#issuecomment-606167919 @vinothchandar Yep, I would like this to move forward. Let me revive this as it seems there are merge

[incubator-hudi] branch master updated: [HUDI-716] Exception: Not an Avro data file when running HoodieCleanClient.runClean (#1432)

2020-03-30 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new dbc9acd [HUDI-716] Exception: Not an

[GitHub] [incubator-hudi] bvaradar merged pull request #1432: [HUDI-716] Exception: Not an Avro data file when running HoodieCleanClient.runClean

2020-03-30 Thread GitBox
bvaradar merged pull request #1432: [HUDI-716] Exception: Not an Avro data file when running HoodieCleanClient.runClean URL: https://github.com/apache/incubator-hudi/pull/1432 This is an automated message from the Apache

[GitHub] [incubator-hudi] satishkotha commented on issue #1396: [HUDI-687] Stop incremental reader on RO table before a pending compaction

2020-03-30 Thread GitBox
satishkotha commented on issue #1396: [HUDI-687] Stop incremental reader on RO table before a pending compaction URL: https://github.com/apache/incubator-hudi/pull/1396#issuecomment-606157488 > Looks great @satishkotha Once you rebase and fix conflicts, we should be good to commit.

[GitHub] [incubator-hudi] satishkotha edited a comment on issue #1396: [HUDI-687] Stop incremental reader on RO table before a pending compaction

2020-03-30 Thread GitBox
satishkotha edited a comment on issue #1396: [HUDI-687] Stop incremental reader on RO table before a pending compaction URL: https://github.com/apache/incubator-hudi/pull/1396#issuecomment-606157488 > Looks great @satishkotha Once you rebase and fix conflicts, we should be good to commit.

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider URL: https://github.com/apache/incubator-hudi/pull/1453#discussion_r400376661 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider URL: https://github.com/apache/incubator-hudi/pull/1453#discussion_r400386144 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider URL: https://github.com/apache/incubator-hudi/pull/1453#discussion_r400376992 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider URL: https://github.com/apache/incubator-hudi/pull/1453#discussion_r400384846 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider URL: https://github.com/apache/incubator-hudi/pull/1453#discussion_r400377358 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider URL: https://github.com/apache/incubator-hudi/pull/1453#discussion_r400385884 ## File path:

[jira] [Updated] (HUDI-724) Parallelize GetSmallFiles For Partitions

2020-03-30 Thread Feichi Feng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feichi Feng updated HUDI-724: - Status: In Progress (was: Open) > Parallelize GetSmallFiles For Partitions >

[jira] [Resolved] (HUDI-724) Parallelize GetSmallFiles For Partitions

2020-03-30 Thread Feichi Feng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feichi Feng resolved HUDI-724. -- Resolution: Fixed > Parallelize GetSmallFiles For Partitions >

[jira] [Commented] (HUDI-724) Parallelize GetSmallFiles For Partitions

2020-03-30 Thread Feichi Feng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071145#comment-17071145 ] Feichi Feng commented on HUDI-724: -- PR is merged.  > Parallelize GetSmallFiles For Partitions >

[jira] [Updated] (HUDI-724) Parallelize GetSmallFiles For Partitions

2020-03-30 Thread Feichi Feng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feichi Feng updated HUDI-724: - Status: Open (was: New) > Parallelize GetSmallFiles For Partitions >

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#discussion_r400325322 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on issue #1427: [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema

2020-03-30 Thread GitBox
vinothchandar commented on issue #1427: [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema URL: https://github.com/apache/incubator-hudi/pull/1427#issuecomment-606077974 Looks like the hive query exited with 2.. Hmmm. seeing a bit of

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#discussion_r400285880 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#discussion_r400285226 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#discussion_r400290759 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#discussion_r400283983 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#discussion_r400284466 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#discussion_r400286409 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#discussion_r400282621 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#discussion_r400292884 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#discussion_r400291594 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#discussion_r400281970 ## File path:

[GitHub] [incubator-hudi] EdwinGuo commented on a change in pull request #1466: [HUDI-742] Fix Java Math Exception

2020-03-30 Thread GitBox
EdwinGuo commented on a change in pull request #1466: [HUDI-742] Fix Java Math Exception URL: https://github.com/apache/incubator-hudi/pull/1466#discussion_r400260629 ## File path: hudi-client/src/main/java/org/apache/hudi/index/bloom/BucketizedBloomCheckPartitioner.java

[GitHub] [incubator-hudi] vinothchandar commented on issue #1450: [MINOR] Adding .codecov.yml to set exclusions for code coverage reports.

2020-03-30 Thread GitBox
vinothchandar commented on issue #1450: [MINOR] Adding .codecov.yml to set exclusions for code coverage reports. URL: https://github.com/apache/incubator-hudi/pull/1450#issuecomment-606042381 and please file a JIRA for this. Not sure if this qualifies as MINOR

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1450: [MINOR] Adding .codecov.yml to set exclusions for code coverage reports.

2020-03-30 Thread GitBox
vinothchandar commented on a change in pull request #1450: [MINOR] Adding .codecov.yml to set exclusions for code coverage reports. URL: https://github.com/apache/incubator-hudi/pull/1450#discussion_r400244323 ## File path: .codecov.yml ## @@ -0,0 +1,46 @@ +# Licensed to

  1   2   >