[GitHub] [hudi] hudi-bot edited a comment on pull request #3120: [HUDI-2045] Support Read Hoodie As DataSource Table For Flink And Del…

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #3120: URL: https://github.com/apache/hudi/pull/3120#issuecomment-864760893 ## CI report: * aaca30fffd1ea37f803f51ef3cf49c59ed79badc UNKNOWN * fcd06c8bccfc90b272b51d3511094e6617ec25bd UNKNOWN *

[GitHub] [hudi] hudi-bot edited a comment on pull request #3120: [HUDI-2045] Support Read Hoodie As DataSource Table For Flink And Del…

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #3120: URL: https://github.com/apache/hudi/pull/3120#issuecomment-864760893 ## CI report: * aaca30fffd1ea37f803f51ef3cf49c59ed79badc UNKNOWN * fcd06c8bccfc90b272b51d3511094e6617ec25bd UNKNOWN *

[hudi] branch master updated: [MINOR] Removing un-used files and references (#3150)

2021-06-24 Thread nagarwal
This is an automated email from the ASF dual-hosted git repository. nagarwal pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 23dbc09 [MINOR] Removing un-used files and

[GitHub] [hudi] n3nash merged pull request #3150: [MINOR] Removing un-used files and references

2021-06-24 Thread GitBox
n3nash merged pull request #3150: URL: https://github.com/apache/hudi/pull/3150 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] hudi-bot edited a comment on pull request #3120: [HUDI-2045] Support Read Hoodie As DataSource Table For Flink And Del…

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #3120: URL: https://github.com/apache/hudi/pull/3120#issuecomment-864760893 ## CI report: * aaca30fffd1ea37f803f51ef3cf49c59ed79badc UNKNOWN * fcd06c8bccfc90b272b51d3511094e6617ec25bd UNKNOWN *

[GitHub] [hudi] hudi-bot edited a comment on pull request #3150: [MINOR] Removing un-used files and references

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #3150: URL: https://github.com/apache/hudi/pull/3150#issuecomment-868179059 ## CI report: * 926d850de2f652c1ee1d7349d9de6411aaa2a2ac Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3150: [MINOR] Removing un-used files and references

2021-06-24 Thread GitBox
codecov-commenter edited a comment on pull request #3150: URL: https://github.com/apache/hudi/pull/3150#issuecomment-868180451 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] n3nash commented on a change in pull request #3092: [HUDI-1910] Commit Offset to Kafka after successful Hudi commit

2021-06-24 Thread GitBox
n3nash commented on a change in pull request #3092: URL: https://github.com/apache/hudi/pull/3092#discussion_r658465855 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/DeltaSync.java ## @@ -473,7 +476,9 @@ public void refreshTimeline()

[GitHub] [hudi] n3nash commented on pull request #3097: [HUDI-1996] Adding functionality to allow the providing of basic auth creds for confluent cloud schema registry

2021-06-24 Thread GitBox
n3nash commented on pull request #3097: URL: https://github.com/apache/hudi/pull/3097#issuecomment-868194167 @nsivabalan Can you review this please ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3150: [MINOR] Removing un-used files and references

2021-06-24 Thread GitBox
codecov-commenter edited a comment on pull request #3150: URL: https://github.com/apache/hudi/pull/3150#issuecomment-868180451 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3120: [HUDI-2045] Support Read Hoodie As DataSource Table For Flink And Del…

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #3120: URL: https://github.com/apache/hudi/pull/3120#issuecomment-864760893 ## CI report: * aaca30fffd1ea37f803f51ef3cf49c59ed79badc UNKNOWN * fcd06c8bccfc90b272b51d3511094e6617ec25bd UNKNOWN *

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3150: [MINOR] Removing un-used files and references

2021-06-24 Thread GitBox
codecov-commenter edited a comment on pull request #3150: URL: https://github.com/apache/hudi/pull/3150#issuecomment-868180451 #

[GitHub] [hudi] jsbali commented on pull request #3150: [MINOR] Removing un-used files and references

2021-06-24 Thread GitBox
jsbali commented on pull request #3150: URL: https://github.com/apache/hudi/pull/3150#issuecomment-868184999 @n3nash Yes they are duplicates and the fixed functions already exist in the same file. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hudi] nsivabalan commented on a change in pull request #2963: [HUDI-1904] Introduce SchemaProviderInterface to make SchemaProvider unified

2021-06-24 Thread GitBox
nsivabalan commented on a change in pull request #2963: URL: https://github.com/apache/hudi/pull/2963#discussion_r658454888 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/schema/SchemaProviderInterface.java ## @@ -25,12 +25,13 @@ /** * Class to

[GitHub] [hudi] hudi-bot edited a comment on pull request #3120: [HUDI-2045] Support Read Hoodie As DataSource Table For Flink And Del…

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #3120: URL: https://github.com/apache/hudi/pull/3120#issuecomment-864760893 ## CI report: * aaca30fffd1ea37f803f51ef3cf49c59ed79badc UNKNOWN * fcd06c8bccfc90b272b51d3511094e6617ec25bd UNKNOWN *

[GitHub] [hudi] hudi-bot edited a comment on pull request #3150: [MINOR] Removing un-used files and references

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #3150: URL: https://github.com/apache/hudi/pull/3150#issuecomment-868179059 ## CI report: * 926d850de2f652c1ee1d7349d9de6411aaa2a2ac Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3120: [HUDI-2045] Support Read Hoodie As DataSource Table For Flink And Del…

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #3120: URL: https://github.com/apache/hudi/pull/3120#issuecomment-864760893 ## CI report: * aaca30fffd1ea37f803f51ef3cf49c59ed79badc UNKNOWN * 716127b9b66a728854c9fd81a278abdcc23a4e7c Azure:

[GitHub] [hudi] xiarixiaoyao commented on pull request #3139: [HUDI-2058]support incremental query for insert_overwrite_table/insert_overwrite operation on cow table

2021-06-24 Thread GitBox
xiarixiaoyao commented on pull request #3139: URL: https://github.com/apache/hudi/pull/3139#issuecomment-868180580 @n3nash @garyli1019 could you help me review this pr, thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hudi] codecov-commenter commented on pull request #3150: [MINOR] Removing un-used files and references

2021-06-24 Thread GitBox
codecov-commenter commented on pull request #3150: URL: https://github.com/apache/hudi/pull/3150#issuecomment-868180451 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3150?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation)

[GitHub] [hudi] hudi-bot commented on pull request #3150: [MINOR] Removing un-used files and references

2021-06-24 Thread GitBox
hudi-bot commented on pull request #3150: URL: https://github.com/apache/hudi/pull/3150#issuecomment-868179059 ## CI report: * 926d850de2f652c1ee1d7349d9de6411aaa2a2ac UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] n3nash commented on pull request #3150: [MINOR] Removing un-used files and references

2021-06-24 Thread GitBox
n3nash commented on pull request #3150: URL: https://github.com/apache/hudi/pull/3150#issuecomment-868178483 @satishkotha @jsbali Can you review this ? Seems like the global sync PR had these remnants which got overlooked before merging. -- This is an automated message from the Apache

[GitHub] [hudi] n3nash opened a new pull request #3150: [MINOR] Removing un-used files and references

2021-06-24 Thread GitBox
n3nash opened a new pull request #3150: URL: https://github.com/apache/hudi/pull/3150 ## What is the purpose of the pull request *Removing commented code and unused files incorrectly committed* ## Committer checklist - [ ] Has a corresponding JIRA in PR title & commit

[GitHub] [hudi] hudi-bot edited a comment on pull request #3120: [HUDI-2045] Support Read Hoodie As DataSource Table For Flink And Del…

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #3120: URL: https://github.com/apache/hudi/pull/3120#issuecomment-864760893 ## CI report: * aaca30fffd1ea37f803f51ef3cf49c59ed79badc UNKNOWN * 716127b9b66a728854c9fd81a278abdcc23a4e7c Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3120: [HUDI-2045] Support Read Hoodie As DataSource Table For Flink And Del…

2021-06-24 Thread GitBox
codecov-commenter edited a comment on pull request #3120: URL: https://github.com/apache/hudi/pull/3120#issuecomment-864770805 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] n3nash merged pull request #2542: Add ability to provide multi-region (global) data consistency across HMS in different regions

2021-06-24 Thread GitBox
n3nash merged pull request #2542: URL: https://github.com/apache/hudi/pull/2542 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[hudi] branch master updated: Add ability to provide multi-region (global) data consistency across HMS in different regions (#2542)

2021-06-24 Thread nagarwal
This is an automated email from the ASF dual-hosted git repository. nagarwal pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 0fb8556 Add ability to provide multi-region

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3120: [HUDI-2045] Support Read Hoodie As DataSource Table For Flink And Del…

2021-06-24 Thread GitBox
codecov-commenter edited a comment on pull request #3120: URL: https://github.com/apache/hudi/pull/3120#issuecomment-864770805 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3139: [HUDI-2058]support incremental query for insert_overwrite_table/insert_overwrite operation on cow table

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #3139: URL: https://github.com/apache/hudi/pull/3139#issuecomment-866671675 ## CI report: * 42066935f5571aad75be3d27ba3321b6e61f4b22 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3120: [HUDI-2045] Support Read Hoodie As DataSource Table For Flink And Del…

2021-06-24 Thread GitBox
codecov-commenter edited a comment on pull request #3120: URL: https://github.com/apache/hudi/pull/3120#issuecomment-864770805 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3139: [HUDI-2058]support incremental query for insert_overwrite_table/insert_overwrite operation on cow table

2021-06-24 Thread GitBox
codecov-commenter edited a comment on pull request #3139: URL: https://github.com/apache/hudi/pull/3139#issuecomment-866741631 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3139: [HUDI-2058]support incremental query for insert_overwrite_table/insert_overwrite operation on cow table

2021-06-24 Thread GitBox
codecov-commenter edited a comment on pull request #3139: URL: https://github.com/apache/hudi/pull/3139#issuecomment-866741631 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3120: [HUDI-2045] Support Read Hoodie As DataSource Table For Flink And Del…

2021-06-24 Thread GitBox
codecov-commenter edited a comment on pull request #3120: URL: https://github.com/apache/hudi/pull/3120#issuecomment-864770805 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3120: [HUDI-2045] Support Read Hoodie As DataSource Table For Flink And Del…

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #3120: URL: https://github.com/apache/hudi/pull/3120#issuecomment-864760893 ## CI report: * aaca30fffd1ea37f803f51ef3cf49c59ed79badc UNKNOWN * 716127b9b66a728854c9fd81a278abdcc23a4e7c Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3139: [HUDI-2058]support incremental query for insert_overwrite_table/insert_overwrite operation on cow table

2021-06-24 Thread GitBox
codecov-commenter edited a comment on pull request #3139: URL: https://github.com/apache/hudi/pull/3139#issuecomment-866741631 #

[GitHub] [hudi] pengzhiwei2018 commented on pull request #3120: [HUDI-2045] Support Read Hoodie As DataSource Table For Flink And Del…

2021-06-24 Thread GitBox
pengzhiwei2018 commented on pull request #3120: URL: https://github.com/apache/hudi/pull/3120#issuecomment-868157970 > @pengzhiwei2018 : Looks like an integ test is failing. Can you please check that out > ITTestHoodieDemo.testParquetDemo Hi @nsivabalan , The reason of test

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3120: [HUDI-2045] Support Read Hoodie As DataSource Table For Flink And Del…

2021-06-24 Thread GitBox
codecov-commenter edited a comment on pull request #3120: URL: https://github.com/apache/hudi/pull/3120#issuecomment-864770805 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3120: [HUDI-2045] Support Read Hoodie As DataSource Table For Flink And Del…

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #3120: URL: https://github.com/apache/hudi/pull/3120#issuecomment-864760893 ## CI report: * aaca30fffd1ea37f803f51ef3cf49c59ed79badc UNKNOWN * 716127b9b66a728854c9fd81a278abdcc23a4e7c Azure:

[jira] [Created] (HUDI-2071) Support Reading Bootstrap MOR RT Table In Spark DataSource Table

2021-06-24 Thread pengzhiwei (Jira)
pengzhiwei created HUDI-2071: Summary: Support Reading Bootstrap MOR RT Table In Spark DataSource Table Key: HUDI-2071 URL: https://issues.apache.org/jira/browse/HUDI-2071 Project: Apache Hudi

[GitHub] [hudi] pengzhiwei2018 commented on a change in pull request #3140: [HUDI-2063] Add Doc For Spark Sql Integrates With Hudi

2021-06-24 Thread GitBox
pengzhiwei2018 commented on a change in pull request #3140: URL: https://github.com/apache/hudi/pull/3140#discussion_r658426373 ## File path: docs/_docs/1_1_spark_quick_start_guide.md ## @@ -300,6 +300,221 @@ spark. show(100, false) ``` +# Spark-Sql example +## Setup

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3139: [HUDI-2058]support incremental query for insert_overwrite_table/insert_overwrite operation on cow table

2021-06-24 Thread GitBox
codecov-commenter edited a comment on pull request #3139: URL: https://github.com/apache/hudi/pull/3139#issuecomment-866741631 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3139: [HUDI-2058]support incremental query for insert_overwrite_table/insert_overwrite operation on cow table

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #3139: URL: https://github.com/apache/hudi/pull/3139#issuecomment-866671675 ## CI report: * ebd7ae14e0fafb413abdd4561361b2fbbd398473 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-865885733 ## CI report: * 92bbb23756ffa63d7dd77a8a9285f3dd7e94d55c Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3139: [HUDI-2058]support incremental query for insert_overwrite_table/insert_overwrite operation on cow table

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #3139: URL: https://github.com/apache/hudi/pull/3139#issuecomment-866671675 ## CI report: * ebd7ae14e0fafb413abdd4561361b2fbbd398473 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction

2021-06-24 Thread GitBox
codecov-commenter edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-866110119 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction

2021-06-24 Thread GitBox
codecov-commenter edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-866110119 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-865885733 ## CI report: * b428ad50cd2a09bd5b9201acbd007e3a155cfc69 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction

2021-06-24 Thread GitBox
codecov-commenter edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-866110119 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-865885733 ## CI report: * b428ad50cd2a09bd5b9201acbd007e3a155cfc69 Azure:

[GitHub] [hudi] yuzhaojing commented on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction

2021-06-24 Thread GitBox
yuzhaojing commented on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-868109188 > There are some checkstyle issues reported by CI. Can you please look into fixing I will fix that. -- This is an automated message from the Apache Git Service. To

[jira] [Closed] (HUDI-2068) Skip the assign state for SmallFileAssign when the state can not assign initially

2021-06-24 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-2068. -- Resolution: Fixed e64fe5505487f3ee591b2b5d044c2c57989f8991 > Skip the assign state for SmallFileAssign when

[hudi] branch master updated: [HUDI-2068] Skip the assign state for SmallFileAssign when the state can not assign initially (#3148)

2021-06-24 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new e64fe55 [HUDI-2068] Skip the assign state for

[GitHub] [hudi] yanghua merged pull request #3148: [HUDI-2068] Skip the assign state for SmallFileAssign when the state …

2021-06-24 Thread GitBox
yanghua merged pull request #3148: URL: https://github.com/apache/hudi/pull/3148 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[jira] [Closed] (HUDI-2062) Catch FileNotFoundException in WriteProfiles #getCommitMetadataSafely

2021-06-24 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-2062. -- Fix Version/s: 0.9.0 Resolution: Fixed 218f2a6df8a41279d904a76b594d22f4d66d17c2 > Catch

[hudi] branch master updated: [HUDI-2062] Catch FileNotFoundException in WriteProfiles #getCommitMetadata Safely (#3138)

2021-06-24 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 218f2a6 [HUDI-2062] Catch

[GitHub] [hudi] yanghua merged pull request #3138: [HUDI-2062] Catch FileNotFoundException in WriteProfiles #getCommitMetadataSafely

2021-06-24 Thread GitBox
yanghua merged pull request #3138: URL: https://github.com/apache/hudi/pull/3138 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2542: Add ability to provide multi-region (global) data consistency across HMS in different regions

2021-06-24 Thread GitBox
codecov-commenter edited a comment on pull request #2542: URL: https://github.com/apache/hudi/pull/2542#issuecomment-849630457 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #2833: [HUDI-89] Add configOption & refactor Hudi configuration framework

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #2833: URL: https://github.com/apache/hudi/pull/2833#issuecomment-864208731 ## CI report: * 91d35c32fb09d5a607707f37f2818b2ee541c460 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #2833: [HUDI-89] Add configOption & refactor Hudi configuration framework

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #2833: URL: https://github.com/apache/hudi/pull/2833#issuecomment-864208731 ## CI report: * 78dd4297c7503795c05647afad048ed3d809e958 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #2833: [HUDI-89] Add configOption & refactor Hudi configuration framework

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #2833: URL: https://github.com/apache/hudi/pull/2833#issuecomment-864208731 ## CI report: * 78dd4297c7503795c05647afad048ed3d809e958 Azure:

[GitHub] [hudi] vinothchandar commented on a change in pull request #3111: [HUDI-2069] Fix KafkaAvroSchemaDeserializer to not rely on reflection

2021-06-24 Thread GitBox
vinothchandar commented on a change in pull request #3111: URL: https://github.com/apache/hudi/pull/3111#discussion_r658281970 ## File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/deser/TestKafkaAvroSchemaDeserializer.java ## @@ -102,9 +99,10 @@ private

[GitHub] [hudi] vinothchandar commented on a change in pull request #3111: [HUDI-2069] Fix KafkaAvroSchemaDeserializer to not rely on reflection

2021-06-24 Thread GitBox
vinothchandar commented on a change in pull request #3111: URL: https://github.com/apache/hudi/pull/3111#discussion_r658281481 ## File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/deser/TestKafkaAvroSchemaDeserializer.java ## @@ -102,9 +99,10 @@ private

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3097: [HUDI-1996] Adding functionality to allow the providing of basic auth creds for confluent cloud schema registry

2021-06-24 Thread GitBox
codecov-commenter edited a comment on pull request #3097: URL: https://github.com/apache/hudi/pull/3097#issuecomment-862839067 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3097: [HUDI-1996] Adding functionality to allow the providing of basic auth creds for confluent cloud schema registry

2021-06-24 Thread GitBox
codecov-commenter edited a comment on pull request #3097: URL: https://github.com/apache/hudi/pull/3097#issuecomment-862839067 #

[GitHub] [hudi] vinothchandar commented on a change in pull request #3111: [HUDI-2069] Fix KafkaAvroSchemaDeserializer to not rely on reflection

2021-06-24 Thread GitBox
vinothchandar commented on a change in pull request #3111: URL: https://github.com/apache/hudi/pull/3111#discussion_r658274376 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/KafkaOffsetGen.java ## @@ -176,7 +176,9 @@ public

[GitHub] [hudi] vinothchandar commented on a change in pull request #3111: [HUDI-2069] Fix KafkaAvroSchemaDeserializer to not rely on reflection

2021-06-24 Thread GitBox
vinothchandar commented on a change in pull request #3111: URL: https://github.com/apache/hudi/pull/3111#discussion_r658273889 ## File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala ## @@ -382,8 +382,6 @@ object

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3097: [HUDI-1996] Adding functionality to allow the providing of basic auth creds for confluent cloud schema registry

2021-06-24 Thread GitBox
codecov-commenter edited a comment on pull request #3097: URL: https://github.com/apache/hudi/pull/3097#issuecomment-862839067 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3097: [HUDI-1996] Adding functionality to allow the providing of basic auth creds for confluent cloud schema registry

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #3097: URL: https://github.com/apache/hudi/pull/3097#issuecomment-862822918 ## CI report: * 10c79acd28075b0e7b7351e5ffb1378c522527aa Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3097: [HUDI-1996] Adding functionality to allow the providing of basic auth creds for confluent cloud schema registry

2021-06-24 Thread GitBox
codecov-commenter edited a comment on pull request #3097: URL: https://github.com/apache/hudi/pull/3097#issuecomment-862839067 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3097: [HUDI-1996] Adding functionality to allow the providing of basic auth creds for confluent cloud schema registry

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #3097: URL: https://github.com/apache/hudi/pull/3097#issuecomment-862822918 ## CI report: * 75d4a7114e7541fd23297a0c4aab381327da5a69 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3097: [HUDI-1996] Adding functionality to allow the providing of basic auth creds for confluent cloud schema registry

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #3097: URL: https://github.com/apache/hudi/pull/3097#issuecomment-862822918 ## CI report: * 75d4a7114e7541fd23297a0c4aab381327da5a69 Azure:

[jira] [Updated] (HUDI-2070) Adding .asf.yaml file for web site publishing as per directives

2021-06-24 Thread Navinder Brar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navinder Brar updated HUDI-2070: Summary: Adding .asf.yaml file for web site publishing as per directives (was: Adding .asf.yaml

[jira] [Updated] (HUDI-2070) Adding .asf.yaml file for web site publishing

2021-06-24 Thread Navinder Brar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navinder Brar updated HUDI-2070: Description: Hudi uses git for project web site and is not deployed via .asf.yaml. We need to

[jira] [Updated] (HUDI-2070) Adding .asf.yaml file for web site publishing

2021-06-24 Thread Navinder Brar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navinder Brar updated HUDI-2070: Priority: Major (was: Blocker) > Adding .asf.yaml file for web site publishing >

[jira] [Created] (HUDI-2070) Adding .asf.yaml file for web site publishing

2021-06-24 Thread Navinder Brar (Jira)
Navinder Brar created HUDI-2070: --- Summary: Adding .asf.yaml file for web site publishing Key: HUDI-2070 URL: https://issues.apache.org/jira/browse/HUDI-2070 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-2070) Adding .asf.yaml file for web site publishing

2021-06-24 Thread Navinder Brar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navinder Brar updated HUDI-2070: Issue Type: New Feature (was: Improvement) > Adding .asf.yaml file for web site publishing >

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3097: [HUDI-1996] Adding functionality to allow the providing of basic auth creds for confluent cloud schema registry

2021-06-24 Thread GitBox
codecov-commenter edited a comment on pull request #3097: URL: https://github.com/apache/hudi/pull/3097#issuecomment-862839067 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3097: [HUDI-1996] Adding functionality to allow the providing of basic auth creds for confluent cloud schema registry

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #3097: URL: https://github.com/apache/hudi/pull/3097#issuecomment-862822918 ## CI report: * 75d4a7114e7541fd23297a0c4aab381327da5a69 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2542: Add ability to provide multi-region (global) data consistency across HMS in different regions

2021-06-24 Thread GitBox
codecov-commenter edited a comment on pull request #2542: URL: https://github.com/apache/hudi/pull/2542#issuecomment-849630457 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3097: [HUDI-1996] Adding functionality to allow the providing of basic auth creds for confluent cloud schema registry

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #3097: URL: https://github.com/apache/hudi/pull/3097#issuecomment-862822918 ## CI report: * 5cfa5f10483f81338814037045dc8974cd3a50f8 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2542: Add ability to provide multi-region (global) data consistency across HMS in different regions

2021-06-24 Thread GitBox
codecov-commenter edited a comment on pull request #2542: URL: https://github.com/apache/hudi/pull/2542#issuecomment-849630457 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3097: [HUDI-1996] Adding functionality to allow the providing of basic auth creds for confluent cloud schema registry

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #3097: URL: https://github.com/apache/hudi/pull/3097#issuecomment-862822918 ## CI report: * 5cfa5f10483f81338814037045dc8974cd3a50f8 Azure:

[jira] [Closed] (HUDI-2066) Fix flaky test: HoodieSparkSqlWriterSuite.test schema evolution

2021-06-24 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-2066. - Resolution: Fixed > Fix flaky test: HoodieSparkSqlWriterSuite.test schema evolution >

[jira] [Updated] (HUDI-2066) Fix flaky test: HoodieSparkSqlWriterSuite.test schema evolution

2021-06-24 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2066: -- Status: Closed (was: Patch Available) > Fix flaky test: HoodieSparkSqlWriterSuite.test

[jira] [Updated] (HUDI-2066) Fix flaky test: HoodieSparkSqlWriterSuite.test schema evolution

2021-06-24 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2066: -- Status: In Progress (was: Open) > Fix flaky test: HoodieSparkSqlWriterSuite.test

[jira] [Updated] (HUDI-2066) Fix flaky test: HoodieSparkSqlWriterSuite.test schema evolution

2021-06-24 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2066: -- Fix Version/s: 0.9.0 > Fix flaky test: HoodieSparkSqlWriterSuite.test schema evolution

[jira] [Reopened] (HUDI-2066) Fix flaky test: HoodieSparkSqlWriterSuite.test schema evolution

2021-06-24 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reopened HUDI-2066: --- > Fix flaky test: HoodieSparkSqlWriterSuite.test schema evolution >

[jira] [Updated] (HUDI-2066) Fix flaky test: HoodieSparkSqlWriterSuite.test schema evolution

2021-06-24 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2066: -- Status: Patch Available (was: In Progress) > Fix flaky test:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3100: [HUDI-2034] Support explicit partition compaction strategy for flink …

2021-06-24 Thread GitBox
codecov-commenter edited a comment on pull request #3100: URL: https://github.com/apache/hudi/pull/3100#issuecomment-862906759 #

[GitHub] [hudi] nsivabalan commented on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction

2021-06-24 Thread GitBox
nsivabalan commented on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-867786135 There are some checkstyle issues reported by CI. Can you please look into fixing -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hudi] nsivabalan commented on pull request #3128: [HUDI-2029] Implement compression for DiskBasedMap in Spillable Map

2021-06-24 Thread GitBox
nsivabalan commented on pull request #3128: URL: https://github.com/apache/hudi/pull/3128#issuecomment-867784936 Looks like there are some checkstyle issues. Can you please look into it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hudi] nsivabalan commented on pull request #3120: [HUDI-2045] Support Read Hoodie As DataSource Table For Flink And Del…

2021-06-24 Thread GitBox
nsivabalan commented on pull request #3120: URL: https://github.com/apache/hudi/pull/3120#issuecomment-867783069 @pengzhiwei2018 : Looks like an integ test is failing. Can you please check that out ITTestHoodieDemo.testParquetDemo -- This is an automated message from the Apache

[GitHub] [hudi] nsivabalan commented on pull request #3108: [HUDI-2042] Compare the field object directly in OverwriteWithLatestA…

2021-06-24 Thread GitBox
nsivabalan commented on pull request #3108: URL: https://github.com/apache/hudi/pull/3108#issuecomment-867775132 Looks like existing tests are failing. Can please you fix those. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hudi] sbernauer commented on a change in pull request #3111: [HUDI-2069] Fix KafkaAvroSchemaDeserializer to not rely on reflection

2021-06-24 Thread GitBox
sbernauer commented on a change in pull request #3111: URL: https://github.com/apache/hudi/pull/3111#discussion_r658093617 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/KafkaOffsetGen.java ## @@ -176,7 +176,9 @@ public

[GitHub] [hudi] sbernauer commented on a change in pull request #3111: [HUDI-2069] Fix KafkaAvroSchemaDeserializer to not rely on reflection

2021-06-24 Thread GitBox
sbernauer commented on a change in pull request #3111: URL: https://github.com/apache/hudi/pull/3111#discussion_r658090982 ## File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala ## @@ -382,8 +382,6 @@ object

[GitHub] [hudi] sbernauer commented on a change in pull request #3111: [HUDI-2069] Fix KafkaAvroSchemaDeserializer to not rely on reflection

2021-06-24 Thread GitBox
sbernauer commented on a change in pull request #3111: URL: https://github.com/apache/hudi/pull/3111#discussion_r658090982 ## File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala ## @@ -382,8 +382,6 @@ object

[GitHub] [hudi] hudi-bot edited a comment on pull request #2542: Add ability to provide multi-region (global) data consistency across HMS in different regions

2021-06-24 Thread GitBox
hudi-bot edited a comment on pull request #2542: URL: https://github.com/apache/hudi/pull/2542#issuecomment-861653385 ## CI report: * 436fadc5b76fce640dd8f71764fbfad32de758d9 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction

2021-06-24 Thread GitBox
codecov-commenter edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-866110119 #

[GitHub] [hudi] nsivabalan commented on a change in pull request #3111: [HUDI-2069] Fix KafkaAvroSchemaDeserializer to not rely on reflection

2021-06-24 Thread GitBox
nsivabalan commented on a change in pull request #3111: URL: https://github.com/apache/hudi/pull/3111#discussion_r658063310 ## File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala ## @@ -382,8 +382,6 @@ object

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3097: [HUDI-1996] Adding functionality to allow the providing of basic auth creds for confluent cloud schema registry

2021-06-24 Thread GitBox
codecov-commenter edited a comment on pull request #3097: URL: https://github.com/apache/hudi/pull/3097#issuecomment-862839067 #

[GitHub] [hudi] vinothchandar commented on a change in pull request #3111: [HUDI-2069] Fix KafkaAvroSchemaDeserializer to not rely on reflection

2021-06-24 Thread GitBox
vinothchandar commented on a change in pull request #3111: URL: https://github.com/apache/hudi/pull/3111#discussion_r658037497 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/KafkaOffsetGen.java ## @@ -176,7 +176,9 @@ public

  1   2   3   >