[GitHub] [hudi] tandonraghav commented on issue #3078: [SUPPORT] combineAndGetUpdateValue is not getting called when Schema evolution happens

2021-06-22 Thread GitBox
tandonraghav commented on issue #3078: URL: https://github.com/apache/hudi/issues/3078#issuecomment-866269573 @n3nash I am trying to implement exactly `https://github.com/apache/hudi/pull/2106/files` , in this also `PartialAvroPayload` class only implements `combineAndGetUpdateValue` .

[GitHub] [hudi] vinothchandar commented on pull request #2701: [HUDI 1623] New Hoodie Instant on disk format with end time and milliseconds granularity

2021-06-22 Thread GitBox
vinothchandar commented on pull request #2701: URL: https://github.com/apache/hudi/pull/2701#issuecomment-866298936 @prashantwason could you review this and see if you can land. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot commented on pull request #2701: [HUDI 1623] New Hoodie Instant on disk format with end time and milliseconds granularity

2021-06-22 Thread GitBox
hudi-bot commented on pull request #2701: URL: https://github.com/apache/hudi/pull/2701#issuecomment-866299648 ## CI report: * cf79ca863369d8d7326ade272da67ca63a42bad8 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] hudi-bot edited a comment on pull request #3074: [HUDI-2007] Fixing hudi_test_suite for spark nodes and adding spark bulk_insert node

2021-06-22 Thread GitBox
hudi-bot edited a comment on pull request #3074: URL: https://github.com/apache/hudi/pull/3074#issuecomment-861653947 ## CI report: * 2e782acd2f3d8f79d2014875cddf69a62f736a54 Azure:

[GitHub] [hudi] nsivabalan commented on a change in pull request #3074: [HUDI-2007] Fixing hudi_test_suite for spark nodes and adding spark bulk_insert node

2021-06-22 Thread GitBox
nsivabalan commented on a change in pull request #3074: URL: https://github.com/apache/hudi/pull/3074#discussion_r656538309 ## File path: hudi-integ-test/pom.xml ## @@ -407,7 +407,46 @@ + Review comment: scala classes were not part of build output if not

[jira] [Updated] (HUDI-1839) FSUtils getAllPartitions broken by NotSerializableException: org.apache.hadoop.fs.Path

2021-06-22 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1839: -- Fix Version/s: 0.9.0 > FSUtils getAllPartitions broken by NotSerializableException: >

[jira] [Commented] (HUDI-1839) FSUtils getAllPartitions broken by NotSerializableException: org.apache.hadoop.fs.Path

2021-06-22 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17367647#comment-17367647 ] Nishith Agarwal commented on HUDI-1839: --- [~pwason] Is this something that we have identified the

[jira] [Updated] (HUDI-1839) FSUtils getAllPartitions broken by NotSerializableException: org.apache.hadoop.fs.Path

2021-06-22 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1839: -- Priority: Blocker (was: Major) > FSUtils getAllPartitions broken by NotSerializableException:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3074: [HUDI-2007] Fixing hudi_test_suite for spark nodes and adding spark bulk_insert node

2021-06-22 Thread GitBox
hudi-bot edited a comment on pull request #3074: URL: https://github.com/apache/hudi/pull/3074#issuecomment-861653947 ## CI report: * 2e782acd2f3d8f79d2014875cddf69a62f736a54 Azure:

[GitHub] [hudi] codecov-commenter commented on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

2021-06-22 Thread GitBox
codecov-commenter commented on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3135?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation)

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3129: [HUDI-2055] Added metric for time of lastSync

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3129: URL: https://github.com/apache/hudi/pull/3129#issuecomment-865650383 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3130: [HUDI-1826] Add ORC support in HoodieSnapshotExporter

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3130: URL: https://github.com/apache/hudi/pull/3130#issuecomment-865672234 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #2701: [HUDI 1623] New Hoodie Instant on disk format with end time and milliseconds granularity

2021-06-22 Thread GitBox
hudi-bot edited a comment on pull request #2701: URL: https://github.com/apache/hudi/pull/2701#issuecomment-866299648 ## CI report: * cf79ca863369d8d7326ade272da67ca63a42bad8 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3084: [HUDI-2017] Add API to set a metric in the registry.

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3084: URL: https://github.com/apache/hudi/pull/3084#issuecomment-861292418 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3105: [HUDI-2038] Support rollback inflight compaction instances for CompactionPlanOperator

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3105: URL: https://github.com/apache/hudi/pull/3105#issuecomment-863292214 #

[GitHub] [hudi] nsivabalan commented on pull request #3074: [HUDI-2007] Fixing hudi_test_suite for spark nodes and adding spark bulk_insert node

2021-06-22 Thread GitBox
nsivabalan commented on pull request #3074: URL: https://github.com/apache/hudi/pull/3074#issuecomment-866292959 @n3nash wrt comment "Also, please rename the title to "Adding bulk_insert spark node to hudi_test_suite". Fixing gives a wrong context here.". As I have responded to your

[GitHub] [hudi] hudi-bot edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

2021-06-22 Thread GitBox
hudi-bot edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865758353 ## CI report: * 49c13d34df195890cb258e8ca654bce3a7a2714a Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3129: [HUDI-2055] Added metric for time of lastSync

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3129: URL: https://github.com/apache/hudi/pull/3129#issuecomment-865650383 #

[GitHub] [hudi] nsivabalan commented on a change in pull request #3075: [HUDI-2009] Fixing extra commit metadata in row writer path

2021-06-22 Thread GitBox
nsivabalan commented on a change in pull request #3075: URL: https://github.com/apache/hudi/pull/3075#discussion_r656537913 ## File path: hudi-spark-datasource/hudi-spark-common/src/main/java/org/apache/hudi/internal/DataSourceInternalWriterHelper.java ## @@ -31,15 +31,17 @@

[GitHub] [hudi] nsivabalan commented on a change in pull request #2903: [HUDI-1850] Fixing read of a empty table but with failed write

2021-06-22 Thread GitBox
nsivabalan commented on a change in pull request #2903: URL: https://github.com/apache/hudi/pull/2903#discussion_r656545767 ## File path: hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/functional/HoodieSparkSqlWriterSuite.scala ## @@ -229,7 +231,42 @@ class

[GitHub] [hudi] hudi-bot edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

2021-06-22 Thread GitBox
hudi-bot edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865758353 ## CI report: * 56300526602d1eccfe7f64720e9b4d25db6cef64 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3130: [HUDI-1826] Add ORC support in HoodieSnapshotExporter

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3130: URL: https://github.com/apache/hudi/pull/3130#issuecomment-865672234 #

[GitHub] [hudi] nsivabalan commented on a change in pull request #3108: [HUDI-2042] Compare the field object directly in OverwriteWithLatestA…

2021-06-22 Thread GitBox
nsivabalan commented on a change in pull request #3108: URL: https://github.com/apache/hudi/pull/3108#discussion_r656526739 ## File path: hudi-common/src/main/java/org/apache/hudi/common/model/OverwriteWithLatestAvroPayload.java ## @@ -94,6 +94,6 @@ protected boolean

[GitHub] [hudi] tandonraghav edited a comment on issue #3078: [SUPPORT] combineAndGetUpdateValue is not getting called when Schema evolution happens

2021-06-22 Thread GitBox
tandonraghav edited a comment on issue #3078: URL: https://github.com/apache/hudi/issues/3078#issuecomment-866269573 @n3nash I am trying to implement exactly `https://github.com/apache/hudi/pull/2106/files` , in this also `PartialAvroPayload` class only implements

[GitHub] [hudi] nsivabalan commented on a change in pull request #3074: [HUDI-2007] Fixing hudi_test_suite for spark nodes and adding spark bulk_insert node

2021-06-22 Thread GitBox
nsivabalan commented on a change in pull request #3074: URL: https://github.com/apache/hudi/pull/3074#discussion_r656542270 ## File path: hudi-integ-test/src/main/java/org/apache/hudi/integ/testsuite/configuration/DeltaConfig.java ## @@ -189,6 +190,10 @@ public boolean

[jira] [Commented] (HUDI-1839) FSUtils getAllPartitions broken by NotSerializableException: org.apache.hadoop.fs.Path

2021-06-22 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17367656#comment-17367656 ] Udit Mehrotra commented on HUDI-1839: - [~satishkotha] Were you using Kryo serializer while doing this

[GitHub] [hudi] hudi-bot edited a comment on pull request #3074: [HUDI-2007] Fixing hudi_test_suite for spark nodes and adding spark bulk_insert node

2021-06-22 Thread GitBox
hudi-bot edited a comment on pull request #3074: URL: https://github.com/apache/hudi/pull/3074#issuecomment-861653947 ## CI report: * 37197b78a1a8ead38d37a760df920cb53ec451de Azure:

[GitHub] [hudi] nsivabalan commented on pull request #3111: Fix KafkaAvroSchemaDeserializer to not rely on reflection

2021-06-22 Thread GitBox
nsivabalan commented on pull request #3111: URL: https://github.com/apache/hudi/pull/3111#issuecomment-866384611 awesome  Can you please check why CI is failing. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hudi] yanghua closed pull request #3130: [HUDI-1826] Add ORC support in HoodieSnapshotExporter

2021-06-22 Thread GitBox
yanghua closed pull request #3130: URL: https://github.com/apache/hudi/pull/3130 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3130: [HUDI-1826] Add ORC support in HoodieSnapshotExporter

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3130: URL: https://github.com/apache/hudi/pull/3130#issuecomment-865672234 #

[GitHub] [hudi] danny0405 closed pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

2021-06-22 Thread GitBox
danny0405 closed pull request #3135: URL: https://github.com/apache/hudi/pull/3135 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[jira] [Commented] (HUDI-1542) Fix Flaky test : TestHoodieMetadata#testSync

2021-06-22 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17367808#comment-17367808 ] Nishith Agarwal commented on HUDI-1542: --- [~pwason] Will take this up next week. > Fix Flaky test :

[jira] [Commented] (HUDI-1537) Move validation of file listings to something that happens before each write

2021-06-22 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17367807#comment-17367807 ] Nishith Agarwal commented on HUDI-1537: --- This logic is being removed. Additionally, falling back to

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3100: [HUDI-2034] Support explicit partition compaction strategy for flink …

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3100: URL: https://github.com/apache/hudi/pull/3100#issuecomment-862906759 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

2021-06-22 Thread GitBox
hudi-bot edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865758353 ## CI report: * 56300526602d1eccfe7f64720e9b4d25db6cef64 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865868967 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] danny0405 closed pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

2021-06-22 Thread GitBox
danny0405 closed pull request #3135: URL: https://github.com/apache/hudi/pull/3135 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] hudi-bot edited a comment on pull request #3105: [HUDI-2038] Support rollback inflight compaction instances for CompactionPlanOperator

2021-06-22 Thread GitBox
hudi-bot edited a comment on pull request #3105: URL: https://github.com/apache/hudi/pull/3105#issuecomment-863188980 ## CI report: * 0cd7cd2b1b1eefce813de9d7d7b3dc00835f44a7 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction

2021-06-22 Thread GitBox
hudi-bot edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-865885733 ## CI report: * 31e04ecbeb122113dd074f7abdef44eda1fdab44 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction

2021-06-22 Thread GitBox
hudi-bot edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-865885733 ## CI report: * 31e04ecbeb122113dd074f7abdef44eda1fdab44 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] n3nash closed issue #3048: [SUPPORT]delta streamer run bootstrap from one hudi table to another error .parquet is not a Parquet file. expected magic number at tail

2021-06-22 Thread GitBox
n3nash closed issue #3048: URL: https://github.com/apache/hudi/issues/3048 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact

[GitHub] [hudi] n3nash commented on issue #3048: [SUPPORT]delta streamer run bootstrap from one hudi table to another error .parquet is not a Parquet file. expected magic number at tail

2021-06-22 Thread GitBox
n3nash commented on issue #3048: URL: https://github.com/apache/hudi/issues/3048#issuecomment-866463882 @fengjian428 Closing this due to inactivity. Please feel free to re-open if you need assistance. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] hudi-bot edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

2021-06-22 Thread GitBox
hudi-bot edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865758353 ## CI report: * 56300526602d1eccfe7f64720e9b4d25db6cef64 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3105: [HUDI-2038] Support rollback inflight compaction instances for CompactionPlanOperator

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3105: URL: https://github.com/apache/hudi/pull/3105#issuecomment-863292214 #

[GitHub] [hudi] yanghua commented on pull request #3130: [HUDI-1826] Add ORC support in HoodieSnapshotExporter

2021-06-22 Thread GitBox
yanghua commented on pull request #3130: URL: https://github.com/apache/hudi/pull/3130#issuecomment-866453190 reopen to retrigger the CI. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3100: [HUDI-2034] Support explicit partition compaction strategy for flink …

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3100: URL: https://github.com/apache/hudi/pull/3100#issuecomment-862906759 #

[jira] [Assigned] (HUDI-2057) CTAS Generate An External Table When Create Managed Table

2021-06-22 Thread pengzhiwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pengzhiwei reassigned HUDI-2057: Assignee: pengzhiwei > CTAS Generate An External Table When Create Managed Table >

[jira] [Created] (HUDI-2057) CTAS Generate An External Table When Create Managed Table

2021-06-22 Thread pengzhiwei (Jira)
pengzhiwei created HUDI-2057: Summary: CTAS Generate An External Table When Create Managed Table Key: HUDI-2057 URL: https://issues.apache.org/jira/browse/HUDI-2057 Project: Apache Hudi Issue

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3105: [HUDI-2038] Support rollback inflight compaction instances for CompactionPlanOperator

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3105: URL: https://github.com/apache/hudi/pull/3105#issuecomment-863292214 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3105: [HUDI-2038] Support rollback inflight compaction instances for CompactionPlanOperator

2021-06-22 Thread GitBox
hudi-bot edited a comment on pull request #3105: URL: https://github.com/apache/hudi/pull/3105#issuecomment-863188980 ## CI report: * 0cd7cd2b1b1eefce813de9d7d7b3dc00835f44a7 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 #

[GitHub] [hudi] nsivabalan commented on pull request #2903: [HUDI-1850] Fixing read of a empty table but with failed write

2021-06-22 Thread GitBox
nsivabalan commented on pull request #2903: URL: https://github.com/apache/hudi/pull/2903#issuecomment-866310217 SQL DML extension tests are failing. I need time to check those out. Will update once I am able to make CI happy. -- This is an automated message from the Apache Git

[GitHub] [hudi] sbernauer commented on pull request #3111: Fix KafkaAvroSchemaDeserializer to not rely on reflection

2021-06-22 Thread GitBox
sbernauer commented on pull request #3111: URL: https://github.com/apache/hudi/pull/3111#issuecomment-866347883 Yes, we tested it on our staging env for multiple streaming jobs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hudi] danny0405 closed pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

2021-06-22 Thread GitBox
danny0405 closed pull request #3135: URL: https://github.com/apache/hudi/pull/3135 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865868967 #

[jira] [Created] (HUDI-2058) support incremental query for insert_overwrite_table/insert_overwrite operation on cow table

2021-06-22 Thread tao meng (Jira)
tao meng created HUDI-2058: -- Summary: support incremental query for insert_overwrite_table/insert_overwrite operation on cow table Key: HUDI-2058 URL: https://issues.apache.org/jira/browse/HUDI-2058

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3074: [HUDI-2007] Fixing hudi_test_suite for spark nodes and adding spark bulk_insert node

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3074: URL: https://github.com/apache/hudi/pull/3074#issuecomment-860337193 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865868967 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

2021-06-22 Thread GitBox
hudi-bot edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865758353 ## CI report: * f69fed2fd3de9550531afe5c50887976f1b249e0 Azure:

[jira] [Updated] (HUDI-1896) [UMBRELLA] Implement DeltaStreamer Source for cloud object stores

2021-06-22 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1896: - Description: As discussed in HUDI-1723, we need a better implementation for Cloud object storage

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 #

[GitHub] [hudi] swuferhong closed pull request #3100: [HUDI-2034] Support explicit partition compaction strategy for flink …

2021-06-22 Thread GitBox
swuferhong closed pull request #3100: URL: https://github.com/apache/hudi/pull/3100 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[jira] [Assigned] (HUDI-1077) Integration tests to validate clustering

2021-06-22 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal reassigned HUDI-1077: - Assignee: satish > Integration tests to validate clustering >

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3100: [HUDI-2034] Support explicit partition compaction strategy for flink …

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3100: URL: https://github.com/apache/hudi/pull/3100#issuecomment-862906759 #

[jira] [Commented] (HUDI-1492) Handle DeltaWriteStat correctly for storage schemes that support appends

2021-06-22 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17367806#comment-17367806 ] Nishith Agarwal commented on HUDI-1492: --- Confirmed with [~pwason] that this does not affect

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3130: [HUDI-1826] Add ORC support in HoodieSnapshotExporter

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3130: URL: https://github.com/apache/hudi/pull/3130#issuecomment-865672234 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-866110119 #

[GitHub] [hudi] vinothchandar commented on a change in pull request #3092: [HUDI-1910] Commit Offset to Kafka after successful Hudi commit

2021-06-22 Thread GitBox
vinothchandar commented on a change in pull request #3092: URL: https://github.com/apache/hudi/pull/3092#discussion_r656753261 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/KafkaOffsetGen.java ## @@ -157,29 +161,23 @@ public static long

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-866110119 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

2021-06-22 Thread GitBox
hudi-bot edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865758353 ## CI report: * f69fed2fd3de9550531afe5c50887976f1b249e0 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865868967 #

[GitHub] [hudi] danny0405 closed pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

2021-06-22 Thread GitBox
danny0405 closed pull request #3135: URL: https://github.com/apache/hudi/pull/3135 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] n3nash merged pull request #3050: [HUDI-1988] FinalizeWrite() been executed twice in AbstractHoodieWrit…

2021-06-22 Thread GitBox
n3nash merged pull request #3050: URL: https://github.com/apache/hudi/pull/3050 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[hudi] branch master updated (11e64b2 -> 3fb59dd)

2021-06-22 Thread nagarwal
This is an automated email from the ASF dual-hosted git repository. nagarwal pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 11e64b2 [HUDI-1717] Metadata Reader should merge all the un-synced but complete instants from the dataset

[GitHub] [hudi] guanziyue edited a comment on issue #3078: [SUPPORT] combineAndGetUpdateValue is not getting called when Schema evolution happens

2021-06-22 Thread GitBox
guanziyue edited a comment on issue #3078: URL: https://github.com/apache/hudi/issues/3078#issuecomment-866499977 Hi tandonraghav I did some similar work before. Hope my experience could help you. First, as nanash mentioned before, we may call precombine method in two cases. First is

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3105: [HUDI-2038] Support rollback inflight compaction instances for CompactionPlanOperator

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3105: URL: https://github.com/apache/hudi/pull/3105#issuecomment-863292214 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865868967 #

[GitHub] [hudi] veenaypatil commented on a change in pull request #3092: [HUDI-1910] Commit Offset to Kafka after successful Hudi commit

2021-06-22 Thread GitBox
veenaypatil commented on a change in pull request #3092: URL: https://github.com/apache/hudi/pull/3092#discussion_r656757106 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/KafkaOffsetGen.java ## @@ -157,29 +161,23 @@ public static long

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865868967 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865868967 #

[GitHub] [hudi] veenaypatil commented on a change in pull request #3092: [HUDI-1910] Commit Offset to Kafka after successful Hudi commit

2021-06-22 Thread GitBox
veenaypatil commented on a change in pull request #3092: URL: https://github.com/apache/hudi/pull/3092#discussion_r656759751 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/DeltaSync.java ## @@ -473,7 +476,9 @@ public void refreshTimeline()

[GitHub] [hudi] danny0405 closed pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

2021-06-22 Thread GitBox
danny0405 closed pull request #3135: URL: https://github.com/apache/hudi/pull/3135 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[jira] [Commented] (HUDI-1482) async clustering for spark streaming

2021-06-22 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17367874#comment-17367874 ] Vinoth Chandar commented on HUDI-1482: -- [~codope] is looking into this. mind if he grabs it.

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 #

[GitHub] [hudi] guanziyue edited a comment on issue #3078: [SUPPORT] combineAndGetUpdateValue is not getting called when Schema evolution happens

2021-06-22 Thread GitBox
guanziyue edited a comment on issue #3078: URL: https://github.com/apache/hudi/issues/3078#issuecomment-866499977 Hi tandonraghav I did some similar work before. Hope my experience could help you. First, as nanash mentioned before, we may call precombine method in two cases. First is

[GitHub] [hudi] hudi-bot edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

2021-06-22 Thread GitBox
hudi-bot edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865758353 ## CI report: * f69fed2fd3de9550531afe5c50887976f1b249e0 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction

2021-06-22 Thread GitBox
hudi-bot edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-865885733 ## CI report: * 886976b7067dc3062b6d465f6d962c3b7db012a0 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

2021-06-22 Thread GitBox
codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 #

[jira] [Created] (HUDI-2059) When log exists in mor table, clustering is triggered. The query result shows that the update record in log is lost

2021-06-22 Thread tao meng (Jira)
tao meng created HUDI-2059: -- Summary: When log exists in mor table, clustering is triggered. The query result shows that the update record in log is lost Key: HUDI-2059 URL:

[GitHub] [hudi] guanziyue commented on issue #3078: [SUPPORT] combineAndGetUpdateValue is not getting called when Schema evolution happens

2021-06-22 Thread GitBox
guanziyue commented on issue #3078: URL: https://github.com/apache/hudi/issues/3078#issuecomment-866499977 Hi tandonraghav I did some similar work before. Hope my experience could help you. First, as nanash mentioned before, we may call precombine method in two cases. First is dedup

[GitHub] [hudi] hudi-bot edited a comment on pull request #3105: [HUDI-2038] Support rollback inflight compaction instances for CompactionPlanOperator

2021-06-22 Thread GitBox
hudi-bot edited a comment on pull request #3105: URL: https://github.com/apache/hudi/pull/3105#issuecomment-863188980 ## CI report: * edbd869ef0057cf18caaa643ccb61cb7371a5f20 Azure:

  1   2   3   4   >