[hudi] branch master updated (11e64b2 -> 3fb59dd)

This is an automated email from the ASF dual-hosted git repository. nagarwal pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 11e64b2 [HUDI-1717] Metadata Reader should merge all the un-synced but complete instants from the dataset

[GitHub] [hudi] n3nash merged pull request #3050: [HUDI-1988] FinalizeWrite() been executed twice in AbstractHoodieWrit…

n3nash merged pull request #3050: URL: https://github.com/apache/hudi/pull/3050 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 #

[GitHub] [hudi] danny0405 closed pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

danny0405 closed pull request #3135: URL: https://github.com/apache/hudi/pull/3135 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[jira] [Commented] (HUDI-1482) async clustering for spark streaming

[ https://issues.apache.org/jira/browse/HUDI-1482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17367874#comment-17367874 ] Vinoth Chandar commented on HUDI-1482: -- [~codope] is looking into this. mind if he grabs it.

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

hudi-bot edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865758353 ## CI report: * a3c0b1b37a806a5df7e3b21f00670c8b623b4f0d Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

codecov-commenter edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865868967 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

codecov-commenter edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865868967 #

[GitHub] [hudi] veenaypatil commented on a change in pull request #3092: [HUDI-1910] Commit Offset to Kafka after successful Hudi commit

veenaypatil commented on a change in pull request #3092: URL: https://github.com/apache/hudi/pull/3092#discussion_r656759751 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/DeltaSync.java ## @@ -473,7 +476,9 @@ public void refreshTimeline()

[GitHub] [hudi] veenaypatil commented on a change in pull request #3092: [HUDI-1910] Commit Offset to Kafka after successful Hudi commit

veenaypatil commented on a change in pull request #3092: URL: https://github.com/apache/hudi/pull/3092#discussion_r656757106 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/KafkaOffsetGen.java ## @@ -157,29 +161,23 @@ public static long

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 #

[GitHub] [hudi] vinothchandar commented on a change in pull request #3092: [HUDI-1910] Commit Offset to Kafka after successful Hudi commit

vinothchandar commented on a change in pull request #3092: URL: https://github.com/apache/hudi/pull/3092#discussion_r656753261 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/KafkaOffsetGen.java ## @@ -157,29 +161,23 @@ public static long

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

codecov-commenter edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865868967 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction

hudi-bot edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-865885733 ## CI report: * 886976b7067dc3062b6d465f6d962c3b7db012a0 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3105: [HUDI-2038] Support rollback inflight compaction instances for CompactionPlanOperator

hudi-bot edited a comment on pull request #3105: URL: https://github.com/apache/hudi/pull/3105#issuecomment-863188980 ## CI report: * edbd869ef0057cf18caaa643ccb61cb7371a5f20 Azure:

[GitHub] [hudi] danny0405 closed pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

danny0405 closed pull request #3135: URL: https://github.com/apache/hudi/pull/3135 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

hudi-bot edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865758353 ## CI report: * f69fed2fd3de9550531afe5c50887976f1b249e0 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

codecov-commenter edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865868967 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

hudi-bot edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865758353 ## CI report: * f69fed2fd3de9550531afe5c50887976f1b249e0 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction

codecov-commenter edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-866110119 #

[GitHub] [hudi] guanziyue edited a comment on issue #3078: [SUPPORT] combineAndGetUpdateValue is not getting called when Schema evolution happens

guanziyue edited a comment on issue #3078: URL: https://github.com/apache/hudi/issues/3078#issuecomment-866499977 Hi tandonraghav I did some similar work before. Hope my experience could help you. First, as nanash mentioned before, we may call precombine method in two cases. First is

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3105: [HUDI-2038] Support rollback inflight compaction instances for CompactionPlanOperator

codecov-commenter edited a comment on pull request #3105: URL: https://github.com/apache/hudi/pull/3105#issuecomment-863292214 #

[GitHub] [hudi] guanziyue edited a comment on issue #3078: [SUPPORT] combineAndGetUpdateValue is not getting called when Schema evolution happens

guanziyue edited a comment on issue #3078: URL: https://github.com/apache/hudi/issues/3078#issuecomment-866499977 Hi tandonraghav I did some similar work before. Hope my experience could help you. First, as nanash mentioned before, we may call precombine method in two cases. First is

[jira] [Created] (HUDI-2059) When log exists in mor table, clustering is triggered. The query result shows that the update record in log is lost

tao meng created HUDI-2059: -- Summary: When log exists in mor table, clustering is triggered. The query result shows that the update record in log is lost Key: HUDI-2059 URL:

[GitHub] [hudi] guanziyue commented on issue #3078: [SUPPORT] combineAndGetUpdateValue is not getting called when Schema evolution happens

guanziyue commented on issue #3078: URL: https://github.com/apache/hudi/issues/3078#issuecomment-866499977 Hi tandonraghav I did some similar work before. Hope my experience could help you. First, as nanash mentioned before, we may call precombine method in two cases. First is dedup

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction

codecov-commenter edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-866110119 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction

hudi-bot edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-865885733 ## CI report: * 31e04ecbeb122113dd074f7abdef44eda1fdab44 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3105: [HUDI-2038] Support rollback inflight compaction instances for CompactionPlanOperator

hudi-bot edited a comment on pull request #3105: URL: https://github.com/apache/hudi/pull/3105#issuecomment-863188980 ## CI report: * 0cd7cd2b1b1eefce813de9d7d7b3dc00835f44a7 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3105: [HUDI-2038] Support rollback inflight compaction instances for CompactionPlanOperator

codecov-commenter edited a comment on pull request #3105: URL: https://github.com/apache/hudi/pull/3105#issuecomment-863292214 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction

hudi-bot edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-865885733 ## CI report: * 31e04ecbeb122113dd074f7abdef44eda1fdab44 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3105: [HUDI-2038] Support rollback inflight compaction instances for CompactionPlanOperator

hudi-bot edited a comment on pull request #3105: URL: https://github.com/apache/hudi/pull/3105#issuecomment-863188980 ## CI report: * 0cd7cd2b1b1eefce813de9d7d7b3dc00835f44a7 Azure:

[GitHub] [hudi] danny0405 closed pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

danny0405 closed pull request #3135: URL: https://github.com/apache/hudi/pull/3135 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[jira] [Created] (HUDI-2058) support incremental query for insert_overwrite_table/insert_overwrite operation on cow table

tao meng created HUDI-2058: -- Summary: support incremental query for insert_overwrite_table/insert_overwrite operation on cow table Key: HUDI-2058 URL: https://issues.apache.org/jira/browse/HUDI-2058

[GitHub] [hudi] hudi-bot edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

hudi-bot edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865758353 ## CI report: * f69fed2fd3de9550531afe5c50887976f1b249e0 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

codecov-commenter edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865868967 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Assigned] (HUDI-2057) CTAS Generate An External Table When Create Managed Table

[ https://issues.apache.org/jira/browse/HUDI-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pengzhiwei reassigned HUDI-2057: Assignee: pengzhiwei > CTAS Generate An External Table When Create Managed Table >

[jira] [Created] (HUDI-2057) CTAS Generate An External Table When Create Managed Table

pengzhiwei created HUDI-2057: Summary: CTAS Generate An External Table When Create Managed Table Key: HUDI-2057 URL: https://issues.apache.org/jira/browse/HUDI-2057 Project: Apache Hudi Issue

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

codecov-commenter edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865868967 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3130: [HUDI-1826] Add ORC support in HoodieSnapshotExporter

codecov-commenter edited a comment on pull request #3130: URL: https://github.com/apache/hudi/pull/3130#issuecomment-865672234 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

hudi-bot edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865758353 ## CI report: * 56300526602d1eccfe7f64720e9b4d25db6cef64 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

codecov-commenter edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865868967 #

[jira] [Commented] (HUDI-1537) Move validation of file listings to something that happens before each write

[ https://issues.apache.org/jira/browse/HUDI-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17367807#comment-17367807 ] Nishith Agarwal commented on HUDI-1537: --- This logic is being removed. Additionally, falling back to

[jira] [Commented] (HUDI-1542) Fix Flaky test : TestHoodieMetadata#testSync

[ https://issues.apache.org/jira/browse/HUDI-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17367808#comment-17367808 ] Nishith Agarwal commented on HUDI-1542: --- [~pwason] Will take this up next week. > Fix Flaky test :

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3100: [HUDI-2034] Support explicit partition compaction strategy for flink …

codecov-commenter edited a comment on pull request #3100: URL: https://github.com/apache/hudi/pull/3100#issuecomment-862906759 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3133: [HUDI-2053] Insert Static Partition With DateType Return Incorrect P…

hudi-bot edited a comment on pull request #3133: URL: https://github.com/apache/hudi/pull/3133#issuecomment-865758353 ## CI report: * 56300526602d1eccfe7f64720e9b4d25db6cef64 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3100: [HUDI-2034] Support explicit partition compaction strategy for flink …

codecov-commenter edited a comment on pull request #3100: URL: https://github.com/apache/hudi/pull/3100#issuecomment-862906759 #

[jira] [Commented] (HUDI-1492) Handle DeltaWriteStat correctly for storage schemes that support appends

[ https://issues.apache.org/jira/browse/HUDI-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17367806#comment-17367806 ] Nishith Agarwal commented on HUDI-1492: --- Confirmed with [~pwason] that this does not affect

[jira] [Assigned] (HUDI-1077) Integration tests to validate clustering

[ https://issues.apache.org/jira/browse/HUDI-1077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal reassigned HUDI-1077: - Assignee: satish > Integration tests to validate clustering >

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 #

[GitHub] [hudi] n3nash closed issue #3048: [SUPPORT]delta streamer run bootstrap from one hudi table to another error .parquet is not a Parquet file. expected magic number at tail

n3nash closed issue #3048: URL: https://github.com/apache/hudi/issues/3048 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact

[GitHub] [hudi] n3nash commented on issue #3048: [SUPPORT]delta streamer run bootstrap from one hudi table to another error .parquet is not a Parquet file. expected magic number at tail

n3nash commented on issue #3048: URL: https://github.com/apache/hudi/issues/3048#issuecomment-866463882 @fengjian428 Closing this due to inactivity. Please feel free to re-open if you need assistance. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] danny0405 closed pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

danny0405 closed pull request #3135: URL: https://github.com/apache/hudi/pull/3135 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3130: [HUDI-1826] Add ORC support in HoodieSnapshotExporter

codecov-commenter edited a comment on pull request #3130: URL: https://github.com/apache/hudi/pull/3130#issuecomment-865672234 #

[GitHub] [hudi] yanghua commented on pull request #3130: [HUDI-1826] Add ORC support in HoodieSnapshotExporter

yanghua commented on pull request #3130: URL: https://github.com/apache/hudi/pull/3130#issuecomment-866453190 reopen to retrigger the CI. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3100: [HUDI-2034] Support explicit partition compaction strategy for flink …

codecov-commenter edited a comment on pull request #3100: URL: https://github.com/apache/hudi/pull/3100#issuecomment-862906759 #

[GitHub] [hudi] yanghua closed pull request #3130: [HUDI-1826] Add ORC support in HoodieSnapshotExporter

yanghua closed pull request #3130: URL: https://github.com/apache/hudi/pull/3130 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] swuferhong closed pull request #3100: [HUDI-2034] Support explicit partition compaction strategy for flink …

swuferhong closed pull request #3100: URL: https://github.com/apache/hudi/pull/3100 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 #

[GitHub] [hudi] danny0405 closed pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

danny0405 closed pull request #3135: URL: https://github.com/apache/hudi/pull/3135 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[jira] [Updated] (HUDI-1896) [UMBRELLA] Implement DeltaStreamer Source for cloud object stores

[ https://issues.apache.org/jira/browse/HUDI-1896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1896: - Description: As discussed in HUDI-1723, we need a better implementation for Cloud object storage

[GitHub] [hudi] nsivabalan commented on pull request #3111: Fix KafkaAvroSchemaDeserializer to not rely on reflection

nsivabalan commented on pull request #3111: URL: https://github.com/apache/hudi/pull/3111#issuecomment-866384611 awesome  Can you please check why CI is failing. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hudi] sbernauer commented on pull request #3111: Fix KafkaAvroSchemaDeserializer to not rely on reflection

sbernauer commented on pull request #3111: URL: https://github.com/apache/hudi/pull/3111#issuecomment-866347883 Yes, we tested it on our staging env for multiple streaming jobs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hudi] hudi-bot edited a comment on pull request #3074: [HUDI-2007] Fixing hudi_test_suite for spark nodes and adding spark bulk_insert node

hudi-bot edited a comment on pull request #3074: URL: https://github.com/apache/hudi/pull/3074#issuecomment-861653947 ## CI report: * 37197b78a1a8ead38d37a760df920cb53ec451de Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3074: [HUDI-2007] Fixing hudi_test_suite for spark nodes and adding spark bulk_insert node

codecov-commenter edited a comment on pull request #3074: URL: https://github.com/apache/hudi/pull/3074#issuecomment-860337193 #

[GitHub] [hudi] nsivabalan commented on pull request #2903: [HUDI-1850] Fixing read of a empty table but with failed write

nsivabalan commented on pull request #2903: URL: https://github.com/apache/hudi/pull/2903#issuecomment-866310217 SQL DML extension tests are failing. I need time to check those out. Will update once I am able to make CI happy. -- This is an automated message from the Apache Git

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3105: [HUDI-2038] Support rollback inflight compaction instances for CompactionPlanOperator

codecov-commenter edited a comment on pull request #3105: URL: https://github.com/apache/hudi/pull/3105#issuecomment-863292214 #

[jira] [Commented] (HUDI-1839) FSUtils getAllPartitions broken by NotSerializableException: org.apache.hadoop.fs.Path

[ https://issues.apache.org/jira/browse/HUDI-1839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17367656#comment-17367656 ] Udit Mehrotra commented on HUDI-1839: - [~satishkotha] Were you using Kryo serializer while doing this

[GitHub] [hudi] hudi-bot edited a comment on pull request #3074: [HUDI-2007] Fixing hudi_test_suite for spark nodes and adding spark bulk_insert node

hudi-bot edited a comment on pull request #3074: URL: https://github.com/apache/hudi/pull/3074#issuecomment-861653947 ## CI report: * 2e782acd2f3d8f79d2014875cddf69a62f736a54 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #2701: [HUDI 1623] New Hoodie Instant on disk format with end time and milliseconds granularity

hudi-bot edited a comment on pull request #2701: URL: https://github.com/apache/hudi/pull/2701#issuecomment-866299648 ## CI report: * cf79ca863369d8d7326ade272da67ca63a42bad8 Azure:

[jira] [Updated] (HUDI-1839) FSUtils getAllPartitions broken by NotSerializableException: org.apache.hadoop.fs.Path

[ https://issues.apache.org/jira/browse/HUDI-1839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1839: -- Priority: Blocker (was: Major) > FSUtils getAllPartitions broken by NotSerializableException:

[jira] [Updated] (HUDI-1839) FSUtils getAllPartitions broken by NotSerializableException: org.apache.hadoop.fs.Path

[ https://issues.apache.org/jira/browse/HUDI-1839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1839: -- Fix Version/s: 0.9.0 > FSUtils getAllPartitions broken by NotSerializableException: >

[jira] [Commented] (HUDI-1839) FSUtils getAllPartitions broken by NotSerializableException: org.apache.hadoop.fs.Path

[ https://issues.apache.org/jira/browse/HUDI-1839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17367647#comment-17367647 ] Nishith Agarwal commented on HUDI-1839: --- [~pwason] Is this something that we have identified the

[GitHub] [hudi] nsivabalan commented on a change in pull request #2903: [HUDI-1850] Fixing read of a empty table but with failed write

nsivabalan commented on a change in pull request #2903: URL: https://github.com/apache/hudi/pull/2903#discussion_r656545767 ## File path: hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/functional/HoodieSparkSqlWriterSuite.scala ## @@ -229,7 +231,42 @@ class

[GitHub] [hudi] hudi-bot edited a comment on pull request #3074: [HUDI-2007] Fixing hudi_test_suite for spark nodes and adding spark bulk_insert node

hudi-bot edited a comment on pull request #3074: URL: https://github.com/apache/hudi/pull/3074#issuecomment-861653947 ## CI report: * 2e782acd2f3d8f79d2014875cddf69a62f736a54 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #2701: [HUDI 1623] New Hoodie Instant on disk format with end time and milliseconds granularity

hudi-bot commented on pull request #2701: URL: https://github.com/apache/hudi/pull/2701#issuecomment-866299648 ## CI report: * cf79ca863369d8d7326ade272da67ca63a42bad8 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] vinothchandar commented on pull request #2701: [HUDI 1623] New Hoodie Instant on disk format with end time and milliseconds granularity

vinothchandar commented on pull request #2701: URL: https://github.com/apache/hudi/pull/2701#issuecomment-866298936 @prashantwason could you review this and see if you can land. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hudi] nsivabalan commented on a change in pull request #3074: [HUDI-2007] Fixing hudi_test_suite for spark nodes and adding spark bulk_insert node

nsivabalan commented on a change in pull request #3074: URL: https://github.com/apache/hudi/pull/3074#discussion_r656542270 ## File path: hudi-integ-test/src/main/java/org/apache/hudi/integ/testsuite/configuration/DeltaConfig.java ## @@ -189,6 +190,10 @@ public boolean

[GitHub] [hudi] nsivabalan commented on pull request #3074: [HUDI-2007] Fixing hudi_test_suite for spark nodes and adding spark bulk_insert node

nsivabalan commented on pull request #3074: URL: https://github.com/apache/hudi/pull/3074#issuecomment-866292959 @n3nash wrt comment "Also, please rename the title to "Adding bulk_insert spark node to hudi_test_suite". Fixing gives a wrong context here.". As I have responded to your

[GitHub] [hudi] nsivabalan commented on a change in pull request #3074: [HUDI-2007] Fixing hudi_test_suite for spark nodes and adding spark bulk_insert node

nsivabalan commented on a change in pull request #3074: URL: https://github.com/apache/hudi/pull/3074#discussion_r656538309 ## File path: hudi-integ-test/pom.xml ## @@ -407,7 +407,46 @@ + Review comment: scala classes were not part of build output if not

[GitHub] [hudi] nsivabalan commented on a change in pull request #3075: [HUDI-2009] Fixing extra commit metadata in row writer path

nsivabalan commented on a change in pull request #3075: URL: https://github.com/apache/hudi/pull/3075#discussion_r656537913 ## File path: hudi-spark-datasource/hudi-spark-common/src/main/java/org/apache/hudi/internal/DataSourceInternalWriterHelper.java ## @@ -31,15 +31,17 @@

[GitHub] [hudi] tandonraghav edited a comment on issue #3078: [SUPPORT] combineAndGetUpdateValue is not getting called when Schema evolution happens

tandonraghav edited a comment on issue #3078: URL: https://github.com/apache/hudi/issues/3078#issuecomment-866269573 @n3nash I am trying to implement exactly `https://github.com/apache/hudi/pull/2106/files` , in this also `PartialAvroPayload` class only implements

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3105: [HUDI-2038] Support rollback inflight compaction instances for CompactionPlanOperator

codecov-commenter edited a comment on pull request #3105: URL: https://github.com/apache/hudi/pull/3105#issuecomment-863292214 #

[GitHub] [hudi] nsivabalan commented on a change in pull request #3108: [HUDI-2042] Compare the field object directly in OverwriteWithLatestA…

nsivabalan commented on a change in pull request #3108: URL: https://github.com/apache/hudi/pull/3108#discussion_r656526739 ## File path: hudi-common/src/main/java/org/apache/hudi/common/model/OverwriteWithLatestAvroPayload.java ## @@ -94,6 +94,6 @@ protected boolean

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3084: [HUDI-2017] Add API to set a metric in the registry.

codecov-commenter edited a comment on pull request #3084: URL: https://github.com/apache/hudi/pull/3084#issuecomment-861292418 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] tandonraghav commented on issue #3078: [SUPPORT] combineAndGetUpdateValue is not getting called when Schema evolution happens

tandonraghav commented on issue #3078: URL: https://github.com/apache/hudi/issues/3078#issuecomment-866269573 @n3nash I am trying to implement exactly `https://github.com/apache/hudi/pull/2106/files` , in this also `PartialAvroPayload` class only implements `combineAndGetUpdateValue` .

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3130: [HUDI-1826] Add ORC support in HoodieSnapshotExporter

codecov-commenter edited a comment on pull request #3130: URL: https://github.com/apache/hudi/pull/3130#issuecomment-865672234 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3130: [HUDI-1826] Add ORC support in HoodieSnapshotExporter

codecov-commenter edited a comment on pull request #3130: URL: https://github.com/apache/hudi/pull/3130#issuecomment-865672234 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3129: [HUDI-2055] Added metric for time of lastSync

codecov-commenter edited a comment on pull request #3129: URL: https://github.com/apache/hudi/pull/3129#issuecomment-865650383 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3135: [HUDI-2054] Remove the duplicate name for flink write pipeline

codecov-commenter edited a comment on pull request #3135: URL: https://github.com/apache/hudi/pull/3135#issuecomment-866181744 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3129: [HUDI-2055] Added metric for time of lastSync

codecov-commenter edited a comment on pull request #3129: URL: https://github.com/apache/hudi/pull/3129#issuecomment-865650383 #

  1   2   3   4   >