[jira] [Commented] (HUDI-8248) Fix LogRecord reader to account for rollback blocks with higher timestamps

[ https://issues.apache.org/jira/browse/HUDI-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884478#comment-17884478 ] sivabalan narayanan commented on HUDI-8248: --- - lets fix the rollback

[jira] [Comment Edited] (HUDI-8248) Fix LogRecord reader to account for rollback blocks with higher timestamps

[ https://issues.apache.org/jira/browse/HUDI-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884413#comment-17884413 ] sivabalan narayanan edited comment on HUDI-8248 at 9/24/24 6:4

[jira] [Comment Edited] (HUDI-8248) Fix LogRecord reader to account for rollback blocks with higher timestamps

[ https://issues.apache.org/jira/browse/HUDI-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884413#comment-17884413 ] sivabalan narayanan edited comment on HUDI-8248 at 9/24/24 6:4

[jira] [Commented] (HUDI-8248) Fix LogRecord reader to account for rollback blocks with higher timestamps

[ https://issues.apache.org/jira/browse/HUDI-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884413#comment-17884413 ] sivabalan narayanan commented on HUDI-8248: --- Lets discuss (B) is bit

[jira] [Updated] (HUDI-8249) Generate rollback timestamps earlier than ingestion commits with single writer

[ https://issues.apache.org/jira/browse/HUDI-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8249: -- Description: Our current logic for rollbacks is, we first generate commit times for

[jira] [Comment Edited] (HUDI-8249) Generate rollback timestamps earlier than ingestion commits with single writer

[ https://issues.apache.org/jira/browse/HUDI-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884070#comment-17884070 ] sivabalan narayanan edited comment on HUDI-8249 at 9/24/24 6:2

[jira] [Updated] (HUDI-8248) Fix LogRecord reader to account for rollback blocks with higher timestamps

[ https://issues.apache.org/jira/browse/HUDI-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8248: -- Description: With LogRecordReader, we also configure maxIntant time to read. Sometimes

[jira] [Comment Edited] (HUDI-8248) Fix LogRecord reader to account for rollback blocks with higher timestamps

[ https://issues.apache.org/jira/browse/HUDI-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884391#comment-17884391 ] sivabalan narayanan edited comment on HUDI-8248 at 9/24/24 5:4

[jira] [Commented] (HUDI-8248) Fix LogRecord reader to account for rollback blocks with higher timestamps

[ https://issues.apache.org/jira/browse/HUDI-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884391#comment-17884391 ] sivabalan narayanan commented on HUDI-8248: --- Thoughts on fixing the i

[jira] [Comment Edited] (HUDI-8248) Fix LogRecord reader to account for rollback blocks with higher timestamps

[ https://issues.apache.org/jira/browse/HUDI-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884391#comment-17884391 ] sivabalan narayanan edited comment on HUDI-8248 at 9/24/24 5:4

[jira] [Updated] (HUDI-7975) Transfer extrametada to new commits when new data is not ingeested to trigger table services on the dataset

[ https://issues.apache.org/jira/browse/HUDI-7975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7975: -- Story Points: 3 Remaining Estimate: 4h Original Estimate: 4h > Trans

[jira] [Updated] (HUDI-8248) Fix LogRecord reader to account for rollback blocks with higher timestamps

[ https://issues.apache.org/jira/browse/HUDI-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8248: -- Sprint: Hudi 1.0 Sprint 2024/09/23-29 > Fix LogRecord reader to account for rollb

[jira] [Updated] (HUDI-8249) Generate rollback timestamps earlier than ingestion commits with single writer

[ https://issues.apache.org/jira/browse/HUDI-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8249: -- Status: In Progress (was: Open) > Generate rollback timestamps earlier than ingest

[jira] [Updated] (HUDI-8248) Fix LogRecord reader to account for rollback blocks with higher timestamps

[ https://issues.apache.org/jira/browse/HUDI-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8248: -- Status: Patch Available (was: In Progress) > Fix LogRecord reader to account

[jira] [Updated] (HUDI-8189) Introduce a `.abort` state for abandoned commits and table services

[ https://issues.apache.org/jira/browse/HUDI-8189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8189: -- Status: In Progress (was: Open) > Introduce a `.abort` state for abandoned commits

[jira] [Updated] (HUDI-8249) Generate rollback timestamps earlier than ingestion commits with single writer

[ https://issues.apache.org/jira/browse/HUDI-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8249: -- Remaining Estimate: 3h Original Estimate: 3h > Generate rollback timesta

[jira] [Updated] (HUDI-8249) Generate rollback timestamps earlier than ingestion commits with single writer

[ https://issues.apache.org/jira/browse/HUDI-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8249: -- Status: Patch Available (was: In Progress) > Generate rollback timestamps earlier t

[jira] [Updated] (HUDI-7975) Transfer extrametada to new commits when new data is not ingeested to trigger table services on the dataset

[ https://issues.apache.org/jira/browse/HUDI-7975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7975: -- Status: In Progress (was: Open) > Transfer extrametada to new commits when new data

[jira] [Updated] (HUDI-8248) Fix LogRecord reader to account for rollback blocks with higher timestamps

[ https://issues.apache.org/jira/browse/HUDI-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8248: -- Status: In Progress (was: Open) > Fix LogRecord reader to account for rollback blo

[jira] [Updated] (HUDI-8249) Generate rollback timestamps earlier than ingestion commits with single writer

[ https://issues.apache.org/jira/browse/HUDI-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8249: -- Story Points: 1 > Generate rollback timestamps earlier than ingestion commits w

[jira] [Updated] (HUDI-8248) Fix LogRecord reader to account for rollback blocks with higher timestamps

[ https://issues.apache.org/jira/browse/HUDI-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8248: -- Story Points: 4 Labels: pull-request-available (was

[jira] [Updated] (HUDI-8248) Fix LogRecord reader to account for rollback blocks with higher timestamps

[ https://issues.apache.org/jira/browse/HUDI-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8248: -- Reviewers: Danny Chen, Y Ethan Guo > Fix LogRecord reader to account for rollb

[jira] [Updated] (HUDI-7975) Transfer extrametada to new commits when new data is not ingeested to trigger table services on the dataset

[ https://issues.apache.org/jira/browse/HUDI-7975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7975: -- Fix Version/s: 0.16.0 > Transfer extrametada to new commits when new data is

[jira] [Updated] (HUDI-7975) Transfer extrametada to new commits when new data is not ingeested to trigger table services on the dataset

[ https://issues.apache.org/jira/browse/HUDI-7975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7975: -- Fix Version/s: 1.0.0 > Transfer extrametada to new commits when new data is

[jira] [Updated] (HUDI-8249) Generate rollback timestamps earlier than ingestion commits with single writer

[ https://issues.apache.org/jira/browse/HUDI-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8249: -- Fix Version/s: 1.0.0 > Generate rollback timestamps earlier than ingestion commits w

[jira] [Updated] (HUDI-8248) Fix LogRecord reader to account for rollback blocks with higher timestamps

[ https://issues.apache.org/jira/browse/HUDI-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8248: -- Fix Version/s: 1.0.0 > Fix LogRecord reader to account for rollback blocks with hig

[jira] [Updated] (HUDI-8248) Fix LogRecord reader to account for rollback blocks with higher timestamps

[ https://issues.apache.org/jira/browse/HUDI-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8248: -- Fix Version/s: 0.16.0 > Fix LogRecord reader to account for rollback blocks with hig

[jira] [Comment Edited] (HUDI-8249) Generate rollback timestamps earlier than ingestion commits with single writer

[ https://issues.apache.org/jira/browse/HUDI-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884070#comment-17884070 ] sivabalan narayanan edited comment on HUDI-8249 at 9/24/24 12:4

[jira] [Assigned] (HUDI-8248) Fix LogRecord reader to account for rollback blocks with higher timestamps

[ https://issues.apache.org/jira/browse/HUDI-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-8248: - Assignee: sivabalan narayanan > Fix LogRecord reader to account for rollb

[jira] [Updated] (HUDI-8249) Generate rollback timestamps earlier than ingestion commits with single writer

[ https://issues.apache.org/jira/browse/HUDI-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8249: -- Sprint: Hudi 1.0 Sprint 2024/09/23-29 > Generate rollback timestamps earlier t

[jira] [Commented] (HUDI-8249) Generate rollback timestamps earlier than ingestion commits with single writer

[ https://issues.apache.org/jira/browse/HUDI-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884070#comment-17884070 ] sivabalan narayanan commented on HUDI-8249: --- Approach A: introduce a lazy

[jira] [Assigned] (HUDI-7975) Transfer extrametada to new commits when new data is not ingeested to trigger table services on the dataset

[ https://issues.apache.org/jira/browse/HUDI-7975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-7975: - Assignee: sivabalan narayanan (was: Surya Prasanna Yalla) > Trans

[jira] [Updated] (HUDI-7975) Transfer extrametada to new commits when new data is not ingeested to trigger table services on the dataset

[ https://issues.apache.org/jira/browse/HUDI-7975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7975: -- Sprint: Hudi 1.0 Sprint 2024/09/23-29 > Transfer extrametada to new commits when

[jira] [Created] (HUDI-8249) Generate rollback timestamps earlier than ingestion commits with single writer

sivabalan narayanan created HUDI-8249: - Summary: Generate rollback timestamps earlier than ingestion commits with single writer Key: HUDI-8249 URL: https://issues.apache.org/jira/browse/HUDI-8249

[jira] [Updated] (HUDI-8249) Generate rollback timestamps earlier than ingestion commits with single writer

[ https://issues.apache.org/jira/browse/HUDI-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8249: -- Fix Version/s: 0.16.0 > Generate rollback timestamps earlier than ingestion comm

[jira] [Assigned] (HUDI-8249) Generate rollback timestamps earlier than ingestion commits with single writer

[ https://issues.apache.org/jira/browse/HUDI-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-8249: - Assignee: sivabalan narayanan > Generate rollback timestamps earlier t

[jira] [Created] (HUDI-8248) Fix LogRecord reader to account for rollback blocks with higher timestamps

sivabalan narayanan created HUDI-8248: - Summary: Fix LogRecord reader to account for rollback blocks with higher timestamps Key: HUDI-8248 URL: https://issues.apache.org/jira/browse/HUDI-8248

[jira] [Created] (HUDI-8240) Add locks to clean and rollbacks to validate timestamps

sivabalan narayanan created HUDI-8240: - Summary: Add locks to clean and rollbacks to validate timestamps Key: HUDI-8240 URL: https://issues.apache.org/jira/browse/HUDI-8240 Project: Apache Hudi

[jira] [Updated] (HUDI-8240) Add locks to clean and rollbacks to validate timestamps

[ https://issues.apache.org/jira/browse/HUDI-8240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8240: -- Fix Version/s: 0.16.0 > Add locks to clean and rollbacks to validate timesta

[jira] [Closed] (HUDI-8200) Add support to configure StorageViewType with HoodieMetadataTableValidator

[ https://issues.apache.org/jira/browse/HUDI-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-8200. - Resolution: Fixed > Add support to configure StorageViewType w

(hudi) branch master updated: [HUDI-8200] Adding support to configure view storage type with HoodieMetadataTableValidator (#11944)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new fd5ecbb6f5e [HUDI-8200] Adding support to

[jira] [Commented] (HUDI-7975) Transfer extrametada to new commits when new data is not ingeested to trigger table services on the dataset

[ https://issues.apache.org/jira/browse/HUDI-7975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882200#comment-17882200 ] sivabalan narayanan commented on HUDI-7975: --- If we characterize diffe

[jira] [Created] (HUDI-8200) Add support to configure StorageViewType with HoodieMetadataTableValidator

sivabalan narayanan created HUDI-8200: - Summary: Add support to configure StorageViewType with HoodieMetadataTableValidator Key: HUDI-8200 URL: https://issues.apache.org/jira/browse/HUDI-8200

[jira] [Assigned] (HUDI-8200) Add support to configure StorageViewType with HoodieMetadataTableValidator

[ https://issues.apache.org/jira/browse/HUDI-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-8200: - Assignee: sivabalan narayanan > Add support to configure StorageViewType w

[jira] [Updated] (HUDI-8199) Support timely compaction triggers even if there is not data to consume in deltastreamer continuous mode

[ https://issues.apache.org/jira/browse/HUDI-8199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8199: -- Labels: clustering compaction (was: ) > Support timely compaction triggers even

[jira] [Created] (HUDI-8199) Support timely compaction triggers even if there is not data to consume in deltastreamer continuous mode

sivabalan narayanan created HUDI-8199: - Summary: Support timely compaction triggers even if there is not data to consume in deltastreamer continuous mode Key: HUDI-8199 URL: https://issues.apache.org/jira

[jira] [Updated] (HUDI-8199) Support timely compaction triggers even if there is not data to consume in deltastreamer continuous mode

[ https://issues.apache.org/jira/browse/HUDI-8199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8199: -- Fix Version/s: 1.1.0 > Support timely compaction triggers even if there is not data

[jira] [Updated] (HUDI-7507) ongoing concurrent writers with smaller timestamp can cause issues with table services

[ https://issues.apache.org/jira/browse/HUDI-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7507: -- Status: Patch Available (was: In Progress) > ongoing concurrent writers with smal

[jira] [Updated] (HUDI-8181) Add reconcile commit metadata support for flink and java

[ https://issues.apache.org/jira/browse/HUDI-8181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8181: -- Fix Version/s: 0.16.0 > Add reconcile commit metadata support for flink and j

[jira] [Updated] (HUDI-8111) Add support for validating last N file slices with HoodieMetadataValidator

[ https://issues.apache.org/jira/browse/HUDI-8111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8111: -- Status: In Progress (was: Open) > Add support for validating last N file slices w

[jira] [Updated] (HUDI-8111) Add support for validating last N file slices with HoodieMetadataValidator

[ https://issues.apache.org/jira/browse/HUDI-8111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8111: -- Status: Patch Available (was: In Progress) > Add support for validating last N f

[jira] [Assigned] (HUDI-8111) Add support for validating last N file slices with HoodieMetadataValidator

[ https://issues.apache.org/jira/browse/HUDI-8111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-8111: - Assignee: sivabalan narayanan (was: Lokesh Jain) > Add support for validat

[jira] [Updated] (HUDI-8111) Add support for validating last N file slices with HoodieMetadataValidator

[ https://issues.apache.org/jira/browse/HUDI-8111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8111: -- Fix Version/s: 1.0.0 > Add support for validating last N file slices w

[jira] [Assigned] (HUDI-8111) Add support for validating last N file slices with HoodieMetadataValidator

[ https://issues.apache.org/jira/browse/HUDI-8111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-8111: - Assignee: Lokesh Jain > Add support for validating last N file slices w

[jira] [Updated] (HUDI-8111) Add support for validating last N file slices with HoodieMetadataValidator

[ https://issues.apache.org/jira/browse/HUDI-8111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8111: -- Sprint: Hudi 1.0 Sprint 2024/08/19-25 > Add support for validating last N file sli

[jira] [Created] (HUDI-8111) Add support for validating last N file slices with HoodieMetadataValidator

sivabalan narayanan created HUDI-8111: - Summary: Add support for validating last N file slices with HoodieMetadataValidator Key: HUDI-8111 URL: https://issues.apache.org/jira/browse/HUDI-8111

[jira] [Updated] (HUDI-7507) ongoing concurrent writers with smaller timestamp can cause issues with table services

[ https://issues.apache.org/jira/browse/HUDI-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7507: -- Story Points: 4 > ongoing concurrent writers with smaller timestamp can cause iss

[jira] [Updated] (HUDI-7507) ongoing concurrent writers with smaller timestamp can cause issues with table services

[ https://issues.apache.org/jira/browse/HUDI-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7507: -- Fix Version/s: 1.0.0 > ongoing concurrent writers with smaller timestamp can ca

[jira] [Updated] (HUDI-7507) ongoing concurrent writers with smaller timestamp can cause issues with table services

[ https://issues.apache.org/jira/browse/HUDI-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7507: -- Sprint: 2024/06/17-30, Hudi 1.0 Sprint 2024/08/19-25 (was: 2024/06/17-30) > ongo

(hudi) branch master updated: [HUDI-7979] Adjusting defaults with spillable map memory (#11611)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 9ee96655094 [HUDI-7979] Adjusting defaults

[jira] [Assigned] (HUDI-7972) Add fallback for deletion vector in 0.16.x reader while reading 1.x tables

[ https://issues.apache.org/jira/browse/HUDI-7972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-7972: - Assignee: sivabalan narayanan > Add fallback for deletion vector in 0.1

[jira] [Updated] (HUDI-7971) Test and Certify 0.14.x to 0.16.x tables are readable in 1.x Hudi reader

[ https://issues.apache.org/jira/browse/HUDI-7971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7971: -- Description: Lets ensure 1.x reader is fully compatible w/ reading any of 0.14.x to

[jira] [Updated] (HUDI-7971) Test and Certify 0.14.x to 0.16.x tables are readable in 1.x Hudi reader

[ https://issues.apache.org/jira/browse/HUDI-7971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7971: -- Description: Lets ensure 1.x reader is fully compatible w/ reading any of 0.14.x to

(hudi) branch asf-site updated: [HUDI-7978][DOCS] Add a note on field oldering in partitioned by clause of create sql (#11610)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 488438fbb6a [HUDI-7978][DOCS] Add a note

(hudi) branch master updated: [HUDI-7921] Fixing file system view closures in MDT (#11496)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 3789840be3d [HUDI-7921] Fixing file system

[jira] [Created] (HUDI-7979) Fix out of the box defaults with spillable memory configs

sivabalan narayanan created HUDI-7979: - Summary: Fix out of the box defaults with spillable memory configs Key: HUDI-7979 URL: https://issues.apache.org/jira/browse/HUDI-7979 Project: Apache Hudi

[jira] [Updated] (HUDI-7971) Test and Certify 0.14.x to 0.16.x tables are readable in 1.x Hudi reader

[ https://issues.apache.org/jira/browse/HUDI-7971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7971: -- Description: Lets ensure 1.x reader is fully compatible w/ reading any of 0.14.x to

[jira] [Updated] (HUDI-7866) Pull commit metadata changes in bridge release.

[ https://issues.apache.org/jira/browse/HUDI-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7866: -- Epic Link: (was: HUDI-7856) > Pull commit metadata changes in bridge rele

[jira] [Assigned] (HUDI-7866) Pull commit metadata changes in bridge release.

[ https://issues.apache.org/jira/browse/HUDI-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-7866: - Assignee: Balaji Varadarajan (was: sivabalan narayanan) > Pull commit metad

[jira] [Updated] (HUDI-7866) Pull commit metadata changes in bridge release.

[ https://issues.apache.org/jira/browse/HUDI-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7866: -- Parent: HUDI-7882 Issue Type: Sub-task (was: Task) > Pull commit metad

[jira] [Updated] (HUDI-7973) Add table property to track list of columns being indexed in col stats

[ https://issues.apache.org/jira/browse/HUDI-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7973: -- Fix Version/s: 1.0.0 > Add table property to track list of columns being indexed in

[jira] [Created] (HUDI-7973) Add table property to track list of columns being indexed in col stats

sivabalan narayanan created HUDI-7973: - Summary: Add table property to track list of columns being indexed in col stats Key: HUDI-7973 URL: https://issues.apache.org/jira/browse/HUDI-7973

[jira] [Updated] (HUDI-7973) Add table property to track list of columns being indexed in col stats

[ https://issues.apache.org/jira/browse/HUDI-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7973: -- Epic Link: (was: HUDI-7856) > Add table property to track list of columns be

[jira] [Updated] (HUDI-7973) Add table property to track list of columns being indexed in col stats

[ https://issues.apache.org/jira/browse/HUDI-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7973: -- Epic Link: HUDI-7856 > Add table property to track list of columns being indexed in

[jira] [Updated] (HUDI-7973) Add table property to track list of columns being indexed in col stats

[ https://issues.apache.org/jira/browse/HUDI-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7973: -- Parent: HUDI-7882 Issue Type: Sub-task (was: Improvement) > Add table prope

[jira] [Updated] (HUDI-7888) Throw meaningful error when reading partial update or DV written in 1.x from 0.16.0 reader

[ https://issues.apache.org/jira/browse/HUDI-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7888: -- Fix Version/s: 1.0.0 > Throw meaningful error when reading partial update or DV writ

[jira] [Updated] (HUDI-7888) Throw meaningful error when reading partial update or DV written in 1.x from 0.16.0 reader

[ https://issues.apache.org/jira/browse/HUDI-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7888: -- Description: If 0.16.x reader is used to read 1.x table having partial updates/merges

[jira] [Updated] (HUDI-7972) Add fallback for deletion vector in 0.16.x reader while reading 1.x tables

[ https://issues.apache.org/jira/browse/HUDI-7972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7972: -- Parent: HUDI-7882 Issue Type: Sub-task (was: Improvement) > Add fallback

[jira] [Created] (HUDI-7972) Add fallback for deletion vector in 0.16.x reader while reading 1.x tables

sivabalan narayanan created HUDI-7972: - Summary: Add fallback for deletion vector in 0.16.x reader while reading 1.x tables Key: HUDI-7972 URL: https://issues.apache.org/jira/browse/HUDI-7972

[jira] [Updated] (HUDI-7865) Pull table properties changes in bridge release

[ https://issues.apache.org/jira/browse/HUDI-7865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7865: -- Parent: HUDI-7882 Issue Type: Sub-task (was: Task) > Pull table propert

[jira] [Updated] (HUDI-7888) Throw meaningful error when reading partial update or DV written in 1.x from 0.16.0 reader

[ https://issues.apache.org/jira/browse/HUDI-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7888: -- Epic Link: (was: HUDI-7856) > Throw meaningful error when reading partial update

[jira] [Updated] (HUDI-7865) Pull table properties changes in bridge release

[ https://issues.apache.org/jira/browse/HUDI-7865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7865: -- Epic Link: (was: HUDI-7856) > Pull table properties changes in bridge rele

[jira] [Updated] (HUDI-7888) Throw meaningful error when reading partial update or DV written in 1.x from 0.16.0 reader

[ https://issues.apache.org/jira/browse/HUDI-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7888: -- Parent: HUDI-7882 Issue Type: Sub-task (was: Improvement) > Throw meaning

[jira] [Updated] (HUDI-7972) Add fallback for deletion vector in 0.16.x reader while reading 1.x tables

[ https://issues.apache.org/jira/browse/HUDI-7972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7972: -- Fix Version/s: 1.0.0 > Add fallback for deletion vector in 0.16.x reader while read

[jira] [Updated] (HUDI-7972) Add fallback for deletion vector in 0.16.x reader while reading 1.x tables

[ https://issues.apache.org/jira/browse/HUDI-7972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7972: -- Labels: 1.0-migration (was: ) > Add fallback for deletion vector in 0.16.x rea

[jira] [Updated] (HUDI-7887) Any log format header types changes need to be ported to 0.16.0 from 1.x

[ https://issues.apache.org/jira/browse/HUDI-7887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7887: -- Epic Link: (was: HUDI-7856) > Any log format header types changes need to be por

[jira] [Updated] (HUDI-7887) Any log format header types changes need to be ported to 0.16.0 from 1.x

[ https://issues.apache.org/jira/browse/HUDI-7887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7887: -- Parent: HUDI-7882 Issue Type: Sub-task (was: Improvement) > Any log for

[jira] [Updated] (HUDI-7886) Make metadata payload from 1.x readable in 0.16.0

[ https://issues.apache.org/jira/browse/HUDI-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7886: -- Parent: HUDI-7882 Issue Type: Sub-task (was: Improvement) > Make metad

[jira] [Updated] (HUDI-7886) Make metadata payload from 1.x readable in 0.16.0

[ https://issues.apache.org/jira/browse/HUDI-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7886: -- Epic Link: (was: HUDI-7856) > Make metadata payload from 1.x readable in 0.1

[jira] [Updated] (HUDI-7971) Test and Certify 0.14.x to 0.16.x tables are readable in 1.x Hudi reader

[ https://issues.apache.org/jira/browse/HUDI-7971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7971: -- Epic Link: (was: HUDI-7856) > Test and Certify 0.14.x to 0.16.x tables are reada

[jira] [Updated] (HUDI-7971) Test and Certify 0.14.x to 0.16.x tables are readable in 1.x Hudi reader

[ https://issues.apache.org/jira/browse/HUDI-7971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7971: -- Parent: HUDI-7882 Issue Type: Sub-task (was: Test) > Test and Certify 0.1

[jira] [Created] (HUDI-7971) Test and Certify 0.14.x to 0.16.x tables are readable in 1.x Hudi reader

sivabalan narayanan created HUDI-7971: - Summary: Test and Certify 0.14.x to 0.16.x tables are readable in 1.x Hudi reader Key: HUDI-7971 URL: https://issues.apache.org/jira/browse/HUDI-7971

[jira] [Updated] (HUDI-7971) Test and Certify 0.14.x to 0.16.x tables are readable in 1.x Hudi reader

[ https://issues.apache.org/jira/browse/HUDI-7971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7971: -- Fix Version/s: 1.0.0 > Test and Certify 0.14.x to 0.16.x tables are readable in

[jira] [Updated] (HUDI-7882) Umbrella ticket for 1.x tables and 0.16.x compatibility

[ https://issues.apache.org/jira/browse/HUDI-7882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7882: -- Description: We have 4 major goals w/ this umbrella ticket.  a. 1.x reader should be

[jira] [Updated] (HUDI-7882) Umbrella ticket for 1.x tables and 0.16.x compatibility

[ https://issues.apache.org/jira/browse/HUDI-7882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7882: -- Summary: Umbrella ticket for 1.x tables and 0.16.x compatibility (was: Umbrella ticket

[jira] [Updated] (HUDI-7882) Umbrella ticket 1.x tables and 0.16.x compatibility

[ https://issues.apache.org/jira/browse/HUDI-7882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7882: -- Summary: Umbrella ticket 1.x tables and 0.16.x compatibility (was: Umbrella ticket to

[jira] [Assigned] (HUDI-7865) Pull table properties changes in bridge release

[ https://issues.apache.org/jira/browse/HUDI-7865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-7865: - Assignee: Balaji Varadarajan (was: Lokesh Jain) > Pull table properties chan

[jira] [Updated] (HUDI-7865) Pull table properties changes in bridge release

[ https://issues.apache.org/jira/browse/HUDI-7865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7865: -- Description: In 1.0.0, we changed some table properties to have nums as value instead

[jira] [Updated] (HUDI-7865) Pull table properties changes in bridge release

[ https://issues.apache.org/jira/browse/HUDI-7865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7865: -- Description: In 1.0.0, we changed some table properties to have nums as value instead

[jira] [Updated] (HUDI-7968) RFC for robust handling of spark task failures and retries

[ https://issues.apache.org/jira/browse/HUDI-7968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7968: -- Status: In Progress (was: Open) > RFC for robust handling of spark task failures

  1   2   3   4   5   6   7   8   9   10   >