[jira] [Updated] (HUDI-7834) Setup table versions to differentiate HUDI 0.16.x and 1.0-beta versions

2024-06-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7834: - Labels: pull-request-available (was: ) > Setup table versions to differentiate HUDI 0.1

[jira] [Updated] (HUDI-7830) Use predicate when calculating snapshot checkpoints.

2024-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7830: - Labels: pull-request-available source (was: source) > Use predicate when calculating snaps

[jira] [Updated] (HUDI-7414) Remove hoodie.gcp.bigquery.sync.base_path reference in the gcp docs

2024-06-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7414: - Labels: pull-request-available (was: ) > Remove hoodie.gcp.bigquery.sync.base_path refere

[jira] [Updated] (HUDI-7828) Support Flink 1.18.1

2024-06-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7828: - Labels: pull-request-available (was: ) > Support Flink 1.1

[jira] [Updated] (HUDI-7782) Task not serializable due to DynamoDBBasedLockProvider and HiveMetastoreBasedLockProvider in clean action

2024-06-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7782: - Labels: pull-request-available (was: ) > Task not serializable due to DynamoDBBasedLockProvi

(hudi) branch dependabot/maven/io.airlift-aircompressor-0.27 deleted (was 5042e73eb65)

2024-06-03 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/io.airlift-aircompressor-0.27 in repository https://gitbox.apache.org/repos/asf/hudi.git was 5042e73eb65 Bump io.airlift:aircompressor from 0.25 to 0.27 The revisions

[jira] [Updated] (HUDI-7747) In MetaClient remove getBasePathV2() and return StoragePath from getBasePath()

2024-06-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7747: - Labels: pull-request-available (was: ) > In MetaClient remove getBasePathV2() and ret

[jira] [Updated] (HUDI-7826) hoodie.write.set.null.for.missing.columns results in invalid objects

2024-06-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7826: - Labels: pull-request-available (was: ) > hoodie.write.set.null.for.missing.columns resu

(hudi) branch dependabot/maven/io.airlift-aircompressor-0.27 created (now 5042e73eb65)

2024-06-02 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/io.airlift-aircompressor-0.27 in repository https://gitbox.apache.org/repos/asf/hudi.git at 5042e73eb65 Bump io.airlift:aircompressor from 0.25 to 0.27 No new

[jira] [Updated] (HUDI-7825) Support Report pending clustering and compaction plan metric

2024-06-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7825: - Labels: pull-request-available (was: ) > Support Report pending clustering and compaction p

[jira] [Updated] (HUDI-7824) Fix incremental partitions fetch logic when savepoint is removed for Incr cleaner

2024-05-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7824: - Labels: pull-request-available (was: ) > Fix incremental partitions fetch logic when savepo

[jira] [Updated] (HUDI-7823) Simplify dependency management on exclusions

2024-05-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7823: - Labels: pull-request-available (was: ) > Simplify dependency management on exclusi

[jira] [Updated] (HUDI-7822) Resolve the conflicts between mixed hdfs and local path in Flink tests

2024-05-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7822: - Labels: pull-request-available (was: ) > Resolve the conflicts between mixed hdfs and local p

[jira] [Updated] (HUDI-7821) Handle schema evolution in proto to avro conversion

2024-05-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7821: - Labels: pull-request-available (was: ) > Handle schema evolution in proto to avro convers

[jira] [Updated] (HUDI-7819) Fix OptionsResolver#allowCommitOnEmptyBatch default value bug

2024-05-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7819: - Labels: pull-request-available (was: ) > Fix OptionsResolver#allowCommitOnEmptyBatch defa

[jira] [Updated] (HUDI-7817) Use Jackson Core instead of org.codehaus.jackson for JSON encoding

2024-05-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7817: - Labels: pull-request-available (was: ) > Use Jackson Core instead of org.codehaus.jack

[jira] [Updated] (HUDI-7816) Pass the source profile to the snapshot query splitter

2024-05-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7816: - Labels: pull-request-available (was: ) > Pass the source profile to the snapshot query split

[jira] [Updated] (HUDI-7815) Multiple writer with bulkinsert getAllPendingClusteringPlans should refresh timeline

2024-05-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7815: - Labels: pull-request-available (was: ) > Multiple writer with bulkins

[jira] [Updated] (HUDI-7814) Exclude unused transitive dependencies that introduce vulnerabilities

2024-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7814: - Labels: pull-request-available (was: ) > Exclude unused transitive dependencies that introd

[jira] [Updated] (HUDI-7812) Async Clustering w/ row writer fails due to timetravel query validation

2024-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7812: - Labels: pull-request-available (was: ) > Async Clustering w/ row writer fails due to timetra

[jira] [Updated] (HUDI-7810) Fix OptionsResolver#allowCommitOnEmptyBatch default value bug

2024-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7810: - Labels: pull-request-available (was: ) > Fix OptionsResolver#allowCommitOnEmptyBatch defa

[jira] [Updated] (HUDI-7808) Security upgrade io.acryl:datahub-client from 0.8.31 to 0.8.45

2024-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7808: - Labels: pull-request-available (was: ) > Security upgrade io.acryl:datahub-client from 0.8

[jira] [Updated] (HUDI-7809) Use Spark SerializableConfiguration to avoid NPE in Kryo serde

2024-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7809: - Labels: hoodie-storage pull-request-available (was: hoodie-storage) > Use Sp

[jira] [Updated] (HUDI-7807) spark-sql updates for a pk less table fails w/ partitioned table

2024-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7807: - Labels: pull-request-available (was: ) > spark-sql updates for a pk less table fail

[jira] [Updated] (HUDI-7805) FileSystemBasedLockProvider need delete lock file auto when occur lock conflict to avoid next write failed

2024-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7805: - Labels: pull-request-available (was: ) > FileSystemBasedLockProvider need delete lock file a

[jira] [Updated] (HUDI-7804) Improve flink bucket index partitioner

2024-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7804: - Labels: pull-request-available (was: ) > Improve flink bucket index partitio

[jira] [Updated] (HUDI-7507) ongoing concurrent writers with smaller timestamp can cause issues with table services

2024-05-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7507: - Labels: pull-request-available (was: ) > ongoing concurrent writers with smaller timestamp

[jira] [Updated] (HUDI-7655) Support configuration for clean to fail execution if there is at least one file is marked as a failed delete

2024-05-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7655: - Labels: clean pull-request-available (was: clean) > Support configuration for clean to f

[jira] [Updated] (HUDI-7802) Fix bundle validation scripts

2024-05-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7802: - Labels: pull-request-available (was: ) > Fix bundle validation scri

[jira] [Updated] (HUDI-7801) Directly pass down HoodieStorage instance instead of recreation

2024-05-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7801: - Labels: pull-request-available (was: ) > Directly pass down HoodieStorage instance inst

[jira] [Updated] (HUDI-7799) Optimize the access modifier of AbstractHoodieLogRecordReader#processNextRecord

2024-05-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7799: - Labels: pull-request-available (was: ) > Optimize the access modif

[jira] [Updated] (HUDI-7798) Mark configs included in 0.15.0 release

2024-05-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7798: - Labels: pull-request-available (was: ) > Mark configs included in 0.15.0 rele

[jira] [Updated] (HUDI-7797) Use HoodieIOFactory to return pluggable FileFormatUtils implementation

2024-05-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7797: - Labels: pull-request-available (was: ) > Use HoodieIOFactory to return pluggable FileFormatUt

(hudi) branch dependabot/maven/org.apache.hive-hive-service-2.3.3 deleted (was e7e4b9e3ddf)

2024-05-25 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/org.apache.hive-hive-service-2.3.3 in repository https://gitbox.apache.org/repos/asf/hudi.git was e7e4b9e3ddf Update pom.xml The revisions that were on this branch

[jira] [Updated] (HUDI-7796) Gracefully cast file system instance in Avro writers

2024-05-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7796: - Labels: pull-request-available (was: ) > Gracefully cast file system instance in Avro writ

[jira] [Updated] (HUDI-7794) Bump org.apache.hive:hive-service from 2.3.1 to 2.3.3

2024-05-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7794: - Labels: pull-request-available (was: ) > Bump org.apache.hive:hive-service from 2.3.1 to 2.

[jira] [Updated] (HUDI-7795) Fix loading of input splits from look up table reader

2024-05-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7795: - Labels: pull-request-available (was: ) > Fix loading of input splits from look up table rea

(hudi) branch dependabot/maven/hudi-platform-service/hudi-metaserver/com.h2database-h2-2.2.220 deleted (was 1560e9aa30c)

2024-05-24 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/hudi-platform-service/hudi-metaserver/com.h2database-h2-2.2.220 in repository https://gitbox.apache.org/repos/asf/hudi.git was 1560e9aa30c Bump h2 in /hudi-platform

(hudi) branch dependabot/maven/packaging/hudi-metaserver-server-bundle/com.h2database-h2-2.2.220 deleted (was cb331f02ad6)

2024-05-24 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/packaging/hudi-metaserver-server-bundle/com.h2database-h2-2.2.220 in repository https://gitbox.apache.org/repos/asf/hudi.git was cb331f02ad6 Bump h2 in /packaging/hudi

[jira] [Updated] (HUDI-7792) Bump h2 from 1.4.200 to 2.2.220 in /hudi-platform-service/hudi-metaserver

2024-05-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7792: - Labels: pull-request-available (was: ) > Bump h2 from 1.4.200 to 2.2.220 in /hudi-platf

[jira] [Updated] (HUDI-7791) Bump h2 from 1.4.200 to 2.2.220 in /packaging/hudi-metaserver-server-bundle

2024-05-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7791: - Labels: pull-request-available (was: ) > Bump h2 from 1.4.200 to 2.2.220 in /packaging/h

(hudi) branch dependabot/maven/hive.version-3.1.2 deleted (was ac3ae4a66fa)

2024-05-24 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/hive.version-3.1.2 in repository https://gitbox.apache.org/repos/asf/hudi.git was ac3ae4a66fa Merge branch 'master' into dependabot/maven/hive.version-3.1.2

(hudi) branch dependabot/maven/hive.version-3.1.2 created (now 14e3d559bd0)

2024-05-24 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/hive.version-3.1.2 in repository https://gitbox.apache.org/repos/asf/hudi.git at 14e3d559bd0 Bump hive.version from 2.3.1 to 3.1.2 No new revisions were added

(hudi) branch dependabot/maven/hive.version-3.1.2 deleted (was 14e3d559bd0)

2024-05-24 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/hive.version-3.1.2 in repository https://gitbox.apache.org/repos/asf/hudi.git was 14e3d559bd0 Bump hive.version from 2.3.1 to 3.1.2 The revisions that were

(hudi) branch dependabot/maven/hive.version-3.1.2 created (now 14e3d559bd0)

2024-05-24 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/hive.version-3.1.2 in repository https://gitbox.apache.org/repos/asf/hudi.git at 14e3d559bd0 Bump hive.version from 2.3.1 to 3.1.2 No new revisions were added

(hudi) branch dependabot/maven/org.apache.hive-hive-service-2.3.3 created (now da65366d649)

2024-05-24 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/org.apache.hive-hive-service-2.3.3 in repository https://gitbox.apache.org/repos/asf/hudi.git at da65366d649 Bump org.apache.hive:hive-service from 2.3.1 to 2.3.3

(hudi) branch dependabot/maven/hive.version-3.1.2 deleted (was 14e3d559bd0)

2024-05-24 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/hive.version-3.1.2 in repository https://gitbox.apache.org/repos/asf/hudi.git was 14e3d559bd0 Bump hive.version from 2.3.1 to 3.1.2 The revisions that were

(hudi) branch dependabot/maven/hive.version-3.1.2 created (now 14e3d559bd0)

2024-05-24 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/hive.version-3.1.2 in repository https://gitbox.apache.org/repos/asf/hudi.git at 14e3d559bd0 Bump hive.version from 2.3.1 to 3.1.2 No new revisions were added

(hudi) branch dependabot/maven/hudi-platform-service/hudi-metaserver/com.h2database-h2-2.2.220 updated (e96f60a4406 -> 1560e9aa30c)

2024-05-24 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/hudi-platform-service/hudi-metaserver/com.h2database-h2-2.2.220 in repository https://gitbox.apache.org/repos/asf/hudi.git discard e96f60a4406 Bump h2 in /hudi-platform

(hudi) branch dependabot/maven/packaging/hudi-metaserver-server-bundle/com.h2database-h2-2.2.220 updated (b10b98e5d8f -> cb331f02ad6)

2024-05-24 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/packaging/hudi-metaserver-server-bundle/com.h2database-h2-2.2.220 in repository https://gitbox.apache.org/repos/asf/hudi.git discard b10b98e5d8f Bump h2 in /packaging/hudi

[jira] [Updated] (HUDI-7790) Revert changes in DFSPathSelector and UtilHelpers.readConfig

2024-05-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7790: - Labels: pull-request-available (was: ) > Revert changes in DFSPathSelec

[jira] [Updated] (HUDI-7788) Fixing exception handling in AverageRecordSizeUtils

2024-05-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7788: - Labels: pull-request-available (was: ) > Fixing exception handling in AverageRecordSizeUt

[jira] [Updated] (HUDI-7787) Reload the data for lookup table when found the newer commit instance

2024-05-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7787: - Labels: pull-request-available (was: ) > Reload the data for lookup table when found the ne

[jira] [Updated] (HUDI-7786) Fix roaring bitmap dependency in hudi-integ-test-bundle

2024-05-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7786: - Labels: pull-request-available (was: ) > Fix roaring bitmap dependency in hudi-integ-test-bun

[jira] [Updated] (HUDI-7785) Keep public APIs in utilities module the same as before HoodieStorage abstraction

2024-05-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7785: - Labels: hoodie-storage pull-request-available (was: hoodie-storage) > Keep public A

[jira] [Updated] (HUDI-4491) Re-enable TestHoodieFlinkQuickstart

2024-05-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-4491: - Labels: pull-request-available (was: ) > Re-enable TestHoodieFlinkQuickst

[jira] [Updated] (HUDI-7784) Fix serde of HoodieHadoopConfiguration in Spark

2024-05-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7784: - Labels: hoodie-storage pull-request-available (was: hoodie-storage) > Fix se

[jira] [Updated] (HUDI-7783) Fix connection leak in FileSystemBasedLockProvider

2024-05-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7783: - Labels: pull-request-available (was: ) > Fix connection leak in FileSystemBasedLockProvi

[jira] [Updated] (HUDI-7777) Allow HoodieTableMetaClient to take HoodieStorage instance directly

2024-05-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-: - Labels: hoodie-storage pull-request-available (was: hoodie-storage) > Al

[jira] [Updated] (HUDI-7774) MercifulJsonConvertor should support Avro logical type

2024-05-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7774: - Labels: pull-request-available (was: ) > MercifulJsonConvertor should support Avro logical t

[jira] [Updated] (HUDI-7781) Filter wrong partitions when using hoodie.datasource.write.partitions.to.delete

2024-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7781: - Labels: pull-request-available (was: ) > Filter wrong partitions when us

[jira] [Updated] (HUDI-7776) Simplify HoodieStorage instance fetching

2024-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7776: - Labels: pull-request-available (was: ) > Simplify HoodieStorage instance fetch

[jira] [Updated] (HUDI-7778) Duplicate Key exception with RLI

2024-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7778: - Labels: pull-request-available (was: ) > Duplicate Key exception with

[jira] [Updated] (HUDI-7775) Remove unused APIs in HoodieStorage

2024-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7775: - Labels: pull-request-available (was: ) > Remove unused APIs in HoodieStor

[jira] [Updated] (HUDI-7761) Make the manifest Writer Extendable

2024-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7761: - Labels: pull-request-available (was: ) > Make the manifest Writer Extenda

[jira] [Updated] (HUDI-5505) Compaction NUM_COMMITS policy should only judge completed deltacommit

2024-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-5505: - Labels: pull-request-available (was: ) > Compaction NUM_COMMITS policy should only ju

[jira] [Updated] (HUDI-7770) Bootstrap read tries to parse partition from the bootstrap base path

2024-05-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7770: - Labels: pull-request-available (was: ) > Bootstrap read tries to parse partition f

[jira] [Updated] (HUDI-7772) HoodieTimelineArchiver##getCommitInstantsToArchive need skip limiting archiving of instants

2024-05-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7772: - Labels: pull-request-available (was: ) > HoodieTimelineArchiver##getCommitInstantsToArchive n

[jira] [Updated] (HUDI-7769) Fix Hudi CDC read on Spark 3.3.4 and 3.4.3

2024-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7769: - Labels: pull-request-available (was: ) > Fix Hudi CDC read on Spark 3.3.4 and 3.

[jira] [Updated] (HUDI-7771) Make default hoodie record payload as OverwriteWithLatestPayload for 0.15.0

2024-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7771: - Labels: pull-request-available (was: ) > Make default hoodie record payl

[jira] [Updated] (HUDI-7767) Revert Spark 3.3 and 3.4 upgrades

2024-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7767: - Labels: pull-request-available (was: ) > Revert Spark 3.3 and 3.4 upgra

[jira] [Updated] (HUDI-7766) Adding staging jar deployment command for Spark 3.5 and Scala 2.13 profile

2024-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7766: - Labels: pull-request-available (was: ) > Adding staging jar deployment command for Spark

[jira] [Updated] (HUDI-7765) Turn off native HFile reader for 0.15.0 release

2024-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7765: - Labels: pull-request-available (was: ) > Turn off native HFile reader for 0.15.0 rele

[jira] [Updated] (HUDI-7768) Fix failing tests for 0.15.0 release (async compaction and metadata num commits check)

2024-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7768: - Labels: pull-request-available (was: ) > Fix failing tests for 0.15.0 release (async compact

[jira] [Updated] (HUDI-7764) DefaultHoodieRecordPayload should be projection compatible

2024-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7764: - Labels: pull-request-available (was: ) > DefaultHoodieRecordPayload should be project

[jira] [Updated] (HUDI-7763) Fix that jmx reporter cannot initialized if metadata enables

2024-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7763: - Labels: metrics pull-request-available (was: metrics) > Fix that jmx reporter cannot initiali

[jira] [Updated] (HUDI-7762) Optimizing Hudi Table Check with Delta Lake by Refining Class Name Checks In Spark3.5

2024-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7762: - Labels: pull-request-available (was: ) > Optimizing Hudi Table Check with Delta Lake by Refin

[jira] [Updated] (HUDI-7759) Remove Hadoop dependencies in hudi-common module

2024-05-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7759: - Labels: hoodie-storage pull-request-available (was: hoodie-storage) > Remove Hadoop dependenc

[jira] [Updated] (HUDI-7758) MDT Initialization Parses Non-Hudi files

2024-05-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7758: - Labels: pull-request-available (was: ) > MDT Initialization Parses Non-Hudi fi

[jira] [Updated] (HUDI-7717) hoodie.combine.before.insert silently broken for bulk_insert if meta fields disabled (causes duplicates)

2024-05-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7717: - Labels: pull-request-available (was: ) > hoodie.combine.before.insert silently bro

[jira] [Updated] (HUDI-7752) Abstract serializeRecords for log writing

2024-05-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7752: - Labels: hoodie-storage pull-request-available (was: hoodie-storage) > Abstract serializeReco

[jira] [Updated] (HUDI-7754) Remove AvroWriteSupport and ParquetReaderIterator from hudi-common

2024-05-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7754: - Labels: pull-request-available (was: ) > Remove AvroWriteSupport and ParquetReaderIterator f

[jira] [Updated] (HUDI-7750) Move HoodieLogFormatWriter class to hoodie-hadoop-common module

2024-05-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7750: - Labels: hoodie-storage pull-request-available (was: hoodie-storage) > Move HoodieLogFormatWri

[jira] [Updated] (HUDI-7589) Add API to create HoodieStorage in HoodieIOFactory

2024-05-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7589: - Labels: hoodie-storage pull-request-available (was: hoodie-storage) > Add API to cre

[jira] [Updated] (HUDI-7749) Upgrade Spark patch version to include a fix related to data correctness

2024-05-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7749: - Labels: pull-request-available (was: ) > Upgrade Spark patch version to include a fix rela

[jira] [Updated] (HUDI-7748) Add logs and drop _hoodie_is_deleted in Transformer

2024-05-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7748: - Labels: pull-request-available (was: ) > Add logs and drop _hoodie_is_deleted in Transfor

[jira] [Updated] (HUDI-7745) Move Hadoop-dependent util methods to hudi-hadoop-common

2024-05-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7745: - Labels: hoodie-storage pull-request-available (was: hoodie-storage) > Move Hadoop-dependent u

[jira] [Updated] (HUDI-7744) Create HoodieIOFactory and config to set it

2024-05-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7744: - Labels: pull-request-available (was: ) > Create HoodieIOFactory and config to

[jira] [Updated] (HUDI-7731) Fix usage of new Configuration() in production code

2024-05-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7731: - Labels: pull-request-available (was: ) > Fix usage of new Configuration() in production c

[jira] [Updated] (HUDI-7742) Move Hadoop-dependent reader util classes to hudi-hadoop-common module

2024-05-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7742: - Labels: hoodie-storage pull-request-available (was: hoodie-storage) > Move Hadoop-depend

[jira] [Updated] (HUDI-7743) Fix simple mistakes with StoragePath in production code.

2024-05-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7743: - Labels: pull-request-available (was: ) > Fix simple mistakes with StoragePath in production c

[jira] [Updated] (HUDI-7729) Move ParquetUtils to hudi-hadoop-common

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7729: - Labels: hoodie-storage pull-request-available (was: hoodie-storage) > Move ParquetUtils to h

[jira] [Updated] (HUDI-5616) Docs update for specifying org.apache.spark.HoodieSparkKryoRegistrar

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-5616: - Labels: pull-request-available (was: ) > Docs update for specify

[jira] [Updated] (HUDI-7726) Restructure TableSchemaResolver to separate Hadoop logic and use BaseFileUtils

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7726: - Labels: hoodie-storage pull-request-available (was: hoodie-storage) > Restruct

[jira] [Updated] (HUDI-7739) Shudown asyncDetectorExecutor in AsyncTimelineServerBasedDetectionStrategy

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7739: - Labels: pull-request-available (was: ) > Shudown asyncDetectorExecu

[jira] [Updated] (HUDI-7738) FileStreamReader need set Charset with UTF-8

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7738: - Labels: pull-request-available (was: ) > FileStreamReader need set Charset with UT

[jira] [Updated] (HUDI-7737) Bump Spark 3.4 version to Spark 3.4.3

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7737: - Labels: pull-request-available (was: ) > Bump Spark 3.4 version to Spark 3.

[jira] [Updated] (HUDI-7735) Remove usage of SerializableConfiguration

2024-05-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7735: - Labels: hoodie-storage pull-request-available (was: hoodie-storage) > Remove us

[jira] [Updated] (HUDI-7734) Remove unused FSPermissionDTO

2024-05-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7734: - Labels: hoodie-storage pull-request-available (was: hoodie-storage) > Remove unu

[jira] [Updated] (HUDI-7728) Use StorageConfiguration in LockProvider constructors

2024-05-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7728: - Labels: hoodie-storage pull-request-available (was: hoodie-storage) > Use StorageConfigurat

  1   2   3   4   5   6   7   8   9   10   >