(hudi) branch master updated: [HUDI-7601] Add heartbeat mechanism to refresh lock (#10994)

2024-04-12 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 4fbf5c52f19 [HUDI-7601] Add heartbeat mechanism

(hudi) branch master updated: [HUDI-5823] Partition ttl management (#9723)

2024-02-27 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 89d267a4bf4 [HUDI-5823] Partition ttl management

(hudi) branch master updated: [HUDI-7428] Support Netease Object Storage protocol for Hudi (#10710)

2024-02-21 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new cba65e3711e [HUDI-7428] Support Netease Object

(hudi) branch master updated: [MINOR] Remove unused import (#10159)

2023-11-22 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new aabaa9947fc [MINOR] Remove unused import (#10159

[hudi] branch master updated: [HUDI-6925] Do not list all partitions for 'alter table drop partition' (#9837)

2023-10-11 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 21a8a3c3693 [HUDI-6925] Do not list all partitions

[hudi] branch master updated: [HUDI-6832] Ensure other table services with correct path are not affected by table with wrong path. (#9652)

2023-10-09 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 8e434b816dc [HUDI-6832] Ensure other table

[hudi] branch master updated: [HUDI-6481] Support run multi tables services in a single spark job (#9558)

2023-09-07 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new bbeb53128fd [HUDI-6481] Support run multi tables

[hudi] branch master updated: [MINOR] Fix consistent hashing bucket index FT failure (#9401)

2023-08-09 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 9b22583dbe0 [MINOR] Fix consistent hashing bucket

[hudi] branch master updated (7102e0fbe5f -> 7541cd7e6f8)

2023-08-08 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 7102e0fbe5f [HUDI-4987] Rename Hudi Streamer related configs (#9377) add 7541cd7e6f8 [HUDI-6534]Support consistent

[hudi] branch master updated: [HUDI-6501] HoodieHeartbeatClient should stop all heartbeats and not delete heartbeat files for close (#9160)

2023-07-20 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 6ed0fca1520 [HUDI-6501] HoodieHeartbeatClient

[hudi] branch master updated: Revert "[HUDI-6521] Disable failing test case. (#9169)" (#9181)

2023-07-13 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 56cc64f8c8f Revert "[HUDI-6521] Disable fa

[hudi] branch master updated: [HUDI-6515] Fix Spark2 do not support bucket bulk insert (#9163)

2023-07-10 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 0258a89112a [HUDI-6515] Fix Spark2 do not support

[hudi] branch master updated: [HUDI-6381] Support bucket bulk insert for CoW table (#8983)

2023-06-18 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new a0340a10b96 [HUDI-6381] Support bucket bulk insert

[hudi] branch master updated: [HUDI-6219] Ensure consistency between Spark catalog schema and Hudi schema (#8725)

2023-05-24 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new ea547e5681a [HUDI-6219] Ensure consistency between

[hudi] branch master updated (3e788ba8b33 -> 3dba6e488a1)

2023-05-16 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 3e788ba8b33 [HUDI-6134] Prevent clean run concurrently in flink (#8568) add 3dba6e488a1 [HUDI-6218] Support

[hudi] branch master updated (04517310ae9 -> 68c3be5df5b)

2023-04-20 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 04517310ae9 [HUDI-5987] Fix clustering on bootstrap table with row writer disabled (#8342) add 68c3be5df5b [HUDI

[hudi] branch master updated: [MINOR] Refactor tests - spark read only once to df, then assert (#8045)

2023-02-26 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 828a85e8c2e [MINOR] Refactor tests - spark read

[hudi] branch master updated (0f99315ab84 -> 9c8144045de)

2023-02-21 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 0f99315ab84 Handle empty payloads for AbstractDebeziumAvroPayload (#7944) add 9c8144045de [HUDI-5823] Claim RFC-65

[hudi] branch master updated: [MINOR] Fix spark sql run clean do not exit (#7918)

2023-02-16 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 91505853144 [MINOR] Fix spark sql run clean do

[hudi] branch asf-site updated: [MINOR] Add ZTO to powered by page (#7862)

2023-02-06 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 1b9a344e1de [MINOR] Add ZTO to powered by page

[hudi] branch master updated: [HUDI-5317] Fix insert overwrite table for partitioned table (#7793)

2023-01-31 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 0a9a6d20471 [HUDI-5317] Fix insert overwrite table

[hudi] branch master updated: [HUDI-5540] Close write client after usage of DeleteMarker/RollbackToInstantTime/RunClean/RunCompactionProcedure (#7655)

2023-01-31 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 255d40c5fb5 [HUDI-5540] Close write client after

[hudi] branch master updated (70d450e8389 -> 669e5676725)

2023-01-12 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 70d450e8389 [HUDI-5545] Extending support to other special characters (#7585) add 669e5676725 [HUDI-5543

[hudi] branch master updated: [HUDI-5317] Fix insert overwrite table for partitioned table (#7365)

2023-01-12 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new d65668611e3 [HUDI-5317] Fix insert overwrite table

[hudi] branch master updated (f745e645735 -> 3e49e4c26da)

2023-01-06 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from f745e645735 [HUDI-5341] CleanPlanner retains earliest commits must not be later than earliest pending commit (#7568

[hudi] branch master updated: [HUDI-5341] CleanPlanner retains earliest commits must not be later than earliest pending commit (#7568)

2023-01-06 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new f745e645735 [HUDI-5341] CleanPlanner retains

[hudi] branch master updated (bd57282f248 -> f2b2ec9539d)

2022-12-28 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from bd57282f248 [HUDI-5482] Nulls should be counted in the value count stats for mor table (#7482) add f2b2ec9539d

[hudi] branch asf-site updated: [MINOR] Adding more blogs to our website, dec 17, 2022 (#7496)

2022-12-17 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 6ab4d15a73 [MINOR] Adding more blogs to our

[hudi] branch master updated: [HUDI-5377] Write call stack information to lock file (#7440)

2022-12-17 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 6c7271f60a [HUDI-5377] Write call stack

[hudi] branch master updated: [HUDI-5318] Fix partition pruning for clustering scheduling (#7366)

2022-12-13 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 6de923cfdfd [HUDI-5318] Fix partition pruning

[hudi] branch master updated (ca3333d739 -> fc76499b26)

2022-12-09 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from cad739 [HUDI-5342] Add new bulk insert sort modes repartitioning data by partition path (#7402) add fc76499b26

[hudi] branch master updated (bf2ca54fe0 -> 418091bb4e)

2022-11-29 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from bf2ca54fe0 [HUDI-5269] Enhancing spark-sql write tests for some of the core user flows (#7230) add 418091bb4e

[hudi] branch master updated (431ade06fc -> d10d987288)

2022-11-24 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 431ade06fc [HUDI-5234] Streaming read skip clustering (#7296) add d10d987288 [HUDI-5277] Close HoodieWriteClient

[hudi] branch master updated: [MINOR] Use direct marker for spark engine when timeline server is disabled (#7272)

2022-11-22 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 91e0db57b9 [MINOR] Use direct marker for spark

[hudi] branch master updated: [MINOR] Fix typos in Spark client related classes (#7083)

2022-10-29 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new a7c56978df [MINOR] Fix typos in Spark client

[jira] [Commented] (HUDI-1741) Row Level TTL Support for records stored in Hudi

2022-10-27 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625407#comment-17625407 ] leesf commented on HUDI-1741: - [~nicholasjiang] agree with the solution > Row Level TTL Support for reco

[hudi] branch asf-site updated: [MINOR] Add filesystem based lock provider to release note (#6457)

2022-08-21 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 0afdea7f0f [MINOR] Add filesystem based lock

[hudi] branch master updated (767c196631 -> 78eeb02beb)

2022-08-06 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 767c196631 [HUDI-4303] Adding 4 to 5 upgrade handler to check for old deprecated "default" partition va

[jira] [Created] (HUDI-4546) Optimize catalog cast logic in HoodieSpark3Analysis

2022-08-04 Thread leesf (Jira)
leesf created HUDI-4546: --- Summary: Optimize catalog cast logic in HoodieSpark3Analysis Key: HUDI-4546 URL: https://issues.apache.org/jira/browse/HUDI-4546 Project: Apache Hudi Issue Type: Improvement

[jira] [Assigned] (HUDI-4433) Hudi-CLI repair deduplicate not working with non-partitioned dataset

2022-07-26 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reassigned HUDI-4433: --- Assignee: brightwon > Hudi-CLI repair deduplicate not working with non-partitioned data

[hudi] branch master updated: [HUDI-4336] Fix records overwritten bug with binary primary key (#5996)

2022-06-29 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 3948b8935a [HUDI-4336] Fix records overwritten bug

[hudi] branch master updated: [HUDI-4315] Do not throw exception in BaseSpark3Adapter#toTableIdentifier (#5957)

2022-06-26 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 8f4e2a189e [HUDI-4315] Do not throw exception

[hudi] branch master updated: [HUDI-4309] Spark3.2 custom parser should not throw exception (#5947)

2022-06-26 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 7a6eb0f6e1 [HUDI-4309] Spark3.2 custom parser

[hudi] branch master updated: [HUDI-4296] Fix the bug that TestHoodieSparkSqlWriter.testSchemaEvolutionForTableType is flaky (#5973)

2022-06-25 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 142adf4ccb [HUDI-4296] Fix the bug

[jira] [Updated] (HUDI-4315) Do not throw exception in BaseSpark3Adapter#isHoodieTable

2022-06-24 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-4315: Summary: Do not throw exception in BaseSpark3Adapter#isHoodieTable (was: Do not throw exception

[jira] [Updated] (HUDI-4315) Do not throw exception in BaseSpark3Adapter#toTableIdentifier

2022-06-24 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-4315: Summary: Do not throw exception in BaseSpark3Adapter#toTableIdentifier (was: Do not throw exception when using

[jira] [Updated] (HUDI-4315) Do not throw exception when using BaseSpark3Adapter#toTableIdentifier

2022-06-24 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-4315: Summary: Do not throw exception when using BaseSpark3Adapter#toTableIdentifier (was: Do not throw exception when

[jira] [Created] (HUDI-4315) Do not throw exception when using toTableIdentifier

2022-06-24 Thread leesf (Jira)
leesf created HUDI-4315: --- Summary: Do not throw exception when using toTableIdentifier Key: HUDI-4315 URL: https://issues.apache.org/jira/browse/HUDI-4315 Project: Apache Hudi Issue Type: Improvement

[hudi] branch master updated: [HUDI-4299] Fix problem about hudi-example-java run failed on idea. (#5936)

2022-06-23 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 38ff18a199 [HUDI-4299] Fix problem about hudi

[jira] [Updated] (HUDI-4183) Fix using HoodieCatalog to create non-hudi tables

2022-06-03 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-4183: Description: For now, when users specify `HoodieCatalog` in 0.11.0, they would not create non-hudi tables since

[jira] [Comment Edited] (HUDI-4178) HoodieSpark3Analysis does not pass schema from Spark Catalog

2022-06-03 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545899#comment-17545899 ] leesf edited comment on HUDI-4178 at 6/3/22 2:46 PM: - [~alexey.kudinkin] `making them

[jira] [Comment Edited] (HUDI-4178) HoodieSpark3Analysis does not pass schema from Spark Catalog

2022-06-03 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545899#comment-17545899 ] leesf edited comment on HUDI-4178 at 6/3/22 2:46 PM: - [~alexey.kudinkin] hi, `making

[jira] [Commented] (HUDI-4178) HoodieSpark3Analysis does not pass schema from Spark Catalog

2022-06-03 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545899#comment-17545899 ] leesf commented on HUDI-4178: - [~alexey.kudinkin] `making them fetch the schema from storage (either from

[jira] [Closed] (HUDI-4183) Fix using HoodieCatalog to create non-hudi tables

2022-06-03 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-4183. --- Resolution: Fixed > Fix using HoodieCatalog to create non-hudi tab

[jira] [Updated] (HUDI-4183) Fix using HoodieCatalog to create non-hudi tables

2022-06-03 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-4183: Fix Version/s: 0.12.0 > Fix using HoodieCatalog to create non-hudi tab

[jira] [Resolved] (HUDI-4183) Fix using HoodieCatalog to create non-hudi tables

2022-06-03 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-4183. - > Fix using HoodieCatalog to create non-hudi tab

[hudi] branch master updated: [HUDI-4183] Fix using HoodieCatalog to create non-hudi tables (#5743)

2022-06-03 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 3759a38b99 [HUDI-4183] Fix using HoodieCatalog

[jira] [Updated] (HUDI-4183) Fix using HoodieCatalog to create non-hudi tables

2022-06-02 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-4183: Summary: Fix using HoodieCatalog to create non-hudi tables (was: Fix using HoodieCatalog to create non hudi tables

[jira] [Created] (HUDI-4183) Fix using HoodieCatalog to create non hudi tables

2022-06-02 Thread leesf (Jira)
leesf created HUDI-4183: --- Summary: Fix using HoodieCatalog to create non hudi tables Key: HUDI-4183 URL: https://issues.apache.org/jira/browse/HUDI-4183 Project: Apache Hudi Issue Type: Improvement

[hudi] branch master updated (7f8630cc57 -> 51602a34f7)

2022-06-02 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 7f8630cc57 [HUDI-4167] Remove the timeline refresh with initializing hoodie table (#5716) add 51602a34f7 [HUDI

[hudi] branch master updated: [HUDI-4149] Drop-Table fails when underlying table directory is broken (#5672)

2022-05-30 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 918c4f4e0b [HUDI-4149] Drop-Table fails when

[hudi] branch master updated: [HUDI-3963][RFC-53] Use Lock-Free Message Queue Disruptor Improving Hoodie Writing Efficiency (#5567)

2022-05-26 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 85962ee55d [HUDI-3963][RFC-53] Use Lock-Free

[hudi] branch master updated (8ec625d4d5 -> 922f765ead)

2022-05-21 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 8ec625d4d5 [HUDI-3858] Shade javax.servlet for Spark bundle jar (#5295) add 922f765ead [HUDI-4100] CTAS failed

[hudi] branch master updated (c7576f7613 -> 85b146d3d5)

2022-05-20 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from c7576f7613 [HUDI-4130] Remove the upgrade/downgrade for flink #initTable (#5642) add 85b146d3d5 [HUDI-3985

[hudi] branch master updated (008616c4f6 -> 199f64255e)

2022-05-18 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 008616c4f6 [HUDI-3942] [RFC-50] Improve Timeline Server (#5392) add 199f64255e [HUDI-4111] Bump ANTLR runtime

[hudi] branch master updated: [HUDI-3123] consistent hashing index: basic write path (upsert/insert) (#4480)

2022-05-15 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 61030d8e7a [HUDI-3123] consistent hashing index

[hudi] branch master updated (4a8589f222 -> 7f0c1f3ddf)

2022-05-11 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 4a8589f222 [HUDI-4038] Avoid calling `getDataSize` after every record written (#5497) add 7f0c1f3ddf [HUDI-4079

[hudi] branch master updated: [HUDI-3085] Improve bulk insert partitioner abstraction (#4441)

2022-04-25 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new f2ba0fead2 [HUDI-3085] Improve bulk insert

[hudi] branch master updated: [HUDI-3923] Fix cast exception while reading boolean type of partitioned field (#5373)

2022-04-23 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 5e5c177e4b [HUDI-3923] Fix cast exception while

[jira] [Commented] (HUDI-3861) 'path' in CatalogTable#properties failed to be updated when renaming table

2022-04-12 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17521087#comment-17521087 ] leesf commented on HUDI-3861: - [~KnightChess] yeah, if the real table path is updated, the tblp should also

[jira] [Commented] (HUDI-3861) 'path' in CatalogTable#properties failed to be updated when renaming table

2022-04-12 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17521054#comment-17521054 ] leesf commented on HUDI-3861: - [~jinxing6...@126.com] Thanks for reporting this, but I think renaming should

[hudi] branch master updated (d074089 -> 72e0b52)

2022-03-28 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from d074089 [HUDI-2566] Adding multi-writer test support to integ test (#5065) add 72e0b52 [HUDI-3722] Fix truncate

[hudi] branch master updated (f2a93ea -> d31cde2)

2022-03-27 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from f2a93ea [HUDI-3724] Fixing closure of ParquetReader (#5141) add d31cde2 [MINOR] Fix call command parser use

[hudi] branch master updated (9da2dd4 -> f2a93ea)

2022-03-27 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 9da2dd4 [HUDI-3719] High performance costs of AvroSerizlizer in DataSource wr… (#5137) add f2a93ea [HUDI-3724

[jira] [Commented] (HUDI-2520) Certify sync with Hive 3

2022-03-26 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17512797#comment-17512797 ] leesf commented on HUDI-2520: - [~rex_xiong] hi, are you working on a fix? > Certify sync with Hiv

[hudi] branch asf-site updated: [HUDI-3658] Adding Video of Hudi Meetup on March1st, 2022 (#5068)

2022-03-18 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 3e46b28 [HUDI-3658] Adding Video of Hudi

[hudi] branch master updated (18cdad9 -> faed699)

2022-03-11 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 18cdad9 [HUDI-2999] [RFC-42] RFC for consistent hashing index (#4326) add faed699 [HUDI-3566] Add thread factory

[hudi] branch master updated (f7088a9 -> a81a632)

2022-03-01 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from f7088a9 [HUDI-3497] Adding Datatable validator tool (#4902) add a81a632 [HUDI-3441] Add support for "m

[jira] [Created] (HUDI-3489) Unify config to avoid duplicate code

2022-02-23 Thread leesf (Jira)
leesf created HUDI-3489: --- Summary: Unify config to avoid duplicate code Key: HUDI-3489 URL: https://issues.apache.org/jira/browse/HUDI-3489 Project: Apache Hudi Issue Type: Improvement

[jira] [Commented] (HUDI-2732) Spark Datasource V2 integration RFC

2022-02-22 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17496453#comment-17496453 ] leesf commented on HUDI-2732: - [~shivnarayan] yes, we can close the Jira. > Spark Datasource V2 integrat

[hudi] branch master updated: [HUDI-2732][RFC-38] Spark Datasource V2 Integration (#3964)

2022-02-21 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 76b6ad6 [HUDI-2732][RFC-38] Spark Datasource V2

[jira] [Updated] (HUDI-3416) Incremental read using v2 datasource

2022-02-13 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-3416: Issue Type: Improvement (was: Bug) > Incremental read using v2 datasou

[jira] [Created] (HUDI-3416) Incremental read using v2 datasource

2022-02-13 Thread leesf (Jira)
leesf created HUDI-3416: --- Summary: Incremental read using v2 datasource Key: HUDI-3416 URL: https://issues.apache.org/jira/browse/HUDI-3416 Project: Apache Hudi Issue Type: Bug Reporter

[hudi] branch master updated (26c3f79 -> bf409e8)

2022-01-24 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 26c3f79 [HUDI-3237] gracefully fail to change column data type (#4677) add bf409e8 [MINOR] Standardize

[jira] [Assigned] (HUDI-2645) Rewrite Zoptimize and other files in scala into Java

2022-01-17 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reassigned HUDI-2645: --- Assignee: shibei > Rewrite Zoptimize and other files in scala into J

[jira] [Assigned] (HUDI-2873) Support optimize data layout by sql and make the build more fast

2022-01-17 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reassigned HUDI-2873: --- Assignee: shibei > Support optimize data layout by sql and make the build more f

[hudi] branch master updated (20e7983 -> f184474)

2022-01-17 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 20e7983 [HUDI-3252] Avoid creating empty requestedReplaceCommit in the startCommit method (#4515) add f184474

[jira] [Closed] (HUDI-3172) Refactor hudi existing modules to make more code reuse in V2 implementation

2022-01-16 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-3172. --- > Refactor hudi existing modules to make more code reuse in V2 implementat

[jira] [Reopened] (HUDI-3172) Refactor hudi existing modules to make more code reuse in V2 implementation

2022-01-16 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reopened HUDI-3172: - > Refactor hudi existing modules to make more code reuse in V2 implementat

[jira] [Resolved] (HUDI-3172) Refactor hudi existing modules to make more code reuse in V2 implementation

2022-01-16 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-3172. - > Refactor hudi existing modules to make more code reuse in V2 implementat

[jira] [Created] (HUDI-3254) Introduce HoodieCatalog to manage tables for Spark Datasource V2

2022-01-16 Thread leesf (Jira)
leesf created HUDI-3254: --- Summary: Introduce HoodieCatalog to manage tables for Spark Datasource V2 Key: HUDI-3254 URL: https://issues.apache.org/jira/browse/HUDI-3254 Project: Apache Hudi Issue Type

[jira] [Resolved] (HUDI-3172) Refactor hudi existing modules to make more code reuse in V2 implementation

2022-01-16 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-3172. - > Refactor hudi existing modules to make more code reuse in V2 implementat

[jira] [Closed] (HUDI-3172) Refactor hudi existing modules to make more code reuse in V2 implementation

2022-01-16 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-3172. --- > Refactor hudi existing modules to make more code reuse in V2 implementat

[hudi] branch master updated: [MINOR] Remove org.apache.directory.api.util.Strings import (#4601)

2022-01-16 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 28b3b6a [MINOR] Remove

[hudi] branch master updated (5e0171a -> 822230d)

2022-01-16 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 5e0171a [HUDI-3198] Improve Spark SQL create table from existing hudi table (#4584) add 822230d [MINOR

[hudi] branch master updated (195dac9 -> 5ce45c4)

2022-01-13 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 195dac9 [MINOR] Disable flaky tests to unlock CI (#4592) add 5ce45c4 [HUDI-3172] Refactor hudi existing modules

[jira] [Updated] (HUDI-3172) Refactor hudi existing modules to make more code reuse in V2 implementation

2022-01-05 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-3172: Issue Type: Improvement (was: Bug) > Refactor hudi existing modules to make more code reuse in V2 implementat

[jira] [Assigned] (HUDI-3172) Refactor hudi existing modules to make more code reuse in V2 implementation

2022-01-05 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reassigned HUDI-3172: --- Assignee: leesf > Refactor hudi existing modules to make more code reuse in V2 implementat

[jira] [Updated] (HUDI-3140) Fix bulk_insert failure on Spark 3.2.0

2022-01-05 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-3140: Fix Version/s: 0.11.0 > Fix bulk_insert failure on Spark 3.

[jira] [Resolved] (HUDI-3140) Fix bulk_insert failure on Spark 3.2.0

2022-01-05 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-3140. - > Fix bulk_insert failure on Spark 3.2.0 > -- > > Ke

  1   2   3   4   5   6   7   8   9   10   >