commits  

Messages by Thread

• (fluss) branch main updated: [lake/paimon] Support custom Paimon path (#3523) yuxia
• (fluss) branch main updated: [server] Add configurable disk write-limit recover ratio (#3612) jark
• (fluss) branch main updated: [client] Fix data hole in primary key table batch read (#3627) yuxia
• (fluss) branch main updated: [server] Manage multiple users for sasl/plain authentication via cluster properties (#3047) jark
• (fluss) branch main updated: [hotfix][dist] Disable Log4j shutdown hook in foreground mode (#3634) yunhong
• (fluss) branch main updated: [lake/tiering] Add pendingRecordLag metric for lake tiering (#3469) yuxia
• (fluss) branch main updated: [rust][tests] Add DynamicWriteBatchSizeEstimator integration tests (#3588) aborisov
• (fluss) branch main updated: [cpp] Encode CreateTable column types losslessly (#3603) aborisov
• (fluss) branch main updated: [server] Require new leader ack for leader-only rebalance (#3556) jark
• (fluss) branch main updated: [server] Add negative cache for non-existent partition IDs in metadata requests (#3511) jark
• (fluss) branch main updated: [tiering] fix flink tiering duplicate write result (#3608) yuxia
• (fluss) branch main updated: [server] Periodically checkpoint log recovery points (#3547) jark
• (fluss) branch dependabot/cargo/fluss-rust/arrow-schema-59.0.0 deleted (was d6259ce7a) github-bot
• (fluss) branch dependabot/cargo/fluss-rust/clap-4.6.1 updated (75f355896 -> daded0dac) github-bot
• (fluss) branch main updated: chore: bump arrow stack to 59 (#3600) aborisov
• (fluss) branch main updated: [server] Reject KV leader promotion under disk write lock (#3539) jark
• (fluss) branch main updated (9f0284ddc -> c5a0c00a2) aborisov
  • (fluss) 01/02: [fs] Support AWS S3 credentials provider mode aborisov
  • (fluss) 02/02: [docs] Document S3 custom AWS credentials provider mode aborisov
• (fluss) branch main updated: [docs] Add rust/python/c++/elixir component tags (#3602) yuxia
• (fluss) branch main updated: [server] Limit max bucket num per table partition (#3597) aborisov
• (fluss) branch dependabot/github_actions/actions/cache-6 updated (7acbd5c79 -> aa9752c46) github-bot
• (fluss) branch main updated: [ci] Fix stale elixir NIF cache; run client suites on workflow change (#3598) aborisov
• (fluss) branch main updated: [test] Raise disk write-limit ratio in FlussClusterExtension to avoid test flakiness (#3594) yunhong
• (fluss) branch main updated (dfa33de7c -> cf180274c) yunhong
  • (fluss) 01/02: [common] Limit default max bucket count to 20000 yunhong
  • (fluss) 02/02: [server] Apply ZooKeeper max buffer size without config path yunhong
• (fluss) branch main updated: [docs] Reorganize Streaming Lakehouse documentation to higlight deployment and core features (#2699) yuxia
• (fluss) branch main updated: [rust/elixir] Align rustler version to 0.38.0 in mix.exs and mix.lock (#3587) yuxia
• (fluss) branch dependabot/cargo/fluss-rust/astral-tokio-tar-0.6.3 created (now 8b54cc4f2) github-bot
• (fluss) branch dependabot/cargo/fluss-rust/strum-0.28.0 created (now eee296a3f) github-bot
• (fluss) branch dependabot/cargo/fluss-rust/arrow-schema-59.0.0 created (now d6259ce7a) github-bot
• (fluss) branch dependabot/cargo/fluss-rust/prost-build-0.14.4 created (now 04f2af588) github-bot
• (fluss) branch dependabot/cargo/fluss-rust/uuid-1.23.4 created (now 032bc1a1d) github-bot
• (fluss) branch dependabot/cargo/fluss-rust/clap-4.6.1 created (now 75f355896) github-bot
• (fluss) branch dependabot/github_actions/actions/upload-artifact-7 created (now bcaa73d2e) github-bot
• (fluss) branch dependabot/github_actions/actions/checkout-7 created (now bc4ad86d3) github-bot
• (fluss) branch dependabot/github_actions/erlef/setup-beam-1.24.1 created (now 472335b00) github-bot
• (fluss) branch dependabot/github_actions/actions/cache-6 created (now 7acbd5c79) github-bot
• (fluss) branch dependabot/github_actions/actions/download-artifact-8 created (now d4e88ff23) github-bot
• (fluss) branch main updated (8cd8d1628 -> 400e132bf) aborisov
• (fluss) branch main updated: [lake] Fix union read duplicating rows for non-String partition columns (#3500) yuxia
• (fluss) branch main updated: [dist] Fix incorrect package name of ZK in logger conf (#2768) yuxia
• (fluss) branch main updated: [client] Avoid per-record AutoPartitionStrategy construction in WriterClient.doSend in log tables (#3529) aborisov
• (fluss-rust) branch main updated: [elixir] feat: Support full table descriptor options in create_table (#647) aborisov
• (fluss) branch main updated: [metrics][docs] Support Basic Auth for Prometheus PushGateway reporter (#3552) yuxia
• (fluss) branch main updated: [server] Support adding aggregation columns (#3459) yuxia
• (fluss) branch main updated: [docs] Add PrometheusPushGateway and InfluxDB to Metrics Storage in overview (#3560) yuxia
• (fluss) branch main updated: [lake/iceberg] Fix predicate push-down for TINYINT / SMALLINT into Iceberg (#3565) yuxia
• (fluss) branch main updated: [flink]Newly discovered partition read from earliest rather than scan.startup.mode (#3548) hongshun
• (fluss-rust) branch dependabot/cargo/log-0.4.31 deleted (was b4e001fa) github-bot
• (fluss-rust) branch dependabot/cargo/log-0.4.33 created (now 15c6e5fe) github-bot
• (fluss-rust) branch dependabot/cargo/arrow-schema-59.0.0 created (now 9c3cf302) github-bot
• (fluss-rust) branch dependabot/cargo/bitvec-1.1.1 created (now 8f5c76e8) github-bot
• (fluss-rust) branch dependabot/github_actions/actions/checkout-7 created (now 71850b4b) github-bot
• (fluss-rust) branch dependabot/github_actions/actions/cache-6 created (now c8797050) github-bot
• (fluss) branch main updated: [server] Set table_id on prepareLakeTableSnapshot error response (#3550) yuxia
• (fluss-shaded) branch main updated: [arrow] Bump Arrow Java to 19.0.0 and upgrade CI to Java 11 (#11) yunhong
• (fluss) branch main updated: [lake/iceberg] Fix listener leak in IcebergLakeCommitter (#3542) yuxia
• (fluss) branch main updated: [lake/hudi] Add Hudi Flink union read primary key table IT (#3541) yuxia
• (fluss-rust) branch main updated: [elixir] ci: bump OTP to 28.5.0.2 (#646) aborisov
• (fluss) branch main updated: [security] Redact sensitive config values in startup logs (#3486) aborisov
• (fluss) branch main updated: [lake/iceberg] Fix integer overflow when converting Iceberg LocalTime to Fluss millis-of-day (#3535) yuxia
• (fluss-rust) branch dependabot/cargo/log-0.4.31 updated (4688fbf8 -> b4e001fa) github-bot
• (fluss-rust) branch main updated: [feat] Support subscribing to primary-key table changelog (#639) yuxia
• (fluss) branch main updated: [client] Add validation for client.scanner.log.max-poll-records and client.connect-timeout (#3069) aborisov
• (fluss) branch main updated: [docs] Add Apache Polaris/Iceberg REST catalog quick-start guide (#3515) mehulbatra
• (fluss-rust) branch main updated: [rust] Add Fluss 1.x protocol support to the admin client (#631) aborisov
• (fluss-rust) branch main updated: [elixir] feat: Add get_table_info admin call (#640) aborisov
• (fluss) branch main updated: [lake/hudi] Add Hudi Flink union read log table IT (#3528) yuxia
• (fluss) branch main updated: [lake/hudi] Add Flink union read test base for Hudi (#3522) yuxia
• (fluss) branch main updated: [client] Enum conversion functionality for typed writer/reader (#3447) aborisov
• (fluss) branch main updated: [lake/hudi] Introduce Hudi compaction in tiering service (#3518) yuxia
• (fluss-rust) branch main updated: [rust] Add RPC message wrappers for extended operations (#630) aborisov
• (fluss) branch main updated: [fs] Add jetty exclusion to fluss-fs-azure (#3508) yuxia
• (fluss) branch main updated: [lake/hudi] Introduce Hudi LakeCommitter (#3509) yuxia
• (fluss-rust) branch main updated: [rust] Replace raw i64/i32 with TableId/PartitionId/BucketId type aliases in write path (#635) aborisov
• (fluss) branch main updated: [lake] Refactor tiering split assertions to ignore round metadata (#3506) aborisov
• (fluss) branch main updated: [client] Add support of column aliasing for PojoConverter (#3444) aborisov
• (fluss) branch main updated: [lake/hudi] Introduce Hudi lake writer support for tiering tables (#3507) yuxia
• (fluss) branch main updated: [lake/hudi] Introduce split index field for tiering splits (#3503) yuxia
• (fluss) branch main updated: [lake/hudi] Support predicate pushdown (#3501) yuxia
• (fluss) branch main updated: [flink] Gate single-row lookup pushdown on partition liveness (#3442) aborisov
• (fluss) branch main updated: [lake/hudi] Introduce Hudi source reader (#3499) yuxia
• (fluss-rust) branch main updated (bf94c1c7 -> 9d682e38) aborisov
  • (fluss-rust) 02/02: tighten pub visibility for protos aborisov
  • (fluss-rust) 01/02: [rust] Add RPC message wrappers for core DB/table operations aborisov
• (fluss-rust) branch main updated: [client] Allow bootstrap endpoint with unknown server type (#622) aborisov
• (fluss-rust) branch main updated: [rust] Sync Fluss 1.x proto definitions and ApiKey registry (#628) aborisov
• (fluss-rust) branch main updated: chore: fix tighten test cluster cleanup matching (#627) aborisov
• (fluss-rust) branch main updated: chore: fix(test-cluster): manage containers via testcontainers' Docker client so start/stop share one runtime (#624) leekei
• (fluss-rust) branch main updated: chore: [metrics] Add client metrics and prometheus example (#617) leekei
• (fluss) branch main updated: [test] Fix disk usage collector test (#3491) yunhong
• (fluss) branch main updated: [lake/hudi] Introduce Hudi source split planner (#3456) yuxia
• (fluss) branch main updated: Fix inverted awaitTermination condition in LookupClient#close (#3328) yuxia
• (fluss) branch main updated: [rpc][server][client] add ListRemoteLogManifests and ListKvSnapshots RPCs for orphan cleanup (#3480) jark
• (fluss) branch main updated: [server] Fix tableCount metric after dropping partitioned tables (#3482) jark
• (fluss-rust) branch main updated: [c++] Limit batch scanner (#614) aborisov
• (fluss-rust) branch dependabot/cargo/tokio-1.52.3 deleted (was 22ebcd41) github-bot
• (fluss-rust) branch main updated: chore: bump tokio from 1.51.0 to 1.52.3 (#592) aborisov
• (fluss-rust) branch dependabot/github_actions/astral-sh/setup-uv-8.1.0 deleted (was 9781b1a6) github-bot
• (fluss-rust) branch main updated: chore: bump astral-sh/setup-uv from 7.6.0 to 8.2.0 (#591) aborisov
• (fluss-rust) branch dependabot/cargo/tokio-1.52.3 updated (11ea6461 -> 22ebcd41) github-bot
• (fluss-rust) branch dependabot/github_actions/mozilla-actions/sccache-action-0.0.10 deleted (was f325f22c) github-bot
• (fluss-rust) branch main updated: chore: bump mozilla-actions/sccache-action from 0.0.9 to 0.0.10 (#590) aborisov
• (fluss-rust) branch dependabot/cargo/rustler-0.38.0 deleted (was 3c4d06ea) github-bot
• (fluss-rust) branch main updated: chore: bump rustler from 0.37.3 to 0.38.0 (#594) aborisov
• (fluss) branch main updated: [server] Support altering auto partition enabled option (#3453) yuxia
• (fluss) branch main updated: [server] Support plugin discovery for client authentication (#3474) jark
• (fluss) branch main updated: [hotfix] Use short name for ClusterHealth in TestAdminAdapter (#3472) yunhong
• (fluss) branch main updated: [server] Add TableLifecycleThrottler to throttle drops in coordinator queue (#3174) yunhong
• (fluss-rust) branch main updated: [python] Limit scan (#613) aborisov
• (fluss-rust) branch dependabot/github_actions/astral-sh/setup-uv-8.1.0 updated (9f62af6c -> 9781b1a6) github-bot
• (fluss-rust) branch main updated: [python] Add stub test to catch pyi drift in CI (#616) aborisov
• (fluss-rust) branch main updated: [elixir] feat: Allow comment and custom_properties on create_database (#597) aborisov
• (fluss-website) branch asf-site updated: Deploy website - based on 69234c3a192156454959daeae9f450700063b0ce github-bot
• (fluss) branch main updated: [website] Use theme-aware diagram on intro page (#3470) jark
• (fluss) branch main updated: [server] Add Cluster Health API implementation (#3400) jark
• (fluss) branch main updated: [flink] Fail fast on batch virtual log table reads (#3402) yuxia
• (fluss-blog) branch main updated: Tiering service part 3 (#11) ipolyzos
• (fluss) branch main updated: [test] Delete temp dir after cluster shutdown in FlussClusterExtension (#3411) yuxia
• (fluss) branch main updated: [server] Allow altering datalake auto-compaction before lake enabled (#3458) yuxia
• (fluss-rust) branch main updated: [python] Split examples in Python and enforce executability in CI for python examples (#610) aborisov
• (fluss) branch main updated: [spark] Add scan.maxRecordsPerPartition config to split log table input partitions (#3260) aborisov
• (fluss) branch main updated: [server] Support altering auto partition num-precreate option (#3434) yuxia
• (fluss) branch main updated: [test] Fix ComponentClassLoaderTest tmpdir path handling (#3450) yuxia
• (fluss) branch main updated: [docs] Update README engine support (#3438) yuxia
• (fluss) branch main updated: [hotfix] Fix typo in scanner metric name (#3448) yuxia
• (fluss-blog) branch main updated: Tiering service Deep Dive part 2 (#10) ipolyzos
• (fluss-rust) branch main updated: [metrics] Add writer pipeline metrics (#609) aborisov
• (fluss) branch main updated: [FIP-37] Add bitmap aggregate functions: rb_build_agg, rb_or_agg, rb_and_agg and register via FlussCatalog (#3398) ipolyzos
• (fluss) branch main updated: [flink] Add union read support to datastream (#3432) aborisov
• (fluss) branch main updated: [client] Restrict the use of client.security.sasl.jaas.config to PlainLoginModule exclusively. (#3425) jark
• (fluss) branch main updated: [server] Keep flushedLogOffset monotonic to fix row count after failover (#3427) yunhong
• (fluss-rust) branch main updated: [c++] add prefix lookup (#606) aborisov
• (fluss-rust) branch main updated: [python] map and row complex types support (#601) aborisov
• (fluss) branch main updated: fix: remote orphan files and directories when tablet starts up (#3388) yunhong
• (fluss) branch main updated: [server] Add per-task timeout for RebalanceManager to prevent indefinite blocking (#3429) yunhong
• (fluss-rust) branch main updated: docs: comprehensive README update (#600) yuxia
• (fluss) branch main updated: [lake/paimon] TieringSourceReader adjust to scan arrow record batch and write arrow record batch to lake (#3430) yuxia
• (fluss) branch main updated: [client] Fix tiering hang on first_row merge engine empty batches (#3242) yuxia
• (fluss) branch main updated: [fs] Mask S3 delegation token access keys in logs (#3421) yuxia
• (fluss-rust) branch main updated: [elixir] Optimize CI/CD with proper actions, reusing compiled deps (#598) aborisov
• (fluss-blog) branch main updated: Trigger CI (#13) aborisov
• (fluss-blog) branch main updated: tiering-service-part1-hotfix (#12) ipolyzos
• (fluss-website) branch asf-site updated: Deploy website - based on e32ba47099fb1ea03e3565ce6db903495d58a350 github-bot
  • (fluss-website) branch asf-site updated: Deploy website - based on e32ba47099fb1ea03e3565ce6db903495d58a350 github-bot
• (fluss-blog) branch main updated: Tiering Service Deep Dive - Part1 (#9) ipolyzos
• (fluss) branch main updated: [client] Support log scanner scan to arrow record batch (#2995) yuxia
• (fluss-rust) branch main updated: [elixir] feat: Add get_database_info admin call (#586) aborisov
• (fluss) branch dependabot/maven/fluss-lake/org.apache.flink-flink-table-api-java-1.20.4 created (now 808fb6d97) github-bot
• (fluss) branch main updated: [lake/hudi] Introduce Hudi LakeCatalog to create table (#3395) yuxia
• (fluss) branch main updated: [server] Add table-level config for standby replica with ALTER TABLE support (#3257) yunhong
• (fluss) branch main updated: [client] Fix stale metadata on readOnlyGateway by adding RetryableGatewayClientProxy (#3390) aborisov
• (fluss-rust) branch dependabot/cargo/strum_macros-0.28.0 created (now 037627fe) github-bot
• (fluss-rust) branch dependabot/cargo/log-0.4.31 created (now 4688fbf8) github-bot
• (fluss-rust) branch dependabot/cargo/tokio-1.52.3 created (now 11ea6461) github-bot
• (fluss-rust) branch dependabot/github_actions/astral-sh/setup-uv-8.1.0 created (now 9f62af6c) github-bot
• (fluss-rust) branch dependabot/github_actions/actions/upload-artifact-7 created (now b0522fdf) github-bot
• (fluss-rust) branch dependabot/github_actions/mozilla-actions/sccache-action-0.0.10 created (now f325f22c) github-bot
• (fluss-rust) branch dependabot/github_actions/pypa/gh-action-pypi-publish-1.14.0 created (now d541a70f) github-bot
• (fluss-rust) branch main updated: [rust] Support paimon key encoder. (#579) aborisov
• (fluss) branch main updated: [server] Fix flaky RebalanceManagerITCase.testBuildClusterModel (#3306) yunhong
• (fluss) branch main updated: [client] Abort write batch if table id changes. (#2747) yunhong
• (fluss-rust) branch main updated: [metrics] Add last_poll_seconds_ago scanner metric (#581) aborisov
• (fluss-rust) branch main updated (7d238ec5 -> 20e30e8f) leekei
• (fluss-blog) branch main updated: [blog] Fluss storage hierarchy (#8) ipolyzos
• (fluss) branch main updated: [spark] Implement SupportsPushDownLimit DSv2 interface (#3346) aborisov
• (fluss) branch main updated: [spark] Split non-partition and partition predicates from pushPredicates to limit pushdown (#3397) aborisov
• (fluss) branch main updated: [server] Fix flaky RebalanceManagerITCase.testRebalanceWithRemoteLog (#3313) yunhong
• (fluss-rust) branch main updated: [elixir] feat: Add first batch of admin calls (#583) aborisov
• (fluss) branch main updated: [website] Add Security Updates table to security page (#3408) jark
• (fluss-rust) branch main updated: [elixir] chore: Add dialyzer and tighten Fluss.Config setter guards (#582) aborisov
• (fluss-rust) branch dependabot/cargo/astral-tokio-tar-0.6.1 deleted (was fac0c7bb) github-bot
• (fluss-rust) branch dependabot/cargo/astral-tokio-tar-0.6.2 created (now f24fa7a5) github-bot
• (fluss) branch main updated: [client] Initialize lake comparator before merge read (#3406) aborisov
• (fluss) branch main updated: [server] Optimize RemoteLogFetcher with async prefetch for recovery (#3132) aborisov
• (fluss) branch main updated: org-names (#3380) ipolyzos
• (fluss) branch main updated: feat: [FLUSS-2686] Add COS filesystem support (#2836) leekei
• (fluss) branch main updated: [server] Add request queue size metric per processor (#3232) aborisov
• (fluss-rust) branch main updated: [elixir] feat: Extend Fluss.Config with security, SASL and connect timeout options (#577) aborisov
• (fluss-rust) branch main updated: chore: [ci] Fix rustdoc warning and promote warning to error in CI (#576) leekei
• (fluss-rust) branch main updated: [elixir] feat: Extend Fluss.Config with scanner tuning options (#574) aborisov
• (fluss) branch main updated: [log] Output the leader server id and related table ids on fetching log failure (#2792) aborisov
• (fluss) branch main updated: [server] make RemoteLogManifest sorted with startOffset (#3194) aborisov
• (fluss) branch main updated: [kv] Treat full-schema partial writes as full row for DefaultRowMerger (#3325) yuxia
• (fluss-rust) branch main updated (9f69ae46 -> 426bb1a2) aborisov
  • (fluss-rust) 01/02: [client] Implement BatchScanner with limit-based scan aborisov
  • (fluss-rust) 02/02: [client] Fix KV limit-scan decode + enforce limit, support schema evolution aborisov
• (fluss) branch main updated: [website] Add how to host community call steps (#2760) jark
• (fluss-rust) branch main updated: [tests] replace fixed tokio::time::sleep workarounds with wait_for_table_ready helper. (#564) aborisov
• (fluss) branch main updated: [flink] Preserve log-only source restore mode (#3355) yuxia
• (fluss) branch main updated (3d6ababcd -> b2c4a8481) yuxia
• (fluss) branch main updated: [lake] Handle coordinator disconnect in TieringSourceEnumerator (#3107) yuxia
• (fluss-rust) branch main updated: [elixir] feat: Extend Fluss.Config with writer tuning options (#566) aborisov
• (fluss) branch main updated: [spark] Overwrite paimon dlf authentication configs by spark job level properties yuxia
• (fluss-rust) branch main updated (4ca24ea0 -> 9eee5002) leekei
• (fluss-rust) branch main updated: [metrics] Add scanner poll-timing metrics (#555) aborisov
• (fluss) branch main updated: [flink][spark] Fix partition pruning for non-string partition keys (#3322) yuxia
• (fluss) branch release-0.9 updated: fix broken path (#3382) mehulbatra

• Earlier messages