dependabot[bot] opened a new pull request, #805: URL: https://github.com/apache/hudi-rs/pull/805
Updates the requirements on [lance-io](https://github.com/lance-format/lance) to permit the latest version. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/lance-format/lance/releases";>lance-io's releases</a>.</em></p> <blockquote> <h2>v12.0.0</h2> <!-- raw HTML omitted --> <h2>What's Changed</h2> <h3>Breaking Changes đ </h3> <ul> <li>feat(io)!: paginated directory listing on ObjectStore by <a href="https://github.com/wjones127";><code>@âwjones127</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8606";>lance-format/lance#8606</a></li> <li>perf(mem_wal)!: serve the shard manifest from the store that wrote it by <a href="https://github.com/hamersaw";><code>@âhamersaw</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8640";>lance-format/lance#8640</a></li> <li>feat(table): predecessor-conditioned publication for external manifest stores by <a href="https://github.com/wkalt";><code>@âwkalt</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8800";>lance-format/lance#8800</a></li> <li>feat(namespace)!: accept multiple columns for the merge insert on key by <a href="https://github.com/wjones127";><code>@âwjones127</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8915";>lance-format/lance#8915</a></li> <li>feat: make data file parts serializable by <a href="https://github.com/Xuanwo";><code>@âXuanwo</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/9072";>lance-format/lance#9072</a></li> <li>fix(index)!: do not route json_extract predicates to JSON indices by <a href="https://github.com/westonpace";><code>@âwestonpace</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/9101";>lance-format/lance#9101</a></li> </ul> <h3>New Features đ</h3> <ul> <li>feat(java): support segment-based distributed vector search by <a href="https://github.com/summaryzb";><code>@âsummaryzb</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/7169";>lance-format/lance#7169</a></li> <li>feat(index): share IVF partition scans across batch vector queries by <a href="https://github.com/sezruby";><code>@âsezruby</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/7640";>lance-format/lance#7640</a></li> <li>feat(mem_wal): make write backpressure injectable and account index memory by <a href="https://github.com/hamersaw";><code>@âhamersaw</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/7831";>lance-format/lance#7831</a></li> <li>feat(python): add Bitmap binding for RoaringBitmap by <a href="https://github.com/wjones127";><code>@âwjones127</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/7837";>lance-format/lance#7837</a></li> <li>feat(python): add LanceDataset.slice() method by <a href="https://github.com/Sapnilb15";><code>@âSapnilb15</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8059";>lance-format/lance#8059</a></li> <li>fix(mem-wal): resolve writer shard spec identity by <a href="https://github.com/u70b3";><code>@âu70b3</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8112";>lance-format/lance#8112</a></li> <li>feat(python): expose more scanner options on LanceFragment by <a href="https://github.com/keunhong";><code>@âkeunhong</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8429";>lance-format/lance#8429</a></li> <li>perf(java): reduce fragment statistics allocations by <a href="https://github.com/everySympathy";><code>@âeverySympathy</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8452";>lance-format/lance#8452</a></li> <li>feat(python): expose ObjectStoreProvider registration in pylance by <a href="https://github.com/farazshaikh";><code>@âfarazshaikh</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8522";>lance-format/lance#8522</a></li> <li>feat: add mixed data file version capability by <a href="https://github.com/Xuanwo";><code>@âXuanwo</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8580";>lance-format/lance#8580</a></li> <li>feat: validate mixed V2 data file versions by <a href="https://github.com/Xuanwo";><code>@âXuanwo</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8581";>lance-format/lance#8581</a></li> <li>feat: support per-operation V2 write targets by <a href="https://github.com/Xuanwo";><code>@âXuanwo</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8582";>lance-format/lance#8582</a></li> <li>feat: propagate exact V2 versions across dataset operations by <a href="https://github.com/Xuanwo";><code>@âXuanwo</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8583";>lance-format/lance#8583</a></li> <li>feat: target exact V2 versions in compaction by <a href="https://github.com/Xuanwo";><code>@âXuanwo</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8584";>lance-format/lance#8584</a></li> <li>feat(cleanup): support cleaning specific dataset versions by <a href="https://github.com/hfutatzhanghb";><code>@âhfutatzhanghb</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8617";>lance-format/lance#8617</a></li> <li>feat: resolve stable file format to 2.2 by <a href="https://github.com/Xuanwo";><code>@âXuanwo</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8657";>lance-format/lance#8657</a></li> <li>feat: add column slice stitching by <a href="https://github.com/Xuanwo";><code>@âXuanwo</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8660";>lance-format/lance#8660</a></li> <li>feat: support BinaryView in packed blob writer via iterator-based extraction by <a href="https://github.com/lichuang";><code>@âlichuang</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8700";>lance-format/lance#8700</a></li> <li>feat(python): restore index retraining by <a href="https://github.com/ddupg";><code>@âddupg</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8786";>lance-format/lance#8786</a></li> <li>feat(encoding): add CANDIDATE_BATCH_SIZES and plan_decoded_bytes trait defaults by <a href="https://github.com/westonpace";><code>@âwestonpace</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8791";>lance-format/lance#8791</a></li> <li>feat(java): expose createIndex progress callbacks by <a href="https://github.com/hfutatzhanghb";><code>@âhfutatzhanghb</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8823";>lance-format/lance#8823</a></li> <li>feat(java): align inverted index options by <a href="https://github.com/ddupg";><code>@âddupg</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8829";>lance-format/lance#8829</a></li> <li>feat(mem_wal): let a writer read its own indexed prefix by <a href="https://github.com/hamersaw";><code>@âhamersaw</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8835";>lance-format/lance#8835</a></li> <li>fix(mem_wal): honor distance_range in the LSM vector planner by <a href="https://github.com/hamersaw";><code>@âhamersaw</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8845";>lance-format/lance#8845</a></li> <li>feat(python): return matched row offsets from fragment update_columns by <a href="https://github.com/zhangyue19921010";><code>@âzhangyue19921010</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8891";>lance-format/lance#8891</a></li> <li>feat(java): expose merge insert write mode by <a href="https://github.com/zhangyue19921010";><code>@âzhangyue19921010</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8918";>lance-format/lance#8918</a></li> <li>feat: budget blob materialization readahead by <a href="https://github.com/jackye1995";><code>@âjackye1995</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8919";>lance-format/lance#8919</a></li> <li>feat: add caller-managed data file parts by <a href="https://github.com/Xuanwo";><code>@âXuanwo</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8923";>lance-format/lance#8923</a></li> <li>feat(java): complete transaction operation mappings by <a href="https://github.com/everySympathy";><code>@âeverySympathy</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8925";>lance-format/lance#8925</a></li> <li>feat(index): default ivf_rq to 5-bit quantization by <a href="https://github.com/BubbleCal";><code>@âBubbleCal</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8936";>lance-format/lance#8936</a></li> <li>feat(java): expose referenced file metadata by <a href="https://github.com/everySympathy";><code>@âeverySympathy</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8962";>lance-format/lance#8962</a></li> <li>feat(mem_wal): record what a flushed SSTable holds by <a href="https://github.com/xuanyu-z";><code>@âxuanyu-z</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/8981";>lance-format/lance#8981</a></li> <li>feat(index): proportional hierarchical k-means for IVF training by <a href="https://github.com/BubbleCal";><code>@âBubbleCal</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/9050";>lance-format/lance#9050</a></li> <li>feat(index): split IVF partitions to target size and join undersized ones in one optimize pass by <a href="https://github.com/BubbleCal";><code>@âBubbleCal</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/9051";>lance-format/lance#9051</a></li> <li>feat: expose public accessor for the fragment reuse index by <a href="https://github.com/brendanclement";><code>@âbrendanclement</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/9112";>lance-format/lance#9112</a></li> <li>feat(dataset): expose lance dataset deep clone to python by <a href="https://github.com/dentiny";><code>@âdentiny</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/9181";>lance-format/lance#9181</a></li> <li>feat(search): select metric-aware initial IVF probe budgets by <a href="https://github.com/BubbleCal";><code>@âBubbleCal</code></a> in <a href="https://redirect.github.com/lance-format/lance/pull/9195";>lance-format/lance#9195</a></li> </ul> <h3>Bug Fixes đ</h3> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/lance-format/lance/blob/main/release_process.md";>lance-io's changelog</a>.</em></p> <blockquote> <h1>Release Process</h1> <p>Lance maintains a linear commit history with a controlled release process.</p> <ul> <li>All pull requests are merged into the <code>main</code> branch first.</li> <li>Beta releases (or preview releases) are created on-demand from the <code>main</code> branch.</li> <li>Stable releases (non-prereleases) are created only after a voting process and come from a release branch <code>release/vX.Y</code>. These are typically created once every two weeks.</li> <li>Release Candidates (RC) are created from release branches prior to voting.</li> <li>Minor releases can be cut from either main branch or an existing release branch (when main is targeting a major release).</li> <li>Patch releases are created by committing fixes directly to the release branch, voting on a new RC, and releasing.</li> <li>All changes (features, fixes) must be committed to main first, then cherry-picked to release branches as needed.</li> </ul> <pre lang="mermaid"><code>gitGraph commit branch feature checkout feature commit checkout main merge feature branch bugfix checkout bugfix commit id: "bugfix" checkout main branch "release/v1.4" checkout "release/v1.4" commit tag: "1.4.0-rc.1" commit tag: "1.4.0" checkout main merge bugfix commit id: "merged" checkout "release/v1.4" cherry-pick id: "merged" commit tag: "1.4.1-rc.1" commit tag: "1.4.1" checkout main commit tag: "2.0.0-beta.1" id: "breaking" checkout "release/v1.4" cherry-pick id: "breaking" tag: "1.5.0-rc.1" branch "release/v1.5" checkout "release/v1.5" commit tag: "1.5.0" <p></code></pre></p> <h2>Version Semantics</h2> <p>Lance uses version numbers inspired by semantic versioning, but with flexibility for practical release management. Specifically, minor releases can be cut from existing release branches when the main branch is targeting a major release.</p> <h3>Version Format</h3> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/lance-format/lance/commit/cbeec97cb893a66ad6b3db87f25a57ab0093f358";><code>cbeec97</code></a> chore: release version 12.0.0</li> <li><a href="https://github.com/lance-format/lance/commit/d60981b165e0e451386d9c2bc999a75ddab8b144";><code>d60981b</code></a> chore: release candidate 12.0.0-rc.1</li> <li><a href="https://github.com/lance-format/lance/commit/c3c9632a29a687b4b7e9fcae4282c8903b15ad55";><code>c3c9632</code></a> test(index): stabilize the IVF_HNSW_PQ multivector recall test (<a href="https://redirect.github.com/lance-format/lance/issues/9196";>#9196</a>)</li> <li><a href="https://github.com/lance-format/lance/commit/49223d319ce9a4f5997414a50a35255c0e26c1cf";><code>49223d3</code></a> feat: target exact V2 versions in compaction (<a href="https://redirect.github.com/lance-format/lance/issues/8584";>#8584</a>)</li> <li><a href="https://github.com/lance-format/lance/commit/fb33f1d820d5c3ec12a112a0b1fa1f55647329d1";><code>fb33f1d</code></a> feat(search): select metric-aware initial IVF probe budgets (<a href="https://redirect.github.com/lance-format/lance/issues/9195";>#9195</a>)</li> <li><a href="https://github.com/lance-format/lance/commit/a11b817ad0612c9d26f830d3d1bd37804a9441f9";><code>a11b817</code></a> fix(scanner): respect negated flag when converting <code>InList</code> filters to take o...</li> <li><a href="https://github.com/lance-format/lance/commit/39f8bca8eec85e45340863840cab375cada3ff01";><code>39f8bca</code></a> feat(dataset): expose lance dataset deep clone to python (<a href="https://redirect.github.com/lance-format/lance/issues/9181";>#9181</a>)</li> <li><a href="https://github.com/lance-format/lance/commit/f4acb661b32b2bde4962c109820923d1cd364957";><code>f4acb66</code></a> fix(dataset): handle lance dataset blobs on deep clone (<a href="https://redirect.github.com/lance-format/lance/issues/9185";>#9185</a>)</li> <li><a href="https://github.com/lance-format/lance/commit/08de07e969d8636d3658a91ce624d4e75219f9b5";><code>08de07e</code></a> perf(fts): skip phrase position decode when the BM25 score cannot ent⌠(<a href="https://redirect.github.com/lance-format/lance/issues/9153";>#9153</a>)</li> <li><a href="https://github.com/lance-format/lance/commit/73a5d3c6735412eb24e182091d5c4868c89ada86";><code>73a5d3c</code></a> feat: propagate exact V2 versions across dataset operations (<a href="https://redirect.github.com/lance-format/lance/issues/8583";>#8583</a>)</li> <li>Additional commits viewable in <a href="https://github.com/lance-format/lance/compare/v11.0.0...v12.0.0";>compare view</a></li> </ul> </details> <br /> Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
