lxy-9602 opened a new pull request, #583: URL: https://github.com/apache/paimon-cpp/pull/583
<!-- PR titles must follow Conventional Commits: <type>(<optional-scope>): <description> --> ### Purpose <!-- Linking this pull request to the issue --> Linked issue: #158 Enable Lumina vector search over uncommitted data in append and append deduplicate modes. - Register the Lumina real-time index plugin with per-column configuration for `bruteforce` and `flatnsw`. - Apply scalar filters and committed or pending deletion vectors before source-local TopK. - Allocate search scratch memory from the query pool and track retained index memory separately. - Preserve the existing read-and-write commit path, with a TODO for exporting memory indexes using offset-to-row-ID remapping. <!-- What is the purpose of the change --> ### Tests - Add unit coverage for configuration, input validation, offset bounds, pre-filtering, memory accounting, reader lifetime, and concurrent reads and writes. - Add integration coverage using real Lumina indexes with indexed and unindexed scalar predicates across memory, disk, deletion vectors, and commit transitions. <!-- Describe tests added or updated and what they cover; explain if no test changes are needed. Omit execution commands, results, and reasons tests were not run locally. --> ### API and Format Add a required query memory pool argument to `RealtimeIndex::CreateReader()` and `RealtimeIndexReadSource::CreateIndexReaders()`. Custom implementations and callers must update. <!-- Does this change affect API in include dir or storage format or protocol --> ### Documentation Document real-time Lumina configuration, query setup, and limitations in `realtime.rst`. <!-- Does this change introduce a new feature --> ### Generative AI tooling Generated-by: OpenAI Codex <!-- If generative AI tooling has been used in the process of authoring this patch, please include the phrase: 'Generated-by: ' followed by the name of the tool and its version. If no, write 'No'. Please refer to the [ASF Generative Tooling Guidance](https://www.apache.org/legal/generative-tooling.html) for details. --> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
