LuciferYang opened a new issue, #9894:
URL: https://github.com/apache/paimon/issues/9894

   ### Search before asking
   
   - [x] I searched in the [issues](https://github.com/apache/paimon/issues) 
and found nothing similar.
   
   ### Paimon version
   
   master
   
   ### Compute Engine
   
   Any (primary-key table vector search)
   
   ### Minimal reproduce step
   
   On a primary-key table with a `pk-vector` index and freshly-written rows 
that have not been compacted yet (level-0 APPEND files present in the bucket), 
run a vector search with `vector-index.search-mode` set to `full` or `detail`.
   
   ### What doesn't meet your expectations?
   
   Rows written since the last compaction are missing from the result.
   
   `full` and `detail` are documented to exact-scan unindexed data files, but 
`PrimaryKeyVectorRead` handed the bucket search only the files 
`PrimaryKeyIndexSourcePolicy.shouldRead` accepts (complete COMPACT level>0 
outputs). Level-0 APPEND files were therefore dropped by every search mode. 
`FAST` intentionally ignores unindexed files, but `full`/`detail` should scan 
them.
   
   ### Anything else?
   
   No response
   
   ### Are you willing to submit a PR?
   
   - [x] I'm willing to submit a PR!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to