ColdL opened a new pull request, #6543:
URL: https://github.com/apache/paimon/pull/6543

   ### Purpose
   
   I found a suspected bug in `SingleFileWriter`.
   
   If it is a writer that implements `SupportsDirectWrite` (currently only 
`LanceWriter`), then `outputBytes` will not be updated, ultimately causing the 
`file_size` in the manifest entry to always be `zero`.
   
   I discovered this while testing PK Table & LanceFile & deletion-vectors. I 
found that no matter how I executed `DELETE`, the dv index was never generated 
as expected. Subsequently, I found that the `$files` system table showed 
`file_size_in_bytes` as `zero`, indicating that the `file_size` in the manifest 
is zero, but the actual data file ending with .lance is 1.5MB in size on the 
storage side.
   
   After applying the fix in the PR, I found that the `$files` system table 
could display the actual file size normally, and the dv index could also be 
generated as expected.
   
   ### Tests
   
   Not yet
   
   ### API and Format
   
   No
   
   ### Documentation
   
   No
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to