QuakeWang opened a new pull request, #8124:
URL: https://github.com/apache/paimon/pull/8124

   ### Purpose
   
   Ray write tasks previously closed on the worker-side `TableWrite` when 
write, prepare, or close failed. That is unsafe because close can flush pending 
data, and `prepare_commit()` can materialize normal, blob, or vector files 
before a later failure prevents the driver commit.
   
   This PR makes worker-side Ray writes abort on failure and propagates abort 
through `TableWrite` and `FileStoreWrite`. It also keeps dedicated blob/vector 
metadata reachable from the parent writer so abort can delete files produced 
before the failed commit path.
   
   ### Tests
   
   - `python -m pytest pypaimon/tests/ray_sink_test.py::RaySinkTest::test_write 
-q`


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to