fallintoplace opened a new pull request, #1595:
URL: https://github.com/apache/iceberg-go/pull/1595

   ## What changed
   
   Cancel unpartitioned and fanout write contexts when a `WriteRecords` 
consumer stops early. Fanout writes now cancel record production independently 
from rolling writers and release retained batches left in the input queue after 
workers exit.
   
   Add unpartitioned and partitioned regressions showing that breaking after 
the first output stops the source before all records are consumed. The checked 
allocator also verifies retained Arrow memory is released.
   
   ## Why
   
   The iterator previously drained output without canceling production. 
Breaking iteration could therefore consume the entire source, continue writing 
files, or never return for an unbounded source.
   
   ## Testing
   
   - `go test ./table -run 
'Test(WriteRecords|FanoutWriter|PositionDeletePartitionedFanoutWriter)' 
-count=1 -timeout=180s`\n- `go test -race ./table -run 
'TestWriteRecords/TestEarlyStopCancelsRecordProduction' -count=1 -timeout=120s`


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to