robertwb commented on PR #34740:
URL: https://github.com/apache/beam/pull/34740#issuecomment-2831533055

   > > some SDKs
   > 
   > just wondering what SDKs you were referring to / how you decided to do 
this change now.
   
   This was the Java SDK, and I was using the Python Local Runner to debug 
memory issues for very large iterables for Parquet Write operatiojns. (In 
particular, I hacked up the SDK to deliver TBs of shuffle data over the state 
API, but to use it for Java I needed these fixes which make thing correct more 
generally.)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to