nsivabalan commented on PR #13001: URL: https://github.com/apache/hudi/pull/13001#issuecomment-2908159082
hey @danny0405 : the arg that you are talking about, is computed on the driver and there I don't see much value in making it lazy. We are looking to make the entire write to metadata in a streaming manner to be part of the same RDD stage boundary as data table writes. So, this is the only way that can help achieve that. and I don't see any value in making it lazy. can you help me understand what are we trying to achieve here. I am happy to chat f2f if you need more clarification on the usage of this API -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
