Joy-2000 commented on PR #18103: URL: https://github.com/apache/hudi/pull/18103#issuecomment-3875026861
> Got it. inputSplitsState in StreamReadMonitoringFunction uses the fallback kryo serializer for the state serialization, which doesn't support schema evolution for state. But in StreamReadOperator, there is a inputSplitsState which is a list state for MergeOnReadInputSplit using JavaSerializer as state serializer, and it supports state schema evolution. So it's kind of ambiguous to add a new field to MergeOnReadInputSplit with transient. Maybe we can just extract partition path from the file path directly, since it doesn't incur much extra costs. @cshuo Thx, I 'm ok for this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
