Hello everyone,

I've reported an issue https://issues.apache.org/jira/browse/BEAM-10292
which is about broken DefaultFilenamePolicy.ParamsCoder behavior.
DefaultFilenamePolicy.ParamsCoder loses information whether
DefaultFilenamePolicy.Params's baseFilename resource is file or directory
on some filesystems, at least on local FS and HDFS.

After discussion with @dmvk and @lukecwik, we have agreed that the best
solution could be to take the breaking change and use ResourceIdCoder for
encoding/decoding DefaultFilenamePolicy.Params's baseFilename, this way the
file/directory information is preserved.
The solution is implemented in pull request
https://github.com/apache/beam/pull/12050.

I'd like to ask if there is a consensus on this breaking change. Is
everyone OK with this?
Thanks in advance for answers.

Best regards,
David

Reply via email to