chamikaramj commented on issue #30994: URL: https://github.com/apache/beam/issues/30994#issuecomment-2060077026
I don't think this is necessarily a bug but a limitation due the uber jar not properly registering coders. I tried a job with more logs and seems like we are simply not able to find a translator for the URN "beam:coder:length_prefix:v1" (and `UnknownCoderWrapper ` ends up being the fallback). We register LengthPrefixCoder here: https://github.com/apache/beam/blob/6bca71070e96b56b781600e8833a72cea329b1a1/sdks/java/core/src/main/java/org/apache/beam/sdk/util/construction/ModelCoderRegistrar.java#L48 So seems like this registration is not being performed for the uber-jar. I'm not getting the error when I stage the `beam-sdks-java-core` jar (which performs the above registration) along with the uber jar. `--filesToStage=./build/libs/unknown_coder_error-1.0-all.jar,beam-sdks-java-core-2.56.0-SNAPSHOT.jar` I'm not sure if this is necessarily a release blocker. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
