[ 
https://issues.apache.org/jira/browse/BEAM-7462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16853517#comment-16853517
 ] 

Alex Amato commented on BEAM-7462:
----------------------------------

Next steps are to determine where the Pcolleciton with the failed coder is 
defined, as its not in the bundle descriptor itself (it may be in one of the 
serialized payloads). See where I have added debug logging in,:

[https://github.com/apache/beam/pull/8416]


The ElementFnDataReceiver is trying to sample elements by encoding some of them 
with the pcollections coder. We are incorrectly seeing a WindowValue coder 
instead of an ElementCoder which triggers this failure. We suspect that the 
runner is not properly providing the correct coder, and its only been exercised 
by this code (most coders are not exercised, only those on GBK/stage boundaries 
are). 

 

[https://github.com/apache/beam/pull/8416]  exercises all coders now, which is 
triggering these bugs due to misconfiguration. Next steps are to determine why 
this is happening, what pcollection/ptransform this comes from, and to fix the 
configuration in the runner harness.

Also this related issue could be fixed, but there was a work around.

https://issues.apache.org/jira/browse/BEAM-7452?filter=-2

> Add Sampled Byte Count Metric to the Java SDK
> ---------------------------------------------
>
>                 Key: BEAM-7462
>                 URL: https://issues.apache.org/jira/browse/BEAM-7462
>             Project: Beam
>          Issue Type: New Feature
>          Components: java-fn-execution
>            Reporter: Alex Amato
>            Priority: Major
>         Attachments: bundle_descriptor_dump.txt
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to