[jira] [Commented] (BEAM-6517) Pipeline fails with deserializing lambda function on Spark (MapElements)

[ https://issues.apache.org/jira/browse/BEAM-6517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16755656#comment-16755656 ] Vu Ho commented on BEAM-6517: - Thanks everyone for looking into this. The problem I have is only with Spark

[jira] [Commented] (BEAM-6517) Pipeline fails with deserializing lambda function on Spark (MapElements)

[ https://issues.apache.org/jira/browse/BEAM-6517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16755129#comment-16755129 ] Ismaël Mejía commented on BEAM-6517: Mmm I like the idea of having a separate module for Avro. And as

[jira] [Commented] (BEAM-6517) Pipeline fails with deserializing lambda function on Spark (MapElements)

[ https://issues.apache.org/jira/browse/BEAM-6517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16755072#comment-16755072 ] Kenneth Knowles commented on BEAM-6517: --- As a workaround we could have a separate jar for

[jira] [Commented] (BEAM-6517) Pipeline fails with deserializing lambda function on Spark (MapElements)

[ https://issues.apache.org/jira/browse/BEAM-6517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16755070#comment-16755070 ] Kenneth Knowles commented on BEAM-6517: --- I haven't looked into vendoring Avro. Does Beam core depend

[jira] [Commented] (BEAM-6517) Pipeline fails with deserializing lambda function on Spark (MapElements)

[ https://issues.apache.org/jira/browse/BEAM-6517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754887#comment-16754887 ] Ismaël Mejía commented on BEAM-6517: Thanks for the details [~vho] . This looks more like you have

[jira] [Commented] (BEAM-6517) Pipeline fails with deserializing lambda function on Spark (MapElements)

[ https://issues.apache.org/jira/browse/BEAM-6517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754873#comment-16754873 ] Etienne Chauchot commented on BEAM-6517: [~vho]  what happens if you test on Flink and without the

[jira] [Commented] (BEAM-6517) Pipeline fails with deserializing lambda function on Spark (MapElements)

[ https://issues.apache.org/jira/browse/BEAM-6517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754591#comment-16754591 ] Vu Ho commented on BEAM-6517: - Updated: I tried this on Flink after shading the library (by default it

[jira] [Commented] (BEAM-6517) Pipeline fails with deserializing lambda function on Spark (MapElements)

[ https://issues.apache.org/jira/browse/BEAM-6517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754475#comment-16754475 ] Kenneth Knowles commented on BEAM-6517: --- Please pass the bug back with comment. Also [~iemejia]

[jira] [Commented] (BEAM-6517) Pipeline fails with deserializing lambda function on Spark (MapElements)

[ https://issues.apache.org/jira/browse/BEAM-6517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754473#comment-16754473 ] Kenneth Knowles commented on BEAM-6517: --- This is usually caused by a serialization/deserialization