[ 
https://issues.apache.org/jira/browse/BEAM-1810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aviem Zur resolved BEAM-1810.
-----------------------------
       Resolution: Fixed
    Fix Version/s: First stable release

> Spark runner combineGlobally uses Kryo serialization
> ----------------------------------------------------
>
>                 Key: BEAM-1810
>                 URL: https://issues.apache.org/jira/browse/BEAM-1810
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-spark
>            Reporter: Aviem Zur
>            Assignee: Aviem Zur
>             Fix For: First stable release
>
>
> {{TransformTranslator#combineGlobally}} inadvertently uses Kryo serialization 
> to serialize data. This should never happen.
> This is due to Spark's implementation of {{RDD.isEmpty}} which takes the 
> first element to check if there are elements in the {{RDD}}, it is then 
> serialized with Spark's configured serializer (In our case, Kryo).



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to