[
https://issues.apache.org/jira/browse/SPARK-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14184570#comment-14184570
]
Josh Rosen commented on SPARK-4056:
-----------------------------------
We reverted the 1.1.5 upgrade after discovering that it caused a memory leak.
It looks like this has been fixed in 1.1.6 if we still want to upgrade.
> Upgrade snappy-java to 1.1.1.5
> ------------------------------
>
> Key: SPARK-4056
> URL: https://issues.apache.org/jira/browse/SPARK-4056
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Reporter: Josh Rosen
> Assignee: Josh Rosen
> Fix For: 1.1.1, 1.2.0
>
>
> We should upgrade snappy-java to 1.1.1.5 across all of our maintenance
> branches. This release improves error messages when attempting to
> deserialize empty inputs using SnappyInputStream (this operation is always an
> error, but the old error messages made it hard to distinguish failures due to
> empty streams from ones due to reading invalid / corrupted streams); see
> https://github.com/xerial/snappy-java/issues/89 for more context.
> This should be a major help in the Snappy debugging work that I've been doing.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
