[ https://issues.apache.org/jira/browse/SPARK-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14184570#comment-14184570 ]
Josh Rosen commented on SPARK-4056: ----------------------------------- We reverted the 1.1.5 upgrade after discovering that it caused a memory leak. It looks like this has been fixed in 1.1.6 if we still want to upgrade. > Upgrade snappy-java to 1.1.1.5 > ------------------------------ > > Key: SPARK-4056 > URL: https://issues.apache.org/jira/browse/SPARK-4056 > Project: Spark > Issue Type: Improvement > Components: Spark Core > Reporter: Josh Rosen > Assignee: Josh Rosen > Fix For: 1.1.1, 1.2.0 > > > We should upgrade snappy-java to 1.1.1.5 across all of our maintenance > branches. This release improves error messages when attempting to > deserialize empty inputs using SnappyInputStream (this operation is always an > error, but the old error messages made it hard to distinguish failures due to > empty streams from ones due to reading invalid / corrupted streams); see > https://github.com/xerial/snappy-java/issues/89 for more context. > This should be a major help in the Snappy debugging work that I've been doing. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org