[
https://issues.apache.org/jira/browse/SPARK-16652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15394082#comment-15394082
]
Daniel Barclay commented on SPARK-16652:
----------------------------------------
> This could be reproduced at my side with Spark 1.6.1 and 1.6.2, but not with
> the master branch.
Yes, I see it working on the master branch too.
> JVM crash from unsafe memory access for Dataset of class with List[Long]
> ------------------------------------------------------------------------
>
> Key: SPARK-16652
> URL: https://issues.apache.org/jira/browse/SPARK-16652
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 1.6.1, 1.6.2
> Environment: Scala 2.10.<various>
> JDK: "Java HotSpot(TM) 64-Bit Server VM (build 25.74-b02, mixed mode)"
> MacOs 10.11.2
> Reporter: Daniel Barclay
> Attachments: UnsafeAccessCrashBugTest.scala
>
>
> Generating and writing out a {{Dataset}} of a class that has a {{List}} (at
> least if it's {{List\[Long]}}) member and a {{String}} member causes a JVM
> crash.
> The crash seems to be related to unsafe memory access especially because
> earlier code (before I got it reduced to the current bug test case) reported
> "{{java.lang.InternalError: a fault occurred in a recent unsafe memory access
> operation in compiled Java code}}".
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]