[
https://issues.apache.org/jira/browse/SPARK-16652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15387258#comment-15387258
]
Liwei Lin edited comment on SPARK-16652 at 7/21/16 6:43 AM:
------------------------------------------------------------
Hi [~dsbos], thanks for reporting this. This could be reproduced at my side
with Spark 1.6.1 and 1.6.2, but not with the master branch. Could you try the
master branch or 2.0.0-SNAPSHOT?
Note: this might be OS X-specific, as I could not reproduce this with Spark
1.6.1, 1.6.2, master branch under the Windows environment.
My local environment:
{code}
Mac OS X 10.11.5
JRE version: Java(TM) SE Runtime Environment (8.0_91-b14) (build 1.8.0_91-b14)
Java VM: Java HotSpot(TM) 64-Bit Server VM (25.91-b14 mixed mode bsd-amd64
compressed oops)
{code}
was (Author: proflin):
Hi [~dsbos], thanks for reporting this. This could be reproduced at my side
with Spark 1.6.1 and 1.6.2, but not with the master branch. Could you try the
master branch or 2.0.0-SNAPSHOT?
My local environment:
{code}
Mac OS X 10.11.5
JRE version: Java(TM) SE Runtime Environment (8.0_91-b14) (build 1.8.0_91-b14)
Java VM: Java HotSpot(TM) 64-Bit Server VM (25.91-b14 mixed mode bsd-amd64
compressed oops)
{code}
> JVM crash from unsafe memory access for Dataset of class with List[Long]
> ------------------------------------------------------------------------
>
> Key: SPARK-16652
> URL: https://issues.apache.org/jira/browse/SPARK-16652
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 1.6.1, 1.6.2
> Environment: Scala 2.10.<various>
> JDK: "Java HotSpot(TM) 64-Bit Server VM (build 25.74-b02, mixed mode)"
> MacOs 10.11.2
> Reporter: Daniel Barclay
> Attachments: UnsafeAccessCrashBugTest.scala
>
>
> Generating and writing out a {{Dataset}} of a class that has a {{List}} (at
> least if it's {{List\[Long]}}) member and a {{String}} member causes a JVM
> crash.
> The crash seems to be related to unsafe memory access especially because
> earlier code (before I got it reduced to the current bug test case) reported
> "{{java.lang.InternalError: a fault occurred in a recent unsafe memory access
> operation in compiled Java code}}".
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
