[jira] (SPARK-16652) JVM crash from unsafe memory access for Dataset of class with List[Long]

[Hyukjin Kwon (JIRA)]

Title: Message Title

Hyukjin Kwon resolved as Cannot Reproduce   case class TriggeringRowType(listOfLong: List[Long], string: String) val nonemptyWhateverTypeInputRdd = spark.sparkContext.parallelize(List("")) val outputObjectsRdd = nonemptyWhateverTypeInputRdd.map(_ => TriggeringRowType(List(), "non-empty string")) import spark.implicits._ val shipmentSummariesOutDs = spark.createDataset(outputObjectsRdd) shipmentSummariesOutDs.toDF().write.json("/tmp/temp_" + System.currentTimeMillis() + ".tmp") I am resolving this for now. I can't reproduce this in the current master too. It'd be great if someone could point out the PR that fixes this issue and backports. Spark / SPARK-16652 JVM crash from unsafe memory access for Dataset of class with List[Long] Change By: Hyukjin Kwon Resolution: Cannot Reproduce Status: Open Resolved Add Comment   This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)