Davies Liu created SPARK-11737:
----------------------------------
Summary: String may not be serialized correctly with Kyro
Key: SPARK-11737
URL: https://issues.apache.org/jira/browse/SPARK-11737
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 1.5.1, 1.6.0
Reporter: Davies Liu
Assignee: Davies Liu
Priority: Critical
When run in cluster mode, the driver may have different memory (and configs)
than executor, also if Kyro is used, then string can not be collected back to
driver:
{code}
>>> sqlContext.range(10).selectExpr("repeat(cast(id as string), 9)").show()
+----------------------------+
|repeat(cast(id as string),9)|
+----------------------------+
| 0|
| 1|
| 2|
| 3|
| 4|
| 5|
| 6|
| 7|
| 8|
| 9|
+----------------------------+
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
