Kazuaki Ishizaki created SPARK-16042:
----------------------------------------
Summary: Eliminate nullcheck code at projection for an array type
Key: SPARK-16042
URL: https://issues.apache.org/jira/browse/SPARK-16042
Project: Spark
Issue Type: Improvement
Components: SQL
Reporter: Kazuaki Ishizaki
When we run a spark program with a projection for a array type, nullcheck at a
call to write each element of an array is generated. If we know all of the
elements do not have {{null}} at compilation time, we can eliminate code for
nullcheck.
{code}
val df = sparkContext.parallelize(Seq(1.0, 2.0), 1).toDF("v")
df.selectExpr("Array(v + 2.2, v + 3.3)").collect
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
