Re: Tungsten gives unexpected results when selecting null elements in array

FYI, I filed a JIRA and submitted a PR for this issue: https://issues.apache.org/jira/browse/SPARK-12477 https://github.com/apache/spark/pull/10429 -- View this message in context:

Re: Tungsten gives unexpected results when selecting null elements in array

For info, this is the generated code: GeneratedExpressionCode( cursor8 = 16; convertedStruct6.pointTo(buffer7, Platform.BYTE_ARRAY_OFFSET, 1, cursor8); /* input[0, ArrayType(StringType,true)][0] */ /* input[0, ArrayType(StringType,true)] */ boolean isNull2

Re: Tungsten gives unexpected results when selecting null elements in array

I believe the problem is that the generated code does not check if the selected item in the array is null.Naïvely, I think changing this line would solve this:

Re: [SQL] Self join with ArrayType columns problems

Should I file a JIRA for this? -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/SQL-Self-join-with-ArrayType-columns-problems-tp10269p10322.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com.

Spark 1.2.0: MissingRequirementError

Hi guys, A few people seem to have the same problem with Spark 1.2.0 so I figured I would push it here. see: http://apache-spark-user-list.1001560.n3.nabble.com/MissingRequirementError-with-spark-td21149.html In a nutshell, for sbt test to work, we now need to fork a JVM and also give more

Re: sbt publish-local fails, missing spark-network-common

Hi Pedro, Exact same issue here! Have you found a workaround? Thanks P. -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/sbt-publish-local-fails-missing-spark-network-common-tp9471p9475.html Sent from the Apache Spark Developers List mailing list