Ian Hellstrom created SPARK-13721:
-------------------------------------
Summary: Add support for LATERAL VIEW OUTER explode()
Key: SPARK-13721
URL: https://issues.apache.org/jira/browse/SPARK-13721
Project: Spark
Issue Type: Improvement
Components: SQL
Reporter: Ian Hellstrom
Hive supports the [LATERAL VIEW
OUTER|https://cwiki.apache.org/confluence/display/Hive/LanguageManual+LateralView#LanguageManualLateralView-OuterLateralViews]
syntax to make sure that when an array is empty, the content from the outer
table is still returned.
Within Spark, this is currently only possible within the HiveContext and
executing HiveQL statements. It would be nice if the standard explode()
DataFrame method allows the same. A possible signature would be:
{code:scala}
explode[A, B](inputColumn: String, outputColumn: String, outer: Boolean = false)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
