Joseph K. Bradley created SPARK-6914:
----------------------------------------
Summary: DataFrame.withColumn should take metadata
Key: SPARK-6914
URL: https://issues.apache.org/jira/browse/SPARK-6914
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 1.3.0
Reporter: Joseph K. Bradley
Priority: Minor
It would be nice if DataFrame.withColumn could take metadata. Currently (as
far as I can tell), the best way to specify it is:
{code}
dataset.withColumn(columnName, newCol.as(columnName, myMetadata))
{code}
where "newCol" is a new column (in my use case, a column created by a UDF).
This is weird since the columnName is specified twice.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
