Hyukjin Kwon created SPARK-21536:
------------------------------------
Summary: Remove the workaroud to allow dots in field names in R's
createDataFame
Key: SPARK-21536
URL: https://issues.apache.org/jira/browse/SPARK-21536
Project: Spark
Issue Type: Improvement
Components: SparkR
Affects Versions: 2.3.0
Reporter: Hyukjin Kwon
Priority: Minor
We are currently converting dots to underscore in some cases as below in SparkR
{code}
> createDataFrame(list(list(1)), "a.a")
SparkDataFrame[a_a:double]
...
In FUN(X[[i]], ...) : Use a_a instead of a.a as column name
{code}
{code}
> createDataFrame(list(list(a.a = 1)))
SparkDataFrame[a_a:double]
...
In FUN(X[[i]], ...) : Use a_a instead of a.a as column name
{code}
This looks introduced in the first place due to SPARK-2775 but now it is fixed
in SPARK-6898.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]