[ https://issues.apache.org/jira/browse/SPARK-16210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon resolved SPARK-16210. ---------------------------------- Resolution: Cannot Reproduce I can't reproduce this too {code} scala> val rdd = sc.makeRDD("""{"x.y": 5, "abc": 10}""" :: Nil) rdd: org.apache.spark.rdd.RDD[String] = ParallelCollectionRDD[5] at makeRDD at <console>:24 scala> spark.read.json(rdd).drop("abc") res6: org.apache.spark.sql.DataFrame = [x.y: bigint] {code} and I am going to resolve this JIRA as it seems it complies this {quote} For issues that can't be reproduced against master as reported, resolve as Cannot Reproduce {quote} in wiki https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark > DataFrame.drop(colName) fails if another column has a period in its name > ------------------------------------------------------------------------ > > Key: SPARK-16210 > URL: https://issues.apache.org/jira/browse/SPARK-16210 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 1.6.1 > Environment: Spark 1.6.1 on Databricks > Reporter: Simeon Simeonov > Labels: dataframe, sql > > The following code fails with {{org.apache.spark.sql.AnalysisException: > cannot resolve 'x.y' given input columns: [abc, x.y]}} because of the way > {{drop()}} uses {{select()}} under the covers. > {code} > val rdd = sc.makeRDD("""{"x.y": 5, "abc": 10}""" :: Nil) > sqlContext.read.json(rdd).drop("abc") > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org