Hello, Are there any restriction in the column name? I tried to use ".", but sqlContext.sql cannot find the column. I would guess that "." is tricky as this affects accessing StructType, but are there any more restriction on column name?
scala> case class A(a: Int) defined class A scala> sqlContext.createDataFrame(Seq(A(10), A(20))).withColumn("b.b", $"a" + 1) res19: org.apache.spark.sql.DataFrame = [a: int, b.b: int] scala> res19.registerTempTable("res19") scala> res19.select("a") res24: org.apache.spark.sql.DataFrame = [a: int] scala> res19.select("a", "b.b") org.apache.spark.sql.AnalysisException: cannot resolve 'b.b' given input columns a, b.b; at org.apache.spark.sql.catalyst.analysis.package$AnalysisErrorAt.failAnalysis(package.scala:42) .... Thanks. Justin