Yin Huai created SPARK-2775:
-------------------------------

             Summary: HiveContext does not support dots in column names. 
                 Key: SPARK-2775
                 URL: https://issues.apache.org/jira/browse/SPARK-2775
             Project: Spark
          Issue Type: Bug
          Components: SQL
            Reporter: Yin Huai


When you try the following snippet in hive/console. 
{code}
val data = sc.parallelize(Seq("""{"key.number1": "value1", "key.number2": 
"value2"}"""))
jsonRDD(data).registerAsTable("jt")
hql("select `key.number1` from jt")
{code}
You will find the name of key.number1 cannot be resolved.
{code}
org.apache.spark.sql.catalyst.errors.package$TreeNodeException: Unresolved 
attributes: 'key.number1, tree:
Project ['key.number1]
 LowerCaseSchema 
  Subquery jt
   SparkLogicalPlan (ExistingRdd [key.number1#8,key.number2#9], MappedRDD[17] 
at map at JsonRDD.scala:37)
{code}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to