[
https://issues.apache.org/jira/browse/SPARK-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641471#comment-14641471
]
David Sabater edited comment on SPARK-6898 at 7/25/15 9:14 AM:
---------------------------------------------------------------
[~cloud_fan] I literally copy&pasted the snipped of code from your reply and
used Spark 1.4.1 from brew on my Mac and I am getting the error I just included
in my earlier reply. For reference I am in UK, in case the locale is doing
something weird with backticks...
{noformat}
log4j:WARN No appenders could be found for logger
(org.apache.hadoop.metrics2.lib.MutableMetricsFactory).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more
info.
2015-07-25 10:09:05.510 java[6618:141238] Unable to load realm info from
SCDynamicStore
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
15/07/25 10:09:06 INFO SecurityManager: Changing view acls to: davidsabater
15/07/25 10:09:06 INFO SecurityManager: Changing modify acls to: davidsabater
15/07/25 10:09:06 INFO SecurityManager: SecurityManager: authentication
disabled; ui acls disabled; users with view permissions: Set(davidsabater);
users with modify permissions: Set(davidsabater)
15/07/25 10:09:06 INFO HttpServer: Starting HTTP Server
15/07/25 10:09:06 INFO Utils: Successfully started service 'HTTP class server'
on port 60987.
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 1.4.1
/_/
Using Scala version 2.10.4 (Java HotSpot(TM) 64-Bit Server VM, Java 1.7.0_45)
Type in expressions to have them evaluated.
Type :help for more information.
15/07/25 10:09:09 INFO SparkContext: Running Spark version 1.4.1
15/07/25 10:09:09 INFO SecurityManager: Changing view acls to: davidsabater
15/07/25 10:09:09 INFO SecurityManager: Changing modify acls to: davidsabater
15/07/25 10:09:09 INFO SecurityManager: SecurityManager: authentication
disabled; ui acls disabled; users with view permissions: Set(davidsabater);
users with modify permissions: Set(davidsabater)
{noformat}
My locale:
LANG="en_GB.UTF-8"
LC_COLLATE="en_GB.UTF-8"
LC_CTYPE="en_GB.UTF-8"
LC_MESSAGES="en_GB.UTF-8"
LC_MONETARY="en_GB.UTF-8"
LC_NUMERIC="en_GB.UTF-8"
LC_TIME="en_GB.UTF-8"
was (Author: dsdinter):
[~cloud_fan] I literally copy&pasted the snipped of code from your reply and
used Spark 1.4.1 from brew on my Mac and I am getting the error I just included
in my earlier reply. For reference I am in UK, in case the locale is doing
something weird with backticks...
{noformat}
log4j:WARN No appenders could be found for logger
(org.apache.hadoop.metrics2.lib.MutableMetricsFactory).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more
info.
2015-07-25 10:09:05.510 java[6618:141238] Unable to load realm info from
SCDynamicStore
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
15/07/25 10:09:06 INFO SecurityManager: Changing view acls to: davidsabater
15/07/25 10:09:06 INFO SecurityManager: Changing modify acls to: davidsabater
15/07/25 10:09:06 INFO SecurityManager: SecurityManager: authentication
disabled; ui acls disabled; users with view permissions: Set(davidsabater);
users with modify permissions: Set(davidsabater)
15/07/25 10:09:06 INFO HttpServer: Starting HTTP Server
15/07/25 10:09:06 INFO Utils: Successfully started service 'HTTP class server'
on port 60987.
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 1.4.1
/_/
Using Scala version 2.10.4 (Java HotSpot(TM) 64-Bit Server VM, Java 1.7.0_45)
Type in expressions to have them evaluated.
Type :help for more information.
15/07/25 10:09:09 INFO SparkContext: Running Spark version 1.4.1
15/07/25 10:09:09 INFO SecurityManager: Changing view acls to: davidsabater
15/07/25 10:09:09 INFO SecurityManager: Changing modify acls to: davidsabater
15/07/25 10:09:09 INFO SecurityManager: SecurityManager: authentication
disabled; ui acls disabled; users with view permissions: Set(davidsabater);
users with modify permissions: Set(davidsabater)
{noformat}
> Special chars in column names is broken
> ---------------------------------------
>
> Key: SPARK-6898
> URL: https://issues.apache.org/jira/browse/SPARK-6898
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Reporter: Wenchen Fan
> Assignee: Wenchen Fan
> Fix For: 1.4.0
>
>
> This function is added a long time ago, but it's not complete, it will fail
> if we have "." inside column name.
> {code}
> test("SPARK-3483 Special chars in column names") {
> val data = sparkContext.parallelize(
> Seq("""{"key?number1": "value1", "key.number2": "value2"}"""))
> jsonRDD(data).registerTempTable("records")
> sql("SELECT `key?number1`, `key.number2` FROM records")
> }
> {code}
> this test will fail.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
