Grzegorz Chilkiewicz created SPARK-12982:
--------------------------------------------
Summary: SQLContext: temporary table registration does not accept
valid identifier
Key: SPARK-12982
URL: https://issues.apache.org/jira/browse/SPARK-12982
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 1.6.0
Reporter: Grzegorz Chilkiewicz
Priority: Minor
We have encountered very strange behavior of SparkSQL temporary table
registration.
What identifiers for temporary table should be valid?
Alphanumerical + '_' with at least one non-digit?
Valid identifiers:
df
674123a
674123_
a0e97c59_4445_479d_a7ef_d770e3874123
1ae97c59_4445_479d_a7ef_d770e3874123
Invalid identifier:
10e97c59_4445_479d_a7ef_d770e3874123
Stack trace:
[error] java.lang.RuntimeException: [1.1] failure: identifier expected
[error]
[error] 10e97c59_4445_479d_a7ef_d770e3874123
[error] ^
[error] at scala.sys.package$.error(package.scala:27)
[error] at
org.apache.spark.sql.catalyst.SqlParser$.parseTableIdentifier(SqlParser.scala:58)
[error] at org.apache.spark.sql.SQLContext.table(SQLContext.scala:827)
[error] at
org.apache.spark.sql.SQLContext.dropTempTable(SQLContext.scala:763)
[error] at
io.deepsense.SparkSqlContextTempTableIdentifier$.identifierCheck(SparkSqlContextTempTableIdentifier.scala:27)
[error] at
io.deepsense.SparkSqlContextTempTableIdentifier$.main(SparkSqlContextTempTableIdentifier.scala:58)
[error] at
io.deepsense.SparkSqlContextTempTableIdentifier.main(SparkSqlContextTempTableIdentifier.scala)
Code to reproduce bug:
https://github.com/grzegorz-chilkiewicz/SparkSqlContextTempTableIdentifier
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
