[
https://issues.apache.org/jira/browse/SPARK-19115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaochen Ouyang updated SPARK-19115:
------------------------------------
Description:
spark2.0.1 unsupports the command " create external table if not exist new_tbl
like old_tbl location '/warehouse/new_tbl' "
we tried to modify the sqlbase.g4 file,change
" | CREATE TABLE (IF NOT EXISTS)? target=tableIdentifier
LIKE source=tableIdentifier
#createTableLike"
to
" | CREATE EXTERNAL? TABLE (IF NOT EXISTS)? target=tableIdentifier
LIKE source=tableIdentifier locationSpec?
#createTableLike"
modify method 'visitCreateTableLike' in scala file 'SparkSqlParser.scala' and
update case class CreateTableLikeCommand in 'tables.scala' file
finally we compiled spark and replaced the jars as follow:
'spark-catalyst-2.0.1.jar','spark-sql_2.11-2.0.1.jar', and run the command
'create external table if not exist new_tbl like old_tbl location
'/warehouse/new_tbl' successfully .
was:
spark2.0.1 unsupports the command " create external table if not exist new_tbl
like old_tbl location '/warehouse/new_tbl' "
we tried to modify the sqlbase.g4 file,change
" | CREATE TABLE (IF NOT EXISTS)? target=tableIdentifier
LIKE source=tableIdentifier
#createTableLike"
to
" | CREATE EXTERNAL? TABLE (IF NOT EXISTS)? target=tableIdentifier
LIKE source=tableIdentifier locationSpec?
#createTableLike"
and then we compiled spark and replaced the jar "spark-catalyst-2.0.1.jar"
,after that,we found we can run command "create external table if not exist
new_tbl like old_tbl" successfully,unfortunately we found the generated table's
type is MANAGED_TABLE other than EXTERNAL_TABLE in metastore database .
> SparkSQL unsupports the command " create external table if not exist new_tbl
> like old_tbl location '/warehouse/new_tbl' "
> --------------------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-19115
> URL: https://issues.apache.org/jira/browse/SPARK-19115
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.0.1
> Environment: spark2.0.1 hive1.2.1
> Reporter: Xiaochen Ouyang
>
> spark2.0.1 unsupports the command " create external table if not exist
> new_tbl like old_tbl location '/warehouse/new_tbl' "
> we tried to modify the sqlbase.g4 file,change
> " | CREATE TABLE (IF NOT EXISTS)? target=tableIdentifier
> LIKE source=tableIdentifier
> #createTableLike"
> to
> " | CREATE EXTERNAL? TABLE (IF NOT EXISTS)? target=tableIdentifier
> LIKE source=tableIdentifier locationSpec?
> #createTableLike"
> modify method 'visitCreateTableLike' in scala file 'SparkSqlParser.scala'
> and update case class CreateTableLikeCommand in 'tables.scala' file
> finally we compiled spark and replaced the jars as follow:
> 'spark-catalyst-2.0.1.jar','spark-sql_2.11-2.0.1.jar', and run the command
> 'create external table if not exist new_tbl like old_tbl location
> '/warehouse/new_tbl' successfully .
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
