[
https://issues.apache.org/jira/browse/SPARK-15286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-15286.
---------------------------------
Resolution: Fixed
Fix Version/s: 2.0.0
Issue resolved by pull request 13070
[https://github.com/apache/spark/pull/13070]
> Make the output readable for EXPLAIN CREATE TABLE and DESC EXTENDED
> --------------------------------------------------------------------
>
> Key: SPARK-15286
> URL: https://issues.apache.org/jira/browse/SPARK-15286
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.0.0
> Reporter: Xiao Li
> Fix For: 2.0.0
>
>
> Currently, the outputs of EXPLAIN CREATE TABLE and DESC EXTENDED are not
> readable.
> For example,
> {noformat}
> CREATE EXTERNAL TABLE extTable_with_partitions (key INT, value STRING)
> PARTITIONED BY (ds STRING, hr STRING)
> LOCATION
> '/private/var/folders/4b/sgmfldk15js406vk7lw5llzw0000gn/T/spark-b39a6185-8981-403b-a4aa-36fb2f4ca8a9'
> {noformat}
> The output of EXPLAIN command is
> {noformat}
> ExecutedCommand CreateTable
> CatalogTable(`extTable_with_partitions`,CatalogTableType(EXTERNAL),CatalogStorageFormat(Some(/private/var/folders/4b/sgmfldk15js406vk7lw5llzw0000gn/T/spark-dd234718-e85d-4c5a-8353-8f1834ac0323),Some(org.apache.hadoop.mapred.TextInputFormat),Some(org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat),None,false,Map()),List(CatalogColumn(key,int,true,None),
> CatalogColumn(value,string,true,None), CatalogColumn(ds,string,true,None),
> CatalogColumn(hr,string,true,None)),List(ds,
> hr),List(),List(),-1,,1463026413544,-1,Map(),None,None,None), false
> {noformat}
> The output of DESC EXTENDED is like
> {noformat}
> CatalogTable(`default`.`exttable_with_partitions`,CatalogTableType(EXTERNAL),CatalogStorageFormat(Some(file:/private/var/folders/4b/sgmfldk15js406vk7lw5llzw0000gn/T/spark-dd234718-e85d-4c5a-8353-8f1834ac0323),Some(org.apache.hadoop.mapred.TextInputFormat),Some(org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat),Some(org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe),false,Map(serialization.format
> -> 1)),ArrayBuffer(CatalogColumn(key,int,true,None),
> CatalogColumn(value,string,true,None), CatalogColumn(ds,string,true,None),
> CatalogColumn(hr,string,true,None)),ArrayBuffer(ds,
> hr),List(),Buffer(),-1,xiaoli,1463026414000,0,Map(EXTERNAL -> TRUE,
> transient_lastDdlTime -> 1463026414),None,None,None)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
