Xiao Li created SPARK-15286:
-------------------------------
Summary: Make the output readable for EXPLAIN CREATE TABLE and
DESC EXTENDED
Key: SPARK-15286
URL: https://issues.apache.org/jira/browse/SPARK-15286
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 2.0.0
Reporter: Xiao Li
Currently, the output of EXPLAIN CREATE TABLE and DESC EXTENDED are not
readable.
For example,
{noformat}
CREATE EXTERNAL TABLE extTable_with_partitions (key INT, value STRING)
PARTITIONED BY (ds STRING, hr STRING)
LOCATION
'/private/var/folders/4b/sgmfldk15js406vk7lw5llzw0000gn/T/spark-b39a6185-8981-403b-a4aa-36fb2f4ca8a9'
{noformat}
The output of EXPLAIN command is
{noformat}
ExecutedCommand CreateTable
CatalogTable(`extTable_with_partitions`,CatalogTableType(EXTERNAL),CatalogStorageFormat(Some(/private/var/folders/4b/sgmfldk15js406vk7lw5llzw0000gn/T/spark-dd234718-e85d-4c5a-8353-8f1834ac0323),Some(org.apache.hadoop.mapred.TextInputFormat),Some(org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat),None,false,Map()),List(CatalogColumn(key,int,true,None),
CatalogColumn(value,string,true,None), CatalogColumn(ds,string,true,None),
CatalogColumn(hr,string,true,None)),List(ds,
hr),List(),List(),-1,,1463026413544,-1,Map(),None,None,None), false
{noformat}
The output of DESC EXTENDED is like
{noformat}
CatalogTable(`default`.`exttable_with_partitions`,CatalogTableType(EXTERNAL),CatalogStorageFormat(Some(file:/private/var/folders/4b/sgmfldk15js406vk7lw5llzw0000gn/T/spark-dd234718-e85d-4c5a-8353-8f1834ac0323),Some(org.apache.hadoop.mapred.TextInputFormat),Some(org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat),Some(org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe),false,Map(serialization.format
-> 1)),ArrayBuffer(CatalogColumn(key,int,true,None),
CatalogColumn(value,string,true,None), CatalogColumn(ds,string,true,None),
CatalogColumn(hr,string,true,None)),ArrayBuffer(ds,
hr),List(),Buffer(),-1,xiaoli,1463026414000,0,Map(EXTERNAL -> TRUE,
transient_lastDdlTime -> 1463026414),None,None,None)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
