cxzl25 commented on issue #26577: [SPARK-29943][SQL] Improve error messages for unsupported data type URL: https://github.com/apache/spark/pull/26577#issuecomment-556013936 @HyukjinKwon Create an illegal view, which makes it easier to know which field name and type are not supported. ```create view t AS SELECT STRUCT('a' AS `$a`, 1 AS b) as q;``` current: org.apache.spark.SparkException: Cannot recognize hive type string: struct<$a:string,b:int> change: org.apache.spark.SparkException: Cannot recognize hive type string: struct<$a:string,b:int>,column: q Read multiple tables, which contain tables of unsupported data types, which makes it easier to know which field name and type of which table. hive: ``` create view t as select null as c1 from xxx; ``` c1 void select * from t join t_normal_1 join t_normal_2 current: org.apache.spark.SparkException: Cannot recognize hive type string: void change: org.apache.spark.SparkException: Cannot recognize hive type string: void,db: default,table: t,column: c1
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
