TomokoKomiyama commented on issue #25848: [SPARK-29172][SQL] Fix some exception issue of explain commands URL: https://github.com/apache/spark/pull/25848#issuecomment-535397067 @srowen If we use 'extend', sql behave ``` scala> spark.sql("explain extended select * from hoge").show(false) +------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ |plan | +------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ |== Parsed Logical Plan == 'Project [*] +- 'UnresolvedRelation [hoge] == Analyzed Logical Plan == org.apache.spark.sql.AnalysisException: Table or view not found: hoge; line 1 pos 31; 'Project [*] +- 'UnresolvedRelation [hoge] org.apache.spark.sql.AnalysisException: Table or view not found: hoge; line 1 pos 31; 'Project [*] +- 'UnresolvedRelation [hoge] == Optimized Logical Plan == org.apache.spark.sql.AnalysisException: Table or view not found: hoge; line 1 pos 31; 'Project [*] +- 'UnresolvedRelation [hoge] == Physical Plan == org.apache.spark.sql.AnalysisException: Table or view not found: hoge; line 1 pos 31; 'Project [*] +- 'UnresolvedRelation [hoge] | +------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ ``` , because of the try exception in `sql/core/src/main/scala/org/apache/spark/sql/execution/QueryExecution.scala`(L156-) ``` } catch { case e: AnalysisException => e.toString } append(analyzedOutput) append("\n") QueryPlan.append(analyzed, append, verbose, addSuffix, maxFields) append("\n== Optimized Logical Plan ==\n") QueryPlan.append(optimizedPlan, append, verbose, addSuffix, maxFields) append("\n== Physical Plan ==\n") QueryPlan.append(executedPlan, append, verbose, addSuffix, maxFields) } ``` Other explain commands doesn't behave like this, so it need something change to be consistent. Can we add try exceptions in other explain commands to make these behaviors like 'extend' one?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
