Chao created HIVE-10060: --------------------------- Summary: Provide more informative stage description in Spark Web UI [Spark Branch] Key: HIVE-10060 URL: https://issues.apache.org/jira/browse/HIVE-10060 Project: Hive Issue Type: Sub-task Components: spark-branch Affects Versions: 1.2.0 Reporter: Chao Priority: Minor
Currently, for HoS in Spark Web UI, it displays stage information like the following: Description: foreachAsync at RemoteHiveSparkClient.java:254 org.apache.spark.api.java.JavaPairRDD.foreachAsync(JavaPairRDD.scala:45) org.apache.hadoop.hive.ql.exec.spark.RemoteHiveSparkClient$JobStatusJob.call(RemoteHiveSparkClient.java:254) org.apache.hive.spark.client.RemoteDriver$JobWrapper.call(RemoteDriver.java:366) It would be better to provide more useful information, like what is the part of the query that this stage is about. Looks like this is implemented in SparkSQL. -- This message was sent by Atlassian JIRA (v6.3.4#6332)