Sahil Takiar created HIVE-19008:
-----------------------------------
Summary: Improve Spark session id logging
Key: HIVE-19008
URL: https://issues.apache.org/jira/browse/HIVE-19008
Project: Hive
Issue Type: Sub-task
Components: Spark
Reporter: Sahil Takiar
HoS users have two session ids, one id for the Hive session and another id for
the Spark session, both are UUIDs.
I think some improvements could be made here:
The Spark session id could just be a counter that is incremented for each new
Spark session within a Hive session. Each Spark session is still globally
identifiable by its associated Hive session id + its own counter. This may make
more sense since the Hive session - Spark session has a 1-to-many relationship,
as in a single Hive session can contain multiple Spark sessions, and each Spark
session must belong to a Hive session.
Furthermore, we should include both the Hive session id and Spark session id in
the console logs + the Spark Web UI.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
