This sounds similar to a previous email chain from a few months ago. I
think your answer may be in there.
https://lists.apache.org/thread.html/36c67f57fd3b1fcc9f99c8f894b23618703c1141b32f1dd2a6f7f183@%3Cuser.livy.apache.org%3E
Alex Bozarth
Software Engineer
Center for Open-Source Data & AI Technologies
E-mail: [email protected]
GitHub: github.com/ajbozarth
505 Howard
Street
San Francisco, CA
94105
United
States
From: Praveen Muthusamy <[email protected]>
To: [email protected]
Date: 05/03/2018 06:21 AM
Subject: Globally Unique/ User defined session Ids
Hi,
Is there support for sessionId to be GUID for batch usecase ? or can the
sessionId be made to be user-defined.
This will be useful for uniquely identifying sessions across restarts or
crashes. We are maintaining client side mappings to session Id and
restart / HA scenarios will make this session Id irrelevant.
Found this Jira ticket https://issues.cloudera.org/browse/LIVY-367 , but no
further comments on it.
It would be good if there is an option to assign GUID for a session,
similar to Yarn AppId, which will be unique for certain extent.
Please suggest what is the best way to maintain sessionIds across restarts
or HA scenarios ?
Regards,
Praveen M