That is correct, you will need to know the batchId associated with a session if you want to kill it while it is still running. In the case of batch session though, they end when finished (unlike interactive sessions which run until killed or closed). Also note that you can retrieve the list of batches running or recently finished by calling GET /batches but you would still need the batch id to know which is which. This process will also be easier when the new Web UI is released in Livy 0.4.0 soon.
Alex Bozarth
Software Engineer
Spark Technology Center
E-mail: [email protected]
GitHub: github.com/ajbozarth
505 Howard
Street
San Francisco, CA
94105
United
States
From: Barrett Strausser <[email protected]>
To: [email protected]
Date: 08/28/2017 03:39 PM
Subject: Re: Access Queue and App Name
Thanks for the fast response.
My more direct question is: If I submit a batch via Livy, my only option is
to store the returned batch id, so that I can delete that batch in the
future?
-b
On Mon, Aug 28, 2017 at 6:21 PM, Alex Bozarth <[email protected]> wrote:
As far as I know you can't get that info from the Livy API currently, but
you can get the YARN Application URL from the appInfo returned in a
GET /batches/{batchId} call and could find that info there.
Alex Bozarth
Software Engineer
Spark Technology Center
E-mail: [email protected]
GitHub: github.com/ajbozarth
505 Howard
Street
San Francisco, CA
94105
United
States
Inactive hide details for Barrett Strausser ---08/28/2017 03:05:48
PM---As documented in https://urldefense.proofpoint.com/v2/uBarrett
Strausser ---08/28/2017 03:05:48 PM---As documented in
https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_cloudera_livy-23pos
From: Barrett Strausser <[email protected]>
To: [email protected]
Date: 08/28/2017 03:05 PM
Subject: Access Queue and App Name
As documented in https://github.com/cloudera/livy#post-batches
How do I access the queue and app names once submitted in a batch job?
e.g. If I wanted to find an app with a certain name or submitted to a
certain queue how would I do that?
