Shivam Kapoor created LIVY-806:
----------------------------------
Summary: Where does livy retreives spark job logs from?
Key: LIVY-806
URL: https://issues.apache.org/jira/browse/LIVY-806
Project: Livy
Issue Type: Question
Reporter: Shivam Kapoor
We know that we can retrieve spark job logs via following livy rest api
curl -X GET "http://localhost:8998/batches/1/log"
Excuse me if these question seem silly. But I am very new to this ecosystem, so
kindly bear with me. I have following questions
# This is a great option but where can I find these logs on the livy server or
spark server for the purpose of debugging? I couldn't find any logs being
written under _livy/logs_ or _spark/logs_. Neither does the document says much
about the same.
# What happens to those logs when we delete the batch?
# Would you mind guiding me anything about debugging jobs when livy is involved
Thanks. Would appreciate any response!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)