Shivam Kapoor created LIVY-806:
----------------------------------

             Summary: Where does livy retreives spark job logs from?
                 Key: LIVY-806
                 URL: https://issues.apache.org/jira/browse/LIVY-806
             Project: Livy
          Issue Type: Question
            Reporter: Shivam Kapoor


We know that we can retrieve spark job logs via following livy rest api

 curl -X GET "http://localhost:8998/batches/1/log";

 

Excuse me if these question seem silly. But I am very new to this ecosystem, so 
kindly bear with me. I have following questions
 # This is a great option but where can I find these logs on the livy server or 
spark server for the purpose of debugging? I couldn't find any logs being 
written under _livy/logs_ or _spark/logs_. Neither does the document says much 
about the same. 
 # What happens to those logs when we delete the batch?
 # Would you mind guiding me anything about debugging jobs when livy is involved

Thanks. Would appreciate any response!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to