Robert Kanter created OOZIE-1716:
------------------------------------

             Summary: Add a way to stream the logs for only the last x hours
                 Key: OOZIE-1716
                 URL: https://issues.apache.org/jira/browse/OOZIE-1716
             Project: Oozie
          Issue Type: New Feature
    Affects Versions: trunk
            Reporter: Robert Kanter


When a user has a busy cluster and long running coordinator jobs, streaming the 
logs can be really slow.  In this situation, the user is typically only 
interested in the latest logs and doesn't care about logs from a while ago.  
So, we can speed this up by adding a parameter or something to the log 
streaming API to only fetch the logs from the last x hours.  The log files roll 
over every hour, so this should be pretty straightforward.  We can also prepend 
a message to the logs streamed back mentioning that only the last x hours of 
logs are included.  The existing way of getting all of the logs should remain 
unaffected and still work.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Reply via email to