Re: Mesos task history after restart

2018-08-02 Thread Vinod Kone
Mesos doesn't store task information in ZooKeeper. It is stored in Mesos master's memory and recovered from Mesos agents after a master restart / leader election. The task history can be controlled by `max_completed_frameworks`, `max_completed_tasks_per_framework` master flags. AFAICT, the

Re: Mesos Task History

2016-04-14 Thread Adam Bordelon
You might also want to check out TwoSigma's Satellite: https://github.com/twosigma/satellite Sunil's Satellite talk from MesosCon: https://www.youtube.com/watch?v=yLkc17HFEb8 On Thu, Apr 14, 2016 at 9:16 AM, Dick Davies wrote: > We just grab them with collectds mesos

Re: Mesos Task History

2016-04-14 Thread Dick Davies
We just grab them with collectds mesos plugin and log to Graphite, gives us long term trend details. https://github.com/rayrod2030/collectd-mesos Haven't used this one but it supposedly does per-task metric collection: https://github.com/bobrik/collectd-mesos-tasks On 14 April 2016 at 13:37,

Re: Mesos Task History

2016-04-14 Thread June Taylor
Adam, Is there a way to keep this history? Thanks, June Taylor System Administrator, Minnesota Population Center University of Minnesota On Wed, Apr 13, 2016 at 4:32 PM, Adam Bordelon wrote: > Yes, these counters are only kept in-memory, so any time a Mesos master >

Re: Mesos Task History

2016-04-13 Thread June Taylor
We have a single master at the moment. Does the task history get cleared when the mesos-master restarts? Thanks, June Taylor System Administrator, Minnesota Population Center University of Minnesota On Wed, Apr 13, 2016 at 11:33 AM, Pradeep Chhetri < pradeep.chhetr...@gmail.com> wrote: > Yes,

Re: Mesos Task History

2016-04-13 Thread Pradeep Chhetri
Yes, they get cleaned up whenever the mesos master leader failover happens. On Wed, Apr 13, 2016 at 3:32 PM, June Taylor wrote: > I am noticing that recently our Completed Tasks and Terminated Frameworks > lists are empty. Where are these stored, and do they get automatically >