Re: DUCC services statistics

2018-07-19 Thread Eddie Epstein
Hi, As you may see, the default DUCC pinger for UIMA-AS services scraps JMX stats from the service broker to report the number of producers and consumers, the queue depth and a few other things. This pinger also does stat reset operations on each call to the pinger, I think every 2 minutes. A

DUCC services statistics

2018-07-19 Thread Daniel Baumartz
Hi, we have a DUCC installation with different services that are being used by jobs and external clients. We want to collect some statistics for a monitoring tool that are not included in the DUCC dashboard, e.g. how often and when a service/queue has been used, which services are used by

Re: DUCC services statistics

2018-07-19 Thread Jaroslaw Cwiklik
Daniel, you can monitor AMQ to discover client connections and also monitor queue activity. Jerry On Thu, Jul 19, 2018 at 7:31 AM Daniel Baumartz < bauma...@stud.uni-frankfurt.de> wrote: > Hi, > > we have a DUCC installation with different services that are being used > by jobs and external

Re: High CPU Load on Job Driver

2018-07-19 Thread Eddie Epstein
Hi Rohit, What is the collection reader running in the job driver doing? Look at the memory use (RSS) value for the job driver on the job details page. If nothing is logged (be sure to check ducc.log file) my guess would be that the JD ran out of RAM in its cgroup and was killed. The JD cgroup