Re: [lustre-discuss] how to get statistics from lustre clients ?
To add to the list, I like ‘xltop’ which works like a linux ‘top’ command and integrates with your scheduler. On Tue, Jan 2, 2018 at 9:25 AM Ben Evans wrote: > The OSTs and MDTs have client-specific information in their proc > hierarchies, so there's no need for client-side monitoring if that's all > you're looking for. > > -Ben Evans > > From: Christopher Johnston > Date: Tuesday, January 2, 2018 at 10:21 AM > To: Ben Evans > Cc: "Black.S" , "lustre-discuss@lists.lustre.org" < > lustre-discuss@lists.lustre.org> > Subject: Re: [lustre-discuss] how to get statistics from lustre clients ? > > I use the telgraf plugin for MDS/OSS/OST stats. I know its not the client > side that you were after but I find the metrics to be very useful and > display nicely in grafana. > > https://github.com/influxdata/telegraf/tree/master/plugins/inputs/lustre2 > > On Tue, Jan 2, 2018 at 8:45 AM, Ben Evans wrote: > >> You can get breakdowns of client->OST reads and writes, and combine them >> into OSS-level info. >> >> There is currently no timestamp on it, all the stats files are cumulative >> since you last cleared. You can get around this by reading the file >> regularly and noting the time, and doing the diffs since the last read. >> >> There are a few programs out there that do this sort of thing for you >> already, collectl and collectd come to mind. >> >> -Ben Evans >> >> From: lustre-discuss on behalf >> of "Black.S" >> Date: Saturday, December 30, 2017 at 9:18 AM >> To: "lustre-discuss@lists.lustre.org" >> Subject: [lustre-discuss] how to get statistics from lustre clients ? >> >> May be anybody know it or get the target where I can search >> >> I want to get from each lustre client: >> >>- >> >>how much lustre client read/write ? >>- >> >>which size blocks ? >>- >> >>with which OSS communicate ? >>- >> >>timestemp of operation ( I mean time then start read/write from >>lustre client) ? >> >> Is I can get that from (or by) linux node with lustre client? >> >> ___ >> lustre-discuss mailing list >> lustre-discuss@lists.lustre.org >> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org >> >> > ___ > lustre-discuss mailing list > lustre-discuss@lists.lustre.org > http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org > ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] how to get statistics from lustre clients ?
The OSTs and MDTs have client-specific information in their proc hierarchies, so there's no need for client-side monitoring if that's all you're looking for. -Ben Evans From: Christopher Johnston mailto:chjoh...@gmail.com>> Date: Tuesday, January 2, 2018 at 10:21 AM To: Ben Evans mailto:bev...@cray.com>> Cc: "Black.S" mailto:black@yandex.ru>>, "lustre-discuss@lists.lustre.org<mailto:lustre-discuss@lists.lustre.org>" mailto:lustre-discuss@lists.lustre.org>> Subject: Re: [lustre-discuss] how to get statistics from lustre clients ? I use the telgraf plugin for MDS/OSS/OST stats. I know its not the client side that you were after but I find the metrics to be very useful and display nicely in grafana. https://github.com/influxdata/telegraf/tree/master/plugins/inputs/lustre2 On Tue, Jan 2, 2018 at 8:45 AM, Ben Evans mailto:bev...@cray.com>> wrote: You can get breakdowns of client->OST reads and writes, and combine them into OSS-level info. There is currently no timestamp on it, all the stats files are cumulative since you last cleared. You can get around this by reading the file regularly and noting the time, and doing the diffs since the last read. There are a few programs out there that do this sort of thing for you already, collectl and collectd come to mind. -Ben Evans From: lustre-discuss mailto:lustre-discuss-boun...@lists.lustre.org>> on behalf of "Black.S" mailto:black@yandex.ru>> Date: Saturday, December 30, 2017 at 9:18 AM To: "lustre-discuss@lists.lustre.org<mailto:lustre-discuss@lists.lustre.org>" mailto:lustre-discuss@lists.lustre.org>> Subject: [lustre-discuss] how to get statistics from lustre clients ? May be anybody know it or get the target where I can search I want to get from each lustre client: * how much lustre client read/write ? * which size blocks ? * with which OSS communicate ? * timestemp of operation ( I mean time then start read/write from lustre client) ? Is I can get that from (or by) linux node with lustre client? ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org<mailto:lustre-discuss@lists.lustre.org> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] how to get statistics from lustre clients ?
I use the telgraf plugin for MDS/OSS/OST stats. I know its not the client side that you were after but I find the metrics to be very useful and display nicely in grafana. https://github.com/influxdata/telegraf/tree/master/plugins/inputs/lustre2 On Tue, Jan 2, 2018 at 8:45 AM, Ben Evans wrote: > You can get breakdowns of client->OST reads and writes, and combine them > into OSS-level info. > > There is currently no timestamp on it, all the stats files are cumulative > since you last cleared. You can get around this by reading the file > regularly and noting the time, and doing the diffs since the last read. > > There are a few programs out there that do this sort of thing for you > already, collectl and collectd come to mind. > > -Ben Evans > > From: lustre-discuss on behalf > of "Black.S" > Date: Saturday, December 30, 2017 at 9:18 AM > To: "lustre-discuss@lists.lustre.org" > Subject: [lustre-discuss] how to get statistics from lustre clients ? > > May be anybody know it or get the target where I can search > > I want to get from each lustre client: > >- > >how much lustre client read/write ? >- > >which size blocks ? >- > >with which OSS communicate ? >- > >timestemp of operation ( I mean time then start read/write from lustre >client) ? > > Is I can get that from (or by) linux node with lustre client? > > ___ > lustre-discuss mailing list > lustre-discuss@lists.lustre.org > http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org > > ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] how to get statistics from lustre clients ?
You can get breakdowns of client->OST reads and writes, and combine them into OSS-level info. There is currently no timestamp on it, all the stats files are cumulative since you last cleared. You can get around this by reading the file regularly and noting the time, and doing the diffs since the last read. There are a few programs out there that do this sort of thing for you already, collectl and collectd come to mind. -Ben Evans From: lustre-discuss mailto:lustre-discuss-boun...@lists.lustre.org>> on behalf of "Black.S" mailto:black@yandex.ru>> Date: Saturday, December 30, 2017 at 9:18 AM To: "lustre-discuss@lists.lustre.org<mailto:lustre-discuss@lists.lustre.org>" mailto:lustre-discuss@lists.lustre.org>> Subject: [lustre-discuss] how to get statistics from lustre clients ? May be anybody know it or get the target where I can search I want to get from each lustre client: * how much lustre client read/write ? * which size blocks ? * with which OSS communicate ? * timestemp of operation ( I mean time then start read/write from lustre client) ? Is I can get that from (or by) linux node with lustre client? ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] how to get statistics from lustre clients ?
May be anybody know it or get the target where I can search I want to get from each lustre client: * how much lustre client read/write ? * which size blocks ? * with which OSS communicate ? * timestemp of operation ( I mean time then start read/write from lustre client) ? Is I can get that from (or by) linux node with lustre client? ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
