RE: Gobblin Metrics

2018-06-19 Thread Zhang, Xiuzhu(AWF)
...@gobblin.incubator.apache.org Subject: Re: Gobblin Metrics Hi Xiuzhu, Given an error, I usually find the direct cause from the log, from which, trace the reason bottom-up or top-down along job topology. The majority of gobblin jobs have similar topology as modeled here: https://gobblin.readthedocs.io/en/latest

Re: Gobblin Metrics

2018-06-14 Thread Zhixiong Chen
er log. They are good entry points for reasoning. Zhixiong From: Zhang, Xiuzhu(AWF) Sent: Thursday, June 14, 2018 9:35 AM To: u...@gobblin.incubator.apache.org; dev@gobblin.incubator.apache.org Subject: RE: Gobblin Metrics Hi Zhixiong, Yes, reporting feature can f

RE: Gobblin Metrics

2018-06-14 Thread Zhang, Xiuzhu(AWF)
...@linkedin.com] Sent: Wednesday, June 13, 2018 1:32 AM To: dev@gobblin.incubator.apache.org; u...@gobblin.incubator.apache.org Subject: Re: Gobblin Metrics Hi Xiuzhu, If I understand correctly, you're trying to get counter info in the code block(`TaskState#toTaskExecutionInfo`) when the job

Re: Gobblin Metrics

2018-06-12 Thread Zhixiong Chen
ixiong From: Zhang, Xiuzhu(AWF) Sent: Monday, June 11, 2018 6:58 PM To: u...@gobblin.incubator.apache.org; dev@gobblin.incubator.apache.org Subject: RE: Gobblin Metrics Hi Zhixiong, I haven’t use configure reporter and haven’t sought anything exceptions. Looks like the TaskStat

RE: Gobblin Metrics

2018-06-11 Thread Zhang, Xiuzhu(AWF)
...@gobblin.incubator.apache.org Subject: Re: Gobblin Metrics Hi Xiuzhu, Which metric reporter are you using? Did you see exceptions about sending metrics in mapreduce mode? Zhixiong, From: Zhang, Xiuzhu(AWF) mailto:xiuzhzh...@paypal.com>> Sent: Monday, June 11, 2018 2

Re: Gobblin Metrics

2018-06-11 Thread Zhixiong Chen
Hi Xiuzhu, Which metric reporter are you using? Did you see exceptions about sending metrics in mapreduce mode? Zhixiong, From: Zhang, Xiuzhu(AWF) Sent: Monday, June 11, 2018 2:19 AM To: dev@gobblin.incubator.apache.org; u...@gobblin.incubator.apache.org