[jira] [Commented] (EAGLE-859) MR job performance suggestion

2017-01-18 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/EAGLE-859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15829431#comment-15829431
 ] 

ASF GitHub Bot commented on EAGLE-859:
--

Github user r7raul1984 commented on the issue:

https://github.com/apache/eagle/pull/784
  
@qingwen220  Checkstyle problem.


> MR job performance suggestion
> -
>
> Key: EAGLE-859
> URL: https://issues.apache.org/jira/browse/EAGLE-859
> Project: Eagle
>  Issue Type: New Feature
>Affects Versions: v0.5.0
>Reporter: Zhao, Qingwen
>Assignee: Zhao, Qingwen
>
> Analyze a mapreduce job performance from the following aspects
> * compression setting anaysis
> * split setting analysis
> * spill analysis
> * mapreduce task num analysis
> * data skew analysis
> * GC time analysis
> * queue resource analysis



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (EAGLE-859) MR job performance suggestion

2017-01-18 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/EAGLE-859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15829400#comment-15829400
 ] 

ASF GitHub Bot commented on EAGLE-859:
--

GitHub user qingwen220 opened a pull request:

https://github.com/apache/eagle/pull/784

EAGLE-859 MapReduce job performance suggestion

https://issues.apache.org/jira/browse/EAGLE-859

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/qingwen220/incubator-eagle EAGLE-859

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/eagle/pull/784.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #784


commit 89ba5befd38615c1b35b15f75b610fa0a1e978f0
Author: Qingwen Zhao 
Date:   2017-01-12T03:00:12Z

rename method analysis to analyze

commit f085fce32f4c42b7031bf455e42fdaa7604b6bf8
Author: Qingwen Zhao 
Date:   2017-01-12T06:41:27Z

fix a typo

commit 0d95e1f02b09e18c16795681742fbad72430a826
Author: Qingwen Zhao 
Date:   2017-01-12T07:47:27Z

add job suggestion

commit 69b9646fbdd9e7c4bacf461e9a72305a391e375d
Author: Qingwen Zhao 
Date:   2017-01-13T13:08:12Z

add JobSuggestionListner

commit 5e9c2e0a22e3ff2fabcf28580391064b4b7170b5
Author: Qingwen Zhao 
Date:   2017-01-17T06:34:02Z

add job suggestion processors

commit 46be1b385bb2595edc4e6f2154989261db7cd8d1
Author: Qingwen Zhao 
Date:   2017-01-12T03:00:12Z

rename method analysis to analyze

commit f2f516be66333a3c77d22d731144997081cb3cf8
Author: Qingwen Zhao 
Date:   2017-01-12T06:41:27Z

fix a typo

commit a8a3db5f5cdb3991ec821663b1a9c6f82330c8f9
Author: Qingwen Zhao 
Date:   2017-01-12T07:47:27Z

add job suggestion

commit 6da62e20b8b1fcc30784e1ccbefba0cb9f0c50c7
Author: Qingwen Zhao 
Date:   2017-01-13T13:08:12Z

add JobSuggestionListner

commit 2e756c88579155ea1b8597fcfe2a9b4756427f75
Author: Qingwen Zhao 
Date:   2017-01-17T06:34:02Z

add job suggestion processors

commit d6e3780f07024d2ba84bbb7566970db083d5e233
Author: Qingwen Zhao 
Date:   2017-01-17T06:35:21Z

Merge remote-tracking branch 'refs/remotes/origin/EAGLE-859' into EAGLE-859

commit 634bd709bf91b9182384f3a3cc9cad0ae0d68274
Author: Zhao, Qingwen 
Date:   2017-01-17T08:14:49Z

update

commit d0a61b1b4ee08cad8623996ecfac06bb40a28e46
Author: Zhao, Qingwen 
Date:   2017-01-18T02:13:36Z

update JHFEventReaderBase.java

commit 7651da89104d14bdd4ad873521411f13b7d0dd6f
Author: Zhao, Qingwen 
Date:   2017-01-18T03:06:55Z

Fix code checkstyle

commit a902b5af435dc40569a76ba0b3cc870b18607e56
Author: Zhao, Qingwen 
Date:   2017-01-18T07:22:28Z

rename class name

commit 5529e9ab3a06ee043613b66c1434e4eeedf1e613
Author: Zhao, Qingwen 
Date:   2017-01-18T09:20:14Z

refactor code

commit 475411808d472b749f4b50d7bcbae3cf6321772b
Author: Zhao, Qingwen 
Date:   2017-01-18T09:54:28Z

update EmailPublisher.java

commit 81ed7fd024f5a05ff64e61cde44a64521d40c87e
Author: Zhao, Qingwen 
Date:   2017-01-18T11:01:47Z

change level from warning to none

commit e17657ce7848d9ab7ceb0a68a780f78731f9d775
Author: Zhao, Qingwen 
Date:   2017-01-18T13:19:40Z

add a new column in the alert

commit 13054d2adb2671c4a61d0608cef9b4f0493661fd
Author: Zhao, Qingwen 
Date:   2017-01-18T13:35:48Z

update AnalyzerReportTemplate.vm

commit 19befb11e3b09de72b45d41df88861fde37834a1
Author: Zhao, Qingwen 
Date:   2017-01-19T02:17:19Z

refactor code

commit 218c1e229810fd411a0a2302f985410f70af6ed6
Author: Zhao, Qingwen 
Date:   2017-01-19T06:34:28Z

update




> MR job performance suggestion
> -
>
> Key: EAGLE-859
> URL: https://issues.apache.org/jira/browse/EAGLE-859
> Project: Eagle
>  Issue Type: New Feature
>Affects Versions: v0.5.0
>Reporter: Zhao, Qingwen
>Assignee: Zhao, Qingwen
>
> Analyze a mapreduce job performance from the following aspects
> * compression setting anaysis
> * split setting analysis
> * spill analysis
> * mapreduce task num analysis
> * data skew analysis
> * GC time analysis
> * queue resource analysis



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] eagle pull request #784: EAGLE-859 MapReduce job performance suggestion

2017-01-18 Thread qingwen220 
GitHub user qingwen220 opened a pull request:

https://github.com/apache/eagle/pull/784

EAGLE-859 MapReduce job performance suggestion

https://issues.apache.org/jira/browse/EAGLE-859

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/qingwen220/incubator-eagle EAGLE-859

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/eagle/pull/784.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #784


commit 89ba5befd38615c1b35b15f75b610fa0a1e978f0
Author: Qingwen Zhao 
Date:   2017-01-12T03:00:12Z

rename method analysis to analyze

commit f085fce32f4c42b7031bf455e42fdaa7604b6bf8
Author: Qingwen Zhao 
Date:   2017-01-12T06:41:27Z

fix a typo

commit 0d95e1f02b09e18c16795681742fbad72430a826
Author: Qingwen Zhao 
Date:   2017-01-12T07:47:27Z

add job suggestion

commit 69b9646fbdd9e7c4bacf461e9a72305a391e375d
Author: Qingwen Zhao 
Date:   2017-01-13T13:08:12Z

add JobSuggestionListner

commit 5e9c2e0a22e3ff2fabcf28580391064b4b7170b5
Author: Qingwen Zhao 
Date:   2017-01-17T06:34:02Z

add job suggestion processors

commit 46be1b385bb2595edc4e6f2154989261db7cd8d1
Author: Qingwen Zhao 
Date:   2017-01-12T03:00:12Z

rename method analysis to analyze

commit f2f516be66333a3c77d22d731144997081cb3cf8
Author: Qingwen Zhao 
Date:   2017-01-12T06:41:27Z

fix a typo

commit a8a3db5f5cdb3991ec821663b1a9c6f82330c8f9
Author: Qingwen Zhao 
Date:   2017-01-12T07:47:27Z

add job suggestion

commit 6da62e20b8b1fcc30784e1ccbefba0cb9f0c50c7
Author: Qingwen Zhao 
Date:   2017-01-13T13:08:12Z

add JobSuggestionListner

commit 2e756c88579155ea1b8597fcfe2a9b4756427f75
Author: Qingwen Zhao 
Date:   2017-01-17T06:34:02Z

add job suggestion processors

commit d6e3780f07024d2ba84bbb7566970db083d5e233
Author: Qingwen Zhao 
Date:   2017-01-17T06:35:21Z

Merge remote-tracking branch 'refs/remotes/origin/EAGLE-859' into EAGLE-859

commit 634bd709bf91b9182384f3a3cc9cad0ae0d68274
Author: Zhao, Qingwen 
Date:   2017-01-17T08:14:49Z

update

commit d0a61b1b4ee08cad8623996ecfac06bb40a28e46
Author: Zhao, Qingwen 
Date:   2017-01-18T02:13:36Z

update JHFEventReaderBase.java

commit 7651da89104d14bdd4ad873521411f13b7d0dd6f
Author: Zhao, Qingwen 
Date:   2017-01-18T03:06:55Z

Fix code checkstyle

commit a902b5af435dc40569a76ba0b3cc870b18607e56
Author: Zhao, Qingwen 
Date:   2017-01-18T07:22:28Z

rename class name

commit 5529e9ab3a06ee043613b66c1434e4eeedf1e613
Author: Zhao, Qingwen 
Date:   2017-01-18T09:20:14Z

refactor code

commit 475411808d472b749f4b50d7bcbae3cf6321772b
Author: Zhao, Qingwen 
Date:   2017-01-18T09:54:28Z

update EmailPublisher.java

commit 81ed7fd024f5a05ff64e61cde44a64521d40c87e
Author: Zhao, Qingwen 
Date:   2017-01-18T11:01:47Z

change level from warning to none

commit e17657ce7848d9ab7ceb0a68a780f78731f9d775
Author: Zhao, Qingwen 
Date:   2017-01-18T13:19:40Z

add a new column in the alert

commit 13054d2adb2671c4a61d0608cef9b4f0493661fd
Author: Zhao, Qingwen 
Date:   2017-01-18T13:35:48Z

update AnalyzerReportTemplate.vm

commit 19befb11e3b09de72b45d41df88861fde37834a1
Author: Zhao, Qingwen 
Date:   2017-01-19T02:17:19Z

refactor code

commit 218c1e229810fd411a0a2302f985410f70af6ed6
Author: Zhao, Qingwen 
Date:   2017-01-19T06:34:28Z

update




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] eagle issue #782: [IMPROVEMENT] Using aggregation query in backend instead o...

2017-01-18 Thread haoch 
Github user haoch commented on the issue:

https://github.com/apache/eagle/pull/782
  
LGTM, thanks for the contribution @chitin 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Commented] (EAGLE-872) Transform counter metric to rate metric

2017-01-18 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/EAGLE-872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15829339#comment-15829339
 ] 

ASF GitHub Bot commented on EAGLE-872:
--

GitHub user r7raul1984 opened a pull request:

https://github.com/apache/eagle/pull/783

[EAGLE-872]  Transform counter metric to rate metric

- Add transform bolt using counterToRateFunction in 
HadoopMetricMonitorApp's storm topology.

https://issues.apache.org/jira/browse/EAGLE-872


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/1haodian/eagle EAGLE-872

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/eagle/pull/783.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #783


commit d886628fced8fa352a3032613349bbda6c74fd90
Author: r7raul1984 
Date:   2017-01-19T05:23:41Z

[EAGLE-872]  Transform counter metric to rate metric

- Add transform bolt using counterToRateFunction in 
HadoopMetricMonitorApp's storm topology.

https://issues.apache.org/jira/browse/EAGLE-872




> Transform counter metric to rate metric
> ---
>
> Key: EAGLE-872
> URL: https://issues.apache.org/jira/browse/EAGLE-872
> Project: Eagle
>  Issue Type: Improvement
>Reporter: JiJun Tang
>Assignee: JiJun Tang
>
> Some metric like hbase hadoop.hbase.regionserver.server.totalrequestcount is 
> counter type(the value is always increasing).We will save the rate of change 
> of the value over a step period.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] eagle pull request #783: [EAGLE-872] Transform counter metric to rate metric

2017-01-18 Thread r7raul1984 
GitHub user r7raul1984 opened a pull request:

https://github.com/apache/eagle/pull/783

[EAGLE-872]  Transform counter metric to rate metric

- Add transform bolt using counterToRateFunction in 
HadoopMetricMonitorApp's storm topology.

https://issues.apache.org/jira/browse/EAGLE-872


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/1haodian/eagle EAGLE-872

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/eagle/pull/783.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #783


commit d886628fced8fa352a3032613349bbda6c74fd90
Author: r7raul1984 
Date:   2017-01-19T05:23:41Z

[EAGLE-872]  Transform counter metric to rate metric

- Add transform bolt using counterToRateFunction in 
HadoopMetricMonitorApp's storm topology.

https://issues.apache.org/jira/browse/EAGLE-872




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Work started] (EAGLE-872) Transform counter metric to rate metric

2017-01-18 Thread JiJun Tang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/EAGLE-872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on EAGLE-872 started by JiJun Tang.

> Transform counter metric to rate metric
> ---
>
> Key: EAGLE-872
> URL: https://issues.apache.org/jira/browse/EAGLE-872
> Project: Eagle
>  Issue Type: Improvement
>Reporter: JiJun Tang
>Assignee: JiJun Tang
>
> Some metric like hbase hadoop.hbase.regionserver.server.totalrequestcount is 
> counter type(the value is always increasing).We will save the rate of change 
> of the value over a step period.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (EAGLE-872) Transform counter metric to rate metric

2017-01-18 Thread JiJun Tang (JIRA) 
JiJun Tang created EAGLE-872:


 Summary: Transform counter metric to rate metric
 Key: EAGLE-872
 URL: https://issues.apache.org/jira/browse/EAGLE-872
 Project: Eagle
  Issue Type: Improvement
Reporter: JiJun Tang
Assignee: JiJun Tang


Some metric like hbase hadoop.hbase.regionserver.server.totalrequestcount is 
counter type(the value is always increasing).We will save the rate of change of 
the value over a step period.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (EAGLE-871) Apache Eagle should not use com.sun.* packages

2017-01-18 Thread Jayesh (JIRA) 
Jayesh created EAGLE-871:


 Summary: Apache Eagle should not use com.sun.* packages 
 Key: EAGLE-871
 URL: https://issues.apache.org/jira/browse/EAGLE-871
 Project: Eagle
  Issue Type: Improvement
Reporter: Jayesh
Assignee: Jayesh


com.sun packages are not officially supported, should use javax packages 
instead: refer: 
http://www.oracle.com/technetwork/java/faq-sun-packages-142232.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Assigned] (EAGLE-870) NoClassDefFoundError in alert storm topology

2017-01-18 Thread Jayesh (JIRA) 

 [ 
https://issues.apache.org/jira/browse/EAGLE-870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jayesh reassigned EAGLE-870:


Assignee: Jayesh

> NoClassDefFoundError in alert storm topology
> 
>
> Key: EAGLE-870
> URL: https://issues.apache.org/jira/browse/EAGLE-870
> Project: Eagle
>  Issue Type: Bug
>Reporter: Jayesh
>Assignee: Jayesh
>Priority: Critical
>
> alert module is throwing this error in storm topology about not finding the 
> class
> {code}
> java.lang.NoClassDefFoundError: com/sun/jersey/api/client/GenericType at 
> org.apache.eagle.alert.engine.coordinator.impl.ZKMetadataChangeNotifyService.init(ZKMetadataChangeNotifyService.java:70)
> {code}
> GenericType class here mentioned is part of jetty-client from 
> com.sun.jersey.jetty which is not included in 
> eagle-topology-0.5.0-SNAPSHOT-assembly.jar
> due to this error, alert topology wont be able to execute.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (EAGLE-863) Refactor Topology Monitoring Widgets

2017-01-18 Thread Hao Chen (JIRA) 

[ 
https://issues.apache.org/jira/browse/EAGLE-863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15828091#comment-15828091
 ] 

Hao Chen commented on EAGLE-863:


Two Bugs:

1）`siteId` is totally different from `siteName` so the query 
{code}/rest/entities?query=HbaseServiceInstance[@site="siteName"]{*}=1{code}
 is wrong, should be 
{code}/rest/entities?query=HbaseServiceInstance[@site="siteId"]{*}=1{code}

2) Use eagle count agg query instead of agg purely in front-end with JS, for 
example:
* region server alive count: 
`/rest/entities?query=HbaseServiceInstance[@site="siteId" and @status="live" 
and @role="regionserver"]<@site>{count}=1`
* region server alive count: 
`/rest/entities?query=HbaseServiceInstance[@site="siteId" and @status="dead" 
and @role="regionserver"]<@site>{count}=1`


> Refactor Topology Monitoring Widgets
> 
>
> Key: EAGLE-863
> URL: https://issues.apache.org/jira/browse/EAGLE-863
> Project: Eagle
>  Issue Type: Sub-task
>  Components: Hadoop JMX Monitor
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: JiJun Tang
>Priority: Critical
> Fix For: v0.5.0
>
>
> Currently the widgets (HDFS/HBase/YARN) on site home page (/#/site/$siteId) 
> is just a mockup sample, please:
> 1) Define meaningful information in HBase widget, just for example:
>* Number of Masters (active/standby) ?
>* Number of Region Servers (live/dead)?
> 2) Define meaningful information in HDFS widget, just for example:
>* Storage/Used DFS capacity?
>* Number of DataNodes (live/dead)?
> 3) Define meaningful information in YARN widget, just for example:
>* Resource Manager?
>* Number of Node Manager?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)