[GitHub] incubator-eagle pull request #408: EAGLE-514: Add two job count apis

2016-08-30 Thread qingwen220
GitHub user qingwen220 opened a pull request: https://github.com/apache/incubator-eagle/pull/408 EAGLE-514: Add two job count apis https://issues.apache.org/jira/browse/EAGLE-514 1. adding two job counting apis 2. add tracking url in running/history job execution

[jira] [Created] (EAGLE-515) convert JobHistoryZKStateManager to singleton

2016-08-30 Thread wujinhu (JIRA)
wujinhu created EAGLE-515: - Summary: convert JobHistoryZKStateManager to singleton Key: EAGLE-515 URL: https://issues.apache.org/jira/browse/EAGLE-515 Project: Eagle Issue Type: Improvement

[jira] [Closed] (EAGLE-512) add job count statistics to mr history feeder

2016-08-30 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/EAGLE-512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu closed EAGLE-512. - > add job count statistics to mr history feeder > - > >

[jira] [Created] (EAGLE-514) Add two job count apis

2016-08-30 Thread Zhao, Qingwen (JIRA)
Zhao, Qingwen created EAGLE-514: --- Summary: Add two job count apis Key: EAGLE-514 URL: https://issues.apache.org/jira/browse/EAGLE-514 Project: Eagle Issue Type: New Feature

[jira] [Commented] (EAGLE-512) add job count statistics to mr history feeder

2016-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/EAGLE-512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450882#comment-15450882 ] ASF GitHub Bot commented on EAGLE-512: -- Github user wujinhu closed the pull request at:

[GitHub] incubator-eagle pull request #406: [EAGLE-512] add job count(total) for...

2016-08-30 Thread wujinhu
Github user wujinhu closed the pull request at: https://github.com/apache/incubator-eagle/pull/406 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-eagle issue #402: Eagle-447 convert eagle-maprfs app to use new ap...

2016-08-30 Thread DadanielZ
Github user DadanielZ commented on the issue: https://github.com/apache/incubator-eagle/pull/402 @yonzhang, I see now. In “ AbstractHdfsAuditLogApplication.java”, there is an overrided function which use "HdfsAuditLogParserBolt" directly: ``` @Override public

[jira] [Updated] (EAGLE-508) Fix NullPointerException when zookeeper is trying to shutdown in ZookeeperEmbedded.

2016-08-30 Thread Huizhi Lu (JIRA)
[ https://issues.apache.org/jira/browse/EAGLE-508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huizhi Lu updated EAGLE-508: Summary: Fix NullPointerException when zookeeper is trying to shutdown in ZookeeperEmbedded. (was: Jenkins

[GitHub] incubator-eagle issue #402: Eagle-447 convert eagle-maprfs app to use new ap...

2016-08-30 Thread yonzhang
Github user yonzhang commented on the issue: https://github.com/apache/incubator-eagle/pull/402 @DadanielZ that is why there is already AbstractHdfsAuditLogApplication there, and MapRApplication can extend this and implement getParserBolt method --- If your project is set up for it,

[GitHub] incubator-eagle issue #402: Eagle-447 convert eagle-maprfs app to use new ap...

2016-08-30 Thread DadanielZ
Github user DadanielZ commented on the issue: https://github.com/apache/incubator-eagle/pull/402 @haoch thanks for the review, will add them later. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] incubator-eagle issue #402: Eagle-447 convert eagle-maprfs app to use new ap...

2016-08-30 Thread DadanielZ
Github user DadanielZ commented on the issue: https://github.com/apache/incubator-eagle/pull/402 @yonzhang Their code are almost the same except that: "AbstractHdfsAuditLogApplication" use "HdfsAuditLogParserBolt", "AbstractMapRFSAuditLogApplication" should use

[GitHub] incubator-eagle issue #401: [EAGLE-508] Fix Jenkins building failed on build...

2016-08-30 Thread haoch
Github user haoch commented on the issue: https://github.com/apache/incubator-eagle/pull/401 Pls. change to title to meaningful information which will be part of commit history. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] incubator-eagle issue #402: Eagle-447 convert eagle-maprfs app to use new ap...

2016-08-30 Thread haoch
Github user haoch commented on the issue: https://github.com/apache/incubator-eagle/pull/402 Pls. refer to : * Metadata descriptor and SPI: https://github.com/apache/incubator-eagle/tree/develop/eagle-security/eagle-security-hdfs-auditlog/src/main/resources/META-INF *

[jira] [Commented] (EAGLE-510) Refactor HDFS audit log parser

2016-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/EAGLE-510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449634#comment-15449634 ] ASF GitHub Bot commented on EAGLE-510: -- Github user yonzhang commented on the issue:

[GitHub] incubator-eagle issue #403: EAGLE-510: Refactor HDFS audit log parser

2016-08-30 Thread yonzhang
Github user yonzhang commented on the issue: https://github.com/apache/incubator-eagle/pull/403 sure, we can remove that method --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[jira] [Commented] (EAGLE-510) Refactor HDFS audit log parser

2016-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/EAGLE-510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449628#comment-15449628 ] ASF GitHub Bot commented on EAGLE-510: -- Github user peterkim95 commented on the issue:

[GitHub] incubator-eagle issue #402: Eagle-447 convert eagle-maprfs app to use new ap...

2016-08-30 Thread haoch
Github user haoch commented on the issue: https://github.com/apache/incubator-eagle/pull/402 ApplicationProvider and XML metadata descriptor is missing. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] incubator-eagle issue #403: EAGLE-510: Refactor HDFS audit log parser

2016-08-30 Thread peterkim95
Github user peterkim95 commented on the issue: https://github.com/apache/incubator-eagle/pull/403 I see, can we can still refactor by removing the unused method parseUser --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[jira] [Commented] (EAGLE-489) maven Javadoc phrase fails on develop branch

2016-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/EAGLE-489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449621#comment-15449621 ] ASF GitHub Bot commented on EAGLE-489: -- Github user haoch commented on the issue:

[GitHub] incubator-eagle issue #405: [EAGLE-489] loosen javadoc restriction to get ri...

2016-08-30 Thread haoch
Github user haoch commented on the issue: https://github.com/apache/incubator-eagle/pull/405 LGTM, pls. merge. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] incubator-eagle pull request #407: DataNode Usage Metric added in JMX Collec...

2016-08-30 Thread haoch
Github user haoch commented on a diff in the pull request: https://github.com/apache/incubator-eagle/pull/407#discussion_r76841756 --- Diff: eagle-external/hadoop_jmx_collector/hadoop_jmx_kafka.py --- @@ -64,6 +64,23 @@ def on_bean(self, bean): capacityusage =

[jira] [Commented] (EAGLE-510) Refactor HDFS audit log parser

2016-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/EAGLE-510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449597#comment-15449597 ] ASF GitHub Bot commented on EAGLE-510: -- Github user yonzhang commented on the issue:

[GitHub] incubator-eagle issue #403: EAGLE-510: Refactor HDFS audit log parser

2016-08-30 Thread yonzhang
Github user yonzhang commented on the issue: https://github.com/apache/incubator-eagle/pull/403 We may not change the code to use regex matching as it is too slow. We have achieved more than 10 times performance gain by using string operations than using regex. This is critical

[GitHub] incubator-eagle issue #399: Eagle505 oozie auditlog parser don't deal with N...

2016-08-30 Thread yonzhang
Github user yonzhang commented on the issue: https://github.com/apache/incubator-eagle/pull/399 Thanks for the fix. We can remove the internal try/catch and only use outer try/catch to catch exception and finally it will do ack anyway --- If your project is set up for it, you can

[GitHub] incubator-eagle issue #402: Eagle-447 convert eagle-maprfs app to use new ap...

2016-08-30 Thread yonzhang
Github user yonzhang commented on the issue: https://github.com/apache/incubator-eagle/pull/402 Thanks for the improvement. Why we create a new AbstractMapRFSAuditLogApplication, can't we use AbstractHdfsAuditLogApplication? They share the same code --- If your project is set up

[GitHub] incubator-eagle issue #407: DataNode Usage Metric added in JMX Collector

2016-08-30 Thread yonzhang
Github user yonzhang commented on the issue: https://github.com/apache/incubator-eagle/pull/407 good fix, but Senthil can you do PR against develop branch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

ApacheCon Seville CFP closes September 9th

2016-08-30 Thread Rich Bowen
It's traditional. We wait for the last minute to get our talk proposals in for conferences. Well, the last minute has arrived. The CFP for ApacheCon Seville closes on September 9th, which is less than 2 weeks away. It's time to get your talks in, so that we can make this the best ApacheCon yet.

[GitHub] incubator-eagle issue #407: DataNode Usage Metric added in JMX Collector

2016-08-30 Thread RalphSu
Github user RalphSu commented on the issue: https://github.com/apache/incubator-eagle/pull/407 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[jira] [Comment Edited] (EAGLE-513) Add DataNodes usages Metrics in JMX Collector

2016-08-30 Thread Senthilkumar (JIRA)
[ https://issues.apache.org/jira/browse/EAGLE-513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449104#comment-15449104 ] Senthilkumar edited comment on EAGLE-513 at 8/30/16 2:09 PM: - Added code in

[GitHub] incubator-eagle pull request #407: DataNode Usage Metric added in JMX Collec...

2016-08-30 Thread senthilec566
GitHub user senthilec566 opened a pull request: https://github.com/apache/incubator-eagle/pull/407 DataNode Usage Metric added in JMX Collector Modified Hadoop JMX collector to Parse Data Node Usage. You can merge this pull request into a Git repository by running: $ git pull

[jira] [Created] (EAGLE-513) Add DataNodes usages Metrics in JMX Collector

2016-08-30 Thread Senthilkumar (JIRA)
Senthilkumar created EAGLE-513: -- Summary: Add DataNodes usages Metrics in JMX Collector Key: EAGLE-513 URL: https://issues.apache.org/jira/browse/EAGLE-513 Project: Eagle Issue Type:

[GitHub] incubator-eagle pull request #406: [EAGLE-512] add job count(total) for...

2016-08-30 Thread wujinhu
GitHub user wujinhu opened a pull request: https://github.com/apache/incubator-eagle/pull/406 [EAGLE-512] add job count(total) for mr history feeder You can merge this pull request into a Git repository by running: $ git pull https://github.com/wujinhu/incubator-eagle

[jira] [Created] (EAGLE-512) add job count statistics to mr history feeder

2016-08-30 Thread wujinhu (JIRA)
wujinhu created EAGLE-512: - Summary: add job count statistics to mr history feeder Key: EAGLE-512 URL: https://issues.apache.org/jira/browse/EAGLE-512 Project: Eagle Issue Type: New Feature