Check Eagle service running status

[Da Zhou]

Hi,

Is there a command that I can run to make sure Eagle is definitely up?

I'm using Eagle-0.4, tried to use "/bin/eagle-service.sh status".
Though it returns "running" but in fact it is not fully started, because
existed topology in Storm could not connect to it.  Then I have to kill the
topology and wait for a few while then submit it.



Regards,
Da

Re: [ANNOUNCE] New Apache Eagle Committer: Jinhu Wu

[Da Zhou]

Congrats and welcome Jinhu!!!

Regards,
Da
> On Sep 6, 2016, at 10:14 PM, Jinhu Wu  wrote:
> 
> Thanks, I'm very glad to become a Apache Eagle committer and PPMC member
> and will make more contributions to Eagle and Apache open source
> community.
> 
> On Wed, Sep 7, 2016 at 11:13 AM, Michael Wu  wrote:
> 
>> Eagle Community,
>> 
>> The Project Management Committee (PMC) for Apache Eagle has asked Jinhu Wu
>> to become a committer and PPMC member, we are now pleased to announce that
>> he has accepted.
>> 
>> Jinhu has demonstrated a strong commitment to the Apache Eagle community
>> by carrying out several
>> monitoring features for Map-Reduce Job, Spark Job, Hive Security, etc. He
>> also participated widely in design discussion, and bug fixing endeavors.
>> 
>> Not only his insight and solid technical skills have brought the project
>> extra productivity, his enthusiasm in programming and continuous
>> contribution also benefits the community and is believed to guide Eagle
>> project to the next level.
>> 
>> @ Jinhu,
>> 
>> Welcome to join us! Would you like to make a brief self-introduction to
>> the community?
>> 
>> Yours,
>> Michael on behalf of Apache Eagle PPMC
>> 

Re: metrics-core version problem

[Da Zhou]

Hi Luping,

I tested Apache Eagle 0.4.0 on CDH 5.5.2 last month, it was working fine.
But what I used was "Logstash"  but not log4j appender, as logstash is
easier to configure from my view.

If you want to try logstash, you can follow this link to set up Apache
Eagle env on CDH:
https://github.com/DadanielZ/eaglemonitoring.github.io/blob/199dc0f280d408cd4cb3ad76a861b6d05e228d69/cloudera-integration.md

Or if you have already set up  configurations including  kafka, storm, et,
 then all you need to do is:
- install logstash on you machine (Apache Eagle online documents provides
conf sample for version 1.5.x, and 2.x, so I suggest you to use logstash
2.x.)
- create a logstash conf file. Conf file sample is here:
https://github.com/apache/incubator-eagle/blob/branch-0.4/eagle-assembly/src/main/docs/logstash-kafka-conf.md
)
Then you should be all set.

Let me know if you have any other issues.

Thanks and regards,
Da

On Aug 23, 2016, at 3:47 AM, 邱路平  wrote:

Hi：

The CDH hadoop got the error，and the KafkaLog4jAppender do not work.



log4j:WARN Error during default initialization

java.lang.NoClassDefFoundError: com/yammer/metrics/Metrics

   at kafka.metrics.KafkaMetricsGroup$class.newMeter(KafkaMetricsGroup.
scala:79)

   at kafka.producer.ProducerStats.newMeter(ProducerStats.scala:23)

   at kafka.producer.ProducerStats.(ProducerStats.scala:25)

   at
kafka.producer.ProducerStatsRegistry$$anonfun$1.apply(ProducerStats.scala:34
)

   at
kafka.producer.ProducerStatsRegistry$$anonfun$1.apply(ProducerStats.scala:34
)

   at kafka.utils.Pool.getAndMaybePut(Pool.scala:61)

   at
kafka.producer.ProducerStatsRegistry$.getProducerStats(ProducerStats.scala:3
8)

   at
kafka.producer.async.DefaultEventHandler.(DefaultEventHandler.scala:48
)

   at kafka.producer.Producer.(Producer.scala:60)

   at
org.apache.eagle.log4j.kafka.KafkaLog4jAppender.activateOptions(KafkaLog4jAp
pender.scala:113)

   at
org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:307)

   at
org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:172
)

   at
org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:104
)

   at
org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigurator.jav
a:842)

   at
org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.jav
a:768)

   at
org.apache.log4j.PropertyConfigurator.parseCatsAndRenderers(PropertyConfigur
ator.java:672)

   at
org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:
516)

   at
org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:
580)

   at
org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.
java:526)

   at org.apache.log4j.LogManager.(LogManager.java:127)

   at org.apache.log4j.Logger.getLogger(Logger.java:104)

   at
org.apache.commons.logging.impl.Log4JLogger.getLogger(Log4JLogger.java:262)

   at
org.apache.commons.logging.impl.Log4JLogger.(Log4JLogger.java:108)

   at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)

   at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAcces
sorImpl.java:57)

   at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstruc
torAccessorImpl.java:45)

   at java.lang.reflect.Constructor.newInstance(Constructor.java:526)

   at
org.apache.commons.logging.impl.LogFactoryImpl.createLogFromClass(LogFactory
Impl.java:1025)

   at
org.apache.commons.logging.impl.LogFactoryImpl.discoverLogImplementation(Log
FactoryImpl.java:844)

   at
org.apache.commons.logging.impl.LogFactoryImpl.newInstance(LogFactoryImpl.ja
va:541)

   at
org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.ja
va:292)

   at
org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.ja
va:269)

   at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:657)

   at
org.apache.hadoop.conf.Configuration.(Configuration.java:178)

   at
org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:175)

Caused by: java.lang.ClassNotFoundException: com.yammer.metrics.Metrics

   at java.net.URLClassLoader$1.run(URLClassLoader.java:366)

   at java.net.URLClassLoader$1.run(URLClassLoader.java:355)

   at java.security.AccessController.doPrivileged(Native Method)

   at java.net.URLClassLoader.findClass(URLClassLoader.java:354)

   at java.lang.ClassLoader.loadClass(ClassLoader.java:425)

   at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)

   at java.lang.ClassLoader.loadClass(ClassLoader.java:358)



How Can I fix it?



rube

Re: 答复: Eagle graduation steps

[Da Zhou]

+1 for nominating Edward as VP and Chair of Apache Eagle.

Regards,
Da

On Sun, Nov 13, 2016 at 11:48 PM, Tang Jijun(上海_技术部_数据平台_唐觊隽) <
tangji...@yhd.com> wrote:

> +1 for Edward Zhang as VP for Apache Eagle
>
> Best Wishes
>
> Ji Jun Tang
> Jr. Engineer , Architecture - Fundation, Tech Dept
> Floor 4, 295 ZUCHONGZHI RD, Zhangjiang, Shanghai (201203)
>
> -邮件原件-
> 发件人: Zhao Qingwen [mailto:qingwen...@gmail.com]
> 发送时间: 2016年11月14日 15:36
> 收件人: dev@eagle.incubator.apache.org
> 主题: Re: Eagle graduation steps
>
> +1 for Edward Zhang as VP for Apache Eagle
>
>
> Best Regards,
> Qingwen Zhao | 赵晴雯
>
>
>
>
> 2016-11-14 15:28 GMT+08:00 Liangfei.Su :
>
> > +1 for Edward Zhang as VP for Apache Eagle
> >
> > Ralph
> >
> >
> > On Mon, Nov 14, 2016 at 1:35 PM, Hao Chen  wrote:
> >
> > > +1 for nominating Edward as VP and Chair of Eagle.
> > >
> > > - Hao
> > >
> > > On Mon, Nov 14, 2016 at 1:14 PM, Henry Saputra
> > > 
> > > wrote:
> > >
> > > > Thanks for driving the graduation discussion, Edward,
> > > >
> > > > One thing that we need for graduation is VP or Chair for Eagle as
> > > > Top
> > > Level
> > > > project.
> > > >
> > > > I am nominating Edward Zhang as VP for Apache Eagle since he has
> > > > been
> > > very
> > > > active to drive Apache Eagle community,
> > > >
> > > > - Henry
> > > >
> > > > On Mon, Nov 7, 2016 at 9:27 PM, Edward Zhang
> > > > 
> > > > wrote:
> > > >
> > > > > Hi Mentors,
> > > > >
> > > > > Can you please reply this email if you have remaining issues
> > regarding
> > > > > Eagle graduation before we call official vote?
> > > > >
> > > > > According to Apache project graduation guideline, we need make
> > > > > sure
> > > > mentors
> > > > > and IPMC have no remaining issues.
> > > > >
> > > > >
> > > > >- Ensure Mentors
> > > > > > > > > Responsibilities.html#Mentor>
> > > > > and IPMC
> > > > > > > > > Responsibilities.html#Incubator+Project+Management+
> > > Committee+%28PMC%29>
> > > > > have
> > > > >no remaining issues
> > > > >
> > > > >  > > > > >
> > > > >
> > > > >
> > > > >
> > > > > Thanks
> > > > > Edward
> > > > >
> > > > > On Sun, Nov 6, 2016 at 11:01 AM, Edward Zhang <
> > yonzhang2...@apache.org
> > > >
> > > > > wrote:
> > > > >
> > > > > > Hi Henry and Eagle Mentors,
> > > > > >
> > > > > > Seems we have gone through most of check list for graduation,
> > > > > > can I
> > > > start
> > > > > > formal community vote on graduation according to
> > > > http://incubator.apache
> > > > > .
> > > > > > org/guides/graduation.html#process?
> > > > > >
> > > > > >
> > > > > >
> > > > > >- a charter for your project(Draft resolution
> > was
> > > > > done)
> > > > > >- a positive community graduation VOTE
> > > > > >
> > > > > >- a positive IPMC recommendation VOTE
> > > > > >
> > > > > >- the acceptance of the resolution
> > > > > > > > resolution>
> > > > > by
> > > > > >the Board
> > > > > >
> > > > > > Also, do you have any remaining issues about graduation before
> > > > > > we
> > do
> > > > > vote?
> > > > > >
> > > > > >
> > > > > >- Ensure Mentors
> > > > > > > > > > Responsibilities.html#Mentor>
> > > > > > and IPMC
> > > > > > > > > > Responsibilities.html#Incubator+Project+Management+
> > > Committee+%28PMC%29>
> > > > > have
> > > > > >no remaining issues
> > > > > > > issues>
> > > > > >
> > > > > >
> > > > > >
> > > > > > Thanks
> > > > > > Edward
> > > > > >
> > > > > > On Sun, Oct 30, 2016 at 8:59 PM, Edward Zhang <
> > > yonzhang2...@apache.org
> > > > >
> > > > > > wrote:
> > > > > >
> > > > > >> Hi Eagle community,
> > > > > >>
> > > > > >> As one step towards graduation, the following is proposed
> > > > > >> project destination and resolution and please provide your
> feedback.
> > > > > >>
> > > > > >> For destination, according to the guide line
> > > > > >> http://incubator.apache.org/guides/graduation.html#subprojec
> > > > > >> t-or-top-level, because Apache Eagle is sponsored by IPMC, we
> > should
> > > > put
> > > > > >> it to be top-level project instead of subproject.
> > > > > >>
> > > > > >> For revision, here is the template, template
> > https://svn.apache.or
> > > > > >> g/repos/private/committers/board/templates/podling-tlp-
> > > > resolution.txt.
> > > > > I
> > > > > >> put initial committers there and we need a chair for this
> project.
> > > > > >>
> > > > > >> 

Re: [DISCUSS] restart Eagle graduate discussion

[Da Zhou]

Vote +1.
 "Eagle Maturity Assessment" looks good to me. Great process has been made
since last discussion:

- Lots of new features have been introduced, now Apache Eagle has become
more powerful and user-friendly.(eg,  Application Management through Eagle
UI.)
- Also many fixes have been checked in, which makes Eagle more stable and
robust.
- Community is getting more active, we can tell this based on daily
discussion happened in the emails.
- Apache Eagle is getting more attention by different corporations and
organizations,  their cooperation has been reported online (eg, Yahoo News)

Regards,
Da

On Wed, Oct 12, 2016 at 8:12 PM, Edward Zhang 
wrote:

> Hi Eagle Community,
>
> It's been more than 2 months and a lot have been improved since we last
> time discussed Eagle graduation. Here I want to suggest we restart
> discussion of Eagle graduation. Please share your comments.
>
> Some documents and data are as follows:
> 1. Maturity assessment,
> https://cwiki.apache.org/confluence/display/EAG/Eagle+
> Podling+Maturity+Assessment
> 2. https://cwiki.apache.org/confluence/display/EAG/Documentation
> 3. Four new committers were added since incubation
> 4. Two releases are made
> 5. >600 Jira tickets,
> https://issues.apache.org/jira/browse/EAGLE-614?jql=project%20%3D%20EAGLE
> 6. ~500 pull requests.
> https://github.com/apache/incubator-eagle/pulls?utf8=%E2%9C%93=is%3Apr
>
> Thanks
> Edward
>
>
> On Sat, Oct 1, 2016 at 7:34 AM, Ge, Jing  wrote:
>
> > Hi Jijun,
> >
> > Thanks for your nice feedback and excellent contribution. We appreciate
> it.
> >
> > Best regards
> > Jing
> >
> > On 9/30/16, 8:43 PM, "Tang Jijun(上海_技术部_数据平台_唐觊隽)" 
> > wrote:
> >
> > Great work! Great advances have been made for Apache Eagle.
> > I think Apache Eagle will became a great project for community with
> > these improvement.
> >
> > Best Wishes
> >
> > 唐觊隽
> > Jr. Engineer , Architecture - Fundation, Tech Dept
> > Floor 4, 295 ZUCHONGZHI RD, Zhangjiang, Shanghai (201203)
> >
> > -邮件原件-
> > 发件人: Ge, Jing [mailto:ji...@ebay.com]
> > 发送时间: 2016年9月30日 19:50
> > 收件人: dev@eagle.incubator.apache.org; Tang Jijun(上海_技术部_数据平台_唐觊隽)
> > 主题: Re: [DISCUSS] Is Eagle ready to graduate?
> >
> > Hi Jijun,
> >
> > Thanks for pointing out where we can improve ourselves. We have been
> > working on that since we got your email. Now:
> >
> > 1. We have CI server which will make sure the code will be stable and
> > build will be successful.
> > 2. We have more than 430 Unit tests.
> > 3. We have published fundamental documentation to let user and
> > developer understand Eagle and will continue working on them a.
> Development
> > Guide https://cwiki.apache.org/confluence/display/EAG/Development+Guide
> > b. Product features introduction https://cwiki.apache.org/
> > confluence/display/EAG/Development+Guide
> > c. More information w.r.t. roadmap or technical design, etc. can be
> > found at https://cwiki.apache.org/confluence/display/EAG/Eagle
> >
> > Speaking of documentation, many thanks for your contribution to the
> > Alert Engine on Spark Streaming https://cwiki.apache.org/
> > confluence/display/EAG/Alert+Engine+on+Spark+Streaming. We really
> > appreciate it.
> >
> > Your concerns should be solved. please let us know your thoughts.
> >
> > Best regards
> > Jing
> >
> > On 9/1/16, 1:17 PM, "Michael Wu"  wrote:
> >
> > Security page at http://eagle.incubator.apache.
> org/sup/index.html
> > is
> > updated with new content, please review if it conforms to what we
> > expected.
> >
> > On Thu, Aug 25, 2016 at 10:28 AM, Michael Wu  >
> > wrote:
> >
> > > Hi mentors,
> > >
> > > I will update security page content taking the mentioned
> aspects.
> > >
> > > Except for the security part, is there any other gaps that you
> > feel eagle
> > > has to fill before graduation? Please feel free to point issues
> > out and we
> > > will do our best to get aligned to what graduation requires.
> > Thanks.
> > >
> > > Michael
> > >
> > > On Wed, Aug 24, 2016 at 9:53 AM, Julian Hyde  >
> > wrote:
> > >
> > >> I did a quick survey, and it seems that most projects do not
> > have a
> > >> security team[1], which means that vulnerabilities should be
> > reported to
> > >> secur...@apache.org. Of the projects that do, Kafka seems a
> > good model
> > >> to follow; its security page is simple and clear[2].
> > >>
> > >> Julian
> > >>
> > >> [1] http://www.apache.org/security/projects.html <
> > >> http://www.apache.org/security/projects.html>
> > >>
> > >> [2] http://kafka.apache.org/project-security.html <
> > >> 

Re: [VOTE] Graduate Apache Eagle to top level project

[Da Zhou]

+1

Being a scalable and robust framework for monitoring and alerting,  Apache
Eagle is ready to go.

Regards,
Da

On Thu, Dec 1, 2016 at 3:12 AM, wp chun  wrote:

> +1
>
>
> Eagle has been progressively maturing with a lot more flexible and robust
> framework.  Building monitoring and alerting application becomes very
> easy.  I can foresee more and more applications to be contributed to the
> community base on this framework.
>
> 
> From: Zhao Qingwen 
> Sent: December 1, 2016 5:49:31 AM
> To: dev@eagle.incubator.apache.org
> Subject: Re: [VOTE] Graduate Apache Eagle to top level project
>
> +1
>
> Since last Oct, Eagle has grown a lot in all aspects described in Apache
> Project Maturity Model. It also accepts 4+ new committers and multiple
> other organizations also actively participate in the new feature
> development.
>
>
> Best Regards,
> Qingwen Zhao | 赵晴雯
>
>
>
>
> 2016-12-01 16:30 GMT+08:00 Michael Wu :
>
> > +1
> >
> > Ever since I got in touch with this project, I've been enjoying the
> > energetic atmosphere among the members of eagle community, who are filled
> > with marvelous passion in their mind on developing and delivery fantastic
> > grogram. In the year+ open-source incubation journey, the community
> proved
> > itself having the right technical skill set for the project and being
> > ability to drive the project on the right path. I believe all those above
> > is the key reason why this project evolves so well.
> >
> > Besides, this community is open enough to evenly discussing on technical
> > topics and community affairs, and always concentrating on solutions with
> > professional perspectives. In the incubation phase, people learnt,
> > practiced, and shared their experiences of running the project under
> > apache's policies, with not only the new comer, but also other existing
> > members, all making the community grow healthily and speedily.
> >
> > I feel the project deserve the shift to top-level project, and it will
> be a
> > star shining in the sky of apache projects. :)
> >
> > Thanks.
> >
> > Michael
> >
> > On Thu, Dec 1, 2016 at 3:52 PM, Liangfei.Su 
> wrote:
> >
> > > +1
> > >
> > > Glad to see we start this vote process.
> > >
> > > On Thu, Dec 1, 2016 at 1:46 PM, Edward Zhang 
> > > wrote:
> > >
> > > > Hi Eagle community,
> > > >
> > > > After a very positive discussion in Apache Eagle community
> > http://apache
> > > .
> > > > markmail.org/thread/s2yegpmxf3g7fa34, I'd like to bring the
> following
> > > > resolution for a formal vote in Eagle community and after this we
> need
> > > > another formal vote in IPMC and then we reach a stage close to
> > graduation
> > > > :-)
> > > >
> > > > Please vote on the resolution pasted below to graduate Apache Eagle
> > from
> > > > the incubator to top level project.
> > > >
> > > >
> > > > [ ] +1 Graduate Apache Eagle from the Incubator.
> > > >
> > > > [ ] +0 Don't care.
> > > >
> > > > [ ] -1 Don't graduate Apache Eagle from the Incubator because...
> > > >
> > > >
> > > > This vote will be open for at least 72 hours.
> > > >
> > > >
> > > > Many thanks to our mentors and everyone else for the support,
> > > >
> > > > Edward Zhang (on behalf of the Apache Eagle PPMC).
> > > >
> > > > Resolution:
> > > >
> > > >   Establish the Apache Eagle Project
> > > >
> > > >   WHEREAS, the Board of Directors deems it to be in the best
> > > >   interests of the Foundation and consistent with the
> > > >   Foundation's purpose to establish a Project Management
> > > >   Committee charged with the creation and maintenance of
> > > >   open-source software, for distribution at no charge to
> > > >   the public, related to a distributed monitoring solution for
> > > > identifying security and performance issues in real time on big data
> > > > platforms, including Hadoop and Spark etc.
> > > >
> > > >   NOW, THEREFORE, BE IT RESOLVED, that a Project Management
> > > >   Committee (PMC), to be known as the "Apache Eagle Project",
> > > >   be and hereby is established pursuant to Bylaws of the
> > > >   Foundation; and be it further
> > > >
> > > >   RESOLVED, that the Apache Eagle Project be and hereby is
> > > >   responsible for the creation and maintenance of software
> > > >   related to a distributed monitoring solution for identifying
> > > security
> > > > and performance issues in real time on big data platforms, including
> > > Hadoop
> > > > and Spark etc.;
> > > >   and be it further
> > > >
> > > >   RESOLVED, that the office of "Vice President, Apache Eagle" be
> > > >   and hereby is created, the person holding such office to
> > > >   serve at the direction of the Board of Directors as the chair
> > > >   of the Apache Eagle Project, and to have primary responsibility
> > > >   for management of the