Re: [VOTE] Move Apache Metron to the Apache Attic and Dissolve PMC

2020-11-16 Thread David Lyle
+1 On Mon, Nov 16, 2020 at 3:10 PM Michael Miklavcic < michael.miklav...@gmail.com> wrote: > +1 > > On Mon, Nov 16, 2020 at 7:01 AM Justin Leet wrote: > > > Hi all, > > > > This is a vote thread to retire Metron to the Attic, and dissolve the > PMC. > > This follows a discussion thread on the de

Re: [DISCUSS] Retire Metron to the Attic

2020-11-10 Thread David Lyle
+1 to both. -David... On Mon, Nov 9, 2020 at 3:21 PM zeo...@gmail.com wrote: > I also agree with a move to the attic. +1 to Otto's comment about forking > the kafka plugin. > > -- > Jon Zeolla > @jonzeolla > > PittSec | BsidesPGH | SteelCityInfoSec > > > On Mon, Nov 9, 2020 at 1:30 PM Otto Fow

Re: [VOTE] Development Guidelines Addendum on Inactive Pull Requests

2018-04-20 Thread David Lyle
+1 sounds good to me. -D... On Fri, Apr 20, 2018 at 11:09 AM, zeo...@gmail.com wrote: > +1 (non-binding) > > On Fri, Apr 20, 2018 at 9:42 AM Michel Sumbul > wrote: > > > +1 > > > > 2018-04-20 14:40 GMT+01:00 Otto Fowler : > > > > > +1 > > > > > > > > > On April 20, 2018 at 09:30:30, Nick Alle

Re: [DISCUSS] Metron RPM spec changelog

2018-04-18 Thread David Lyle
We use it to maintain compatibility with rpm -q --changelog. It's duplicative, but somewhat useful if all you have are the binaries. -D... On Wed, Apr 18, 2018 at 3:51 PM, Otto Fowler wrote: > I could not find it. > > > On April 18, 2018 at 15:34:25, Justin Leet (justinjl...@gmail.com) wrote:

Re: [DISCUSS] Split Elasticsearch and Kibana into separate MPack from Metron

2018-02-21 Thread David Lyle
Hi Mike, I agree. Def +1 on the first approach. Keep it with the Metron version. -D... On Wed, Feb 21, 2018 at 11:30 AM, Michael Miklavcic < michael.miklav...@gmail.com> wrote: > Anyone have any opinions on how we should version the ES/Kibana MPack? > > We currently rev the Metron one based o

Re: Anand is a new Committer!

2018-01-11 Thread David Lyle
Well deserved, Anand. Welcome! -D... On Thu, Jan 11, 2018 at 9:30 AM, Justin Leet wrote: > Congrats, Anand! > > On Thu, Jan 11, 2018 at 9:29 AM, Casey Stella wrote: > > > The Project Management Committee (PMC) for Apache Metron has invited > Anand > > Subramanian to become a committer and we

Re: Upgrade vagrant base to centos 7

2017-08-07 Thread David Lyle
Hi Jon, I'm not sure how to answer your question, but the base image (used for full-dev) we use is defined here: https://github.com/apache/metron/blob/master/metron-deployment/packaging/packer-build/base-centos-6.7.json. It's forked from bento/centos6.7, but not derived from it. Same deal with qu

Re: [VOTE][PROPOSAL] minor changes to release process

2017-07-05 Thread David Lyle
+1 on all. Sensible and much welcome changes. Thanks, -D... On Wed, Jul 5, 2017 at 5:47 PM, Matt Foley wrote: > (The below proposal is also stated in https://issues.apache.org/ > jira/browse/METRON-1020 ) > > The following proposed changes are small, but not just editorial in > nature, hence

Re: Help needed in assign a Task

2017-06-08 Thread David Lyle
Added. -D... On Thu, Jun 8, 2017 at 3:33 AM, RaghuMitra Kandikonda < raghumitra@gmail.com> wrote: > Hi Matt, > > Thanks for pointing me in the right direction. > > Can any PMC help me with this?. > > username: raghumitra > email: raghumitra@gmail.com > > -Raghu Mitra > > On Wed, Jun 7,

Re: AWS single_node_vm

2017-05-30 Thread David Lyle
e,enrichment,metron,ec2,zeppelin > - include: tasks/create-hosts.yml host_count=2 > host_type=ambari_slave,search,ec2 > - include: tasks/create-hosts.yml host_count=1 > host_type=ambari_slave,web,ec2 > > On 2017-05-30 08:53, David Lyle wrote: > >> That's actually a

Re: AWS single_node_vm

2017-05-30 Thread David Lyle
ed=1 > ec2-35-163-138-4.us-west-2.compute.amazonaws.com : ok=41 changed=27 > unreachable=0failed=0 > ec2-35-163-150-6.us-west-2.compute.amazonaws.com : ok=41 changed=27 > unreachable=0failed=0 > ec2-35-167-207-80.us-west-2.compute.amazonaws.com : ok=17 changed=8 > unreachab

Re: AWS single_node_vm

2017-05-27 Thread David Lyle
,ec2 >> - include: tasks/create-hosts.yml host_count=1 >> host_type=ambari_slave,enrichment,metron,ec2,zeppelin >> - include: tasks/create-hosts.yml host_count=2 >> host_type=ambari_slave,search,ec2 >> - include: tasks/create-hosts.yml host_count=1 >> h

Re: AWS single_node_vm

2017-05-26 Thread David Lyle
I'm gonna to venture a 'no' simply because I don't know what that is. Afaik, single_node_vm.yml was never used with AWS. What are you trying to do? -D... On Thu, May 25, 2017 at 8:50 PM, Laurens Vets wrote: > Is AWS single_node_vm still supported? >

Re: Elasticsearch: network.publish_host needed it seems

2017-05-11 Thread David Lyle
Hi Laurens, Have you tried [_local_,_site_]? If that doesn't work, perhaps give the publish address for enp0s8. Be sure to set that on the network_host field in the Elasticsearch config and leave network_publish_host empty. -D... On Thu, May 11, 2017 at 2:51 PM, Laurens Vets wrote: > Environm

Re: [MASTER BROKEN] Possible Issue in METRON.SPEC in master

2017-05-09 Thread David Lyle
don’t think I said what I meant. > I meant that they could investigate what happened from logs etc. rather > than they would actually do any > git commits or history modifications. > > > > On May 9, 2017 at 17:45:03, David Lyle (dlyle65...@gmail.com) wrote: > > Seems lik

Re: [MASTER BROKEN] Possible Issue in METRON.SPEC in master

2017-05-09 Thread David Lyle
Seems like more trouble than it's worth. I have a patch in test now. On Tue, May 9, 2017 at 5:24 PM, Otto Fowler wrote: > I wonder if an INFRA ticket is in order? > they can muck about with the git history. > > > > On May 9, 2017 at 17:19:34, David Lyle (dlyle65...@gmail

Re: [MASTER BROKEN] Possible Issue in METRON.SPEC in master

2017-05-09 Thread David Lyle
lt;<< HEAD > * Thu May 4 2017 Ryan Merriman - 0.4.0 > - Added REST > * Fri Apr 28 2017 Apache Metron - 0.4.0 > - Add Zeppelin Connection Report Dashboard > === > * Tue May 2 2017 David Lyle - 0.4.0 > - Add Metron IP Report > >

Re: Metron with HDP 2.5 bare-metal install fails

2017-05-04 Thread David Lyle
Looks like those instructions could use a bit of a re-vamp. Ambari 2.4.1 isn't supported, but it has you download that version. You'll need to use Ambari 2.4.2+. Here's the link for 2.4.2: http://public-repo-1.hortonworks.com/ambari/centos6/2.x/updates/2.4.2.0/ambari.repo -O /etc/yum.repos.d/amba

Re: [DISCUSS] Metron global config

2017-05-03 Thread David Lyle
Ambari has to manage the global configuration at least once or we cannot deploy. IIRC, last time this came up, we decided to expose it via Ambari but see if we could turn off the restart. I think we could expose it via an action. I'm pretty happy with any solution that takes that initial deploymen

Re: Request double-check on Ambari config logic (ES network_host)

2017-05-03 Thread David Lyle
Hi Otto, The Ansible settings were preserved by the mpack when deploying with Ansible. Ansible overrides the defaults. -D... On Wed, May 3, 2017 at 8:53 AM, Otto Fowler wrote: > My experience deploying with small_cluster / ansible was that it just > worked at the time to > my centos 6.9 esxi

Re: Failure to Deploy "Quick Dev"

2017-05-03 Thread David Lyle
Hi Nick, You do. just need to set up an Atlas account and shoot over the name. -D... On Wed, May 3, 2017 at 8:44 AM, Nick Allen wrote: > Who has the credentials to be able to update the images on Atlas? > > On Fri, Apr 21, 2017 at 11:02 AM, Casey Stella wrote: > > > I'm betting we need to re

Re: Quick Dev - Atlas Images

2017-04-26 Thread David Lyle
obligation > is > > to make it work with the current master and any branches currently used > by > > devs. > > > > Would be interested to get other opinions on this. I am good with making > > that assumption. Whatever the community agrees on for Quick Dev

Re: [DISCUSS] Regression introduced in Full Dev

2017-04-26 Thread David Lyle
, Otto Fowler wrote: > It did, I didn’t see it until later in the night though, all my jira spam > goes into one folder > and honestly, nifi issues is flooding it. I’ll have to split that out. > > Is there a metron issues list? > > > On April 26, 2017 at 08:08:59, David Lyle (

Re: [DISCUSS] Regression introduced in Full Dev

2017-04-26 Thread David Lyle
Thanks Otto, the original JIRA is good. I reopened it yesterday when I had the issue. I was hoping it would have emailed you. -D... On Wed, Apr 26, 2017 at 8:04 AM, zeo...@gmail.com wrote: > Interesting. I found it via pony mail - > https://lists.apache.org/thread.html/82e194ad8f8b8378676a28c

Re: auto-install on bare metal

2017-04-25 Thread David Lyle
Hi Dima, The same Ansible playbooks that work for EC2 and Vagrant will work for bare metal installations. The only difference is that you would need to pre-provision your machines and hand-build your inventory file. The AWS playbooks only provision the machines. All deployment of Metron is handled

Re: [DISCUSS] Storm topology.classpath setting

2017-04-25 Thread David Lyle
I think you have one more restart than is strictly required but I get your point. IIRC, when I did the original implementation there was a bit of a wrinkle getting the right configs on the right classpath so I punted in favor of topology.classpath. If you've got a more efficient way, I'm all for i

Re: Ambari Wizard: Repo Tab

2017-04-25 Thread David Lyle
That would do it. It requires 2.4.2+. I would have sworn I put that in the README, but I must have only annotated the PR. :( I'll get that in asap. -D... On Tue, Apr 25, 2017 at 3:44 PM, Otto Fowler wrote: > 2.4.1 as a matter of fact > > > On April 25, 2017 at 15:29:43, Da

Re: Ambari Wizard: Repo Tab

2017-04-25 Thread David Lyle
Any chance they're running Ambari < 2.4.2? -D... On Tue, Apr 25, 2017 at 3:23 PM, Michael Miklavcic < michael.miklav...@gmail.com> wrote: > Hey Otto, I don't have wizard screenshots in front of me right now to say > for sure, but I do see a repoinfo.xml in the mpack. I haven't run into > anythi

Re: metron_full_install playbook with small_cluster and multiple hosts

2017-04-25 Thread David Lyle
Hi Otto, I don't use a custom inventory that I create, but I do run an EC2 build very frequently, most recently on Friday. That does use the small_cluster file. 1. It's used because the Ansible Vagrant provisioner doesn't add localhost (as it should) to the inventory, so [local] works around that

Re: Status of METRON-153

2017-04-25 Thread David Lyle
So, the current Ansible deployment actually does use blueprints. It constructs them from one of small_cluster.yml or single_node_vm.yml using the ambari_custer_state module. Ambari blueprints [1] and the Ambari Install Wizard are actually two separate things that are only related because both are

Re: Quick Dev - Atlas Images

2017-04-24 Thread David Lyle
I think it's a really good idea. There is some complexity: a) Image releases do not map 1:1 with Metron releases and Atlas doesn't allow -SNAPSHOT in their release number scheme. That is, we'll have different versions of the image that work with a 0.4.1-SNAPSHOT Metron and some released versions o

Re: So we graduated...

2017-04-20 Thread David Lyle
Outstanding! Great work everyone. Building a TLP worthy community is difficult and worthy work, congratulations all! -D... On Thu, Apr 20, 2017 at 5:12 PM, Casey Stella wrote: > For anyone paying attention to incubator-general, it will come as no > surprise that we graduated as of last night's

Re: Having difficulty setting up both QuickDev and FullDev

2017-04-20 Thread David Lyle
Being as the dependency additon didn't actually resolve the out-of-order build issue, would it make sense to undo it? -D... On Thu, Apr 20, 2017 at 1:26 PM, Justin Leet wrote: > Our instructions on building the RPMs are slightly out of date. The pom > for metron-deployment changed slightly to

Re: [DISCUSS] next release proposal

2017-04-20 Thread David Lyle
Hi Matt, +1 on the fixes you selected for inclusion. Check with Justin to be sure, but I believe METRON-799 is ready for review, so pending that, it's ready to go. -D... On Thu, Apr 20, 2017 at 2:13 AM, Matt Foley wrote: > Hi all, > I’ve put together RC1 for the 0.4.0 release of Metron, along