Re: [DISCUSS] Build RPM/DEBs in Travis?

https://issues.apache.org/jira/browse/METRON-885 On May 22, 2019 at 10:43:22, Justin Leet (justinjl...@gmail.com) wrote: Yep, that's all I was doing. I'm in favor of adding it to Travis. On Wed, May 22, 2019 at 10:28 AM Michael Miklavcic < michael.miklav...@gmail.com> wrote: > I think Justin w

Re: [DISCUSS] Travis CI Build Time Limits

Yes, that is what I’m proposing, but if we want to try to break things down to speed them up, we can still do that ;) On May 23, 2019 at 11:28:51, Michael Miklavcic (michael.miklav...@gmail.com) wrote: I think we're talking about killing the cache just 1 time for the purpose of verifying that th

Re: [DISCUSS] Bug maybe: Alert UI can't use two status filter

Bug On May 31, 2019 at 08:53:21, Tibor Meller (tibor.mel...@gmail.com) wrote: Hi all, tl;dr: Is it a bug if "* -alert_status:RESOLVE OR -alert_status:DISMISS" not works on Alert UI? I'm experimenting with filtering from the alert UI. What I found is I can run the following query directly again

Storm 1.0.x eol

https://storm.apache.org/2019/05/30/storm200-released.html

Re: What's the status of Metron

Hi Phillip and welcome! You certainly can help. As far as the status, there are several ways to look at it aren’t there? - we have active committers and reviewers, but not as many as we would like - we have an active users like, but not insanely so - metron _is_ part of a large bistro package HC

Re: Metron/Docker failing - should I file a Jira?

Hi Phillip, The docker compose stuff is in contrib because it uses a different method to deploy the cluster than the official builds ( which use Ambari ), and thus has to be maintained separately, and will always lag behind. I don’t believe it is up to date with all the changes that have gone int

Re: Hello Metron Dev Community

Welcome Dale! Btw: Dale is Tigerquoll on slack :) On July 30, 2019 at 03:09:22, Dale Richardson (tigerqu...@outlook.com) wrote: Hi folks, Greetings from down under! I just thought I'd introduce myself now that I am starting to spend some time hanging around the list. I'm Dale, I've been invol

Re: Contributing to Metron

What is your jira id? On August 13, 2019 at 13:06:36, Yerex, Tom (tom.ye...@ubc.ca) wrote: I would like to get access to JIRA (or be assigned a ticket), to add documentation to the Centos7 project folder under metron/metron-deployment/development/*centos7*/, similar to the README.md file that

Jira issue creation

I know that there are many times where the PR work precedes the jira creation, so that you are creating the jira to match the work you are doing, and that is fine as there are all sorts of workflows for contributors. That being said, I don’t think it is great to have empty jiras just to placeholde

Re: [DISCUSS] Deprecate Least Recently Used Pruner

Can you summarize what it does? Is it from OpenSOC? On August 13, 2019 at 17:53:52, Nick Allen (n...@nickallen.org) wrote: As part of https://github.com/apache/metron/pull/1470, I found it difficult to update the "Least Recently Used Pruner" to work with HBase 2.0.2. I am sure that given more

Re: [DISCUSS] HDP 3.1 Upgrade and release strategy

Although we had the discussion, and some great ideas where passed around, I do not believe we came to some kind of consensus on what 1.0 should look like. So that discussion would have to be picked up again so that we could know where we are at, and make it an actual thing if we were going to make

Re: [DISCUSS] HDP 3.1 Upgrade and release strategy

an aware >> of zero users who wish to remain on HDP 2. >> >> Perhaps those users who want to stay on the old platform can stick their >> hands up and raise concerns, but this move will likely have to happen very >> soon. >> >> Simon >> >> On T

Re: [DISCUSS] HDP 3.1 Upgrade and release strategy

;>> >>> Something worth noting here is that HDP 2.6.5 is quite old and >>> approaching EoL rapidly, so the issue of upgrade is urgent. I am aware of a >>> large number of users who require this upgrade ASAP, and in fact an aware >>> of zero users who wish

Re: [DISCUSS] HDP 3.1 Upgrade and release strategy

Good idea METRON–2239 [blocker]. On August 27, 2019 at 16:30:13, Simon Elliston Ball ( si...@simonellistonball.com) wrote: You could always submit a Jira :) On Tue, 27 Aug 2019 at 21:27, Otto Fowler wrote: > You are right, that is much better than backup_metron_configs.sh. > &g

Re: [DISCUSS] HDP 3.1 Upgrade and release strategy

If anyone can think of the things that need to be backed up, please comment the jira. On August 27, 2019 at 17:07:20, Otto Fowler (ottobackwa...@gmail.com) wrote: Good idea METRON–2239 [blocker]. On August 27, 2019 at 16:30:13, Simon Elliston Ball ( si...@simonellistonball.com) wrote: You

Re: [DISCUSS] Metron installation and management - deprecating Ambari support

I need a little while to think about this, but I would just like to say that NiFi is a really bad example to compare Metron too. Nifi can be deployed as a single zip file and run from wherever it is unzipped. It is more of an application that can be clustered with other instances of that applicati

Re: [DISCUSS] Curator client upgrade

+1 On September 17, 2019 at 14:53:13, Michael Miklavcic ( michael.miklav...@gmail.com) wrote: Also, caught this come through the HBase dev list - https://issues.apache.org/jira/browse/HBASE-23032. Might be worth a look at 4.2.0 while we're at it and possibly also avoid this issue that I was ru

Re: [VOTE] Metron-bro-plugin-kafka Release Candidate 0.3.0-RC1

If you are doing the RM duties, just go a head and cut the RC. On September 29, 2019 at 11:35:10, zeo...@gmail.com (zeo...@gmail.com) wrote: Hi everyone, This took much longer than expected, but we recently cleaned up the last blocker to getting a 0.3 release out. As a reminder, currently the

Re: [DISCUSS] Completing HDP 3.1 upgrade feature branch and next steps for Metron 1.x release

I think we also need: - Draft of upgrade guide, reviewed and tried. What is missing? What is hard? Possible refactoring from there. - Draft of the new supported versions of XX for Metron - How are we going to tell current users the change in support? I am not sure bu

Re: [VOTE] Metron-bro-plugin-kafka Release Candidate 0.3.0-RC2

–1 binding. A new feature to our docker testing to add support for the git version / branch of the plugin to test was added during development. This feature however makes it impossible to run the docker testing suite against the signed src tarball for verification. I have created METRON–2269 for

Re: [VOTE] Metron-bro-plugin-kafka Release Candidate 0.3.0-RC2

https://github.com/apache/metron-bro-plugin-kafka/pull/37 On September 30, 2019 at 18:44:29, Otto Fowler (ottobackwa...@gmail.com) wrote: –1 binding. A new feature to our docker testing to add support for the git version / branch of the plugin to test was added during development. This

Re: [VOTE] Metron-bro-plugin-kafka Release Candidate 0.3.0-RC2

The fix has landed. Also, here is a quick script to try for validation https://github.com/ottobackwards/Metron-and-Nifi-Scripts/blob/master/bro-kafka/metron-bro-kafka-rc-check On October 1, 2019 at 07:41:02, Otto Fowler (ottobackwa...@gmail.com) wrote: https://github.com/apache/metron-bro

Re: [VOTE] Metron-bro-plugin-kafka Release Candidate 0.3.0-RC3

I have written a new script for validation of bro-kafka RC’s https://github.com/ottobackwards/Metron-and-Nifi-Scripts/blob/master/bro-kafka/metron-bro-kafka-rc-check Please give it a shot. If there are no issues with it, it will go into the plugin project after the rc is done ( can’t test the rc

Re: [VOTE] Metron-bro-plugin-kafka Release Candidate 0.3.0-RC3

+1 binding Ran RC script including the docker end to end testing On October 10, 2019 at 14:38:45, Otto Fowler (ottobackwa...@gmail.com) wrote: I have written a new script for validation of bro-kafka RC’s https://github.com/ottobackwards/Metron-and-Nifi-Scripts/blob/master/bro-kafka/metron

Re: [VOTE] Metron-bro-plugin-kafka Release Candidate 0.3.0-RC3

Zeolla zeo...@gmail.com On Thu, Oct 10, 2019 at 3:10 PM Otto Fowler wrote: > +1 binding Ran RC script including the docker end to end testing > > > > > On October 10, 2019 at 14:38:45, Otto Fowler (ottobackwa...@gmail.com) > wrote: > > I have written a new script for v

Re: [ANNOUNCE] Apache Metron-bro-plugin-kafka release 0.3.0

Just a reminder, if you used my script to verify the RC, please comment : https://github.com/apache/metron-bro-plugin-kafka/pull/38 On October 16, 2019 at 17:19:24, Justin Leet (l...@apache.org) wrote: Hi all, I’m pleased to announce the release of Metron 0.3.0! It's been a little while comin

[DISCUSS] GeoLite database licensing change, master build broken…..

https://issues.apache.org/jira/browse/METRON–2340 https://blog.maxmind.com/2019/12/18/significant-changes-to-accessing-and-using-geolite2-databases/ Maxmind has changed the way the distribute and license the geolite2 database that we use in our builds and distribution. Master build is broken, an

Re: [DISCUSS] GeoLite database licensing change, master build broken…..

it load files from the local file system into HDFS, how you get the files to the local file system is up to you? On 2020-01-13, 3:52 AM, "Otto Fowler" wrote: https://issues.apache.org/jira/browse/METRON–2340 https://blog.maxmind.com/2019/12/18/significant-changes-to-accessing

Re: [DISCUSS] GeoLite database licensing change, master build broken…..

ke On Mon, Jan 13, 2020 at 1:59 PM Otto Fowler wrote: > Hi Tom, that is true, and I think that is the only viable approach. We do > however use the database for testing during build, and we do however setup > the components that use the data base in the ’sample’ flow with the > simula

Re: [DISCUSS] GeoLite database licensing change, master build broken…..

information and rerun profiles and such. On Mon, Jan 13, 2020 at 5:20 PM Otto Fowler wrote: > I agree with all of that, my only thinking on contrib is, if that component > is not tested and has no coverage, and needs manual steps, then we may want > to separate it. > We would h

Re: [DISCUSS] GeoLite database licensing change, master build broken…..

profiles using the data?). If they do have to remove it, I assume that's not directly out problem (since they have to do cleanup), but we're probably not making it easy on them in terms of providing the ability to clean up that sort of information and rerun profiles and such. On Mo

Re: [DISCUSS] Next Release - Life After 0.7.1

yes On January 14, 2020 at 13:05:17, Michael Miklavcic ( michael.miklav...@gmail.com) wrote: We should probably also get this resolved for this release. https://issues.apache.org/jira/browse/METRON-2340. Thoughts? On Mon, Dec 16, 2019 at 2:19 PM Shane Ardell wrote: > Both PR #1527

Re: [DISCUSS] GeoLite database licensing change, master build broken…..

they need to clean > it up, but that may cause a lot of friction for our users. > > On Mon, Jan 13, 2020 at 5:52 PM Michael Miklavcic < > michael.miklav...@gmail.com> wrote: > > > +1 to Apache Legal advice > > > > On Mon, Jan 13, 2020 at 3:30 PM Otto Fow

Re: Failing to Setup Apache Metron Dev Machine using Vagrant (Require Assistance and Guidance)

I have tried this on master, and progressed all the way to the failure to setup enrichment because of the geomind change. I believe that this issue is only with the 3.1 feature branch. On March 3, 2020 at 09:49:39, Michael Miklavcic (michael.miklav...@gmail.com) wrote: It looks like the binar

Re: Development Activity has dropped to effectively 0, what should we do?

I think the difference is the maintenance of the core of metron that *has* to be, and other things that may still be done, but will be worked on for their merits or by community need and not be required for everything On April 21, 2020 at 10:29:24, Justin Leet (justinjl...@gmail.com) wrote: How

Re: Metron-2340 - Geo Database

I “believe” that those files apply to the database that they ship, looking at the perl It doesn’t seem to mention any claim or restrictions on the databases produced. I don’t think you are talking about distributing the perl module, but rather making it a build dependency, Is that right? On May

Re: [DISCUSS] Retire Metron to the Attic

I am in support of this as well, We have substantial work to do to get metron off of the HDP version it is on, which I think is the minimal work to keep it viable. We do not however have the people to finish the work that was started. Jon Zeolla and myself will be forking the metron-bro-kafka-p

Re: [VOTE] Move Apache Metron to the Apache Attic and Dissolve PMC

+1 From: Justin Leet Reply: dev@metron.apache.org Date: November 16, 2020 at 09:01:36 To: dev@metron.apache.org Subject: [VOTE] Move Apache Metron to the Apache Attic and Dissolve PMC Hi all, This is a vote thread to retire Metron to the Attic, and dissolve the PMC. This follows a disc

Re: Failing build

Maybe it is a container thing? I don’t think my PR for extensions has the problem, or has had it in my travis - and it is a vm in travis. On April 20, 2017 at 09:06:21, Casey Stella (ceste...@gmail.com) wrote: oh man, yeah, it's pissing me off too. I'm still looking at ways to get around Storm

Re: [DISCUSS] next release proposal

+1 on the proposed changes. I think that it is important that if it is in reach, we ‘complete’ any major theme of the release. In this case kerberos. I think that given where pycapa and rest are, we should make the effort to get them in. On April 20, 2017 at 08:52:11, Ryan Merriman (merrim...@

Re: [DISCUSS] next release proposal

ed problem. Casey On Thu, Apr 20, 2017 at 9:17 AM, Otto Fowler wrote: > +1 on the proposed changes. > > I think that it is important that if it is in reach, we ‘complete’ any > major theme of the release. > In this case kerberos. I think that given where pycapa and rest are, we >

Re: [GitHub] incubator-metron issue #538: METRON-868 Fix documentation on building RPMs

Maybe it is the relative parent path? On April 20, 2017 at 20:05:31, mmiklavc (g...@git.apache.org) wrote: Github user mmiklavc commented on the issue: https://github.com/apache/incubator-metron/pull/538 Further, the reason that install worked is not because it needs the artifacts in the cache

Re: Failure to Deploy "Quick Dev"

>From lira: I 'think' that quickdev is actually build from full_dev, with metron installed already. So it may be that we need a new image built to make this not an upgrade situation? On April 21, 2017 at 10:37:39, Nick Allen (n...@nickallen.org) wrote: Not sure if I am doing something stupid, b

Re: Reducing Warnings in Build

Until there is a use case supporting changing to other then the 80% plus case, this should not be changed. or a customer requirement etc. This would need some design and discussion time as well to map out all the implications for the complete pipeline. I think configurable charset should be separ

Re: Reducing Warnings in Build

-8" LC_ADDRESS="en_US.UTF-8" LC_TELEPHONE="en_US.UTF-8" LC_MEASUREMENT="en_US.UTF-8" LC_IDENTIFICATION="en_US.UTF-8" LC_ALL= Best, Mike On Fri, Apr 21, 2017 at 10:45 AM, Otto Fowler wrote: > Until there is a use case supporting changing to othe

Re: Ansible Docker fails to build latest

stack..is this compiling Metron inside of a docker image? On Tue, Apr 18, 2017 at 1:45 PM, Otto Fowler wrote: > Is it something to do with the relocation of google.common that happens in > the other shaded jars but not in the storm kafka client? > > > > On April 18, 2

Re: Ansible Docker fails to build latest

OK, the issue is the old old maven that is in the ansible image. Changing it to 3.3.9 resolved. On April 21, 2017 at 17:21:02, Otto Fowler (ottobackwa...@gmail.com) wrote: Yes. I am following the readme in there and starting the image, then just running mvn package -DskipTests On April 21

Silly question about zk_load_configs.sh

So, this script is in common, but: export JAR=metron-parsers-$METRON_VERSION-uber.jar Is the jar it executes. The class it references is :

Re: Silly question about zk_load_configs.sh

So, this script is in common, but: export JAR=metron-parsers-$METRON_VERSION-uber.jar Is the jar it executes. The class it references is : export CLASSNAME=“org.apache.metron.common.cli.ConfigurationManager" So, why is it calling the parsers jar?

Re: Silly question about zk_load_configs.sh

tten there quite yet. :) Casey On Mon, Apr 24, 2017 at 7:15 AM, Otto Fowler wrote: > So, this script is in common, but: > > export JAR=metron-parsers-$METRON_VERSION-uber.jar > > Is the jar it executes. The class it references is : > > > export CLASSNAME=“org.apache.me

Re: Silly question about zk_load_configs.sh

24, 2017 at 9:54 AM, Otto Fowler wrote: > too bad there isn’t a pr out for that kind of stuff ;) > > There are no stellar functions in parsers, except what is brought in from > common, why doesn’t this just call common? > You don’t need parsers jar for any of this do you? > >

Re: [GitHub] incubator-metron issue #538: METRON-868 Fix documentation on building RPMs

Sorry to be late to this, but since METRON-777 will have to add to this list, can we get a summary of what we think is going on? On April 24, 2017 at 10:23:57, mmiklavc (g...@git.apache.org) wrote: Github user mmiklavc commented on the issue: https://github.com/apache/incubator-metron/pull/538

metron_full_install playbook with small_cluster and multiple hosts

Now that I have docker sorted with building the rpms, I’m trying to deploy using a custom inventory and metron_full_install. So the question is, has anyone else tried to do this recently? I may be doing something wrong here with a couple of things. 1. what is the [local] host type in the inventor

Status of METRON-153

https://issues.apache.org/jira/browse/METRON-153 What is the other approach that is mentioned here? Was it implemented? The ansible build still does not support this and I was thinking of looking at it.

Re: Status of METRON-153

my Metron cluster, I must run on RHEL 7. I assume that will be common across many enterprises. Semi-recentlyI took a stab at CentOS 7 support but it was a bit of a rough go and I dropped it down on my priority list. Jon On Tue, Apr 25, 2017 at 11:28 AM Otto Fowler wrote: > ht

Re: Status of METRON-153

alternatively create some Ansible roles to make the REST calls that Ambari requires to stand up a cluster. -D... [1] https://cwiki.apache.org/confluence/display/AMBARI/Blueprints On Tue, Apr 25, 2017 at 11:35 AM, Otto Fowler wrote: > Let me clarify, that this is support for automated bluepr

Re: metron_full_install playbook with small_cluster and multiple hosts

ough multiple distributed deployments, I only saw one build being executed. I don't know what you mean by "set to become", Become is set to false because I didn't want to sudo to execute the build. -D... On Tue, Apr 25, 2017 at 10:51 AM, Otto Fowler wrote: > Now that I have

Re: Status of METRON-153

Also, I can’t find any list discussion of the issue or other approaches. On April 25, 2017 at 12:48:46, Otto Fowler (ottobackwa...@gmail.com) wrote: What I am looking for is the prior capability wrt centos 6.x work again ( which I think my pr fixing the docker in docker issue would do ), and

Ambari Wizard: Repo Tab

Hi, Should I see the repo tab in the ambari wizard for metron at this point? Asking for a friend who can’t get the wizard to work :)

Re: Status of METRON-153

et, and my PR probably would have done so. Can you elaborate on "prior capability wrt centos 6.x work again" a bit? On Apr 25, 2017 10:59 AM, "Otto Fowler" wrote: > Also, I can’t find any list discussion of the issue or other approaches. > > > On April 25,

Re: Ambari Wizard: Repo Tab

ote: I've been doing an internal hwx deployment (HCP) recently for testing purposes. I have some ES tweaks to work out, but other than that it has been running smoothly. Can you share any log info or screenshots? Mike On Apr 25, 2017 11:30 AM, "Otto Fowler" wrote: > Hi, > Shou

Re: Ambari Wizard: Repo Tab

d', '-R', '755', u'/usr/jdk64/jdk1.8.0_77')] {'sudo': True} 2017-04-25 14:13:00,682 <http://airmail.calendar/2017-04-25%2014:13:00%20EDT> - Initializing 2 repositories 2017-04-25 14:13:00,683 <http://airmail.calendar/2017-04-25%2014:13:00%2

Re: Ambari Wizard: Repo Tab

-deployment/packaging/ambari/metron-mpack/src/main/ > resources/addon-services/ELASTICSEARCH/2.3.3/repos/repoinfo.xml > > > On Tue, Apr 25, 2017 at 12:16 PM, Otto Fowler > wrote: > > > stderr: > > > > Traceback (most recent call last): > > > &g

Re: Ambari Wizard: Repo Tab

n Tue, Apr 25, 2017 at 3:44 PM, Otto Fowler wrote: > 2.4.1 as a matter of fact > > > On April 25, 2017 at 15:29:43, David Lyle (dlyle65...@gmail.com) wrote: > > Any chance they're running Ambari < 2.4.2? > > -D... > > > On Tue, Apr 25, 2017 at 3:23 PM, Mic

Re: Quick Dev - Atlas Images

If it is docker, then it is just the Dockerfiles. I think you can have vagrant use docker as a back end too right? On April 25, 2017 at 14:34:14, Nick Allen (n...@nickallen.org) wrote: >> I hadn't really reasoned about the notion of a "released" Quick Dev image, but I can see a lot of value in

Re: Ambari Wizard: Repo Tab

Ok, now I see the repos in the ‘pick version’ screen, but it is erring on the f://localrepo even though the folder exists, there is no repodata/repomd.xml. What is the command to create a local repo? On April 25, 2017 at 16:05:17, Otto Fowler (ottobackwa...@gmail.com) wrote: I was going by

Re: Ambari Wizard: Repo Tab

Nm. sorry. I fixed it. On April 25, 2017 at 16:42:05, Otto Fowler (ottobackwa...@gmail.com) wrote: Ok, now I see the repos in the ‘pick version’ screen, but it is erring on the f://localrepo even though the folder exists, there is no repodata/repomd.xml. What is the command to create a

Re: [DISCUSS] Regression introduced in Full Dev

Ryan, did you see why it was not working? On April 25, 2017 at 18:17:29, Ryan Merriman (merrim...@gmail.com) wrote: A regression was introduced recently that breaks full dev. I've narrowed down the commit that introduced it and have submitted a PR to revert that commit: https://github.com/apache

Re: auto-install on bare metal

I failed at this today, but maybe it was the way I tried. An example would be great. On April 25, 2017 at 20:11:26, David Lyle (dlyle65...@gmail.com) wrote: Hi Dima, The same Ansible playbooks that work for EC2 and Vagrant will work for bare metal installations. The only difference is that you

Re: [DISCUSS] Regression introduced in Full Dev

and full dev are unable to find the RPMs. On Tue, Apr 25, 2017 at 9:26 PM, Otto Fowler wrote: > Ryan, did you see why it was not working? > > > On April 25, 2017 at 18:17:29, Ryan Merriman (merrim...@gmail.com) wrote: > > A regression was introduced recently that breaks full dev.

Re: [DISCUSS] Regression introduced in Full Dev

Having said that, i see the problem. I am very sorry How do I go about resubmitting if I can fix it? On April 25, 2017 at 22:29:56, Otto Fowler (ottobackwa...@gmail.com) wrote: OK, I’ll take a look. Sorry - I thought they read out of the RPMS dir and verified that they were produced both

Re: [DISCUSS] Regression introduced in Full Dev

So, the copy resources configuration is still there, and not governed by the profile. Is it possible that since they both run in package, that they are out of order? On April 25, 2017 at 22:31:27, Otto Fowler (ottobackwa...@gmail.com) wrote: Having said that, i see the problem. I am very sorry

Re: [DISCUSS] Regression introduced in Full Dev

I think the copy resources should run in the post-package phase, to explicitly set the order. Does that make sense to anyone else? On April 25, 2017 at 22:33:58, Otto Fowler (ottobackwa...@gmail.com) wrote: So, the copy resources configuration is still there, and not governed by the profile. Is

Re: [DISCUSS] Regression introduced in Full Dev

http://stackoverflow.com/questions/22150209/maven-changes-the-order-of-plugins-of-different-profiles https://issues.apache.org/jira/browse/MNG-2258 On April 25, 2017 at 22:33:58, Otto Fowler (ottobackwa...@gmail.com) wrote: So, the copy resources configuration is still there, and not governed

Re: [DISCUSS] Regression introduced in Full Dev

I *think* I have a fix, I have to try to test again tomorrow, my vagrant up worked though. I had to put the rpm copy executions inside the profiles ( so they get merged in order ). On April 25, 2017 at 22:44:13, Otto Fowler (ottobackwa...@gmail.com) wrote: http://stackoverflow.com/questions

Re: [DISCUSS] Regression introduced in Full Dev

What other thread? On April 25, 2017 at 19:56:56, Casey Stella (ceste...@gmail.com) wrote: Ok, I spun up that discussion in another thread. Hopefully we can get some better sense about the various ways to spin up metron and a centralized place to direct people to along with with guidance on when

Re: [DISCUSS] Regression introduced in Full Dev

> Jon > > On Wed, Apr 26, 2017, 6:53 AM Otto Fowler wrote: > > > What other thread? > > > > > > On April 25, 2017 at 19:56:56, Casey Stella (ceste...@gmail.com) wrote: > > > > Ok, I spun up that discussion in another thread. Hopefully we can get &

Re: [DISCUSS] Regression introduced in Full Dev

eah, I don't see the other thread either. Stuck in the outbox Casey? > > > > > > Jon > > > > > > On Wed, Apr 26, 2017, 6:53 AM Otto Fowler > > wrote: > > > > > > > What other thread? > > > > > > > > >

Re: [DISCUSS] Regression introduced in Full Dev

https://github.com/apache/incubator-metron/pull/552 On April 26, 2017 at 08:13:26, Otto Fowler (ottobackwa...@gmail.com) wrote: It did, I didn’t see it until later in the night though, all my jira spam goes into one folder and honestly, nifi issues is flooding it. I’ll have to split that out

Re: Ambari Wizard: Repo Tab

Can you describe what ES issues you are working on? Fixing the repos got everything installed, but my ES components don’t stay running. I need to harvest the errors. On April 25, 2017 at 16:46:00, Otto Fowler (ottobackwa...@gmail.com) wrote: Nm. sorry. I fixed it. On April 25, 2017 at 16

Re: Ambari Wizard: Repo Tab

m a recent build: http://imgur.com/yjkltES Regards, Anand On 4/26/17, 5:57 PM, "Otto Fowler" wrote: >Can you describe what ES issues you are working on? >Fixing the repos got everything installed, but my ES components don’t stay >running. >I need to harvest the errors. >

Re: Ambari Wizard: Repo Tab

22:14:58 <http://airmail.calendar/2017-04-25%2022:14:58%20EDT> ccs-fx-met-poc-86.dev.industrialdefender.com systemd[1]: elasticsearch.service failed. INFO 2017-04-26 08:55:19,962 <http://airmail.calendar/2017-04-26%2008:55:19%20EDT> Contr On April 26, 2017 at 08:27:27, Otto Fowler (ottobackwa...@gmail.com)

Re: Normalization topology or separate normalization bolt for parsing topology

Hi, Are you doing this cleansing all in the parser or are you using any Stellar to do it? Can you create a jira? On April 26, 2017 at 08:59:16, Ali Nazemian (alinazem...@gmail.com) wrote: Hi all, We are facing certain use cases in Metron production that happen to be related to noisy stream.

Re: Normalization topology or separate normalization bolt for parsing topology

is an inevitable part of real world use cases. Cheers, Ali On Wed, Apr 26, 2017 at 11:04 PM, Otto Fowler wrote: > Hi, > > Are you doing this cleansing all in the parser or are you using any > Stellar to do it? > Can you create a jira? > > > > On April 26, 2017 at 08:59

Re: Normalization topology or separate normalization bolt for parsing topology

I’ve added this to the jira On April 26, 2017 at 09:28:54, Otto Fowler (ottobackwa...@gmail.com) wrote: What if you could implement your cleaning in Stellar functions, which would be in libraries that were loaded as plugins and available to all your parsers? my_field = ALI_CLEANMYFIELD

Re: auto-install on bare metal

do that. I created this quite a while ago, but it shows you the structure and how you could manage multiple environments with this method. https://github.com/nickwallen/metron-environments On Tue, Apr 25, 2017 at 9:46 PM, Otto Fowler wrote: > I failed at this today, but maybe it was the wa

Re: Ambari Wizard: Repo Tab

ed, Apr 26, 2017 at 7:02 AM, Otto Fowler wrote: > File > "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line > 293, in _call > > raise ExecutionFailed(err_msg, code, out, err) > > ExecutionFailed: Execution of 'service elasticsearch

Re: auto-install on bare metal

ng for. > Sorry. > > > > On Wed, Apr 26, 2017 at 9:59 AM, Otto Fowler > > wrote: > > > >> Right, I think this : https://cwiki.apache.org/ > confluence/pages/viewpage. > >> action?pageId=65144361 is the flow, > >> but I need to verify it post

Re: auto-install on bare metal

ote: Ok, then I must have totally misunderstood what you're looking for. Sorry. On Wed, Apr 26, 2017 at 9:59 AM, Otto Fowler <mailto:ottobackwa...@gmail.com> wrote: Right, I think this : https://cwiki.apache.org/ confluence/pages/viewpage. action?pageId=65144361 is the flow, bu

Re: Reliable place to get latest release info for script

Can I ask Dima, as comfortable you are in describing, what areas do you make changes or additions to that require you to maintain a fork? Custom parsers? Enrichments? Other? I have done some work, and have more planned and lined up to try to eliminate the requirement to develop in the metron tre

Re: Reliable place to get latest release info for script

them to the decent level currently). We also merged our custom tools that extends Metron batching processing and store data in HDFS and Hive to be used by tableau, zeppelin, etc. Is that answers your question? Let me know if you want to know more. - Dima On 04/26/2017 08:29 PM, Otto Fowler wrote

Re: Quick Dev - Atlas Images

ployment process? - How does the "time to start" compare for a "canned" release image as Dave suggested? On Tue, Apr 25, 2017 at 4:09 PM, Otto Fowler wrote: > If it is docker, then it is just the Dockerfiles. > I think you can have vagrant use docker as a

Re: Reliable place to get latest release info for script

passes data through parsers/enrichments classes and stores in Hive. So what you suggesting is to have internal repo with all our changes alone and to merge it with Apache Metron whenever we need to get full build? - Dima On 04/26/2017 09:09 PM, Otto Fowler wrote: Thanks! Parsers, and

Re: Ambari Wizard: Repo Tab

...@gmail.com (zeo...@gmail.com) wrote: I'm also interested to know why that's important at such a small scale. Jon On Wed, Apr 26, 2017, 10:51 AM Otto Fowler wrote: > I am following > > https://community.hortonworks.com/articles/60805/deploying-a-fresh-metron-cluster-using-amba

Re: Ambari Wizard: Repo Tab

Getting the same error in ES as before from what I can see On April 26, 2017 at 13:47:09, Otto Fowler (ottobackwa...@gmail.com) wrote: I still can’t keep ES running, it dies. Also, I’m getting exceptions from enrichment trying to restart when the topology wasn’t running. Is there some

Re: Ambari Wizard: Repo Tab

So the elasticsearch service is disabled. That is the issue. When ES calls get status ( service elasticsearch status ) it fails. I don’t know systemd too well, but does that mean we didn’t do the equiv of chkconfig on? On April 26, 2017 at 13:54:10, Otto Fowler (ottobackwa...@gmail.com) wrote

Re: Ambari Wizard: Repo Tab

Actually never mind. I am not sure how to read the exception. Is it failing to read the configuration? On April 26, 2017 at 14:01:26, Otto Fowler (ottobackwa...@gmail.com) wrote: So the elasticsearch service is disabled. That is the issue. When ES calls get status ( service elasticsearch

Re: Ambari Wizard: Repo Tab

this: - gateway_recover_after_data_nodes=1 or 2 - index_number_of_replicas=0 or 1 (2 data nodes, with 2 total copies of the index - if you set this value to 2, it would need 1 more data node to attain 1 orig index + 2 replicas) On Wed, Apr 26, 2017 at 12:02 PM, Otto Fowler

Re: Ambari Wizard: Repo Tab

file. network.host: ["_lo:ipv4_","_eth0:ipv4_"] On Wed, Apr 26, 2017 at 3:09 PM, Otto Fowler wrote: > I think it is literally crashing trying to load the config file > > > > On April 26, 2017 at 15:00:25, Michael Miklavcic ( > michael.miklav...@gmail.co

Re: Ambari Wizard: Repo Tab

So now I’m getting errors for ETH0 I think that is one of the things that has to change on centos7? Can you check what you have? On April 26, 2017 at 15:20:18, Nick Allen (n...@nickallen.org) wrote: Yes, I am also running on CentOS 7. On Wed, Apr 26, 2017 at 3:19 PM, Otto Fowler wrote

<    1   2   3   4   5   6   7   >