Re: Reliable place to get latest release info for script

2017-04-26 Thread Dima Kovalyov
Thank you Matt, That is great reply and exactly what I am looking for until 777 PR is in progress. - Dima On 04/27/2017 01:46 AM, Matt Foley wrote: > Hi Dima, > Regardless of the github release area, etc., the official release repository > for Apache Metron are via the Apache mirrors at >

[GitHub] incubator-metron pull request #547: METRON-858 bro-plugin-kafka is throwing ...

2017-04-26 Thread JonZeolla
Github user JonZeolla commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/547#discussion_r113576968 --- Diff: metron-sensors/bro-plugin-kafka/README.md --- @@ -94,6 +95,52 @@ event bro_init() } ``` +### Example 3 +

[GitHub] incubator-metron pull request #550: METRON-890: Intermittent unit test error...

2017-04-26 Thread cestella
Github user cestella closed the pull request at: https://github.com/apache/incubator-metron/pull/550 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-metron pull request #550: METRON-890: Intermittent unit test error...

2017-04-26 Thread cestella
GitHub user cestella reopened a pull request: https://github.com/apache/incubator-metron/pull/550 METRON-890: Intermittent unit test errors in shutting down Storm in memory component ## Contributor Comments Cross your fingers. This may or may not work. Please don't merge

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Otto Fowler
Thanks Nick. I don’t think we catch exceptions at all from the execute calls. I wonder what the best practice is? I can’t seem to find the ambari mpack programming documentation ;) On April 26, 2017 at 16:50:18, Nick Allen (n...@nickallen.org) wrote: I can create the JIRA. I capture the

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Nick Allen
I can create the JIRA. I capture the logs. On Wed, Apr 26, 2017 at 4:48 PM, Nick Allen wrote: > Yes, Otto. I just experienced that myself. It is a bug that we should > create a JIRA for. > > I was able to work around it by just using "start" instead of "restart". > > On

[GitHub] incubator-metron pull request #547: METRON-858 bro-plugin-kafka is throwing ...

2017-04-26 Thread nickwallen
Github user nickwallen commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/547#discussion_r113557275 --- Diff: metron-sensors/bro-plugin-kafka/README.md --- @@ -94,6 +95,60 @@ event bro_init() } ``` +### Example 3 +

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Otto Fowler
I can’t reproduce now, and the log rolled, so I’m not going to log it until I see it again. On April 26, 2017 at 15:47:48, Michael Miklavcic ( michael.miklav...@gmail.com) wrote: I thought we had addressed that at some point, so if it's blowing up still on restart when parsers are down, then I

[GitHub] incubator-metron pull request #550: METRON-890: Intermittent unit test error...

2017-04-26 Thread cestella
GitHub user cestella reopened a pull request: https://github.com/apache/incubator-metron/pull/550 METRON-890: Intermittent unit test errors in shutting down Storm in memory component ## Contributor Comments Cross your fingers. This may or may not work. Please don't merge

[GitHub] incubator-metron pull request #550: METRON-890: Intermittent unit test error...

2017-04-26 Thread cestella
Github user cestella closed the pull request at: https://github.com/apache/incubator-metron/pull/550 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Michael Miklavcic
I thought we had addressed that at some point, so if it's blowing up still on restart when parsers are down, then I would file a Jira. On Wed, Apr 26, 2017 at 1:41 PM, Otto Fowler wrote: > Ok, I did ifconfig, i mean ip a and got the right values > that and the brackets

[GitHub] incubator-metron pull request #550: METRON-890: Intermittent unit test error...

2017-04-26 Thread cestella
GitHub user cestella reopened a pull request: https://github.com/apache/incubator-metron/pull/550 METRON-890: Intermittent unit test errors in shutting down Storm in memory component ## Contributor Comments Cross your fingers. This may or may not work. Please don't merge

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Nick Allen
Yes, I am also running on CentOS 7. On Wed, Apr 26, 2017 at 3:19 PM, Otto Fowler wrote: > Would i have to change that on Centos 7? > > > On April 26, 2017 at 15:12:38, Nick Allen (n...@nickallen.org) wrote: > > Check on the `network_hosts` setting. I just ran into the

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Otto Fowler
Would i have to change that on Centos 7? On April 26, 2017 at 15:12:38, Nick Allen (n...@nickallen.org) wrote: Check on the `network_hosts` setting. I just ran into the same issue. I had to add brackets around it otherwise the file was not valid YAML and it would crash trying to load the config

[GitHub] incubator-metron pull request #547: METRON-858 bro-plugin-kafka is throwing ...

2017-04-26 Thread JonZeolla
Github user JonZeolla commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/547#discussion_r113538317 --- Diff: metron-sensors/bro-plugin-kafka/README.md --- @@ -94,6 +95,52 @@ event bro_init() } ``` +### Example 3 +

[GitHub] incubator-metron issue #459: METRON-726: Clean up mvn site generation

2017-04-26 Thread mattf-horton
Github user mattf-horton commented on the issue: https://github.com/apache/incubator-metron/pull/459 @justinleet , I agree with @dlyle65535 that if the intermittent error rate is demonstrably no worse (aprx) than master, that you should proceed with this commit on the reasonable

[GitHub] incubator-metron pull request #535: METRON-859: Use REST application with Ke...

2017-04-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-metron/pull/535 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Michael Miklavcic
A couple more things you should check, given this setup: - 1 master node (not as data node) - 2 data nodes I'd use something like this: - gateway_recover_after_data_nodes=1 or 2 - index_number_of_replicas=0 or 1 (2 data nodes, with 2 total copies of the index - if you set this

Re: Reliable place to get latest release info for script

2017-04-26 Thread Dima Kovalyov
Otto, had a look at 777 PR. Yes, it looks like something we would use. When do you think it will be released? And in meantime the question still stands, is there a way to get current release id/branch for the script? Thank you. - Dima On 04/26/2017 10:56 PM, Otto Fowler wrote: No, Take a look

[GitHub] incubator-metron issue #541: METRON-870: Add filtering by packet payload to ...

2017-04-26 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/incubator-metron/pull/541 Yeah, no `0x` for specifying the regex syntax. I'll update the function docs to point to the syntax guide. Also, I'm going to give a bit of a better effort at the testing too. Good

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Otto Fowler
Actually never mind. I am not sure how to read the exception. Is it failing to read the configuration? On April 26, 2017 at 14:01:26, Otto Fowler (ottobackwa...@gmail.com) wrote: So the elasticsearch service is disabled. That is the issue. When ES calls get status ( service elasticsearch

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Otto Fowler
So the elasticsearch service is disabled. That is the issue. When ES calls get status ( service elasticsearch status ) it fails. I don’t know systemd too well, but does that mean we didn’t do the equiv of chkconfig on? On April 26, 2017 at 13:54:10, Otto Fowler (ottobackwa...@gmail.com)

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Otto Fowler
Getting the same error in ES as before from what I can see On April 26, 2017 at 13:47:09, Otto Fowler (ottobackwa...@gmail.com) wrote: I still can’t keep ES running, it dies. Also, I’m getting exceptions from enrichment trying to restart when the topology wasn’t running. Is there some

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Otto Fowler
I still can’t keep ES running, it dies. Also, I’m getting exceptions from enrichment trying to restart when the topology wasn’t running. Is there some coordination in this work? Should I just log jiras? If someone is already sussing out ES, we can sync up On April 26, 2017 at 11:35:03,

Re: Quick Dev - Atlas Images

2017-04-26 Thread David Lyle
It's not an anti-Ansible sentiment, it's more of an anti-using-Ansible-as-a-general-purpose-installer sentiment. Ansible is fantastic in a constrained environment where the OS, Python versions, and Ansible versions are known a priori and won't change without the Ansible maintainer's knowledge.

Re: Reliable place to get latest release info for script

2017-04-26 Thread Otto Fowler
No, Take a look at METRON-777 PR. What I want is an extension mechanism, where you can: 1. create a project from a metron maven archetype 2. produce an extension ( parser, enrichment, stellar lib, ?? ) 3. install that extension through the management UI and configure All without touching the

Re: Quick Dev - Atlas Images

2017-04-26 Thread Otto Fowler
I know there is a lot of anti-ansible sentiment. But having gone spelunking through the MPack scripts and the metron.spec to more -777 let me just say I missed ansible’s flexibility, and documentation. On April 26, 2017 at 12:12:08, Nick Allen (n...@nickallen.org) wrote: > I think you can have

[GitHub] incubator-metron pull request #550: METRON-890: Intermittent unit test error...

2017-04-26 Thread cestella
Github user cestella closed the pull request at: https://github.com/apache/incubator-metron/pull/550 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-metron pull request #550: METRON-890: Intermittent unit test error...

2017-04-26 Thread cestella
GitHub user cestella reopened a pull request: https://github.com/apache/incubator-metron/pull/550 METRON-890: Intermittent unit test errors in shutting down Storm in memory component ## Contributor Comments Cross your fingers. This may or may not work. Please don't merge

Re: Reliable place to get latest release info for script

2017-04-26 Thread Dima Kovalyov
Regarding parsers and enrichment, new java based topologies for bluecoat, msexchange, msserver, asa, etc. Batching, we use NiFi + Kylo for both stream and batch, but batch data send to java based tool that passes data through parsers/enrichments classes and stores in Hive. So what you

Re: Quick Dev - Atlas Images

2017-04-26 Thread Nick Allen
> I think you can have vagrant use docker as a back end too right? I don't know about using Docker as a backend for Vagrant. I don't think Vagrant is our major sticking point. I think Ansible is the problem. We have a lot of deployment functionality still in Ansible. Much of that has been

[GitHub] incubator-metron pull request #550: METRON-890: Intermittent unit test error...

2017-04-26 Thread cestella
Github user cestella closed the pull request at: https://github.com/apache/incubator-metron/pull/550 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-metron pull request #550: METRON-890: Intermittent unit test error...

2017-04-26 Thread cestella
GitHub user cestella reopened a pull request: https://github.com/apache/incubator-metron/pull/550 METRON-890: Intermittent unit test errors in shutting down Storm in memory component ## Contributor Comments Cross your fingers. This may or may not work. Please don't merge

Re: Reliable place to get latest release info for script

2017-04-26 Thread Otto Fowler
Thanks! Parsers, and Enrichments, we have a plan or idea about. When you say extends batch processing… can you say what tech/component/part of stack you extended? New topologies? New WriterBolts? etc? I would like as complete a picture as possible of the things for which anyone would say: “If

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread zeo...@gmail.com
I'm also interested to know why that's important at such a small scale. Jon On Wed, Apr 26, 2017, 10:51 AM Otto Fowler wrote: > I am following > > https://community.hortonworks.com/articles/60805/deploying-a-fresh-metron-cluster-using-ambari-serv.html > I DO have

[GitHub] incubator-metron pull request #547: METRON-858 bro-plugin-kafka is throwing ...

2017-04-26 Thread nickwallen
Github user nickwallen commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/547#discussion_r113484992 --- Diff: metron-sensors/bro-plugin-kafka/README.md --- @@ -94,6 +95,52 @@ event bro_init() } ``` +### Example 3 +

[GitHub] incubator-metron pull request #547: METRON-858 bro-plugin-kafka is throwing ...

2017-04-26 Thread nickwallen
Github user nickwallen commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/547#discussion_r113483664 --- Diff: metron-sensors/bro-plugin-kafka/README.md --- @@ -94,6 +95,52 @@ event bro_init() } ``` +### Example 3 +

[GitHub] incubator-metron pull request #547: METRON-858 bro-plugin-kafka is throwing ...

2017-04-26 Thread nickwallen
Github user nickwallen commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/547#discussion_r113485511 --- Diff: metron-sensors/bro-plugin-kafka/configure.plugin --- @@ -31,7 +31,7 @@ plugin_option() { case "$1" in

[GitHub] incubator-metron pull request #547: METRON-858 bro-plugin-kafka is throwing ...

2017-04-26 Thread nickwallen
Github user nickwallen commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/547#discussion_r113484619 --- Diff: metron-sensors/bro-plugin-kafka/README.md --- @@ -43,6 +43,7 @@ The following examples highlight different ways that the plugin can

[GitHub] incubator-metron pull request #550: METRON-890: Intermittent unit test error...

2017-04-26 Thread cestella
GitHub user cestella reopened a pull request: https://github.com/apache/incubator-metron/pull/550 METRON-890: Intermittent unit test errors in shutting down Storm in memory component ## Contributor Comments Cross your fingers. This may or may not work. Please don't merge

[GitHub] incubator-metron pull request #550: METRON-890: Intermittent unit test error...

2017-04-26 Thread cestella
Github user cestella closed the pull request at: https://github.com/apache/incubator-metron/pull/550 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

Re: Reliable place to get latest release info for script

2017-04-26 Thread Dima Kovalyov
Otto, Yes, we developed custom parsers and enrichments (in future we seek to open source them, but have no time to up them to the decent level currently). We also merged our custom tools that extends Metron batching processing and store data in HDFS and Hive to be used by tableau, zeppelin,

Re: Reliable place to get latest release info for script

2017-04-26 Thread Otto Fowler
Can I ask Dima, as comfortable you are in describing, what areas do you make changes or additions to that require you to maintain a fork? Custom parsers? Enrichments? Other? I have done some work, and have more planned and lined up to try to eliminate the requirement to develop in the metron

Re: auto-install on bare metal

2017-04-26 Thread Otto Fowler
Well, let’s be sure what Dima’s looking for. That site is most def. what I’m looking for however. On April 26, 2017 at 10:29:36, Nick Allen (n...@nickallen.org) wrote: > But that still requires to pre-install Ambari first, right? No. Just like what happens when deploying "Full Dev", Ansible

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Otto Fowler
I am following https://community.hortonworks.com/articles/60805/deploying-a-fresh-metron-cluster-using-ambari-serv.html I DO have master and data node together. Why is that a problem? I will try again with master and data node separate. On April 26, 2017 at 10:41:59, Michael Miklavcic (

[GitHub] incubator-metron issue #552: METRON-857 FIX: Full_Dev regression: use the pr...

2017-04-26 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/incubator-metron/pull/552 lol beat me to it --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] incubator-metron pull request #541: METRON-870: Add filtering by packet payl...

2017-04-26 Thread justinleet
Github user justinleet commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/541#discussion_r113468302 --- Diff: metron-platform/metron-pcap/src/main/java/org/apache/metron/pcap/filter/fixed/FixedPcapFilter.java --- @@ -21,76 +21,131 @@

Re: auto-install on bare metal

2017-04-26 Thread Dima Kovalyov
Thank you Nick, Yes, I was referring to a link that Jon and Otto provided, their method requires Ambari to be setup seems like. We will test your solution, thanks. - Dima On 04/26/2017 07:59 PM, Nick Allen wrote: But

[GitHub] incubator-metron pull request #541: METRON-870: Add filtering by packet payl...

2017-04-26 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/541#discussion_r113467882 --- Diff: metron-platform/metron-pcap-backend/README.md --- @@ -127,3 +130,23 @@ usage: Query filter options -q,--query

[GitHub] incubator-metron pull request #541: METRON-870: Add filtering by packet payl...

2017-04-26 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/541#discussion_r113467857 --- Diff: metron-platform/metron-pcap/src/main/java/org/apache/metron/pcap/filter/fixed/FixedPcapFilter.java --- @@ -21,76 +21,131 @@

[GitHub] incubator-metron pull request #552: METRON-857 FIX: Full_Dev regression: use...

2017-04-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-metron/pull/552 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Michael Miklavcic
Hey Otto, How do you have the ES nodes configured? For a base install I would setup 1 master (NOT as data node) and 2 data nodes (NOT on the same node as the master). This is the install configuration I got working. You can also modify some configuration properties around master node as data

Re: auto-install on bare metal

2017-04-26 Thread Nick Allen
> But that still requires to pre-install Ambari first, right? No. Just like what happens when deploying "Full Dev", Ansible will install Ambari. On Wed, Apr 26, 2017 at 10:25 AM, Dima Kovalyov wrote: > But that still requires to pre-install Ambari first, right? > > -

Re: auto-install on bare metal

2017-04-26 Thread Dima Kovalyov
But that still requires to pre-install Ambari first, right? - Dima On 04/26/2017 07:54 PM, Nick Allen wrote: > Ok, then I must have totally misunderstood what you're looking for. Sorry. > > On Wed, Apr 26, 2017 at 9:59 AM, Otto Fowler > wrote: > >> Right, I think this

Re: auto-install on bare metal

2017-04-26 Thread Nick Allen
Ok, then I must have totally misunderstood what you're looking for. Sorry. On Wed, Apr 26, 2017 at 9:59 AM, Otto Fowler wrote: > Right, I think this : https://cwiki.apache.org/confluence/pages/viewpage. > action?pageId=65144361 is the flow, > but I need to verify it

Re: Normalization topology or separate normalization bolt for parsing topology

2017-04-26 Thread Casey Stella
Yeah, we definitely don't want to rewrite parsing in Stellar. I would expect the job of the parser, however, to handle structural issues. In my mind, parsing is about transforming structures into fields and the role of the field transformations are to transform values. There's obvious overlap

[GitHub] incubator-metron pull request #551: METRON-892 add docker to platform info

2017-04-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-metron/pull/551 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

Re: auto-install on bare metal

2017-04-26 Thread zeo...@gmail.com
I can verify that I've used https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=65144361 to install Metron on a bare metal cluster before the docker requirement was imposed. Jon On Wed, Apr 26, 2017 at 9:59 AM Otto Fowler wrote: > Right, I think this : >

Re: Normalization topology or separate normalization bolt for parsing topology

2017-04-26 Thread Casey Stella
Ok, this may be easier with a couple of examples: *Simple Example : Downstream Processing is Independent of Normalization* Pretend we have a data format that is CSV and the first field, let's call it 'input_dname' is supposed to be a domain name, but sometimes you get IP addresses. In the

Re: auto-install on bare metal

2017-04-26 Thread Otto Fowler
Right, I think this : https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=65144361 is the flow, but I need to verify it post recent changes to allow building in docker again. On April 26, 2017 at 09:54:26, Nick Allen (n...@nickallen.org) wrote: Here is an example of how you might

Re: auto-install on bare metal

2017-04-26 Thread Nick Allen
Here is an example of how you might do that. I created this quite a while ago, but it shows you the structure and how you could manage multiple environments with this method. https://github.com/nickwallen/metron-environments On Tue, Apr 25, 2017 at 9:46 PM, Otto Fowler

Re: Normalization topology or separate normalization bolt for parsing topology

2017-04-26 Thread Nick Allen
> For some reason, the incoming data do not look like in the way that has to be. In my mind that would be something for your parser to handle. On Wed, Apr 26, 2017 at 9:43 AM, Ali Nazemian wrote: > Having Stellar function for the normalization is very cool actually. > >

[GitHub] incubator-metron issue #552: METRON-857 FIX: Full_Dev regression: use the pr...

2017-04-26 Thread dlyle65535
Github user dlyle65535 commented on the issue: https://github.com/apache/incubator-metron/pull/552 Ditto. +1, thanks Otto! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

Re: Normalization topology or separate normalization bolt for parsing topology

2017-04-26 Thread Ali Nazemian
Having Stellar function for the normalization is very cool actually. Casey, how are you going to deal with normalization after the parsing if that noise affects the parsing? For some reason, the incoming data do not look like in the way that has to be. On Wed, Apr 26, 2017 at 11:37 PM, Casey

[GitHub] incubator-metron pull request #549: METRON-889: Regression introduced in Ful...

2017-04-26 Thread merrimanr
Github user merrimanr closed the pull request at: https://github.com/apache/incubator-metron/pull/549 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

Re: Normalization topology or separate normalization bolt for parsing topology

2017-04-26 Thread Casey Stella
Ok, that's another story. h, we don't generally pre-parse becuase we try to not assume any particular format there (i.e. it could be strings, could be byte arrays). Maybe the right answer is to pass the raw, non-normalized data (best effort tyep of thing) through the parser and do the

[GitHub] incubator-metron issue #552: METRON-857 FIX: Full_Dev regression: use the pr...

2017-04-26 Thread merrimanr
Github user merrimanr commented on the issue: https://github.com/apache/incubator-metron/pull/552 Ran up full dev with this change and it is working again. Thanks for addressing this so quickly @ottobackwards. +1 --- If your project is set up for it, you can reply to this email and

Re: Normalization topology or separate normalization bolt for parsing topology

2017-04-26 Thread Ali Nazemian
Hi Casey, It is actually pre-parse process, not a post-parse one. These type of noises affect the position of an attribute for example and give us parsing exception. The timestamp example was not a good one because that is actually a post-parse exception. On Wed, Apr 26, 2017 at 11:28 PM, Casey

Re: Normalization topology or separate normalization bolt for parsing topology

2017-04-26 Thread Casey Stella
So, having stellar operate on the whole message is definitely something that would be cool. That being said, it's also nice to motivate the construction of functions to do simple transformations/normalizations. That way, common useful capabilities may be reused all the places Stellar is used

Re: Normalization topology or separate normalization bolt for parsing topology

2017-04-26 Thread Casey Stella
So, further transformation post-parse was one of the motivating reasons for Stellar (to do that transformation post-parse). Is there a capability that it's lacking that we can add to fit your usecase? On Wed, Apr 26, 2017 at 9:24 AM, Ali Nazemian wrote: > I've created a

Re: Normalization topology or separate normalization bolt for parsing topology

2017-04-26 Thread Ali Nazemian
I've created a Jira ticket regarding this feature. https://issues.apache.org/jira/browse/METRON-893 On Wed, Apr 26, 2017 at 11:11 PM, Ali Nazemian wrote: > Currently, we are using normal regex at the Java source code to handle > those situations. However, it would be

[GitHub] incubator-metron pull request #550: METRON-890: Intermittent unit test error...

2017-04-26 Thread cestella
GitHub user cestella reopened a pull request: https://github.com/apache/incubator-metron/pull/550 METRON-890: Intermittent unit test errors in shutting down Storm in memory component ## Contributor Comments Cross your fingers. This may or may not work. Please don't merge

[GitHub] incubator-metron pull request #550: METRON-890: Intermittent unit test error...

2017-04-26 Thread cestella
Github user cestella closed the pull request at: https://github.com/apache/incubator-metron/pull/550 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-metron pull request #548: METRON-888: Update README to show requir...

2017-04-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-metron/pull/548 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

Re: Normalization topology or separate normalization bolt for parsing topology

2017-04-26 Thread Ali Nazemian
Currently, we are using normal regex at the Java source code to handle those situations. However, it would be nice to have a separate bolt and deal with them separately. Yeah, I can create a Jira issue regarding that. The main reason I am asking for such a feature is the fact that lack of such a

[GitHub] incubator-metron issue #459: METRON-726: Clean up mvn site generation

2017-04-26 Thread justinleet
Github user justinleet commented on the issue: https://github.com/apache/incubator-metron/pull/459 For the errors on master: [master_error.txt](https://github.com/apache/incubator-metron/files/958364/master_error.txt) 4 BUILD FAILURE 8 BUILD SUCCESS

[GitHub] incubator-metron issue #459: METRON-726: Clean up mvn site generation

2017-04-26 Thread justinleet
Github user justinleet commented on the issue: https://github.com/apache/incubator-metron/pull/459 @cestella I wish, I'd have been more than willing to ignore issues if it was. I'm scraping together a more concise version of the some of the logs and will post them. --- If your

[GitHub] incubator-metron issue #549: METRON-889: Regression introduced in Full Dev

2017-04-26 Thread justinleet
Github user justinleet commented on the issue: https://github.com/apache/incubator-metron/pull/549 A PR was opened up at https://github.com/apache/incubator-metron/pull/552. Given that both involve spinning up quick/full dev, I'm personally inclined to hold off on the revert, and

[GitHub] incubator-metron issue #552: METRON-857 FIX: Full_Dev regression: use the pr...

2017-04-26 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/incubator-metron/pull/552 Appreciate it, sorry for the trouble --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Otto Fowler
Can you describe what ES issues you are working on? Fixing the repos got everything installed, but my ES components don’t stay running. I need to harvest the errors. On April 25, 2017 at 16:46:00, Otto Fowler (ottobackwa...@gmail.com) wrote: Nm. sorry. I fixed it. On April 25, 2017 at

[GitHub] incubator-metron issue #459: METRON-726: Clean up mvn site generation

2017-04-26 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/incubator-metron/pull/459 I did submit a PR that is in flight and somewhat promising at cleaning up the intermittent storm shutdown errors. Are those what you are seeing? --- If your project is set up for it,

Re: [DISCUSS] Regression introduced in Full Dev

2017-04-26 Thread David Lyle
I just filter on 'to:(iss...@metron.incubator.apache.org)' and skip the inbox. There's an interesting (and useful to me anyway) side-effect in Gmail- issues I'm watching still end up in my inbox because JIRA also emails me directly. -D... On Wed, Apr 26, 2017 at 8:13 AM, Otto Fowler

Re: [DISCUSS] Regression introduced in Full Dev

2017-04-26 Thread zeo...@gmail.com
Interesting. I found it via pony mail - https://lists.apache.org/thread.html/82e194ad8f8b8378676a28c09b074f45dee82820ead6ff8ee8fbebcc@ But nothing in my inbox. I suspected it was @metron.incubator.apache.org vs @metron.apache.org but when I attempted to subscribe to the top level mailing list

[GitHub] incubator-metron issue #459: METRON-726: Clean up mvn site generation

2017-04-26 Thread dlyle65535
Github user dlyle65535 commented on the issue: https://github.com/apache/incubator-metron/pull/459 I think you're suffering from the same intermittent issues we have on master. Concur that you didn't add anything that obviously would create a problem and you may have helped. Maybe

Re: [DISCUSS] Regression introduced in Full Dev

2017-04-26 Thread Otto Fowler
So I have a fix, vagrant full installs for me, with the rpm’s in /localrepo. I do have issues post deploy cluster, but I think they are resource related. How should I go about this? What Jira would I post the PR against? The same as the original? On April 26, 2017 at 07:39:07, Justin Leet

Re: metron UI

2017-04-26 Thread Raghu Mitra Kandikonda
Yeah I do agree there is a technical debt. But it might be true for any framework :). If you wish to extend the existing ui happy to help in any way. -Raghu On 26/04/17, 12:45 PM, "Kevin Waterson" wrote: >I have no real issues with Angular2, aside from possible

Re: metron UI

2017-04-26 Thread Kevin Waterson
I have no real issues with Angular2, aside from possible technical debt with A3. I just do not feel it is the right tool for the job. A2 makes great single page applications, however, this is somewhat more modular. Kevin On Wed, Apr 26, 2017 at 4:38 PM, Raghu Mitra Kandikonda <