[GitHub] metron issue #717: METRON-1134: Allow parser command line options to be spec...

Github user cestella commented on the issue: https://github.com/apache/metron/pull/717 So, correct me if I'm wrong, but it should be independent of the archetype and extensions. They define the operation of the parser, this would be entirely specifying the configs for the storm

Re: [DISCUSS] Metron release 0.4.1

Hi all, Thanks for your inputs. The three PRs Nick mentioned have been successfully closed. Casey, do you have an ETA for these two PRs? (PR#709 and 717) Thanks, --Matt On 8/29/17, 9:34 AM, "Casey Stella" wrote: For my PRs, I'd vote for METRON-1122 being in (commit

[GitHub] metron pull request #709: METRON-1122: Add support for the profiler in the m...

Github user asfgit closed the pull request at: https://github.com/apache/metron/pull/709 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] metron issue #717: METRON-1134: Allow parser command line options to be spec...

Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/717 I am +1 on this. Though I think it should be documented in the tuning guide as well at some point. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] metron issue #709: METRON-1122: Add support for the profiler in the manageme...

Github user merrimanr commented on the issue: https://github.com/apache/metron/pull/709 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] metron issue #717: METRON-1134: Allow parser command line options to be spec...

Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/717 We will need to integrate this in with 1136, maybe we should make it 'part' of it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] metron issue #717: METRON-1134: Allow parser command line options to be spec...

Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/717 I need to think of how this need to integrate with the archetype and extension installer --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] metron issue #717: METRON-1134: Allow parser command line options to be spec...

Github user cestella commented on the issue: https://github.com/apache/metron/pull/717 Ok, I think maybe a better explanation is in order then. Currently, when you start a topology, you can specify certain properties of the topology via the CLI. These are things like the spout

[GitHub] metron issue #709: METRON-1122: Add support for the profiler in the manageme...

Github user nickwallen commented on the issue: https://github.com/apache/metron/pull/709 Assuming your test in Full Dev goes smoothly, my +1 stands. It works great. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] metron issue #712: METRON-1129 Management UI - Package Node Dependencies in ...

Github user nickwallen commented on the issue: https://github.com/apache/metron/pull/712 If I don't set permissions, then those warnings still occur as some of the packages have files that violate this rpmlint check. If I set to 644, then I get the following warnings. ```

Re: [DISCUSS] Metron release 0.4.1

For my PRs, I'd vote for METRON-1122 being in (commit very imminent). I'd very much like METRON-1134 to be in as well. Beyond that, I'm ok On Tue, Aug 22, 2017 at 4:37 PM, Nick Allen wrote: > Thanks for starting the process, Matt. > > These are my own open PRs that I would

[GitHub] metron issue #717: METRON-1134: Allow parser command line options to be spec...

Github user cestella commented on the issue: https://github.com/apache/metron/pull/717 Yeah, we would need a UI JIRA to have people set this for the sensors. It provides some value by itself and it should not be a regression, but in order to change it in the UI, it'd need a hook.

[GitHub] metron issue #717: METRON-1134: Allow parser command line options to be spec...

Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/717 Maybe I'm miss understanding. Does this introduce per parser configuration? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] metron issue #712: METRON-1129 Management UI - Package Node Dependencies in ...

Github user merrimanr commented on the issue: https://github.com/apache/metron/pull/712 I tested this in full dev and everything works. The only issue I'm seeing is during the rpm build. There are several instances of this error being reported by rpmlint: "This text file

[GitHub] metron issue #712: METRON-1129 Management UI - Package Node Dependencies in ...

Github user nickwallen commented on the issue: https://github.com/apache/metron/pull/712 I took a look through the permissions that get set when running `npm install` manually. It appears that it is kind of a mixed bag. Each module kind of does its own thing. I could try to

[GitHub] metron pull request #717: METRON-1134: Allow parser command line options to ...

Github user ottobackwards commented on a diff in the pull request: https://github.com/apache/metron/pull/717#discussion_r135883683 --- Diff: metron-interface/metron-rest/src/test/java/org/apache/metron/rest/controller/SensorParserConfigControllerIntegrationTest.java --- @@

[GitHub] metron issue #717: METRON-1134: Allow parser command line options to be spec...

Github user cestella commented on the issue: https://github.com/apache/metron/pull/717 Also, to my knowledge, the other value it provides is being able to set these configs in such a way that ambari starting parsers actually is configurable (just not configurable directly from the

Re: [DISCUSS] Metron release 0.4.1

709 is in and 717 is under concerted review by Otto. I'd like to see it in by Friday. On Tue, Aug 29, 2017 at 1:35 PM, Matt Foley wrote: > Hi all, > Thanks for your inputs. The three PRs Nick mentioned have been > successfully closed. > Casey, do you have an ETA for these

[GitHub] metron issue #717: METRON-1134: Allow parser command line options to be spec...

Github user merrimanr commented on the issue: https://github.com/apache/metron/pull/717 I tested this in full dev and everything worked as advertised. The only major issue I see is that the num workers property is missing from SensorParserConfig. I feel like this is one of the most

[GitHub] metron issue #709: METRON-1122: Add support for the profiler in the manageme...

Github user cestella commented on the issue: https://github.com/apache/metron/pull/709 @merrimanr @nickwallen Ok, I changed the default acker executors to `1`. I'll spin up again in full-dev, let me know if there's anything else I missed. --- If your project is set up for it, you

[GitHub] metron pull request #694: METRON-1085: Add REST endpoint to save a user prof...

Github user mmiklavc commented on a diff in the pull request: https://github.com/apache/metron/pull/694#discussion_r135919427 --- Diff: metron-interface/metron-rest/src/test/java/org/apache/metron/rest/controller/AlertsProfileControllerIntegrationTest.java --- @@ -0,0 +1,226 @@

Re: [DISCUSS] Metron release 0.4.1

Okay, just to be clear, you’re requesting we wait until Friday, if necessary, to cut an RC with 717 in it? Thanks, --Matt On 8/29/17, 11:45 AM, "Casey Stella" wrote: 709 is in and 717 is under concerted review by Otto. I'd like to see it in by Friday. On

[GitHub] metron pull request #722: METRON-1139 Fixed service advisor profilerHost var...

GitHub user simonellistonball opened a pull request: https://github.com/apache/metron/pull/722 METRON-1139 Fixed service advisor profilerHost variable ## Contributor Comments This is a simple variable mis-naming error which doesn't cause any immediate problems, but prevents the

[GitHub] metron pull request #719: METRON-1137: Build RPM for Metron MaaS as a part o...

GitHub user anandsubbu opened a pull request: https://github.com/apache/metron/pull/719 METRON-1137: Build RPM for Metron MaaS as a part of rpm-docker packaging ## Contributor Comments Fixed metron.spec and the pom.xml to now copy and generate metron-maas-service RPM.

[GitHub] metron pull request #711: METRON-1127: Add ability to escalate alerts for ex...

Github user merrimanr commented on a diff in the pull request: https://github.com/apache/metron/pull/711#discussion_r135791883 --- Diff: metron-interface/metron-rest/src/main/java/org/apache/metron/rest/service/impl/AlertServiceImpl.java --- @@ -0,0 +1,57 @@ +/** + *

[GitHub] metron issue #685: METRON-1087: Adjust license headers to be comments instea...

Github user justinleet commented on the issue: https://github.com/apache/metron/pull/685 Closing per a dev thread discussion --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

Re: Feature Branch: Extension System for Metron and Metron Parsers

And finally : https://github.com/apache/metron/pull/720 On August 28, 2017 at 10:24:43, Otto Fowler (ottobackwa...@gmail.com) wrote: https://github.com/apache/metron/tree/feature/METRON-1136-extensions-parsers On August 27, 2017 at 12:39:15, Otto Fowler (ottobackwa...@gmail.com) wrote: To

[GitHub] metron pull request #685: METRON-1087: Adjust license headers to be comments...

Github user justinleet closed the pull request at: https://github.com/apache/metron/pull/685 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] metron pull request #718: METRON-1135: Make Stellar field transformations ha...

Github user asfgit closed the pull request at: https://github.com/apache/metron/pull/718 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] metron pull request #711: METRON-1127: Add ability to escalate alerts for ex...

Github user ottobackwards commented on a diff in the pull request: https://github.com/apache/metron/pull/711#discussion_r135794224 --- Diff: metron-interface/metron-rest/src/main/java/org/apache/metron/rest/service/impl/AlertServiceImpl.java --- @@ -0,0 +1,57 @@ +/** + *

[GitHub] metron issue #709: METRON-1122: Add support for the profiler in the manageme...

Github user cestella commented on the issue: https://github.com/apache/metron/pull/709 Alright, I think I've fixed the enrichment dependency issue. We should probably spin up in full-dev again to verify. --- If your project is set up for it, you can reply to this email and have

Re: AWS cloudformation script for Metron deployment

In case folks are considering alternatives to ambari, one option would be to use spinnaker.io thx debo On Tue, May 23, 2017 at 1:46 PM, Satish Abburi wrote: > > I agree – good to have cloud neutral. I still think, we might end up with > some custom wrapper for specific

[GitHub] metron pull request #714: METRON-1128: MAAS_GET_ENDPOINT - Unable to resolve...

Github user anandsubbu commented on a diff in the pull request: https://github.com/apache/metron/pull/714#discussion_r135785927 --- Diff: metron-analytics/metron-maas-service/README.md --- @@ -126,16 +126,20 @@ Now let's install some prerequisites: Start Squid via `service

[GitHub] metron pull request #714: METRON-1128: MAAS_GET_ENDPOINT - Unable to resolve...

Github user anandsubbu commented on a diff in the pull request: https://github.com/apache/metron/pull/714#discussion_r135786862 --- Diff: metron-analytics/metron-maas-service/README.md --- @@ -126,16 +126,20 @@ Now let's install some prerequisites: Start Squid via `service

[GitHub] metron pull request #720: METRON-1136 Initial Merge of Metron Extensions and...

GitHub user ottobackwards opened a pull request: https://github.com/apache/metron/pull/720 METRON-1136 Initial Merge of Metron Extensions and Parser Extensions This pull request will land the Metron Extensions and Parser Extensions functionality in the new feature branch.

[GitHub] metron pull request #714: METRON-1128: MAAS_GET_ENDPOINT - Unable to resolve...

Github user asfgit closed the pull request at: https://github.com/apache/metron/pull/714 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] metron pull request #709: METRON-1122: Add support for the profiler in the m...

Github user cestella commented on a diff in the pull request: https://github.com/apache/metron/pull/709#discussion_r135794935 --- Diff: metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/CURRENT/metainfo.xml --- @@ -119,6 +119,45 @@

[GitHub] metron pull request #711: METRON-1127: Add ability to escalate alerts for ex...

Github user merrimanr commented on a diff in the pull request: https://github.com/apache/metron/pull/711#discussion_r135828943 --- Diff: metron-interface/metron-rest/src/main/java/org/apache/metron/rest/service/impl/AlertServiceImpl.java --- @@ -0,0 +1,57 @@ +/** + *

[GitHub] metron pull request #711: METRON-1127: Add ability to escalate alerts for ex...

Github user merrimanr commented on a diff in the pull request: https://github.com/apache/metron/pull/711#discussion_r135806560 --- Diff: metron-interface/metron-rest/src/main/java/org/apache/metron/rest/service/impl/AlertServiceImpl.java --- @@ -0,0 +1,57 @@ +/** + *

[GitHub] metron pull request #711: METRON-1127: Add ability to escalate alerts for ex...

Github user ottobackwards commented on a diff in the pull request: https://github.com/apache/metron/pull/711#discussion_r135811520 --- Diff: metron-interface/metron-rest/src/main/java/org/apache/metron/rest/service/impl/AlertServiceImpl.java --- @@ -0,0 +1,57 @@ +/** + *

[GitHub] metron pull request #711: METRON-1127: Add ability to escalate alerts for ex...

Github user simonellistonball commented on a diff in the pull request: https://github.com/apache/metron/pull/711#discussion_r135813488 --- Diff: metron-interface/metron-rest/src/main/java/org/apache/metron/rest/service/impl/AlertServiceImpl.java --- @@ -0,0 +1,57 @@ +/**

[GitHub] metron issue #711: METRON-1127: Add ability to escalate alerts for external ...

Github user simonellistonball commented on the issue: https://github.com/apache/metron/pull/711 I'd say the docs belong with the UI docs, since this is pretty much an endpoint to drive the UI buttons, no? --- If your project is set up for it, you can reply to this email and have

[GitHub] metron issue #711: METRON-1127: Add ability to escalate alerts for external ...

Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/711 Platform wise, we want both. The metron configuration UI is the 'default' ui for the project, but the rest api is the main supported interface. As such they should be treated as separate

[GitHub] metron pull request #711: METRON-1127: Add ability to escalate alerts for ex...

Github user ottobackwards commented on a diff in the pull request: https://github.com/apache/metron/pull/711#discussion_r135816057 --- Diff: metron-interface/metron-rest/src/main/java/org/apache/metron/rest/service/impl/AlertServiceImpl.java --- @@ -0,0 +1,57 @@ +/** + *

[GitHub] metron pull request #721: METRON-1138 Improve Error Message with Bad Profile...

GitHub user nickwallen opened a pull request: https://github.com/apache/metron/pull/721 METRON-1138 Improve Error Message with Bad Profile Expression I have found that it can be very natural for a new Profiler user to attempt to reference a field defined in a telemetry message, in

[GitHub] metron issue #709: METRON-1122: Add support for the profiler in the manageme...

Github user merrimanr commented on the issue: https://github.com/apache/metron/pull/709 I ran this up in full dev and it worked. However when I was looking at the Profiler tab in Ambari I noticed "Number of Acker Executors" was set to 0. Shouldn't this be set to 1, similar to

[GitHub] metron issue #717: METRON-1134: Allow parser command line options to be spec...

Github user cestella commented on the issue: https://github.com/apache/metron/pull/717 Testing Instructions beyond the normal smoke test (i.e. letting data flow through to the indices and checking them). # Preliminaries Set an environment variable to indicate

[GitHub] metron issue #717: METRON-1134: Allow parser command line options to be spec...

Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/717 Or Rest? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] metron issue #709: METRON-1122: Add support for the profiler in the manageme...

Github user cestella commented on the issue: https://github.com/apache/metron/pull/709 @merrimanr yeah, maybe, this was the default before for the profiler, so it stuck. Do we want to adjust this to be consistent with enrichment or indexing? I'd vote yes. --- If your project is

[GitHub] metron pull request #711: METRON-1127: Add ability to escalate alerts for ex...

Github user nickwallen commented on a diff in the pull request: https://github.com/apache/metron/pull/711#discussion_r135898556 --- Diff: metron-interface/metron-rest/src/main/java/org/apache/metron/rest/service/impl/AlertServiceImpl.java --- @@ -0,0 +1,57 @@ +/** + *

[GitHub] metron issue #711: METRON-1127: Add ability to escalate alerts for external ...

Github user nickwallen commented on the issue: https://github.com/apache/metron/pull/711 I don't see the need for additional docs. Escalating an alert here means to push the alert data to a Kafka topic. That is all documented in the README, as far as I can see. Additional detailed

[GitHub] metron pull request #694: METRON-1085: Add REST endpoint to save a user prof...

Github user merrimanr commented on a diff in the pull request: https://github.com/apache/metron/pull/694#discussion_r135909951 --- Diff: metron-interface/metron-rest/src/test/java/org/apache/metron/rest/controller/AlertsProfileControllerIntegrationTest.java --- @@ -0,0 +1,226 @@