[jira] [Assigned] (METRON-2247) rpm-docker: Provide an option to bypass running rpmlint

2019-09-04 Thread Dale Richardson (Jira)
[ https://issues.apache.org/jira/browse/METRON-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dale Richardson reassigned METRON-2247: --- Assignee: Dale Richardson > rpm-docker: Provide an option to bypass running

[jira] [Created] (METRON-2247) rpm-docker: Provide an option to bypass running rpmlint

2019-09-04 Thread Dale Richardson (Jira)
Dale Richardson created METRON-2247: --- Summary: rpm-docker: Provide an option to bypass running rpmlint Key: METRON-2247 URL: https://issues.apache.org/jira/browse/METRON-2247 Project: Metron

[jira] [Assigned] (METRON-2246) rpm-docker: minimise use of bind mounts due to performance

2019-09-04 Thread Dale Richardson (Jira)
[ https://issues.apache.org/jira/browse/METRON-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dale Richardson reassigned METRON-2246: --- Assignee: Dale Richardson > rpm-docker: minimise use of bind mounts due to

[jira] [Commented] (METRON-1967) Create a base image for quick dev with HDP already installed and configured

2019-09-04 Thread Dale Richardson (Jira)
[ https://issues.apache.org/jira/browse/METRON-1967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922976#comment-16922976 ] Dale Richardson commented on METRON-1967: - [~otto] One thing to consider here which I do not

[GitHub] [metron] tigerquoll commented on issue #1501: Metron-2246 rpm-docker - minimise use of bind mounts due to performance

2019-09-04 Thread GitBox
tigerquoll commented on issue #1501: Metron-2246 rpm-docker - minimise use of bind mounts due to performance URL: https://github.com/apache/metron/pull/1501#issuecomment-528155042 @mmiklavc Documentation on the docker build caching process

[GitHub] [metron] JonZeolla commented on issue #1282: METRON-1881: Update the bro plugin used in metron development

2019-09-04 Thread GitBox
JonZeolla commented on issue #1282: METRON-1881: Update the bro plugin used in metron development URL: https://github.com/apache/metron/pull/1282#issuecomment-528152825 As a side note, 0.2 has an issue (segfaults bro/zeek on shutdown) which hasn't been resolved, and a large number of

[GitHub] [metron] JonZeolla commented on issue #1282: METRON-1881: Update the bro plugin used in metron development

2019-09-04 Thread GitBox
JonZeolla commented on issue #1282: METRON-1881: Update the bro plugin used in metron development URL: https://github.com/apache/metron/pull/1282#issuecomment-528152270 Yeah, so once [METRON-2069](https://issues.apache.org/jira/browse/METRON-2069) is completed we should be ready to cut

[jira] [Assigned] (METRON-2069) Add btests for bro plugin topic_name selection

2019-09-04 Thread Jon Zeolla (Jira)
[ https://issues.apache.org/jira/browse/METRON-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jon Zeolla reassigned METRON-2069: -- Assignee: (was: Jon Zeolla) > Add btests for bro plugin topic_name selection >

[GitHub] [metron] JonZeolla closed pull request #1287: METRON-1915: Disable vagrant hostmanager in the development guest

2019-09-04 Thread GitBox
JonZeolla closed pull request #1287: METRON-1915: Disable vagrant hostmanager in the development guest URL: https://github.com/apache/metron/pull/1287 This is an automated message from the Apache Git Service. To respond to

[GitHub] [metron] JonZeolla commented on issue #1287: METRON-1915: Disable vagrant hostmanager in the development guest

2019-09-04 Thread GitBox
JonZeolla commented on issue #1287: METRON-1915: Disable vagrant hostmanager in the development guest URL: https://github.com/apache/metron/pull/1287#issuecomment-528151015 Nothing more to add than I mentioned before. Happy to close to clean things up

[GitHub] [metron] tigerquoll edited a comment on issue #1501: Metron-2246 rpm-docker - minimise use of bind mounts due to performance

2019-09-04 Thread GitBox
tigerquoll edited a comment on issue #1501: Metron-2246 rpm-docker - minimise use of bind mounts due to performance URL: https://github.com/apache/metron/pull/1501#issuecomment-528135292 @ottobackwards First some clarification: The old docker build process mounted the entire project

[GitHub] [metron] tigerquoll edited a comment on issue #1501: Metron-2246 rpm-docker - minimise use of bind mounts due to performance

2019-09-04 Thread GitBox
tigerquoll edited a comment on issue #1501: Metron-2246 rpm-docker - minimise use of bind mounts due to performance URL: https://github.com/apache/metron/pull/1501#issuecomment-528137707 @mmiklavc Fair question. During the maven prepare phase for the packaging project, the jars from all

[GitHub] [metron] tigerquoll edited a comment on issue #1501: Metron-2246 rpm-docker - minimise use of bind mounts due to performance

2019-09-04 Thread GitBox
tigerquoll edited a comment on issue #1501: Metron-2246 rpm-docker - minimise use of bind mounts due to performance URL: https://github.com/apache/metron/pull/1501#issuecomment-528137707 @mmiklavc Fair question. During the maven prepare phase for the packaging project, the jars from all

[GitHub] [metron] tigerquoll commented on issue #1501: Metron-2246 rpm-docker - minimise use of bind mounts due to performance

2019-09-04 Thread GitBox
tigerquoll commented on issue #1501: Metron-2246 rpm-docker - minimise use of bind mounts due to performance URL: https://github.com/apache/metron/pull/1501#issuecomment-528137707 @mmiklavc Fair question. During the maven prepare phase for the packaging project, the jars from all of

[GitHub] [metron] tigerquoll edited a comment on issue #1501: Metron-2246 rpm-docker - minimise use of bind mounts due to performance

2019-09-04 Thread GitBox
tigerquoll edited a comment on issue #1501: Metron-2246 rpm-docker - minimise use of bind mounts due to performance URL: https://github.com/apache/metron/pull/1501#issuecomment-528137707 @mmiklavc Fair question. During the maven prepare phase for the packaging project, the jars from all

[GitHub] [metron] tigerquoll commented on issue #1501: Metron-2246 rpm-docker - minimise use of bind mounts due to performance

2019-09-04 Thread GitBox
tigerquoll commented on issue #1501: Metron-2246 rpm-docker - minimise use of bind mounts due to performance URL: https://github.com/apache/metron/pull/1501#issuecomment-528135292 @ottobackwards First some clarification: The old docker build process mounted the entire project

[GitHub] [metron] mmiklavc commented on issue #1501: Metron-2246 rpm-docker - minimise use of bind mounts due to performance

2019-09-04 Thread GitBox
mmiklavc commented on issue #1501: Metron-2246 rpm-docker - minimise use of bind mounts due to performance URL: https://github.com/apache/metron/pull/1501#issuecomment-528110304 > This PR restructures the rpm-docker project to use a three-stage docker build process. The first docker file

[jira] [Commented] (METRON-2239) Metron Automated backup and restore

2019-09-04 Thread Michael Miklavcic (Jira)
[ https://issues.apache.org/jira/browse/METRON-2239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922898#comment-16922898 ] Michael Miklavcic commented on METRON-2239: --- [~otto] - this is marked as "Blocker", but I'm

[jira] [Updated] (METRON-2232) Upgrade to Hadoop 3.1.1

2019-09-04 Thread Nick Allen (Jira)
[ https://issues.apache.org/jira/browse/METRON-2232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Allen updated METRON-2232: --- Summary: Upgrade to Hadoop 3.1.1 (was: Upgrade Hadoop) > Upgrade to Hadoop 3.1.1 >

[jira] [Updated] (METRON-2217) Migrate current HBase client from HTableInterface to Table

2019-09-04 Thread Michael Miklavcic (Jira)
[ https://issues.apache.org/jira/browse/METRON-2217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Miklavcic updated METRON-2217: -- Fix Version/s: Next + 1 > Migrate current HBase client from HTableInterface to Table

[GitHub] [metron] asfgit closed pull request #1483: METRON-2217 Migrate current HBase client from HTableInterface to Table

2019-09-04 Thread GitBox
asfgit closed pull request #1483: METRON-2217 Migrate current HBase client from HTableInterface to Table URL: https://github.com/apache/metron/pull/1483 This is an automated message from the Apache Git Service. To respond

[GitHub] [metron] nickwallen commented on issue #1497: METRON-2231 Revert METRON-2175, METRON-2176, METRON-2177 in HDP 3.1 upgrade feature branch

2019-09-04 Thread GitBox
nickwallen commented on issue #1497: METRON-2231 Revert METRON-2175, METRON-2176, METRON-2177 in HDP 3.1 upgrade feature branch URL: https://github.com/apache/metron/pull/1497#issuecomment-528067186 This has been merged into the feature branch as f77946d6eb421ad89ac0221048113111b34502a1

[GitHub] [metron] nickwallen closed pull request #1497: METRON-2231 Revert METRON-2175, METRON-2176, METRON-2177 in HDP 3.1 upgrade feature branch

2019-09-04 Thread GitBox
nickwallen closed pull request #1497: METRON-2231 Revert METRON-2175, METRON-2176, METRON-2177 in HDP 3.1 upgrade feature branch URL: https://github.com/apache/metron/pull/1497 This is an automated message from the Apache

[GitHub] [metron] mmiklavc commented on issue #1497: METRON-2231 Revert METRON-2175, METRON-2176, METRON-2177 in HDP 3.1 upgrade feature branch

2019-09-04 Thread GitBox
mmiklavc commented on issue #1497: METRON-2231 Revert METRON-2175, METRON-2176, METRON-2177 in HDP 3.1 upgrade feature branch URL: https://github.com/apache/metron/pull/1497#issuecomment-528065113 Ok, thanks @nickwallen! +1 by inspection.

[GitHub] [metron] nickwallen edited a comment on issue #1497: METRON-2231 Revert METRON-2175, METRON-2176, METRON-2177 in HDP 3.1 upgrade feature branch

2019-09-04 Thread GitBox
nickwallen edited a comment on issue #1497: METRON-2231 Revert METRON-2175, METRON-2176, METRON-2177 in HDP 3.1 upgrade feature branch URL: https://github.com/apache/metron/pull/1497#issuecomment-528061667 The revert of #1456 was not 100% clean since there have been changes introduced

[GitHub] [metron] nickwallen commented on issue #1497: METRON-2231 Revert METRON-2175, METRON-2176, METRON-2177 in HDP 3.1 upgrade feature branch

2019-09-04 Thread GitBox
nickwallen commented on issue #1497: METRON-2231 Revert METRON-2175, METRON-2176, METRON-2177 in HDP 3.1 upgrade feature branch URL: https://github.com/apache/metron/pull/1497#issuecomment-528061667 The revert of #1456 was not 100% clean since there have been changes introduced after

[GitHub] [metron] mmiklavc commented on issue #1497: METRON-2231 Revert METRON-2175, METRON-2176, METRON-2177 in HDP 3.1 upgrade feature branch

2019-09-04 Thread GitBox
mmiklavc commented on issue #1497: METRON-2231 Revert METRON-2175, METRON-2176, METRON-2177 in HDP 3.1 upgrade feature branch URL: https://github.com/apache/metron/pull/1497#issuecomment-528055572 @nickwallen I stepped through the list of commits per your PR description and it looks

[GitHub] [metron] nickwallen closed pull request #1499: METRON-2241 Profiler Integration Test Fails After Storm 1.2.1 Upgrade

2019-09-04 Thread GitBox
nickwallen closed pull request #1499: METRON-2241 Profiler Integration Test Fails After Storm 1.2.1 Upgrade URL: https://github.com/apache/metron/pull/1499 This is an automated message from the Apache Git Service. To

[GitHub] [metron] nickwallen commented on issue #1499: METRON-2241 Profiler Integration Test Fails After Storm 1.2.1 Upgrade

2019-09-04 Thread GitBox
nickwallen commented on issue #1499: METRON-2241 Profiler Integration Test Fails After Storm 1.2.1 Upgrade URL: https://github.com/apache/metron/pull/1499#issuecomment-528030116 This has been committed to the feature branch as 1004b694b2157acb9c8dda51fa49dd088d47fbbe.

[jira] [Updated] (METRON-2201) The description for the IS_IP method default behavior needs to corrected as per implementation

2019-09-04 Thread Michael Miklavcic (Jira)
[ https://issues.apache.org/jira/browse/METRON-2201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Miklavcic updated METRON-2201: -- Fix Version/s: Next + 1 > The description for the IS_IP method default behavior needs

[jira] [Assigned] (METRON-2201) The description for the IS_IP method default behavior needs to corrected as per implementation

2019-09-04 Thread Michael Miklavcic (Jira)
[ https://issues.apache.org/jira/browse/METRON-2201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Miklavcic reassigned METRON-2201: - Assignee: Michael Miklavcic (was: Mohan) > The description for the IS_IP

[jira] [Assigned] (METRON-2201) The description for the IS_IP method default behavior needs to corrected as per implementation

2019-09-04 Thread Michael Miklavcic (Jira)
[ https://issues.apache.org/jira/browse/METRON-2201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Miklavcic reassigned METRON-2201: - Assignee: Mohan (was: Michael Miklavcic) > The description for the IS_IP

[GitHub] [metron] asfgit closed pull request #1474: METRON-2201: The description for the IS_IP method default behavior needs to corrected as per implementation

2019-09-04 Thread GitBox
asfgit closed pull request #1474: METRON-2201: The description for the IS_IP method default behavior needs to corrected as per implementation URL: https://github.com/apache/metron/pull/1474 This is an automated message from

[GitHub] [metron] mmiklavc commented on issue #1287: METRON-1915: Disable vagrant hostmanager in the development guest

2019-09-04 Thread GitBox
mmiklavc commented on issue #1287: METRON-1915: Disable vagrant hostmanager in the development guest URL: https://github.com/apache/metron/pull/1287#issuecomment-528011984 Bump, any update? This is an automated message from

[GitHub] [metron] mmiklavc commented on issue #1282: METRON-1881: Update the bro plugin used in metron development

2019-09-04 Thread GitBox
mmiklavc commented on issue #1282: METRON-1881: Update the bro plugin used in metron development URL: https://github.com/apache/metron/pull/1282#issuecomment-528011553 @JonZeolla just checking in on this - still TBD for 0.3? Heh, that rhymes.

[GitHub] [metron] mmiklavc commented on issue #1496: METRON-2235 - Increase server startup timeout

2019-09-04 Thread GitBox
mmiklavc commented on issue #1496: METRON-2235 - Increase server startup timeout URL: https://github.com/apache/metron/pull/1496#issuecomment-528010840 @tigerquoll - can you indicate what you've completed on the checklist? Anything not done bc it's "n/a" just replace the box "[]" with

[jira] [Assigned] (METRON-2227) Kafka test harness has a hardcoded 5 second timeout

2019-09-04 Thread Michael Miklavcic (Jira)
[ https://issues.apache.org/jira/browse/METRON-2227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Miklavcic reassigned METRON-2227: - Assignee: Dale Richardson (was: Michael Miklavcic) > Kafka test harness has a

[GitHub] [metron] asfgit closed pull request #1493: METRON-2227 - Increase Kafka test harness timeout

2019-09-04 Thread GitBox
asfgit closed pull request #1493: METRON-2227 - Increase Kafka test harness timeout URL: https://github.com/apache/metron/pull/1493 This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Assigned] (METRON-2227) Kafka test harness has a hardcoded 5 second timeout

2019-09-04 Thread Michael Miklavcic (Jira)
[ https://issues.apache.org/jira/browse/METRON-2227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Miklavcic reassigned METRON-2227: - Assignee: Michael Miklavcic > Kafka test harness has a hardcoded 5 second

[jira] [Updated] (METRON-2227) Kafka test harness has a hardcoded 5 second timeout

2019-09-04 Thread Michael Miklavcic (Jira)
[ https://issues.apache.org/jira/browse/METRON-2227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Miklavcic updated METRON-2227: -- Fix Version/s: Next + 1 > Kafka test harness has a hardcoded 5 second timeout >

[GitHub] [metron] asfgit closed pull request #1489: METRON-2221: Notebook import fails through Zeppelin REST API

2019-09-04 Thread GitBox
asfgit closed pull request #1489: METRON-2221: Notebook import fails through Zeppelin REST API URL: https://github.com/apache/metron/pull/1489 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [metron] ottobackwards commented on issue #1501: Metron-2246 rpm-docker - minimise use of bind mounts due to performance

2019-09-04 Thread GitBox
ottobackwards commented on issue #1501: Metron-2246 rpm-docker - minimise use of bind mounts due to performance URL: https://github.com/apache/metron/pull/1501#issuecomment-527927570 Can you do a scan of the documentation and make sure that the RPM location is correctly referenced?

[GitHub] [metron] sardell commented on issue #1489: METRON-2221: Notebook import fails through Zeppelin REST API

2019-09-04 Thread GitBox
sardell commented on issue #1489: METRON-2221: Notebook import fails through Zeppelin REST API URL: https://github.com/apache/metron/pull/1489#issuecomment-527915254 +1. Manually validated with full dev. Works exactly as described. Good stuff, @anandsubbu!

[GitHub] [metron] ottobackwards commented on issue #1501: Metron-2246 rpm-docker - minimise use of bind mounts due to performance

2019-09-04 Thread GitBox
ottobackwards commented on issue #1501: Metron-2246 rpm-docker - minimise use of bind mounts due to performance URL: https://github.com/apache/metron/pull/1501#issuecomment-527903970 I was considering this type of thing as my next step in my pr. I'll review

[jira] [Commented] (METRON-2237) Metron RPM Build - Move npm installs outside of RPM construction

2019-09-04 Thread Dale Richardson (Jira)
[ https://issues.apache.org/jira/browse/METRON-2237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922347#comment-16922347 ] Dale Richardson commented on METRON-2237: - The new docker rpm infrastructure means that the npm

[jira] [Commented] (METRON-2234) Metron full dev deployment can persist bad state preventing builds

2019-09-04 Thread Dale Richardson (Jira)
[ https://issues.apache.org/jira/browse/METRON-2234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922346#comment-16922346 ] Dale Richardson commented on METRON-2234: - The proposed new rpm-docker infrastructure means that

[jira] [Commented] (METRON-2246) rpm-docker: minimise use of bind mounts due to performance

2019-09-04 Thread Dale Richardson (Jira)
[ https://issues.apache.org/jira/browse/METRON-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922340#comment-16922340 ] Dale Richardson commented on METRON-2246: -   Original code performance (On 2019 MacBook Pro):

[GitHub] [metron] tigerquoll opened a new pull request #1501: Metron-2246 rpm-docker - minimise use of bind mounts due to performance

2019-09-04 Thread GitBox
tigerquoll opened a new pull request #1501: Metron-2246 rpm-docker - minimise use of bind mounts due to performance URL: https://github.com/apache/metron/pull/1501 ## Contributor Comments Docker bind shared folders have a reputation as being fairly slow and inefficient on Docker for

[jira] [Created] (METRON-2246) rpm-docker: minimise use of bind mounts due to performance

2019-09-04 Thread Dale Richardson (Jira)
Dale Richardson created METRON-2246: --- Summary: rpm-docker: minimise use of bind mounts due to performance Key: METRON-2246 URL: https://issues.apache.org/jira/browse/METRON-2246 Project: Metron