Looks like everything’s in now. Thanks very much everyone for the efforts! I’m spinning the RC and will have it out for vote shortly. --Matt
On 9/7/17, 11:41 PM, "Matt Foley" <[email protected]> wrote: METRON-1163 turns out to be invalid, due to a bad maven settings file. It is no longer an issue. Just waiting for the last couple items. On 9/7/17, 9:26 AM, "Matt Foley" <[email protected] on behalf of [email protected]> wrote: Okay. Please ping when committed. Also, any input on https://issues.apache.org/jira/browse/METRON-1163 ? On 9/7/17, 7:39 AM, "Ryan Merriman" <[email protected]> wrote: Matt, We recently found a bug that's breaking certain features in the management UI. The fixes are still in review ( https://github.com/apache/metron/pull/729 and https://github.com/apache/metron/pull/730) and should make it in soon. It would be good to include these if possible. Ryan On Thu, Sep 7, 2017 at 12:23 AM, Matt Foley <[email protected]> wrote: > I’ve got a blocker bug, https://issues.apache.org/jira/browse/METRON-1163 > , RAT failures for metron-interface/metron-alerts. A comment in the jira > suggests a way to address it, but someone familiar with the code should > look at it. > > > > Raghu, would you be able to take a look? > > > > Thanks, > > --Matt > > > > From: Matt Foley <[email protected]> on behalf of Matt Foley < > [email protected]> > Date: Tuesday, September 5, 2017 at 10:01 AM > To: "[email protected]" <[email protected]> > Subject: Re: [DISCUSS] Metron release 0.4.1 > > > > Great, working on it! > > > > From: Nick Allen <[email protected]> > Date: Tuesday, September 5, 2017 at 8:00 AM > To: Casey Stella <[email protected]>, "[email protected]" < > [email protected]> > Cc: Anand Subramanian <[email protected]>, Matt Foley < > [email protected]>, "[email protected]" <[email protected]> > Subject: Re: [DISCUSS] Metron release 0.4.1 > > > > All set here. Let's get this shipped! > > > > > > > > On Tue, Sep 5, 2017 at 10:44 AM Casey Stella <[email protected]> wrote: > > me too > > > > On Tue, Sep 5, 2017 at 10:43 AM, [email protected] <[email protected]> > wrote: > > All set from my perspective. > > > > Jon > > > > On Sat, Sep 2, 2017 at 4:38 AM Anand Subramanian < > [email protected]> wrote: > > Hello Matt, > > Simon's pull request supersedes mine (METRON-1139 / > https://github.com/apache/metron/pull/722) and is already merged into > master. > > Thanks, > Anand > > > > On 9/1/17, 12:41 AM, "Matt Foley" <[email protected]> wrote: > > >Please mark them 0.4.1, as that’s what the community says we want to call > the upcoming release, and everything that’s there when I throw the switch > will be included. > > > >Jon and Anand, will they be in by end/day Friday? > >Thanks, > >--Matt > > > >On 8/31/17, 7:45 AM, "Nick Allen" <[email protected]> wrote: > > > > Matt, et al - For JIRAs that are going into master, should we be > marking > > these as "Next + 1" or "0.4.1" ? > > > > On Thu, Aug 31, 2017 at 8:17 AM [email protected] <[email protected]> > wrote: > > > > > Can I advocate to get METRON-1129 in the RC, and throw in a second > vote for > > > METRON-1134? Both in an attempt to better support of prod/offline > use. > > > Happy to provide testing cycles for the former. > > > > > > Jon > > > > > > On Wed, Aug 30, 2017 at 11:41 AM Anand Subramanian < > > > [email protected]> wrote: > > > > > > > Hi Matt, > > > > > > > > This defect needs to be included as a follow-on to METRON-1122: > > > > * METRON-1141 (https://github.com/apache/metron/pull/723) > > > > > > > > > > > > Thanks, > > > > Anand > > > > > > > > > > > > > > > > On 8/30/17, 8:57 PM, "Michael Miklavcic" < > [email protected]> > > > > wrote: > > > > > > > > >I have some work around fixing how we handle config with Ambari > that I'd > > > > >like to see go in. No PR yet, but coming soon. I expect to have > this by > > > > the > > > > >RC deadline. > > > > > > > > > >Mike > > > > > > > > > >On Wed, Aug 30, 2017 at 8:57 AM, Nick Allen <[email protected]> > wrote: > > > > > > > > > >> The following PRs are usability enhancements for the > Profiler. They > > > are > > > > >> fairly simple and I think are very helpful for > troubleshooting. I > > > don't > > > > >> want to hold up the release, but it would be a "nice to have" > to get > > > > these > > > > >> in. > > > > >> > > > > >> If anyone has cycles, I would appreciate some reviews of these > PRs. > > > > >> https://github.com/apache/metron/pull/721 > > > > >> https://github.com/apache/metron/pull/716 > > > > >> > > > > >> > > > > >> > > > > >> On Tue, Aug 29, 2017 at 8:59 PM Matt Foley <[email protected]> > wrote: > > > > >> > > > > >> > Okay, just to be clear, you’re requesting we wait until > Friday, if > > > > >> > necessary, to cut an RC with 717 in it? > > > > >> > Thanks, > > > > >> > --Matt > > > > >> > > > > > >> > On 8/29/17, 11:45 AM, "Casey Stella" <[email protected]> > wrote: > > > > >> > > > > > >> > 709 is in and 717 is under concerted review by Otto. > I'd like > > > to > > > > see > > > > >> > it in > > > > >> > by Friday. > > > > >> > > > > > >> > On Tue, Aug 29, 2017 at 1:35 PM, Matt Foley < > [email protected]> > > > > >> wrote: > > > > >> > > > > > >> > > Hi all, > > > > >> > > Thanks for your inputs. The three PRs Nick mentioned > have > > > been > > > > >> > > successfully closed. > > > > >> > > Casey, do you have an ETA for these two PRs? (PR#709 > and 717) > > > > >> > > Thanks, > > > > >> > > --Matt > > > > >> > > > > > > >> > > On 8/29/17, 9:34 AM, "Casey Stella" < > [email protected]> > > > wrote: > > > > >> > > > > > > >> > > For my PRs, I'd vote for METRON-1122 being in > (commit very > > > > >> > imminent). > > > > >> > > I'd very much like METRON-1134 to be in as well. > > > > >> > > > > > > >> > > Beyond that, I'm ok > > > > >> > > > > > > >> > > On Tue, Aug 22, 2017 at 4:37 PM, Nick Allen < > > > > >> [email protected]> > > > > >> > > wrote: > > > > >> > > > > > > >> > > > Thanks for starting the process, Matt. > > > > >> > > > > > > > >> > > > These are my own open PRs that I would most like > to see > > > > get > > > > >> in. > > > > >> > > They all > > > > >> > > > relate to the Profiler. My other outstanding PRs > are > > > less > > > > >> > important. > > > > >> > > > > > > > >> > > > - https://github.com/apache/metron/pull/705 > > > > >> > > > - https://github.com/apache/metron/pull/707 > > > > >> > > > - https://github.com/apache/metron/pull/708 > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > On Tue, Aug 22, 2017 at 4:17 PM Matt Foley < > > > > [email protected] > > > > >> > > > > > >> > wrote: > > > > >> > > > > > > > >> > > > > Hello all, > > > > >> > > > > At the meeting this morning, the community > expressed > > > the > > > > >> > wish to > > > > >> > > create a > > > > >> > > > > new release, to be a point release and not > including > > > > >> > METRON-777. > > > > >> > > > > > > > > >> > > > > Therefore, I propose to create release 0.4.1 > from > > > Metron > > > > >> > master > > > > >> > > branch, > > > > >> > > > > with whatever additional commits the community > > > considers > > > > >> > vital and > > > > >> > > can > > > > >> > > > get > > > > >> > > > > in in the next few days. > > > > >> > > > > > > > > >> > > > > There have been 74 commits since the 0.4.0 > release > > > (list > > > > >> > appended > > > > >> > > to end > > > > >> > > > > of this message). > > > > >> > > > > I have not yet done a compare to make sure all > 74 > > > > completed > > > > >> > > commits have > > > > >> > > > > closed their Jiras, but I will follow up with > that > > > info. > > > > >> > > > > > > > > >> > > > > There are 35 open PRs, see > > > > >> > https://github.com/apache/metron/pulls > > > > >> > > , > > > > >> > > > which > > > > >> > > > > is getting a little clunky. Surely not all of > them > > > can > > > > get > > > > >> > in in > > > > >> > > the > > > > >> > > > next > > > > >> > > > > few days, but do we want to try to close and > include > > > > some > > > > >> of > > > > >> > them? > > > > >> > > > > > > > > >> > > > > Please respond to the list with your requests > to > > > include > > > > >> > specific > > > > >> > > > > additional PRs before we cut the 0.4.1 release > > > > candidate. > > > > >> > Let’s > > > > >> > > keep it > > > > >> > > > > practical so we don’t delay more than a week > or so. > > > > >> > > > > > > > > >> > > > > TIMEFRAME: Tentatively I would like to start > the > > > > process > > > > >> of > > > > >> > > cutting an > > > > >> > > > RC > > > > >> > > > > this coming Monday 28 August. If we have too > many PRs > > > > >> > required to > > > > >> > > be in, > > > > >> > > > > we may have to slip that. Likewise, if there > is need > > > > for > > > > >> > urgency, > > > > >> > > I can > > > > >> > > > > start as soon as tomorrow. We will be guided > by your > > > > >> > responses. > > > > >> > > > > > > > > >> > > > > Thanks, > > > > >> > > > > --Matt > > > > >> > > > > (Release Manager) > > > > >> > > > > > > > > >> > > > > COMPLETED PRs as of 22 Aug 2017: > > > > >> > > > > METRON-1115 Jackson is not properly > serializing > > > > >> > readMetadata > > > > >> > > and > > > > >> > > > > mergeMetadata SensorParserConfig properties > > > (merrimanr) > > > > >> > closes > > > > >> > > > > apache/metron#703 > > > > >> > > > > METRON-1047 REST should use core-site.xml > for > > > Hadoop > > > > >> > > configuration > > > > >> > > > > (merrimanr) closes apache/metron#672 > > > > >> > > > > METRON-1111 Mislabeled Configuration > Property in > > > > Ambari > > > > >> > > (nickwallen) > > > > >> > > > > closes apache/metron#698 > > > > >> > > > > METRON-1113 UpdateControllerIntegrationTest > fails > > > > with > > > > >> > 500 > > > > >> > > error > > > > >> > > > > (merrimanr) closes apache/metron#701 > > > > >> > > > > METRON-711 StellarShell assigns variables > even if > > > an > > > > >> > exception > > > > >> > > was > > > > >> > > > > thrown in the statement. (ottobackwards) closes > > > > >> > apache/metron#686 > > > > >> > > > > METRON-1110 REST jvm flags property is > being > > > > >> overwritten > > > > >> > when > > > > >> > > > Kerberos > > > > >> > > > > is enabled (merrimanr) closes apache/metron#697 > > > > >> > > > > METRON-739 Create Local Profile Runner > > > (nickwallen) > > > > >> > closes > > > > >> > > > > apache/metron#693 > > > > >> > > > > METRON-1109 Indexing topology fails to > start after > > > > >> > Kerberos is > > > > >> > > > enabled > > > > >> > > > > (merrimanr) closes apache/metron#696 > > > > >> > > > > METRON-1108 Metron configuration tabs are > not > > > > showing > > > > >> up > > > > >> > in > > > > >> > > Ambari > > > > >> > > > > this closes apache/incubator-metron#695 > > > > >> > > > > METRON-1078 Metron Indexing fails to stop > during > > > > >> > "Stop All > > > > >> > > > > Services" (dlyle65535) closes > apache/metron#680 > > > > >> > > > > METRON-1104 Build Failure - Due to > Bootstrap > > > version > > > > >> > change > > > > >> > > > > (iraghumitra via justinleet) closes > apache/metron#691 > > > > >> > > > > METRON-1094 MaaS will not start due to > classpath > > > > error > > > > >> > > relating to > > > > >> > > > > Yarn closes apache/incubator-metron#688 > > > > >> > > > > METRON-1102 Add support for ingesting > cybox URI > > > > >> > observables > > > > >> > > from > > > > >> > > > taxii > > > > >> > > > > feeds closes apache/incubator-metron#689 > > > > >> > > > > METRON-838 Incorrect set of ts in FireEye > parser > > > > >> (bjigmp > > > > >> > via > > > > >> > > > > justinleet) closes apache/metron#528 > > > > >> > > > > METRON-322 Global Batching and Flushing > > > > (mattf-horton) > > > > >> > closes > > > > >> > > > > apache/metron#481 > > > > >> > > > > METRON-988 UI for viewing alerts generated > by > > > Metron > > > > >> > > (iraghumitra > > > > >> > > > via > > > > >> > > > > nickwallen) closes apache/metron#620 > > > > >> > > > > METRON-1084 Management UI web server > license > > > should > > > > be > > > > >> > Apache > > > > >> > > > > (merrimanr) closes apache/metron#683 > > > > >> > > > > METRON-1026 threatintel_taxii_load.sh > throws > > > > exception > > > > >> > closes > > > > >> > > > > apache/incubator-metron#643 > > > > >> > > > > METRON-1051 Enable the ability to update > indexed > > > > >> messages > > > > >> > > closes > > > > >> > > > > apache/incubator-metron#666 > > > > >> > > > > METRON-1069 Ambari MPack documentation > around > > > > >> development > > > > >> > > strategies > > > > >> > > > > (justinleet) closes apache/metron#1069 > > > > >> > > > > METRON-1069 Ambari MPack documentation > around > > > > >> development > > > > >> > > strategies > > > > >> > > > > (merrimanr via justinleet) closes > apache/metron#1069 > > > > >> > > > > METRON-1069 Ambari MPack documentation > around > > > > >> development > > > > >> > > strategies > > > > >> > > > > (justinleet) closes apache/metron#1069 > > > > >> > > > > METRON-1076 Management UI status check > always > > > > reports > > > > >> the > > > > >> > > service as > > > > >> > > > > running (merrimanr) closes apache/metron#678 > > > > >> > > > > METRON-1075 Add faceted search capabilities > > > > (merrimanr) > > > > >> > closes > > > > >> > > > > apache/metron#679 > > > > >> > > > > METRON-379 Stellar - No Error When Adding > > > Variables > > > > >> That > > > > >> > Do > > > > >> > > Not Exist > > > > >> > > > > (ottobackwards) closes apache/metron#675 > > > > >> > > > > METRON-1038 Stellar should have a better > > > collection > > > > of > > > > >> > basic > > > > >> > > math > > > > >> > > > > operations closes apache/incubator-metron#650 > > > > >> > > > > METRON-1072 Cleanup Maven build warnings > > > (mmiklavc) > > > > >> > closes > > > > >> > > > > apache/metron#676 > > > > >> > > > > METRON-1056 Get field types from > Elasticsearch > > > > >> > (merrimanr) > > > > >> > > closes > > > > >> > > > > apache/metron#662 > > > > >> > > > > METRON-1011 Stellar ENRICHMENT functions > should > > > > enforce > > > > >> > > submission of > > > > >> > > > > 4 parameters (jasper-k via ottobackwards) > closes > > > > >> > apache/metron#628 > > > > >> > > > > METRON-975 Normalize logging and switch to > common > > > > idiom > > > > >> > with > > > > >> > > SLF4J > > > > >> > > > > (mmiklavc) closes apache/metron#599 > > > > >> > > > > METRON-681 CSVConverter should trim values > (basvdl > > > > via > > > > >> > > ottobackwards) > > > > >> > > > > closes apache/metron#674 > > > > >> > > > > METRON-746 Build Custom Checkstyle and IDE > > > > formatting > > > > >> > settings > > > > >> > > > > (justinleet via mmiklavc) closes > apache/metron#577 > > > > >> > > > > METRON-1060 Add performance timing logging > to > > > > >> enrichment > > > > >> > > topology > > > > >> > > > > (mmiklavc) closes apache/metron#665 > > > > >> > > > > METRON-982 REST STORM Support for > supervisor > > > summary > > > > >> > > (ottobackwards) > > > > >> > > > > closes apache/metron#607 > > > > >> > > > > METRON-1064 Make init script OS-agnostic > > > (merrimanr) > > > > >> > closes > > > > >> > > > > apache/metron#669 > > > > >> > > > > METRON-984 Create STELLAR Decoding > Functions > > > > >> > (ottobackwards) > > > > >> > > closes > > > > >> > > > > apache/metron#642 > > > > >> > > > > METRON-1067 Minor typo in documentation > > > > (spencer-hanson > > > > >> > via > > > > >> > > > > justinleet) closes apache/metron#671 > > > > >> > > > > METRON-1018 Integration tests should > reference > > > flux > > > > >> yaml > > > > >> > and > > > > >> > > property > > > > >> > > > > files deployed by Ambari (merrimanr) closes > > > > >> apache/metron#635 > > > > >> > > > > METRON-1050 Improve Docs of > > > > `profiler.period.duration` > > > > >> > > (nickwallen) > > > > >> > > > > closes apache/metron#656 > > > > >> > > > > METRON-1043 Profiler Should be Less > Dramatic When > > > > >> Missing > > > > >> > > > > Configuration (nickwallen) closes > apache/metron#655 > > > > >> > > > > METRON-1053 Relocate Metron Docker > (nickwallen) > > > > closes > > > > >> > > > > apache/metron#659 > > > > >> > > > > METRON-1058 address checkstyle warnings for > > > > >> > UnusedImports in > > > > >> > > > > metron-stellar (dbist via ottobackwards) closes > > > > >> > apache/metron#663 > > > > >> > > > > METRON-1035 Added SUM to the rules triage > > > > aggregation > > > > >> > docs > > > > >> > > closes > > > > >> > > > > apache/incubator-metron#649 > > > > >> > > > > METRON-1039 Add ZIP function to Stellar > closes > > > > >> > > > > apache/incubator-metron#652 > > > > >> > > > > METRON-1054 Ambari Mpack Attempts to Kill > > > Topologies > > > > >> > That Are > > > > >> > > Not > > > > >> > > > > Running (nickwallen) closes apache/metron#660 > > > > >> > > > > METRON-992: Create performance tuning guide > > > > (mmiklavc) > > > > >> > closes > > > > >> > > > > apache/metron#614 > > > > >> > > > > METRON-1044 Disabled writers are not acking > > > messages > > > > >> > > (merrimanr) > > > > >> > > > > closes apache/metron#654 > > > > >> > > > > METRON-1022 Elasticsearch REST endpoint > this > > > closes > > > > >> > > > > apache/incubator-metron#636 > > > > >> > > > > METRON-1048 Intermittent Test Failure for > > > > >> > > > > SimpleHBaseEnrichmentWriterLoggingTest > (nickwallen) > > > > closes > > > > >> > > > apache/metron#658 > > > > >> > > > > METRON-1029 Topology worker opts are not > being set > > > > when > > > > >> > > Kerberos is > > > > >> > > > > enabled (merrimanr) closes apache/metron#645 > > > > >> > > > > METRON-1031 Management UI Cannot Start > Topologies > > > in > > > > >> > Kerberized > > > > >> > > > > Environment (nickwallen) closes > apache/metron#647 > > > > >> > > > > METRON-1008 Migrate Travis build to use > Trusty > > > > (jjmeyer > > > > >> > via > > > > >> > > > > justinleet) closes apache/metron#633 > > > > >> > > > > METRON-633 Create better logging for > > > > >> > HbaseEnrichmentWriter > > > > >> > > (zezutom > > > > >> > > > > via justinleet) closes apache/metron#572 > > > > >> > > > > METRON-1003 ParserUtil parses dates > incorrect > > > > (bjigmp > > > > >> via > > > > >> > > justinleet) > > > > >> > > > > closes apache/metron#623 > > > > >> > > > > METRON-1040 Create Installation > Instructions for > > > the > > > > >> > Profiler > > > > >> > > > > (nickwallen) closes apache/metron#653 > > > > >> > > > > METRON-833 Update MaaS documentation to > explain > > > how > > > > it > > > > >> > > interacts with > > > > >> > > > > kerberos (cestella via justinleet) closes > > > > apache/metron#520 > > > > >> > > > > METRON-1033 Profiler example uses > incorrect units > > > > for > > > > >> > expires > > > > >> > > > > (simonellistonball via nickwallen) closes > > > > apache/metron#648 > > > > >> > > > > METRON-1019 Metron 0.4.0 manual > installation guide > > > > for > > > > >> > CentOS 6 > > > > >> > > > > (lvets via ottobackwards) closes > apache/metron#631 > > > > >> > > > > METRON-1013 StellarShell does not validate > > > > parameters > > > > >> > > (ottobackwards) > > > > >> > > > > closes apache/metron#639 > > > > >> > > > > METRON-1017 Ambari components should be > separate > > > > >> > (merrimanr) > > > > >> > > closes > > > > >> > > > > apache/metron#634 > > > > >> > > > > METRON-933 STELLAR support for setting > fields to > > > > regex > > > > >> > match > > > > >> > > captures > > > > >> > > > > (ottobackwards) closes apache/metron#638 > > > > >> > > > > METRON-1001 Allow metron to ingest parser > metadata > > > > >> along > > > > >> > with > > > > >> > > data > > > > >> > > > > closes apache/incubator-metron#621 > > > > >> > > > > METRON-1027 Errant Log Message When No > GeoIP Hit > > > on > > > > >> > Valid, > > > > >> > > External > > > > >> > > > > IPv4 Address (nickwallen) closes > apache/metron#644 > > > > >> > > > > METRON-1025 Metron github pr template > should not > > > > >> > reference > > > > >> > > incubator > > > > >> > > > > (ottobackwards) closes apache/metron#640 > > > > >> > > > > METRON-1021 increment metron version > number to > > > > 0.4.1 in > > > > >> > poms > > > > >> > > etc > > > > >> > > > > (mattf-horton) closes apache/metron#637 > > > > >> > > > > METRON-986 Enhance Fastcapa to Support > Intel X520 > > > > >> > (nickwallen) > > > > >> > > closes > > > > >> > > > > apache/metron#608 > > > > >> > > > > METRON-1012 Update Metron public web site > for > > > 0.4.0 > > > > >> > release > > > > >> > > > > (mattf-horton) closes apache/metron#629 > > > > >> > > > > METRON-1014 StellarShell class name typo > > > > (mattf-horton) > > > > >> > closes > > > > >> > > > > apache/metron#630 > > > > >> > > > > METRON-990 Clean up and organize flux > properties > > > > >> > (merrimanr) > > > > >> > > closes > > > > >> > > > > apache/metron#613 > > > > >> > > > > METRON-508 Expand Elasticsearch templates > to > > > support > > > > >> the > > > > >> > > standard bro > > > > >> > > > > logs (JonZeolla) closes apache/metron#586 > > > > >> > > > > METRON-1007 Ship the metron-management jar > as part > > > > of > > > > >> > the mpack > > > > >> > > > > install (ottobackwards) closes > apache/metron#627 > > > > >> > > > > METRON-877 Extract core implementation and > UDF > > > > support, > > > > >> > create > > > > >> > > > > metron-stellar module (mattf-horton) closes > > > > >> apache/metron#616 > > > > >> > > > > METRON-1004 Travis CI - Job Exceeded > Maximum Time > > > > Limit > > > > >> > > (justinleet) > > > > >> > > > > closes apache/metron#624 > > > > >> > > > > METRON-999 Add virtualization support > checks to > > > > >> > > platform-info.sh > > > > >> > > > > (JonZeolla via jonzeolla) closes > apache/metron#618 > > > > >> > > > > > > > > >> > > > > > > > > >> > > > > > > > > >> > > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > > >> > > > > > > >> > > > > > > >> > > > > > >> > > > > > >> > > > > > >> > > > > > >> > > > > > > > -- > > > > > > Jon > > > > > > > > > -- > > Jon > > > >
