The following PRs are usability enhancements for the Profiler. They are fairly simple and I think are very helpful for troubleshooting. I don't want to hold up the release, but it would be a "nice to have" to get these in.
If anyone has cycles, I would appreciate some reviews of these PRs. https://github.com/apache/metron/pull/721 https://github.com/apache/metron/pull/716 On Tue, Aug 29, 2017 at 8:59 PM Matt Foley <ma...@apache.org> wrote: > Okay, just to be clear, you’re requesting we wait until Friday, if > necessary, to cut an RC with 717 in it? > Thanks, > --Matt > > On 8/29/17, 11:45 AM, "Casey Stella" <ceste...@gmail.com> wrote: > > 709 is in and 717 is under concerted review by Otto. I'd like to see > it in > by Friday. > > On Tue, Aug 29, 2017 at 1:35 PM, Matt Foley <ma...@apache.org> wrote: > > > Hi all, > > Thanks for your inputs. The three PRs Nick mentioned have been > > successfully closed. > > Casey, do you have an ETA for these two PRs? (PR#709 and 717) > > Thanks, > > --Matt > > > > On 8/29/17, 9:34 AM, "Casey Stella" <ceste...@gmail.com> wrote: > > > > For my PRs, I'd vote for METRON-1122 being in (commit very > imminent). > > I'd very much like METRON-1134 to be in as well. > > > > Beyond that, I'm ok > > > > On Tue, Aug 22, 2017 at 4:37 PM, Nick Allen <n...@nickallen.org> > > wrote: > > > > > Thanks for starting the process, Matt. > > > > > > These are my own open PRs that I would most like to see get in. > > They all > > > relate to the Profiler. My other outstanding PRs are less > important. > > > > > > - https://github.com/apache/metron/pull/705 > > > - https://github.com/apache/metron/pull/707 > > > - https://github.com/apache/metron/pull/708 > > > > > > > > > > > > > > > > > > On Tue, Aug 22, 2017 at 4:17 PM Matt Foley <ma...@apache.org> > wrote: > > > > > > > Hello all, > > > > At the meeting this morning, the community expressed the > wish to > > create a > > > > new release, to be a point release and not including > METRON-777. > > > > > > > > Therefore, I propose to create release 0.4.1 from Metron > master > > branch, > > > > with whatever additional commits the community considers > vital and > > can > > > get > > > > in in the next few days. > > > > > > > > There have been 74 commits since the 0.4.0 release (list > appended > > to end > > > > of this message). > > > > I have not yet done a compare to make sure all 74 completed > > commits have > > > > closed their Jiras, but I will follow up with that info. > > > > > > > > There are 35 open PRs, see > https://github.com/apache/metron/pulls > > , > > > which > > > > is getting a little clunky. Surely not all of them can get > in in > > the > > > next > > > > few days, but do we want to try to close and include some of > them? > > > > > > > > Please respond to the list with your requests to include > specific > > > > additional PRs before we cut the 0.4.1 release candidate. > Let’s > > keep it > > > > practical so we don’t delay more than a week or so. > > > > > > > > TIMEFRAME: Tentatively I would like to start the process of > > cutting an > > > RC > > > > this coming Monday 28 August. If we have too many PRs > required to > > be in, > > > > we may have to slip that. Likewise, if there is need for > urgency, > > I can > > > > start as soon as tomorrow. We will be guided by your > responses. > > > > > > > > Thanks, > > > > --Matt > > > > (Release Manager) > > > > > > > > COMPLETED PRs as of 22 Aug 2017: > > > > METRON-1115 Jackson is not properly serializing > readMetadata > > and > > > > mergeMetadata SensorParserConfig properties (merrimanr) > closes > > > > apache/metron#703 > > > > METRON-1047 REST should use core-site.xml for Hadoop > > configuration > > > > (merrimanr) closes apache/metron#672 > > > > METRON-1111 Mislabeled Configuration Property in Ambari > > (nickwallen) > > > > closes apache/metron#698 > > > > METRON-1113 UpdateControllerIntegrationTest fails with > 500 > > error > > > > (merrimanr) closes apache/metron#701 > > > > METRON-711 StellarShell assigns variables even if an > exception > > was > > > > thrown in the statement. (ottobackwards) closes > apache/metron#686 > > > > METRON-1110 REST jvm flags property is being overwritten > when > > > Kerberos > > > > is enabled (merrimanr) closes apache/metron#697 > > > > METRON-739 Create Local Profile Runner (nickwallen) > closes > > > > apache/metron#693 > > > > METRON-1109 Indexing topology fails to start after > Kerberos is > > > enabled > > > > (merrimanr) closes apache/metron#696 > > > > METRON-1108 Metron configuration tabs are not showing up > in > > Ambari > > > > this closes apache/incubator-metron#695 > > > > METRON-1078 Metron Indexing fails to stop during > "Stop All > > > > Services" (dlyle65535) closes apache/metron#680 > > > > METRON-1104 Build Failure - Due to Bootstrap version > change > > > > (iraghumitra via justinleet) closes apache/metron#691 > > > > METRON-1094 MaaS will not start due to classpath error > > relating to > > > > Yarn closes apache/incubator-metron#688 > > > > METRON-1102 Add support for ingesting cybox URI > observables > > from > > > taxii > > > > feeds closes apache/incubator-metron#689 > > > > METRON-838 Incorrect set of ts in FireEye parser (bjigmp > via > > > > justinleet) closes apache/metron#528 > > > > METRON-322 Global Batching and Flushing (mattf-horton) > closes > > > > apache/metron#481 > > > > METRON-988 UI for viewing alerts generated by Metron > > (iraghumitra > > > via > > > > nickwallen) closes apache/metron#620 > > > > METRON-1084 Management UI web server license should be > Apache > > > > (merrimanr) closes apache/metron#683 > > > > METRON-1026 threatintel_taxii_load.sh throws exception > closes > > > > apache/incubator-metron#643 > > > > METRON-1051 Enable the ability to update indexed messages > > closes > > > > apache/incubator-metron#666 > > > > METRON-1069 Ambari MPack documentation around development > > strategies > > > > (justinleet) closes apache/metron#1069 > > > > METRON-1069 Ambari MPack documentation around development > > strategies > > > > (merrimanr via justinleet) closes apache/metron#1069 > > > > METRON-1069 Ambari MPack documentation around development > > strategies > > > > (justinleet) closes apache/metron#1069 > > > > METRON-1076 Management UI status check always reports the > > service as > > > > running (merrimanr) closes apache/metron#678 > > > > METRON-1075 Add faceted search capabilities (merrimanr) > closes > > > > apache/metron#679 > > > > METRON-379 Stellar - No Error When Adding Variables That > Do > > Not Exist > > > > (ottobackwards) closes apache/metron#675 > > > > METRON-1038 Stellar should have a better collection of > basic > > math > > > > operations closes apache/incubator-metron#650 > > > > METRON-1072 Cleanup Maven build warnings (mmiklavc) > closes > > > > apache/metron#676 > > > > METRON-1056 Get field types from Elasticsearch > (merrimanr) > > closes > > > > apache/metron#662 > > > > METRON-1011 Stellar ENRICHMENT functions should enforce > > submission of > > > > 4 parameters (jasper-k via ottobackwards) closes > apache/metron#628 > > > > METRON-975 Normalize logging and switch to common idiom > with > > SLF4J > > > > (mmiklavc) closes apache/metron#599 > > > > METRON-681 CSVConverter should trim values (basvdl via > > ottobackwards) > > > > closes apache/metron#674 > > > > METRON-746 Build Custom Checkstyle and IDE formatting > settings > > > > (justinleet via mmiklavc) closes apache/metron#577 > > > > METRON-1060 Add performance timing logging to enrichment > > topology > > > > (mmiklavc) closes apache/metron#665 > > > > METRON-982 REST STORM Support for supervisor summary > > (ottobackwards) > > > > closes apache/metron#607 > > > > METRON-1064 Make init script OS-agnostic (merrimanr) > closes > > > > apache/metron#669 > > > > METRON-984 Create STELLAR Decoding Functions > (ottobackwards) > > closes > > > > apache/metron#642 > > > > METRON-1067 Minor typo in documentation (spencer-hanson > via > > > > justinleet) closes apache/metron#671 > > > > METRON-1018 Integration tests should reference flux yaml > and > > property > > > > files deployed by Ambari (merrimanr) closes apache/metron#635 > > > > METRON-1050 Improve Docs of `profiler.period.duration` > > (nickwallen) > > > > closes apache/metron#656 > > > > METRON-1043 Profiler Should be Less Dramatic When Missing > > > > Configuration (nickwallen) closes apache/metron#655 > > > > METRON-1053 Relocate Metron Docker (nickwallen) closes > > > > apache/metron#659 > > > > METRON-1058 address checkstyle warnings for > UnusedImports in > > > > metron-stellar (dbist via ottobackwards) closes > apache/metron#663 > > > > METRON-1035 Added SUM to the rules triage aggregation > docs > > closes > > > > apache/incubator-metron#649 > > > > METRON-1039 Add ZIP function to Stellar closes > > > > apache/incubator-metron#652 > > > > METRON-1054 Ambari Mpack Attempts to Kill Topologies > That Are > > Not > > > > Running (nickwallen) closes apache/metron#660 > > > > METRON-992: Create performance tuning guide (mmiklavc) > closes > > > > apache/metron#614 > > > > METRON-1044 Disabled writers are not acking messages > > (merrimanr) > > > > closes apache/metron#654 > > > > METRON-1022 Elasticsearch REST endpoint this closes > > > > apache/incubator-metron#636 > > > > METRON-1048 Intermittent Test Failure for > > > > SimpleHBaseEnrichmentWriterLoggingTest (nickwallen) closes > > > apache/metron#658 > > > > METRON-1029 Topology worker opts are not being set when > > Kerberos is > > > > enabled (merrimanr) closes apache/metron#645 > > > > METRON-1031 Management UI Cannot Start Topologies in > Kerberized > > > > Environment (nickwallen) closes apache/metron#647 > > > > METRON-1008 Migrate Travis build to use Trusty (jjmeyer > via > > > > justinleet) closes apache/metron#633 > > > > METRON-633 Create better logging for > HbaseEnrichmentWriter > > (zezutom > > > > via justinleet) closes apache/metron#572 > > > > METRON-1003 ParserUtil parses dates incorrect (bjigmp via > > justinleet) > > > > closes apache/metron#623 > > > > METRON-1040 Create Installation Instructions for the > Profiler > > > > (nickwallen) closes apache/metron#653 > > > > METRON-833 Update MaaS documentation to explain how it > > interacts with > > > > kerberos (cestella via justinleet) closes apache/metron#520 > > > > METRON-1033 Profiler example uses incorrect units for > expires > > > > (simonellistonball via nickwallen) closes apache/metron#648 > > > > METRON-1019 Metron 0.4.0 manual installation guide for > CentOS 6 > > > > (lvets via ottobackwards) closes apache/metron#631 > > > > METRON-1013 StellarShell does not validate parameters > > (ottobackwards) > > > > closes apache/metron#639 > > > > METRON-1017 Ambari components should be separate > (merrimanr) > > closes > > > > apache/metron#634 > > > > METRON-933 STELLAR support for setting fields to regex > match > > captures > > > > (ottobackwards) closes apache/metron#638 > > > > METRON-1001 Allow metron to ingest parser metadata along > with > > data > > > > closes apache/incubator-metron#621 > > > > METRON-1027 Errant Log Message When No GeoIP Hit on > Valid, > > External > > > > IPv4 Address (nickwallen) closes apache/metron#644 > > > > METRON-1025 Metron github pr template should not > reference > > incubator > > > > (ottobackwards) closes apache/metron#640 > > > > METRON-1021 increment metron version number to 0.4.1 in > poms > > etc > > > > (mattf-horton) closes apache/metron#637 > > > > METRON-986 Enhance Fastcapa to Support Intel X520 > (nickwallen) > > closes > > > > apache/metron#608 > > > > METRON-1012 Update Metron public web site for 0.4.0 > release > > > > (mattf-horton) closes apache/metron#629 > > > > METRON-1014 StellarShell class name typo (mattf-horton) > closes > > > > apache/metron#630 > > > > METRON-990 Clean up and organize flux properties > (merrimanr) > > closes > > > > apache/metron#613 > > > > METRON-508 Expand Elasticsearch templates to support the > > standard bro > > > > logs (JonZeolla) closes apache/metron#586 > > > > METRON-1007 Ship the metron-management jar as part of > the mpack > > > > install (ottobackwards) closes apache/metron#627 > > > > METRON-877 Extract core implementation and UDF support, > create > > > > metron-stellar module (mattf-horton) closes apache/metron#616 > > > > METRON-1004 Travis CI - Job Exceeded Maximum Time Limit > > (justinleet) > > > > closes apache/metron#624 > > > > METRON-999 Add virtualization support checks to > > platform-info.sh > > > > (JonZeolla via jonzeolla) closes apache/metron#618 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >