Any idea why we released it as 0.1.0 in the artifacts version? I'm fine with doing x.y if we need to, but I would like the artifact versioning to be consistent if possible.
On Wed, Sep 5, 2018 at 8:26 PM zeo...@gmail.com <zeo...@gmail.com> wrote: > I lied, we didn't need to update our btests because it's limited to a major > and minor version. > > > https://github.com/apache/metron-bro-plugin-kafka/blob/master/src/Plugin.cc#L33-L34 > > Jon > > On Wed, Sep 5, 2018 at 8:10 PM zeo...@gmail.com <zeo...@gmail.com> wrote: > > > I looked into x.y.z back when we released 0.1 and it was not possible in > > bro-pkg at the time but now it is > > <https://github.com/bro/package-manager/issues/32>. In order to do > this, > > we'll also need to configure bro-pkg.meta to require the proper version > of > > bro-pkg, as well as update the btests for the new version string. I will > > throw together a JIRA and PR to do all this in case we decide to align > with > > x.y.z; we can trash it if we decide to stay with x.y. > > > > Jon > > > > On Wed, Sep 5, 2018 at 7:35 PM Justin Leet <justinjl...@gmail.com> > wrote: > > > >> Long story short, while preparing the release candidate, I discovered > our > >> metron-bro-plugin-kafka is inconsistently versioned. > >> > >> In the repo, it's x.y (e.g. 0.2) > >> See: > >> > https://github.com/apache/metron-bro-plugin-kafka/blob/master/VERSION#L18 > >> > >> In our released artifact, it's x.y.z (e.g. 0.1.0) > >> See http://archive.apache.org/dist/metron/0.4.2/ > >> > >> Going forward from this release, I'd like the artifact to be consistent > >> with the repo. I'd personally prefer x.y.z to be entirely consistent > >> throughout Metron, but if there's a particular reason why it was x.y I'm > >> happy to entertain it. > >> > >> If we choose to move to x.y.z, I can provide a PR to update the version > to > >> 0.2.0 unless someone else wants to volunteer. Otherwise, I'd like to > >> release the artifact as apache-metron-bro-plugin-kafka_0.2.tar.gz > >> > >> Justin > >> > >> On Tue, Sep 4, 2018 at 12:15 PM Justin Leet <justinjl...@gmail.com> > >> wrote: > >> > >> > As an update, I'll be working on starting the release process rolling > >> > today. The PCAP Query panel feature branch is in master and I haven't > >> heard > >> > of any other potential blockers. I'd appreciate everyone updating > their > >> > JIRAs with their state (complete, etc.) and version (0.6.0) as needed. > >> > > >> > Do we have anything that needs to go into the UPGRADING.md file? > >> > > >> > A PR is out for updating the version from 0.5.1 to 0.6.0. Please see > >> > https://github.com/apache/metron/pull/1183. I still need to spin up > >> full > >> > dev etc. before this is ready to be merged. > >> > > >> > Updated list of PRs that have made it into master as of Sept 4, 2018 > >> > > >> > 6 days ago METRON-1751 Storm Profiler dies when consuming null message > >> > (nickwallen) closes apache/metron#1176 > >> > 6 days ago METRON-1757 Storm Profiler Serialization Exception > >> (nickwallen) > >> > closes apache/metron#1178 > >> > 6 days ago METRON-1743 CEF testPaloAltoCEF test using a confusing > >> variable > >> > name (JonZeolla via justinleet) closes apache/metron#1173 > >> > 8 days ago METRON-1752 Prevent package.lock from changing during build > >> > (sardell via merrimanr) closes apache/metron#1177 > >> > 8 days ago METRON-1724 Date/time validation missing in PCAP query > >> (tiborm > >> > via nickwallen) closes apache/metron#1172 > >> > 3 weeks ago METRON-1554 Pcap Query Panel (merrimanr) closes > >> > apache/metron#1169 > >> > 3 weeks ago METRON-1739 UDP packets are not handled (merrimanr) closes > >> > apache/metron#1168 > >> > 3 weeks ago METRON-1727: Alerts are not populated on the alerts UI > after > >> > enabling X-pack for Elastic search (MohanDV via mmiklavc) closes > >> > apache/metron#1141 > >> > 3 weeks ago METRON-1738: Pcap directories should have correct > >> permissions > >> > (merrimanr via mmiklavc) closes apache/metron#1166 > >> > 3 weeks ago METRON-1737: Document Job cleanup (merrimanr via mmiklavc) > >> > closes apache/metron#1164 > >> > 3 weeks ago METRON-1732: Fix job status liveness bug and parallelize > >> > finalizer file writing (mmiklavc via mmiklavc) closes > apache/metron#1157 > >> > 3 weeks ago METRON-1735 Empty print status option causes NPE > (merrimanr) > >> > closes apache/metron#1160 > >> > 3 weeks ago METRON-1733 PCAP UI - PCAP queries don't work on > Safari > >> > (sardell via merrimanr) closes apache/metron#1158 > >> > 3 weeks ago METRON-1734 Src and Dst port filters are incorrect after > >> > changing to empty (merrimanr) closes apache/metron#1159 > >> > 4 weeks ago METRON-1725 Add ability to specify YARN queue for pcap > jobs > >> > (merrimanr) closes apache/metron#1153 > >> > 4 weeks ago METRON-1731: PCAP - Escape colons in output dir names > >> > (mmiklavc via mmiklavc) closes apache/metron#1155 > >> > 4 weeks ago METRON-1702 Reload a running job in the UI (merrimanr) > >> closes > >> > apache/metron#1156 > >> > 4 weeks ago METRON-1722 PcapCLI should print progress to stdout > >> > (merrimanr) closes apache/metron#1138 > >> > 4 weeks ago Merge branch 'master' into > >> feature/METRON-1554-pcap-query-panel > >> > 4 weeks ago METRON-1728: Handle null values in config in Pcap backend > >> more > >> > gracefully (mmiklavc via mmiklavc) closes apache/metron#1151 > >> > 4 weeks ago METRON-1730: Update steps to run pycapa on Centos 6 > >> (mmiklavc > >> > via mmiklavc) closes apache/metron#1152 > >> > 4 weeks ago METRON-1713 PCAP UI - Add a way to kill a pcap job (tiborm > >> via > >> > merrimanr) closes apache/metron#1143 > >> > 4 weeks ago METRON-1723 PCAP UI - Unable to select/copy from packets > >> > details in PCAP query panel (sardell via merrimanr) closes > >> > apache/metron#1139 > >> > 4 weeks ago METRON-1712 PCAP UI - Input validation (tiborm via > >> merrimanr) > >> > closes apache/metron#1142 > >> > 4 weeks ago METRON-1720 Better error messages when there are no > results > >> or > >> > wireshark is not installed (merrimanr) closes apache/metron#1154 > >> > 4 weeks ago METRON-1726: Refactor PcapTopologyIntegrationTest > (mmiklavc > >> > via mmiklavc) closes apache/metron#1140 > >> > 4 weeks ago METRON-1683 PCAP UI - Fix the download progress bar > (sardell > >> > via merrimanr) closes apache/metron#1122 > >> > 4 weeks ago METRON-1675 PCAP UI - Introduce the paging capability > >> (sardell > >> > via merrimanr) closes apache/metron#1121 > >> > 4 weeks ago METRON-1721 New default input path is wrong in pcap CLI > >> > (merrimanr) closes apache/metron#1137 > >> > 4 weeks ago Merge branch 'master' into > >> feature/METRON-1554-pcap-query-panel > >> > 4 weeks ago METRON-1676 PCAP UI - Add data range selector to the > filter > >> > bar (tiborm via merrimanr) closes apache/metron#1119 > >> > 5 weeks ago METRON-1662 PCAP UI - Downloading PCAP page files (tiborm > >> via > >> > merrimanr) closes apache/metron#1118 > >> > 5 weeks ago METRON-1700 Create REST endpoint to get job configuration > >> > (merrimanr) closes apache/metron#1135 > >> > 5 weeks ago METRON-1671 Create PCAP UI (tiborm via merrimanr) closes > >> > apache/metron#1103 > >> > 5 weeks ago METRON-1701 Update General notes on the installation of > >> Pycapa > >> > on Kerberized cluster (MohanDV via nickwallen) closes > apache/metron#1136 > >> > 6 weeks ago METRON-1650 Packaging docker containers are too large > >> > (jameslamb via merrimanr) closes apache/metron#1091 > >> > 6 weeks ago METRON-1604 : Add RHEL 7 power pc to OS family for the HCP > >> > management pack repo info closes apache/incubator-metron#1052 > >> > 6 weeks ago Merge branch 'master' into > >> feature/METRON-1554-pcap-query-panel > >> > 6 weeks ago METRON-1687: Upgrade the rat plugin to 0.13-SNAPSHOT > closes > >> > apache/incubator-metron#1126 > >> > 6 weeks ago METRON-1694: Clean up Metron REST docs closes > >> > apache/incubator-metron#1131 > >> > 6 weeks ago METRON-1691: REST should limit the number of Pcap jobs a > >> user > >> > can submit (merrimanr via mmiklavc) closes apache/metron#1129 > >> > 6 weeks ago METRON-1693: Fix Pcap CLI local FS finalizer (mmiklavc via > >> > mmiklavc) closes apache/metron#1130 > >> > 6 weeks ago METRON-1690: Add more context to PcapJob JobStatus > (mmiklavc > >> > via mmiklavc) closes apache/metron#1128 > >> > 6 weeks ago METRON-1661 Create Pcap Query Filter endpoint (merrimanr) > >> > closes apache/metron#1125 > >> > 6 weeks ago METRON-1560 Update MPack to support Pcap panel (merrimanr) > >> > closes apache/metron#1124 > >> > 7 weeks ago METRON-1606 Add a 'wrap' to incoming messages in > >> the > >> > metron json parser (ottobackwards) closes apache/metron#1054 > >> > 7 weeks ago METRON-1562 Enable Kerberos in REST for YARN and MR jobs > >> > (merrimanr) closes apache/metron#1094 > >> > 7 weeks ago Merge branch 'master' into > >> feature/METRON-1554-pcap-query-panel > >> > 7 weeks ago METRON-1685 Retrieve Pcap results in raw binary format > >> > (merrimanr) closes apache/metron#1123 > >> > 7 weeks ago METRON-1638 Retrieve Pcap results in pdml format > (merrimanr) > >> > closes apache/metron#1120 > >> > 7 weeks ago METRON-1686 Create stop job endpoint for Pcap queries > >> > (mmiklavc via merrimanr) closes apache/metron#1115 > >> > 7 weeks ago METRON-1674 Create REST endpoint for job status > abstraction > >> > (merrimanr) closes apache/metron#1109 > >> > 7 weeks ago METRON-1672 Add metron-alerts's UI unit tests to > travis > >> > build process (justinleet) closes apache/metron#1106 > >> > 7 weeks ago METRON-1614: Create job status abstraction (mmiklavc via > >> > mmiklavc) closes apache/metron#1108 > >> > 7 weeks ago METRON-1684 Fix Markdown problems in 3rdPartyParser.md > >> > (justinleet) closes apache/metron#1110 > >> > 7 weeks ago METRON-1657 Parser aggregation in storm (justinleet) > closes > >> > apache/metron#1099 > >> > 7 weeks ago METRON-1651 Fixing failing protractor e2e test (tiborm via > >> > merrimanr) closes apache/metron#1095 > >> > 7 weeks ago METRON-1673 Fix Javadoc errors (justinleet) closes > >> > apache/metron#1107 > >> > 7 weeks ago METRON-1620: Fixes for forensic clustering use case > example > >> > (mmiklavc via mmiklavc) closes apache/metron#1065 > >> > 7 weeks ago METRON-1659: The platform-info.sh should check for the > >> vagrant > >> > hostmanager plugin closes apache/incubator-metron#1100 > >> > 7 weeks ago METRON-1658: Upgrade bro to 2.5.4 closes > >> > apache/incubator-metron#1101 > >> > 7 weeks ago METRON-1236 Add start/stop/restart commands that execute > >> > successfully, when ambari agents run as non-root user closes > >> > apache/incubator-metron#1105 > >> > 7 weeks ago METRON-1670: Stellar WEEK_OF_YEAR test is locale sensitive > >> > closes apache/incubator-metron#1104 > >> > 8 weeks ago METRON-1660 On Solr, sorting by threat score fails > >> > (justinleet) closes apache/metron#1102 > >> > 8 weeks ago METRON-1656 Create KAKFA_SEEK function (nickwallen) closes > >> > apache/metron#1097 > >> > 8 weeks ago Resolve merge conflicts with master. > >> > 8 weeks ago METRON-1641: Enable Pcap jobs to be submitted > asynchronously > >> > (mmiklavc via mmiklavc) closes apache/metron#1081 > >> > 8 weeks ago METRON-1644: Support parser chaining closes > >> > apache/incubator-metron#1084 > >> > 8 weeks ago METRON-1655 Make REGEXP_MATCH take multiple regexs in the > >> 2nd > >> > arg (ottobackwards) closes apache/metron#1098 > >> > 9 weeks ago METRON-1643: Create a REGEX_ROUTING field transformation > >> > closes apache/incubator-metron#1083 > >> > 9 weeks ago METRON-1652 Document X-Pack Common Problem (nickwallen) > >> closes > >> > apache/metron#1092 > >> > 9 weeks ago METRON-1649 Intermittent Test Failure > >> > ProfileBuilderBoltTest#testFlushExpiredProfiles (nickwallen) closes > >> > apache/metron#1090 > >> > 9 weeks ago METRON-1635 Alerts UI status update doesn't > immediately > >> > show up (merrimanr) closes apache/metron#1080 > >> > 9 weeks ago METRON-1642: KafkaWriter should be able choose the topic > >> from > >> > a field in addition to topology construction time closes > >> > apache/incubator-metron#1082 > >> > 9 weeks ago METRON-1636: Fix broken unit test setup in metron-alerts > >> > closes apache/incubator-metron#1085 > >> > 10 weeks ago METRON-1631 Alerts UI: Dash score does not show if only > >> > filtering by one group (sardell via merrimanr) closes > apache/metron#1079 > >> > 10 weeks ago METRON-1647 Fix logging level score closes > >> > apache/incubator-metron#1089 > >> > 10 weeks ago METRON-1621: Sorting alerts table by score closes > >> > apache/incubator-metron#1088 > >> > 10 weeks ago METRON-1619: Stellar empty collections should be > considered > >> > false in boolean expressions closes apache/incubator-metron#1064 > >> > 10 weeks ago METRON-1646 Sensor Stubs should work when kerberized > >> > (nickwallen) closes apache/metron#1087 > >> > 10 weeks ago METRON-1645: Check wether the Solr management pack is > >> > installed before configuring the solr principal name. closes > >> > apache/incubator-metron#1086 > >> > 2 months ago Merge branch 'master' into > feature/METRON-1416-upgrade-solr > >> > 2 months ago METRON-1634 Alerts UI add comment doesn't > immediately > >> > show up. (merrimanr) closes apache/metron#1077 > >> > 2 months ago Merge branch 'master' into > >> > feature/METRON-1554-pcap-query-panel > >> > 2 months ago METRON-1555 Update REST to run YARN and MR jobs > (merrimanr) > >> > closes apache/metron#1019 > >> > 2 months ago METRON-1489 Retrofit UI tests to run reliably during > >> nightly > >> > QE runs (sardell via nickwallen) closes apache/metron#1004 > >> > 2 months ago METRON-1637 Wrong path to escalate alert REST endpoint > >> > (merrimanr) closes apache/metron#1078 > >> > 2 months ago METRON-1624 Set Profiler and Enrichment batch parameters > in > >> > Ambari (nickwallen) closes apache/metron#1069 > >> > 2 months ago Merge remote-tracking branch 'origin/master' into > >> > feature/METRON-1416-upgrade-solr > >> > 2 months ago Merge branch 'master' into > feature/METRON-1416-upgrade-solr > >> > (nickwallen) closes apache/metron#1075 > >> > 2 months ago METRON-1629 Update Solr documentation (merrimanr via > >> > justinleet) closes apache/metron#1072 > >> > 3 months ago METRON-1633 Incorrect instructions when merging PR into > >> > feature branch (nickwallen) closes apache/metron#1074 > >> > 3 months ago METRON-1630 Add threat.triage.score.field to READMEs > >> > (merrimanr) closes apache/metron#1073 > >> > 3 months ago METRON-1609 Elasticsearch settings in Ambari should not > be > >> > required if Solr is the indexer (nickwallen) closes apache/metron#1056 > >> > 3 months ago METRON-1627 Alerts UI: Metaalert details missing in > details > >> > panel when trying to add alert to existing metaalert (sardell via > >> > justinleet) closes apache/metron#1070 > >> > 3 months ago METRON-1625 Merge master into Solr feature branch > >> (merrimanr) > >> > closes apache/metron#1067 > >> > 3 months ago METRON-1626 Alerts UI: An empty result is returned when > >> > searching for a single alert contained in a metaalert (sardell via > >> > nickwallen) closes apache/metron#1068 > >> > 3 months ago METRON-1611 Increment master version number to 0.5.1 for > >> > on-going development (justinleet) closes apache/metron#1057 > >> > 3 months ago METRON-1622 Allow user to define global property > >> > 'threat.triage.score.field' in Ambari (nickwallen) closes > >> apache/metron#1066 > >> > 3 months ago METRON-1599 Allow user to define global property > >> > 'source.type.field' in Ambari (nickwallen) closes apache/metron#1047 > >> > 3 months ago METRON-1616 Changing alert status fails if no metaalerts > >> have > >> > been created yet (merrimanr) closes apache/metron#1061 > >> > 3 months ago METRON-1573 Enhance KAFKA_* functions to return partition > >> and > >> > offset details (nickwallen) closes apache/metron#1030 > >> > 3 months ago Merge branch 'master' into > feature/METRON-1416-upgrade-solr > >> > 3 months ago METRON-1617: Make threat triage score function with dots > as > >> > well as colons closes apache/incubator-metron#1062 > >> > 3 months ago METRON-1613 Metaalerts status update broken in Alerts UI > >> > (merrimanr) closes apache/metron#1059 > >> > 3 months ago Merge branch 'master' into > feature/METRON-1416-upgrade-solr > >> > 3 months ago METRON-1588 Migrate storm-kafka-client to 1.2.1 closes > >> > apache/incubator-metron#1039 > >> > 3 months ago Merge branch 'master' into > feature/METRON-1416-upgrade-solr > >> > 3 months ago Merge branch 'feature/METRON-1416-upgrade-solr' of > >> > https://git-wip-us.apache.org/repos/asf/metron into > >> > feature/METRON-1416-upgrade-solr > >> > 3 months ago Merge branch 'master' into > feature/METRON-1416-upgrade-solr > >> > 3 months ago Merge branch 'master' into > feature/METRON-1416-upgrade-solr > >> > 3 months ago Merge branch 'master' into > feature/METRON-1416-upgrade-solr > >> > 3 months ago METRON-1587 Make collection utility work for HDP search > >> > (merrimanr) closes apache/metron#1043 > >> > 3 months ago METRON-1612 Fix website download links (justinleet) > closes > >> > apache/metron#1058 > >> > 3 months ago METRON-1608 Add configuration for threat.triage.field > name > >> > (merrimanr) closes apache/metron#1055 > >> > 3 months ago METRON-1585 SolrRetrieveLatestDao does not use the > >> collection > >> > lookup (justinleet via merrimanr) closes apache/metron#1050 > >> > 3 months ago METRON-1533 Create KAFKA_FIND Stellar Function > (nickwallen) > >> > closes apache/metron#1025 > >> > 3 months ago METRON-1601: Rename metaalert alert nested field to > >> > metron_alert to avoid collision closes apache/incubator-metron#1049 > >> > 3 months ago METRON-1572 Enhance KAFKA_PUT function (nickwallen) > closes > >> > apache/metron#1024 > >> > 3 months ago METRON-1607 update public web site to point at 0.5.0 new > >> > release (justinleet) closes apache/metron#1053 > >> > 3 months ago METRON-1568: Stellar should have a _ special variable > which > >> > returns the message in map form closes apache/incubator-metron#1021 > >> > 3 months ago METRON-1594: KafkaWriter is asynchronous and may lose > data > >> on > >> > node failure (mmiklavc via mmiklavc) closes apache/metron#1045 > >> > 3 months ago METRON-1603: Fix multivalue field errors in Bro Solr > schema > >> > (mmiklavc via mmiklavc) closes apache/metron#1051 > >> > 3 months ago METRON-1584 Indexing Topology Crashes with Invalid > Message > >> > (nickwallen) closes apache/metron#1036 > >> > 3 months ago METRON-1547 Solr Comment Fields (justinleet) closes > >> > apache/metron#1037 > >> > 3 months ago METRON-1553 Validate JIRA Script Error (nickwallen) > closes > >> > apache/metron#1013 > >> > 3 months ago METRON-1592 Unable to use third party parser with Storm > >> > versions >= 1.1.0 (nickwallen) closes apache/metron#1042 > >> > 3 months ago METRON-1598 NoClassDefFoundError when running with > >> > Elasticsearch X-Pack (nickwallen) closes apache/metron#1048 > >> > 3 months ago METRON-1589 '/api/v1/search/search' fails when 'Solr > >> > Zookeeper Urls' has comma separated multiple zookeeper urls > (justinleet) > >> > closes apache/metron#1040 > >> > 3 months ago METRON-1593 Setting Metron rest additional classpath > >> removes > >> > HBase and Hadoop configs from classpath (merrimanr) closes > >> > apache/metron#1044 > >> > 3 months ago METRON-1571 Correct KAFKA_TAIL Seek to End Logic > >> (nickwallen) > >> > closes apache/metron#1023 > >> > 3 months ago METRON-1579: Stellar should return the expression that > >> failed > >> > in the exception closes apache/incubator-metron#1033 > >> > 3 months ago METRON-1586 Defaulting for the source type field in > alerts > >> UI > >> > does not work (merrimanr via justinleet) closes apache/metron#1038 > >> > 3 months ago METRON-1569: Allow user to change field name conversion > >> when > >> > indexing to Elasticsearch (nickwallen via mmiklavc) closes > >> > apache/metron#1022 > >> > 3 months ago METRON-1544 Flaky test: > >> > > org.apache.metron.stellar.common.CachingStellarProcessorTest#testCaching > >> > (nickwallen) closes apache/metron#1015 > >> > 3 months ago METRON-1580 Release candidate check script requires Bro > >> > Plugin (nickwallen via ottobackwards) closes apache/metron#1034 > >> > 3 months ago METRON-1532 Getting started documentation improvements > >> > (sardell via nickwallen) closes apache/metron#1001 > >> > 3 months ago METRON-1577 Solr searches don't include the index of > >> the > >> > result (merrimanr) closes apache/metron#1031 > >> > 3 months ago METRON-1421 Create a SolrMetaAlertDao (justinleet) closes > >> > apache/metron#970 > >> > 4 months ago Merge branch 'master' into > feature/METRON-1416-upgrade-solr > >> > 4 months ago METRON-1567 Large error message can't be written in > >> Solr > >> > (justinleet) closes apache/metron#1020 > >> > 4 months ago METRON-1540 Solr Integration tests should use actual > >> schemas > >> > (justinleet) closes apache/metron#1005 > >> > 4 months ago Merge remote-tracking branch 'origin/master' into > >> > feature/METRON-1416-upgrade-solr > >> > 4 months ago METRON-1526 Location field types cause DocValuesField > >> appear > >> > more than once error (merrimanr via justinleet) closes > apache/metron#995 > >> > 5 months ago METRON-1503 Alerts are not getting populated in alerts UI > >> > when search engine is Solr (merrimanr) closes apache/metron#975 > >> > 6 months ago METRON-1424 Kerberos: Solr (merrimanr) closes > >> > apache/metron#960 > >> > 6 months ago METRON-1482 Update REST to work with Solr (merrimanr) > >> closes > >> > apache/metron#957 > >> > 6 months ago METRON-1464 Convert schemas to be compatible with Solr > >> 5.5.2 > >> > (merrimanr) closes apache/metron#945 > >> > 6 months ago METRON-1423 Ambari work to handle Solr configuration > >> > (merrimanr) closes apache/metron#934 > >> > 6 months ago Merge branch 'master' into > feature/METRON-1416-upgrade-solr > >> > 7 months ago METRON-1448: Update SolrWriter to conform to new > collection > >> > strategy this closes apache/incubator-metron#929 > >> > 7 months ago Merge branch 'master' into > feature/METRON-1416-upgrade-solr > >> > 7 months ago Merge branch 'master' into > feature/METRON-1416-upgrade-solr > >> > 7 months ago METRON-1441: Create complementary Solr schemas for the > main > >> > sensors this closes apache/metron#922 > >> > 7 months ago METRON-1436: Manually Install Solr Cloud in Full Dev > >> > (mmiklavc via mmiklavc) closes apache/metron#918 > >> > 7 months ago METRON-1419: Create a SolrDao this closes > >> > apache/incubator-metron#911 > >> > > >> > > >> > On Wed, Aug 15, 2018 at 2:15 PM Michael Miklavcic < > >> > michael.miklav...@gmail.com> wrote: > >> > > >> >> +1 here as well to the proposed releases. > >> >> > >> >> On Wed, Aug 15, 2018 at 11:06 AM Casey Stella <ceste...@gmail.com> > >> wrote: > >> >> > >> >> > +1 to both releases, this is plenty for an 0.6.0 and a 0.2.0 > >> >> > > >> >> > On Wed, Aug 15, 2018 at 11:04 AM Justin Leet < > justinjl...@gmail.com> > >> >> > wrote: > >> >> > > >> >> > > I just sent a thread about release cadence. Jon, I'd recommend > >> >> starting a > >> >> > > thread on a 1.0 roadmap. I thought about merging the threads, > but > >> I > >> >> > think > >> >> > > that's just going to result in more crosstalk, so I'll let you > >> start > >> >> that > >> >> > > conversation. > >> >> > > > >> >> > > On Wed, Aug 15, 2018 at 10:37 AM Nick Allen <n...@nickallen.org> > >> >> wrote: > >> >> > > > >> >> > > > +1 to a 0.6.0 release that includes the Pcap Panel and Solr > work. > >> >> > > > > >> >> > > > +1 to doing a 0.2.0 release for metron-bro-plugin-kafka. I > >> *think* > >> >> we > >> >> > > need > >> >> > > > to do the plugin release first, so that the 0.6.0 Metron > release > >> >> will > >> >> > > point > >> >> > > > to plugin 0.2.0. > >> >> > > > > >> >> > > > FWIW, here are the changes since the last release. > >> >> > > > > >> >> > > > 6 days ago METRON-1730: Update steps to run pycapa on Centos 6 > >> >> > (mmiklavc > >> >> > > > via mmiklavc) closes apache/metron#1152 > >> >> > > > 2 weeks ago METRON-1701 Update General notes on the > installation > >> of > >> >> > > Pycapa > >> >> > > > on Kerberized cluster (MohanDV via nickwallen) closes > >> >> > apache/metron#1136 > >> >> > > > 3 weeks ago METRON-1650 Packaging docker containers are too > large > >> >> > > > (jameslamb via merrimanr) closes apache/metron#1091 > >> >> > > > 3 weeks ago METRON-1604 : Add RHEL 7 power pc to OS family for > >> the > >> >> HCP > >> >> > > > management pack repo info closes apache/incubator-metron#1052 > >> >> > > > 3 weeks ago METRON-1687: Upgrade the rat plugin to > 0.13-SNAPSHOT > >> >> closes > >> >> > > > apache/incubator-metron#1126 > >> >> > > > 3 weeks ago METRON-1694: Clean up Metron REST docs closes > >> >> > > > apache/incubator-metron#1131 > >> >> > > > 4 weeks ago METRON-1606 Add a 'wrap' to incoming > >> messages > >> >> in > >> >> > > the > >> >> > > > metron json parser (ottobackwards) closes apache/metron#1054 > >> >> > > > 4 weeks ago METRON-1672 Add metron-alerts's UI unit tests > to > >> >> > travis > >> >> > > > build process (justinleet) closes apache/metron#1106 > >> >> > > > 4 weeks ago METRON-1684 Fix Markdown problems in > >> 3rdPartyParser.md > >> >> > > > (justinleet) closes apache/metron#1110 > >> >> > > > 4 weeks ago METRON-1657 Parser aggregation in storm > (justinleet) > >> >> closes > >> >> > > > apache/metron#1099 > >> >> > > > 4 weeks ago METRON-1651 Fixing failing protractor e2e test > >> (tiborm > >> >> via > >> >> > > > merrimanr) closes apache/metron#1095 > >> >> > > > 4 weeks ago METRON-1673 Fix Javadoc errors (justinleet) closes > >> >> > > > apache/metron#1107 > >> >> > > > 4 weeks ago METRON-1620: Fixes for forensic clustering use case > >> >> example > >> >> > > > (mmiklavc via mmiklavc) closes apache/metron#1065 > >> >> > > > 4 weeks ago METRON-1659: The platform-info.sh should check for > >> the > >> >> > > vagrant > >> >> > > > hostmanager plugin closes apache/incubator-metron#1100 > >> >> > > > 4 weeks ago METRON-1658: Upgrade bro to 2.5.4 closes > >> >> > > > apache/incubator-metron#1101 > >> >> > > > 4 weeks ago METRON-1236 Add start/stop/restart commands that > >> execute > >> >> > > > successfully, when ambari agents run as non-root user closes > >> >> > > > apache/incubator-metron#1105 > >> >> > > > 4 weeks ago METRON-1670: Stellar WEEK_OF_YEAR test is locale > >> >> sensitive > >> >> > > > closes apache/incubator-metron#1104 > >> >> > > > 5 weeks ago METRON-1660 On Solr, sorting by threat score fails > >> >> > > (justinleet) > >> >> > > > closes apache/metron#1102 > >> >> > > > 5 weeks ago METRON-1656 Create KAKFA_SEEK function (nickwallen) > >> >> closes > >> >> > > > apache/metron#1097 > >> >> > > > 5 weeks ago METRON-1644: Support parser chaining closes > >> >> > > > apache/incubator-metron#1084 > >> >> > > > 5 weeks ago METRON-1655 Make REGEXP_MATCH take multiple regexs > in > >> >> the > >> >> > 2nd > >> >> > > > arg (ottobackwards) closes apache/metron#1098 > >> >> > > > 6 weeks ago METRON-1643: Create a REGEX_ROUTING field > >> transformation > >> >> > > closes > >> >> > > > apache/incubator-metron#1083 > >> >> > > > 6 weeks ago METRON-1652 Document X-Pack Common Problem > >> (nickwallen) > >> >> > > closes > >> >> > > > apache/metron#1092 > >> >> > > > 6 weeks ago METRON-1649 Intermittent Test Failure > >> >> > > > ProfileBuilderBoltTest#testFlushExpiredProfiles > >> >> > > > (nickwallen) closes apache/metron#1090 > >> >> > > > 6 weeks ago METRON-1635 Alerts UI status update doesn't > >> >> > immediately > >> >> > > > show up (merrimanr) closes apache/metron#1080 > >> >> > > > 6 weeks ago METRON-1642: KafkaWriter should be able choose the > >> topic > >> >> > > from a > >> >> > > > field in addition to topology construction time closes > >> >> > > > apache/incubator-metron#1082 > >> >> > > > 6 weeks ago METRON-1636: Fix broken unit test setup in > >> metron-alerts > >> >> > > closes > >> >> > > > apache/incubator-metron#1085 > >> >> > > > 7 weeks ago METRON-1631 Alerts UI: Dash score does not show if > >> only > >> >> > > > filtering by one group (sardell via merrimanr) closes > >> >> > apache/metron#1079 > >> >> > > > 7 weeks ago METRON-1647 Fix logging level score closes > >> >> > > > apache/incubator-metron#1089 > >> >> > > > 7 weeks ago METRON-1621: Sorting alerts table by score closes > >> >> > > > apache/incubator-metron#1088 > >> >> > > > 7 weeks ago METRON-1619: Stellar empty collections should be > >> >> considered > >> >> > > > false in boolean expressions closes > apache/incubator-metron#1064 > >> >> > > > 7 weeks ago METRON-1646 Sensor Stubs should work when > kerberized > >> >> > > > (nickwallen) closes apache/metron#1087 > >> >> > > > 7 weeks ago METRON-1645: Check wether the Solr management pack > is > >> >> > > installed > >> >> > > > before configuring the solr principal name. closes > >> >> > > > apache/incubator-metron#1086 > >> >> > > > 7 weeks ago Merge branch 'master' into > >> >> feature/METRON-1416-upgrade-solr > >> >> > > > 7 weeks ago METRON-1634 Alerts UI add comment doesn't > >> >> immediately > >> >> > > show > >> >> > > > up. (merrimanr) closes apache/metron#1077 > >> >> > > > 7 weeks ago METRON-1489 Retrofit UI tests to run reliably > during > >> >> > nightly > >> >> > > QE > >> >> > > > runs (sardell via nickwallen) closes apache/metron#1004 > >> >> > > > 7 weeks ago METRON-1637 Wrong path to escalate alert REST > >> endpoint > >> >> > > > (merrimanr) closes apache/metron#1078 > >> >> > > > 8 weeks ago METRON-1624 Set Profiler and Enrichment batch > >> >> parameters in > >> >> > > > Ambari (nickwallen) closes apache/metron#1069 > >> >> > > > 8 weeks ago Merge remote-tracking branch 'origin/master' into > >> >> > > > feature/METRON-1416-upgrade-solr > >> >> > > > 8 weeks ago Merge branch 'master' into > >> >> feature/METRON-1416-upgrade-solr > >> >> > > > (nickwallen) closes apache/metron#1075 > >> >> > > > 8 weeks ago METRON-1629 Update Solr documentation (merrimanr > via > >> >> > > > justinleet) closes apache/metron#1072 > >> >> > > > 8 weeks ago METRON-1633 Incorrect instructions when merging PR > >> into > >> >> > > feature > >> >> > > > branch (nickwallen) closes apache/metron#1074 > >> >> > > > 8 weeks ago METRON-1630 Add threat.triage.score.field to > READMEs > >> >> > > > (merrimanr) closes apache/metron#1073 > >> >> > > > 8 weeks ago METRON-1609 Elasticsearch settings in Ambari should > >> not > >> >> be > >> >> > > > required if Solr is the indexer (nickwallen) closes > >> >> apache/metron#1056 > >> >> > > > 8 weeks ago METRON-1627 Alerts UI: Metaalert details missing in > >> >> details > >> >> > > > panel when trying to add alert to existing metaalert (sardell > via > >> >> > > > justinleet) closes apache/metron#1070 > >> >> > > > 8 weeks ago METRON-1625 Merge master into Solr feature branch > >> >> > (merrimanr) > >> >> > > > closes apache/metron#1067 > >> >> > > > 8 weeks ago METRON-1626 Alerts UI: An empty result is returned > >> when > >> >> > > > searching for a single alert contained in a metaalert (sardell > >> via > >> >> > > > nickwallen) closes apache/metron#1068 > >> >> > > > 8 weeks ago METRON-1611 Increment master version number to > 0.5.1 > >> for > >> >> > > > on-going development (justinleet) closes apache/metron#1057 > >> >> > > > 8 weeks ago METRON-1622 Allow user to define global property > >> >> > > > 'threat.triage.score.field' in Ambari (nickwallen) closes > >> >> > > > apache/metron#1066 > >> >> > > > 8 weeks ago METRON-1599 Allow user to define global property > >> >> > > > 'source.type.field' in Ambari (nickwallen) closes > >> apache/metron#1047 > >> >> > > > 8 weeks ago METRON-1616 Changing alert status fails if no > >> metaalerts > >> >> > have > >> >> > > > been created yet (merrimanr) closes apache/metron#1061 > >> >> > > > 8 weeks ago METRON-1573 Enhance KAFKA_* functions to return > >> >> partition > >> >> > and > >> >> > > > offset details (nickwallen) closes apache/metron#1030 > >> >> > > > 9 weeks ago Merge branch 'master' into > >> >> feature/METRON-1416-upgrade-solr > >> >> > > > 9 weeks ago METRON-1617: Make threat triage score function with > >> >> dots as > >> >> > > > well as colons closes apache/incubator-metron#1062 > >> >> > > > 9 weeks ago METRON-1613 Metaalerts status update broken in > >> Alerts UI > >> >> > > > (merrimanr) closes apache/metron#1059 > >> >> > > > 9 weeks ago Merge branch 'master' into > >> >> feature/METRON-1416-upgrade-solr > >> >> > > > 9 weeks ago METRON-1588 Migrate storm-kafka-client to 1.2.1 > >> closes > >> >> > > > apache/incubator-metron#1039 > >> >> > > > 9 weeks ago Merge branch 'master' into > >> >> feature/METRON-1416-upgrade-solr > >> >> > > > 9 weeks ago Merge branch 'feature/METRON-1416-upgrade-solr' of > >> >> > > > https://git-wip-us.apache.org/repos/asf/metron into > >> >> > > > feature/METRON-1416-upgrade-solr > >> >> > > > 9 weeks ago Merge branch 'master' into > >> >> feature/METRON-1416-upgrade-solr > >> >> > > > 9 weeks ago Merge branch 'master' into > >> >> feature/METRON-1416-upgrade-solr > >> >> > > > 9 weeks ago Merge branch 'master' into > >> >> feature/METRON-1416-upgrade-solr > >> >> > > > 9 weeks ago METRON-1587 Make collection utility work for HDP > >> search > >> >> > > > (merrimanr) closes apache/metron#1043 > >> >> > > > 9 weeks ago METRON-1612 Fix website download links (justinleet) > >> >> closes > >> >> > > > apache/metron#1058 > >> >> > > > 9 weeks ago METRON-1608 Add configuration for > threat.triage.field > >> >> name > >> >> > > > (merrimanr) closes apache/metron#1055 > >> >> > > > 10 weeks ago METRON-1585 SolrRetrieveLatestDao does not use the > >> >> > > collection > >> >> > > > lookup (justinleet via merrimanr) closes apache/metron#1050 > >> >> > > > 10 weeks ago METRON-1533 Create KAFKA_FIND Stellar Function > >> >> > (nickwallen) > >> >> > > > closes apache/metron#1025 > >> >> > > > 10 weeks ago METRON-1601: Rename metaalert alert nested field > to > >> >> > > > metron_alert to avoid collision closes > >> apache/incubator-metron#1049 > >> >> > > > 10 weeks ago METRON-1572 Enhance KAFKA_PUT function > (nickwallen) > >> >> closes > >> >> > > > apache/metron#1024 > >> >> > > > 10 weeks ago METRON-1607 update public web site to point at > 0.5.0 > >> >> new > >> >> > > > release (justinleet) closes apache/metron#1053 > >> >> > > > 10 weeks ago METRON-1568: Stellar should have a _ special > >> variable > >> >> > which > >> >> > > > returns the message in map form closes > >> apache/incubator-metron#1021 > >> >> > > > 2 months ago METRON-1594: KafkaWriter is asynchronous and may > >> lose > >> >> data > >> >> > > on > >> >> > > > node failure (mmiklavc via mmiklavc) closes apache/metron#1045 > >> >> > > > 2 months ago METRON-1603: Fix multivalue field errors in Bro > Solr > >> >> > schema > >> >> > > > (mmiklavc via mmiklavc) closes apache/metron#1051 > >> >> > > > 2 months ago METRON-1584 Indexing Topology Crashes with Invalid > >> >> Message > >> >> > > > (nickwallen) closes apache/metron#1036 > >> >> > > > 2 months ago METRON-1547 Solr Comment Fields (justinleet) > closes > >> >> > > > apache/metron#1037 > >> >> > > > 2 months ago METRON-1553 Validate JIRA Script Error > (nickwallen) > >> >> closes > >> >> > > > apache/metron#1013 > >> >> > > > 2 months ago METRON-1592 Unable to use third party parser with > >> Storm > >> >> > > > versions >= 1.1.0 (nickwallen) closes apache/metron#1042 > >> >> > > > 2 months ago METRON-1598 NoClassDefFoundError when running with > >> >> > > > Elasticsearch X-Pack (nickwallen) closes apache/metron#1048 > >> >> > > > 2 months ago METRON-1589 '/api/v1/search/search' fails when > 'Solr > >> >> > > Zookeeper > >> >> > > > Urls' has comma separated multiple zookeeper urls (justinleet) > >> >> closes > >> >> > > > apache/metron#1040 > >> >> > > > 2 months ago METRON-1593 Setting Metron rest additional > classpath > >> >> > removes > >> >> > > > HBase and Hadoop configs from classpath (merrimanr) closes > >> >> > > > apache/metron#1044 > >> >> > > > 3 months ago METRON-1571 Correct KAFKA_TAIL Seek to End Logic > >> >> > > (nickwallen) > >> >> > > > closes apache/metron#1023 > >> >> > > > 3 months ago METRON-1579: Stellar should return the expression > >> that > >> >> > > failed > >> >> > > > in the exception closes apache/incubator-metron#1033 > >> >> > > > 3 months ago METRON-1586 Defaulting for the source type field > in > >> >> alerts > >> >> > > UI > >> >> > > > does not work (merrimanr via justinleet) closes > >> apache/metron#1038 > >> >> > > > 3 months ago METRON-1569: Allow user to change field name > >> conversion > >> >> > when > >> >> > > > indexing to Elasticsearch (nickwallen via mmiklavc) closes > >> >> > > > apache/metron#1022 > >> >> > > > 3 months ago METRON-1544 Flaky test: > >> >> org.apache.metron.stellar.common. > >> >> > > > CachingStellarProcessorTest#testCaching (nickwallen) closes > >> >> > > > apache/metron#1015 > >> >> > > > 3 months ago METRON-1580 Release candidate check script > requires > >> Bro > >> >> > > Plugin > >> >> > > > (nickwallen via ottobackwards) closes apache/metron#1034 > >> >> > > > 3 months ago METRON-1532 Getting started documentation > >> improvements > >> >> > > > (sardell via nickwallen) closes apache/metron#1001 > >> >> > > > 3 months ago METRON-1577 Solr searches don't include the > >> index > >> >> of > >> >> > > the > >> >> > > > result (merrimanr) closes apache/metron#1031 > >> >> > > > 3 months ago METRON-1421 Create a SolrMetaAlertDao (justinleet) > >> >> closes > >> >> > > > apache/metron#970 > >> >> > > > 3 months ago Merge branch 'master' into > >> >> > feature/METRON-1416-upgrade-solr > >> >> > > > 3 months ago METRON-1567 Large error message can't be > >> written > >> >> in > >> >> > > Solr > >> >> > > > (justinleet) closes apache/metron#1020 > >> >> > > > 4 months ago METRON-1540 Solr Integration tests should use > actual > >> >> > schemas > >> >> > > > (justinleet) closes apache/metron#1005 > >> >> > > > 4 months ago Merge remote-tracking branch 'origin/master' into > >> >> > > > feature/METRON-1416-upgrade-solr > >> >> > > > 4 months ago METRON-1526 Location field types cause > >> DocValuesField > >> >> > appear > >> >> > > > more than once error (merrimanr via justinleet) closes > >> >> > apache/metron#995 > >> >> > > > 4 months ago METRON-1503 Alerts are not getting populated in > >> alerts > >> >> UI > >> >> > > when > >> >> > > > search engine is Solr (merrimanr) closes apache/metron#975 > >> >> > > > 5 months ago METRON-1424 Kerberos: Solr (merrimanr) closes > >> >> > > > apache/metron#960 > >> >> > > > 5 months ago METRON-1482 Update REST to work with Solr > >> (merrimanr) > >> >> > closes > >> >> > > > apache/metron#957 > >> >> > > > 5 months ago METRON-1464 Convert schemas to be compatible with > >> Solr > >> >> > 5.5.2 > >> >> > > > (merrimanr) closes apache/metron#945 > >> >> > > > 6 months ago METRON-1423 Ambari work to handle Solr > configuration > >> >> > > > (merrimanr) closes apache/metron#934 > >> >> > > > 6 months ago Merge branch 'master' into > >> >> > feature/METRON-1416-upgrade-solr > >> >> > > > 6 months ago METRON-1448: Update SolrWriter to conform to new > >> >> > collection > >> >> > > > strategy this closes apache/incubator-metron#929 > >> >> > > > 6 months ago Merge branch 'master' into > >> >> > feature/METRON-1416-upgrade-solr > >> >> > > > 6 months ago Merge branch 'master' into > >> >> > feature/METRON-1416-upgrade-solr > >> >> > > > 6 months ago METRON-1441: Create complementary Solr schemas for > >> the > >> >> > main > >> >> > > > sensors this closes apache/metron#922 > >> >> > > > 6 months ago METRON-1436: Manually Install Solr Cloud in Full > Dev > >> >> > > (mmiklavc > >> >> > > > via mmiklavc) closes apache/metron#918 > >> >> > > > 7 months ago METRON-1419: Create a SolrDao this closes > >> >> > > > apache/incubator-metron#911 > >> >> > > > > >> >> > > > > >> >> > > > > >> >> > > > On Wed, Aug 15, 2018 at 9:48 AM, zeo...@gmail.com < > >> zeo...@gmail.com > >> >> > > >> >> > > > wrote: > >> >> > > > > >> >> > > > > I agree - I would love to see a release not long after the > >> PCAP FB > >> >> > gets > >> >> > > > > into master, and 0.6.0 makes sense to me. > >> >> > > > > > >> >> > > > > I'd also like to see a 0.2 release of > metron-bro-plugin-kafka. > >> >> There > >> >> > > is > >> >> > > > > one new commit, and I have a PR open which is waiting on some > >> >> tests > >> >> > > > before > >> >> > > > > it's ready to be evaluated/merged. I will try to get that > work > >> >> done > >> >> > > > asap. > >> >> > > > > As of right now metron's dev ansible scripts pin to a > specific > >> >> > release > >> >> > > of > >> >> > > > > metron-bro-plugin-kafka (0.1 > >> >> > > > > <0.1https://github.com/apache/metron/blob/master/metron- > >> >> > > > > deployment/ansible/roles/bro/vars/main.yml>), > >> >> > > > > and I'm fine leaving that as is until after the coming > release, > >> >> but > >> >> > we > >> >> > > > > could also do a metron-bro-plugin-kafka release first and > then > >> >> update > >> >> > > > > metron to point the dev environment to the new package prior > to > >> >> the > >> >> > > > > upcoming RC. > >> >> > > > > > >> >> > > > > I would also like to discuss what the roadmap looks like for > a > >> 1.0 > >> >> > > > release > >> >> > > > > and perhaps a more regular release schedule. I have some > >> thoughts > >> >> > but > >> >> > > > > don't want to hijack this thread. > >> >> > > > > > >> >> > > > > Jon > >> >> > > > > > >> >> > > > > On Wed, Aug 15, 2018 at 9:11 AM Justin Leet < > >> >> justinjl...@gmail.com> > >> >> > > > wrote: > >> >> > > > > > >> >> > > > > > Hi all, > >> >> > > > > > > >> >> > > > > > It's been a little while since the last release, and a > couple > >> >> major > >> >> > > > items > >> >> > > > > > have gone in since then (or are hopefully close to going > >> in!). > >> >> In > >> >> > > > > > particular, I'd personally like to see a release with our > >> Solr > >> >> work > >> >> > > > > > <https://issues.apache.org/jira/browse/METRON-1416> and > the > >> >> > > > > > close-to-completion PCAP Query Panel > >> >> > > > > > <https://issues.apache.org/jira/browse/METRON-1554>. > There > >> is > >> >> a > >> >> > > > thread > >> >> > > > > > < > >> >> > > > > > > >> >> > > https://lists.apache.org/thread.html/94ebc9be23f6f2ec8c53f8f6b71e97 > >> >> > > > > d6919baf415caf534e2b25ba9b@%3Cdev.metron.apache.org%3E > >> >> > > > > > > > >> >> > > > > > around what's left before merging the PCAP feature branch, > I > >> >> > > encourage > >> >> > > > > you > >> >> > > > > > to take a look. There are also some nice-to-haves as well > as > >> >> some > >> >> > > > Apache > >> >> > > > > > cleanup around the RAT tool and typescript files > >> >> > > > > > <https://github.com/apache/metron/pull/1126>. > >> >> > > > > > > >> >> > > > > > Version Number > >> >> > > > > > I'm proposing bumping to 0.6.0, in particular because of > the > >> >> Solr > >> >> > and > >> >> > > > > PCAP > >> >> > > > > > efforts. We can adjust that as necessary. > >> >> > > > > > > >> >> > > > > > I'm proposing we release this from the Metron master > branch, > >> >> plus > >> >> > any > >> >> > > > > > commits the community considers necessary. Note that I'm > >> >> proposing > >> >> > > > that > >> >> > > > > > this release occur after the PCAP feature branch is merged > >> into > >> >> > > master. > >> >> > > > > > > >> >> > > > > > Proposed Timeframe > >> >> > > > > > I would tentatively like to start work on the RC Wednesday, > >> >> > September > >> >> > > > > 5th. > >> >> > > > > > It's a little further out than usual, but I wanted to kick > >> off > >> >> the > >> >> > > > > > discussion before Labor Day and to give ongoing time to > >> settle. > >> >> > And > >> >> > > > also > >> >> > > > > > because I'll be unavailable around Labor Day. > >> >> > > > > > > >> >> > > > > > JIRA Status > >> >> > > > > > There are 31 open PRs at > >> https://github.com/apache/metron/pulls > >> >> . > >> >> > We > >> >> > > > > should > >> >> > > > > > work on getting anything we feel merits inclusion closed > out. > >> >> > Please > >> >> > > > > > respond with any tickets we'd like included. > >> >> > > > > > > >> >> > > > > > A couple of these are for the PCAP feature branch, and > there > >> >> will > >> >> > be > >> >> > > at > >> >> > > > > > least one more for documentation. > >> >> > > > > > > >> >> > > > > > There will be updates necessary to get our Jira up to date. > >> >> I'll > >> >> > > > follow > >> >> > > > > up > >> >> > > > > > on that, and ask that everyone double check their tickets. > >> >> > > > > > > >> >> > > > > > There have been 106 commits since the 0.5.0 release (listed > >> at > >> >> the > >> >> > > end > >> >> > > > of > >> >> > > > > > message). There will be a few more when we pull in the PCAP > >> >> feature > >> >> > > > > branch. > >> >> > > > > > > >> >> > > > > > Completed PRs as of Aug 15 as generated by git log > >> --pretty="%cr > >> >> > %s" > >> >> > > > > > tags/apache-metron-0.5.0-release..HEAD. > >> >> > > > > > > >> >> > > > > > 5 days ago METRON-1730: Update steps to run pycapa on > Centos > >> 6 > >> >> > > > (mmiklavc > >> >> > > > > > via mmiklavc) closes apache/metron#1152 > >> >> > > > > > 13 days ago METRON-1701 Update General notes on the > >> >> installation of > >> >> > > > > Pycapa > >> >> > > > > > on Kerberized cluster (MohanDV via nickwallen) closes > >> >> > > > apache/metron#1136 > >> >> > > > > > 3 weeks ago METRON-1650 Packaging docker containers are too > >> >> large > >> >> > > > > > (jameslamb via merrimanr) closes apache/metron#1091 > >> >> > > > > > 3 weeks ago METRON-1604 : Add RHEL 7 power pc to OS family > >> for > >> >> the > >> >> > > HCP > >> >> > > > > > management pack repo info closes > apache/incubator-metron#1052 > >> >> > > > > > 3 weeks ago METRON-1687: Upgrade the rat plugin to > >> 0.13-SNAPSHOT > >> >> > > closes > >> >> > > > > > apache/incubator-metron#1126 > >> >> > > > > > 3 weeks ago METRON-1694: Clean up Metron REST docs closes > >> >> > > > > > apache/incubator-metron#1131 > >> >> > > > > > 4 weeks ago METRON-1606 Add a 'wrap' to incoming > >> >> messages > >> >> > > in > >> >> > > > > the > >> >> > > > > > metron json parser (ottobackwards) closes > apache/metron#1054 > >> >> > > > > > 4 weeks ago METRON-1672 Add metron-alerts's UI unit > >> tests > >> >> to > >> >> > > > travis > >> >> > > > > > build process (justinleet) closes apache/metron#1106 > >> >> > > > > > 4 weeks ago METRON-1684 Fix Markdown problems in > >> >> 3rdPartyParser.md > >> >> > > > > > (justinleet) closes apache/metron#1110 > >> >> > > > > > 4 weeks ago METRON-1657 Parser aggregation in storm > >> (justinleet) > >> >> > > closes > >> >> > > > > > apache/metron#1099 > >> >> > > > > > 4 weeks ago METRON-1651 Fixing failing protractor e2e test > >> >> (tiborm > >> >> > > via > >> >> > > > > > merrimanr) closes apache/metron#1095 > >> >> > > > > > 4 weeks ago METRON-1673 Fix Javadoc errors (justinleet) > >> closes > >> >> > > > > > apache/metron#1107 > >> >> > > > > > 4 weeks ago METRON-1620: Fixes for forensic clustering use > >> case > >> >> > > example > >> >> > > > > > (mmiklavc via mmiklavc) closes apache/metron#1065 > >> >> > > > > > 4 weeks ago METRON-1659: The platform-info.sh should check > >> for > >> >> the > >> >> > > > > vagrant > >> >> > > > > > hostmanager plugin closes apache/incubator-metron#1100 > >> >> > > > > > 4 weeks ago METRON-1658: Upgrade bro to 2.5.4 closes > >> >> > > > > > apache/incubator-metron#1101 > >> >> > > > > > 4 weeks ago METRON-1236 Add start/stop/restart commands > that > >> >> > execute > >> >> > > > > > successfully, when ambari agents run as non-root user > closes > >> >> > > > > > apache/incubator-metron#1105 > >> >> > > > > > 4 weeks ago METRON-1670: Stellar WEEK_OF_YEAR test is > locale > >> >> > > sensitive > >> >> > > > > > closes apache/incubator-metron#1104 > >> >> > > > > > 5 weeks ago METRON-1660 On Solr, sorting by threat score > >> fails > >> >> > > > > (justinleet) > >> >> > > > > > closes apache/metron#1102 > >> >> > > > > > 5 weeks ago METRON-1656 Create KAKFA_SEEK function > >> (nickwallen) > >> >> > > closes > >> >> > > > > > apache/metron#1097 > >> >> > > > > > 5 weeks ago METRON-1644: Support parser chaining closes > >> >> > > > > > apache/incubator-metron#1084 > >> >> > > > > > 5 weeks ago METRON-1655 Make REGEXP_MATCH take multiple > >> regexs > >> >> in > >> >> > the > >> >> > > > 2nd > >> >> > > > > > arg (ottobackwards) closes apache/metron#1098 > >> >> > > > > > 6 weeks ago METRON-1643: Create a REGEX_ROUTING field > >> >> > transformation > >> >> > > > > closes > >> >> > > > > > apache/incubator-metron#1083 > >> >> > > > > > 6 weeks ago METRON-1652 Document X-Pack Common Problem > >> >> (nickwallen) > >> >> > > > > closes > >> >> > > > > > apache/metron#1092 > >> >> > > > > > 6 weeks ago METRON-1649 Intermittent Test Failure > >> >> > > > > > ProfileBuilderBoltTest#testFlushExpiredProfiles > (nickwallen) > >> >> closes > >> >> > > > > > apache/metron#1090 > >> >> > > > > > 6 weeks ago METRON-1635 Alerts UI status update > doesn't > >> >> > > > immediately > >> >> > > > > > show up (merrimanr) closes apache/metron#1080 > >> >> > > > > > 6 weeks ago METRON-1642: KafkaWriter should be able choose > >> the > >> >> > topic > >> >> > > > > from a > >> >> > > > > > field in addition to topology construction time closes > >> >> > > > > > apache/incubator-metron#1082 > >> >> > > > > > 6 weeks ago METRON-1636: Fix broken unit test setup in > >> >> > metron-alerts > >> >> > > > > closes > >> >> > > > > > apache/incubator-metron#1085 > >> >> > > > > > 7 weeks ago METRON-1631 Alerts UI: Dash score does not show > >> if > >> >> only > >> >> > > > > > filtering by one group (sardell via merrimanr) closes > >> >> > > > apache/metron#1079 > >> >> > > > > > 7 weeks ago METRON-1647 Fix logging level score closes > >> >> > > > > > apache/incubator-metron#1089 > >> >> > > > > > 7 weeks ago METRON-1621: Sorting alerts table by score > closes > >> >> > > > > > apache/incubator-metron#1088 > >> >> > > > > > 7 weeks ago METRON-1619: Stellar empty collections should > be > >> >> > > considered > >> >> > > > > > false in boolean expressions closes > >> apache/incubator-metron#1064 > >> >> > > > > > 7 weeks ago METRON-1646 Sensor Stubs should work when > >> kerberized > >> >> > > > > > (nickwallen) closes apache/metron#1087 > >> >> > > > > > 7 weeks ago METRON-1645: Check wether the Solr management > >> pack > >> >> is > >> >> > > > > installed > >> >> > > > > > before configuring the solr principal name. closes > >> >> > > > > > apache/incubator-metron#1086 > >> >> > > > > > 7 weeks ago Merge branch 'master' into > >> >> > > feature/METRON-1416-upgrade-solr > >> >> > > > > > 7 weeks ago METRON-1634 Alerts UI add comment doesn't > >> >> > > immediately > >> >> > > > > show > >> >> > > > > > up. (merrimanr) closes apache/metron#1077 > >> >> > > > > > 7 weeks ago METRON-1489 Retrofit UI tests to run reliably > >> during > >> >> > > > nightly > >> >> > > > > QE > >> >> > > > > > runs (sardell via nickwallen) closes apache/metron#1004 > >> >> > > > > > 7 weeks ago METRON-1637 Wrong path to escalate alert REST > >> >> endpoint > >> >> > > > > > (merrimanr) closes apache/metron#1078 > >> >> > > > > > 8 weeks ago METRON-1624 Set Profiler and Enrichment batch > >> >> > parameters > >> >> > > in > >> >> > > > > > Ambari (nickwallen) closes apache/metron#1069 > >> >> > > > > > 8 weeks ago Merge remote-tracking branch 'origin/master' > into > >> >> > > > > > feature/METRON-1416-upgrade-solr > >> >> > > > > > 8 weeks ago Merge branch 'master' into > >> >> > > feature/METRON-1416-upgrade-solr > >> >> > > > > > (nickwallen) closes apache/metron#1075 > >> >> > > > > > 8 weeks ago METRON-1629 Update Solr documentation > (merrimanr > >> via > >> >> > > > > > justinleet) closes apache/metron#1072 > >> >> > > > > > 8 weeks ago METRON-1633 Incorrect instructions when merging > >> PR > >> >> into > >> >> > > > > feature > >> >> > > > > > branch (nickwallen) closes apache/metron#1074 > >> >> > > > > > 8 weeks ago METRON-1630 Add threat.triage.score.field to > >> READMEs > >> >> > > > > > (merrimanr) closes apache/metron#1073 > >> >> > > > > > 8 weeks ago METRON-1609 Elasticsearch settings in Ambari > >> should > >> >> not > >> >> > > be > >> >> > > > > > required if Solr is the indexer (nickwallen) closes > >> >> > > apache/metron#1056 > >> >> > > > > > 8 weeks ago METRON-1627 Alerts UI: Metaalert details > missing > >> in > >> >> > > details > >> >> > > > > > panel when trying to add alert to existing metaalert > (sardell > >> >> via > >> >> > > > > > justinleet) closes apache/metron#1070 > >> >> > > > > > 8 weeks ago METRON-1625 Merge master into Solr feature > branch > >> >> > > > (merrimanr) > >> >> > > > > > closes apache/metron#1067 > >> >> > > > > > 8 weeks ago METRON-1626 Alerts UI: An empty result is > >> returned > >> >> when > >> >> > > > > > searching for a single alert contained in a metaalert > >> (sardell > >> >> via > >> >> > > > > > nickwallen) closes apache/metron#1068 > >> >> > > > > > 8 weeks ago METRON-1611 Increment master version number to > >> 0.5.1 > >> >> > for > >> >> > > > > > on-going development (justinleet) closes apache/metron#1057 > >> >> > > > > > 8 weeks ago METRON-1622 Allow user to define global > property > >> >> > > > > > 'threat.triage.score.field' in Ambari (nickwallen) closes > >> >> > > > > > apache/metron#1066 > >> >> > > > > > 8 weeks ago METRON-1599 Allow user to define global > property > >> >> > > > > > 'source.type.field' in Ambari (nickwallen) closes > >> >> > apache/metron#1047 > >> >> > > > > > 8 weeks ago METRON-1616 Changing alert status fails if no > >> >> > metaalerts > >> >> > > > have > >> >> > > > > > been created yet (merrimanr) closes apache/metron#1061 > >> >> > > > > > 8 weeks ago METRON-1573 Enhance KAFKA_* functions to return > >> >> > partition > >> >> > > > and > >> >> > > > > > offset details (nickwallen) closes apache/metron#1030 > >> >> > > > > > 9 weeks ago Merge branch 'master' into > >> >> > > feature/METRON-1416-upgrade-solr > >> >> > > > > > 9 weeks ago METRON-1617: Make threat triage score function > >> with > >> >> > dots > >> >> > > as > >> >> > > > > > well as colons closes apache/incubator-metron#1062 > >> >> > > > > > 9 weeks ago METRON-1613 Metaalerts status update broken in > >> >> Alerts > >> >> > UI > >> >> > > > > > (merrimanr) closes apache/metron#1059 > >> >> > > > > > 9 weeks ago Merge branch 'master' into > >> >> > > feature/METRON-1416-upgrade-solr > >> >> > > > > > 9 weeks ago METRON-1588 Migrate storm-kafka-client to 1.2.1 > >> >> closes > >> >> > > > > > apache/incubator-metron#1039 > >> >> > > > > > 9 weeks ago Merge branch 'master' into > >> >> > > feature/METRON-1416-upgrade-solr > >> >> > > > > > 9 weeks ago Merge branch 'feature/METRON-1416-upgrade-solr' > >> of > >> >> > > > > > https://git-wip-us.apache.org/repos/asf/metron into > >> >> > > > > > feature/METRON-1416-upgrade-solr > >> >> > > > > > 9 weeks ago Merge branch 'master' into > >> >> > > feature/METRON-1416-upgrade-solr > >> >> > > > > > 9 weeks ago Merge branch 'master' into > >> >> > > feature/METRON-1416-upgrade-solr > >> >> > > > > > 9 weeks ago Merge branch 'master' into > >> >> > > feature/METRON-1416-upgrade-solr > >> >> > > > > > 9 weeks ago METRON-1587 Make collection utility work for > HDP > >> >> search > >> >> > > > > > (merrimanr) closes apache/metron#1043 > >> >> > > > > > 9 weeks ago METRON-1612 Fix website download links > >> (justinleet) > >> >> > > closes > >> >> > > > > > apache/metron#1058 > >> >> > > > > > 9 weeks ago METRON-1608 Add configuration for > >> >> threat.triage.field > >> >> > > name > >> >> > > > > > (merrimanr) closes apache/metron#1055 > >> >> > > > > > 10 weeks ago METRON-1585 SolrRetrieveLatestDao does not use > >> the > >> >> > > > > collection > >> >> > > > > > lookup (justinleet via merrimanr) closes apache/metron#1050 > >> >> > > > > > 10 weeks ago METRON-1533 Create KAFKA_FIND Stellar Function > >> >> > > > (nickwallen) > >> >> > > > > > closes apache/metron#1025 > >> >> > > > > > 10 weeks ago METRON-1601: Rename metaalert alert nested > >> field to > >> >> > > > > > metron_alert to avoid collision closes > >> >> apache/incubator-metron#1049 > >> >> > > > > > 10 weeks ago METRON-1572 Enhance KAFKA_PUT function > >> (nickwallen) > >> >> > > closes > >> >> > > > > > apache/metron#1024 > >> >> > > > > > 10 weeks ago METRON-1607 update public web site to point at > >> >> 0.5.0 > >> >> > new > >> >> > > > > > release (justinleet) closes apache/metron#1053 > >> >> > > > > > 10 weeks ago METRON-1568: Stellar should have a _ special > >> >> variable > >> >> > > > which > >> >> > > > > > returns the message in map form closes > >> >> apache/incubator-metron#1021 > >> >> > > > > > 10 weeks ago METRON-1594: KafkaWriter is asynchronous and > may > >> >> lose > >> >> > > data > >> >> > > > > on > >> >> > > > > > node failure (mmiklavc via mmiklavc) closes > >> apache/metron#1045 > >> >> > > > > > 10 weeks ago METRON-1603: Fix multivalue field errors in > Bro > >> >> Solr > >> >> > > > schema > >> >> > > > > > (mmiklavc via mmiklavc) closes apache/metron#1051 > >> >> > > > > > 10 weeks ago METRON-1584 Indexing Topology Crashes with > >> Invalid > >> >> > > Message > >> >> > > > > > (nickwallen) closes apache/metron#1036 > >> >> > > > > > 2 months ago METRON-1547 Solr Comment Fields (justinleet) > >> closes > >> >> > > > > > apache/metron#1037 > >> >> > > > > > 2 months ago METRON-1553 Validate JIRA Script Error > >> (nickwallen) > >> >> > > closes > >> >> > > > > > apache/metron#1013 > >> >> > > > > > 2 months ago METRON-1592 Unable to use third party parser > >> with > >> >> > Storm > >> >> > > > > > versions >= 1.1.0 (nickwallen) closes apache/metron#1042 > >> >> > > > > > 2 months ago METRON-1598 NoClassDefFoundError when running > >> with > >> >> > > > > > Elasticsearch X-Pack (nickwallen) closes apache/metron#1048 > >> >> > > > > > 2 months ago METRON-1589 '/api/v1/search/search' fails when > >> >> 'Solr > >> >> > > > > Zookeeper > >> >> > > > > > Urls' has comma separated multiple zookeeper urls > >> (justinleet) > >> >> > closes > >> >> > > > > > apache/metron#1040 > >> >> > > > > > 2 months ago METRON-1593 Setting Metron rest additional > >> >> classpath > >> >> > > > removes > >> >> > > > > > HBase and Hadoop configs from classpath (merrimanr) closes > >> >> > > > > > apache/metron#1044 > >> >> > > > > > 2 months ago METRON-1571 Correct KAFKA_TAIL Seek to End > Logic > >> >> > > > > (nickwallen) > >> >> > > > > > closes apache/metron#1023 > >> >> > > > > > 3 months ago METRON-1579: Stellar should return the > >> expression > >> >> that > >> >> > > > > failed > >> >> > > > > > in the exception closes apache/incubator-metron#1033 > >> >> > > > > > 3 months ago METRON-1586 Defaulting for the source type > >> field in > >> >> > > alerts > >> >> > > > > UI > >> >> > > > > > does not work (merrimanr via justinleet) closes > >> >> apache/metron#1038 > >> >> > > > > > 3 months ago METRON-1569: Allow user to change field name > >> >> > conversion > >> >> > > > when > >> >> > > > > > indexing to Elasticsearch (nickwallen via mmiklavc) closes > >> >> > > > > > apache/metron#1022 > >> >> > > > > > 3 months ago METRON-1544 Flaky test: > >> >> > > > > > > >> >> > > > > >> >> > > >> org.apache.metron.stellar.common.CachingStellarProcessorTest#testCaching > >> >> > > > > > (nickwallen) closes apache/metron#1015 > >> >> > > > > > 3 months ago METRON-1580 Release candidate check script > >> requires > >> >> > Bro > >> >> > > > > Plugin > >> >> > > > > > (nickwallen via ottobackwards) closes apache/metron#1034 > >> >> > > > > > 3 months ago METRON-1532 Getting started documentation > >> >> improvements > >> >> > > > > > (sardell via nickwallen) closes apache/metron#1001 > >> >> > > > > > 3 months ago METRON-1577 Solr searches don't include > the > >> >> index > >> >> > > of > >> >> > > > > the > >> >> > > > > > result (merrimanr) closes apache/metron#1031 > >> >> > > > > > 3 months ago METRON-1421 Create a SolrMetaAlertDao > >> (justinleet) > >> >> > > closes > >> >> > > > > > apache/metron#970 > >> >> > > > > > 3 months ago Merge branch 'master' into > >> >> > > > feature/METRON-1416-upgrade-solr > >> >> > > > > > 3 months ago METRON-1567 Large error message can't be > >> >> written > >> >> > in > >> >> > > > > Solr > >> >> > > > > > (justinleet) closes apache/metron#1020 > >> >> > > > > > 3 months ago METRON-1540 Solr Integration tests should use > >> >> actual > >> >> > > > schemas > >> >> > > > > > (justinleet) closes apache/metron#1005 > >> >> > > > > > 4 months ago Merge remote-tracking branch 'origin/master' > >> into > >> >> > > > > > feature/METRON-1416-upgrade-solr > >> >> > > > > > 4 months ago METRON-1526 Location field types cause > >> >> DocValuesField > >> >> > > > appear > >> >> > > > > > more than once error (merrimanr via justinleet) closes > >> >> > > > apache/metron#995 > >> >> > > > > > 4 months ago METRON-1503 Alerts are not getting populated > in > >> >> alerts > >> >> > > UI > >> >> > > > > when > >> >> > > > > > search engine is Solr (merrimanr) closes apache/metron#975 > >> >> > > > > > 5 months ago METRON-1424 Kerberos: Solr (merrimanr) closes > >> >> > > > > > apache/metron#960 > >> >> > > > > > 5 months ago METRON-1482 Update REST to work with Solr > >> >> (merrimanr) > >> >> > > > closes > >> >> > > > > > apache/metron#957 > >> >> > > > > > 5 months ago METRON-1464 Convert schemas to be compatible > >> with > >> >> Solr > >> >> > > > 5.5.2 > >> >> > > > > > (merrimanr) closes apache/metron#945 > >> >> > > > > > 6 months ago METRON-1423 Ambari work to handle Solr > >> >> configuration > >> >> > > > > > (merrimanr) closes apache/metron#934 > >> >> > > > > > 6 months ago Merge branch 'master' into > >> >> > > > feature/METRON-1416-upgrade-solr > >> >> > > > > > 6 months ago METRON-1448: Update SolrWriter to conform to > new > >> >> > > > collection > >> >> > > > > > strategy this closes apache/incubator-metron#929 > >> >> > > > > > 6 months ago Merge branch 'master' into > >> >> > > > feature/METRON-1416-upgrade-solr > >> >> > > > > > 6 months ago Merge branch 'master' into > >> >> > > > feature/METRON-1416-upgrade-solr > >> >> > > > > > 6 months ago METRON-1441: Create complementary Solr schemas > >> for > >> >> the > >> >> > > > main > >> >> > > > > > sensors this closes apache/metron#922 > >> >> > > > > > 6 months ago METRON-1436: Manually Install Solr Cloud in > Full > >> >> Dev > >> >> > > > > (mmiklavc > >> >> > > > > > via mmiklavc) closes apache/metron#918 > >> >> > > > > > 6 months ago METRON-1419: Create a SolrDao this closes > >> >> > > > > > apache/incubator-metron#911 > >> >> > > > > > > >> >> > > > > -- > >> >> > > > > > >> >> > > > > Jon > >> >> > > > > > >> >> > > > > >> >> > > > >> >> > > >> >> > >> > > >> > > -- > > > > Jon > > > -- > > Jon >
