Migrating the ES client, refactoring parser bolt. There are some interface changes in flight right now that I think would be beneficial to see in the next release.
On Tue, Oct 16, 2018 at 2:01 PM Nick Allen <n...@nickallen.org> wrote: > I am in favor of a release for both. > > There are a lot of really useful bug fixes, management of pcap through > Ambari, more flexibility for configuring JAAS in Ambari, increased > Elasticsearch performance, the Syslog parser, and the Batch Profiler, among > others. I would be happy with calling it a 0.6.1 point release. > > Mike - What is outstanding that you would like to see in the release? > > On Tue, Oct 16, 2018, 12:21 PM Michael Miklavcic < > michael.miklav...@gmail.com> wrote: > > > I'd be +1 on going with just the metron-bro-kafka-plugin release. It > seems > > like it's ready to go, and I think there are a few more things I'd like > to > > see get into our next Metron release so I'm good with holding off there. > > > > Mike > > > > On Tue, Oct 16, 2018 at 10:26 AM Justin Leet <justinjl...@gmail.com> > > wrote: > > > > > Hi all, > > > > > > As you might recall from a prior discussion about release cadence, we > > were > > > interested in initiating release threads near our board reports to see > if > > > we wanted to do releases or not. Additionally, the work is done to do > two > > > separate releases, so our options are releasing both, a single one, or > > > neither. > > > > > > Having said that, a metron-bro-kafka-plugin 0.3.0 release came up on > this > > > thread > > > < > > > > > > https://lists.apache.org/thread.html/3c18c3aba6b436b11032831e7db541d50eb7cb1e3ae54b7423057c88@%3Cdev.metron.apache.org%3E > > > >. > > > In particular, the prospect of a release came up in the context of > > having a > > > version with better (and working) testing. > > > > > > Version Number > > > If we choose to do a core Metron release, I propose 0.6.1. For > > > metron-bro-kafka-plugin, I propose 0.3.0. Keep in mind, the versioning > > for > > > the plugin is a bit different in that we need x.y for bro-pkg, instead > of > > > x.y.z, so we wouldn't release 0.2.1. > > > > > > I would personally be in favor of doing a plugin release, but I'm less > > > inclined to do a core Metron release. > > > > > > For Metron, I believe the main feature is the batch profiler work, but > > > there's a fair amount of fixes and improvements. > > > > > > For the plugin, I believe the main improvements would be around the > > fixing > > > our testing and more maintenance type work. > > > > > > JIRA status > > > *metron* > > > There are 24 opens PRs at https://github.com/apache/metron/pulls. If > we > > > do > > > decide to release, we should work on getting anything meriting > inclusion > > > closed out. > > > > > > There have been 49 commits since the 0.6.0 release (listed at the end > of > > > the message). This assumes a release from master. > > > > > > *metron-bro-kafka-plugin* > > > There are 6 open PRs at > > > https://github.com/apache/metron-bro-plugin-kafka/pulls. If we do > > decide > > > to release, we should get anything we need closed out. > > > > > > There have been 2 commits since the 0.2.0 release (listed at the end of > > the > > > message). This assumes a release from master. > > > > > > *Metron changelog* > > > METRON-1801 Allow Customization of Elasticsearch Document ID > > > (nickwallen) closes apache/metron#1218 > > > METRON-1799 Remove outdated bylaws from site. (justinleet) closes > > > apache/metron#1216 > > > METRON-1769 Script creation of a release candidate (justinleet) > > closes > > > apache/metron#1188 > > > METRON-1761 Allow a grok statement to be applied to each line in a > > > file. (ottobackwards) closes apache/metron#1184 > > > METRON-1813 Stellar REPL Not Initialized with Client JAAS > > (nickwallen) > > > closes apache/metron#1232 > > > METRON-1812: Fix dependencies_with_url.csv (mmiklavc via mmiklavc) > > > closes apache/metron#1230 > > > METRON-1811 Alert Search Fails When Sorting by Alert Status > > (merrimanr) > > > closes apache/metron#1231 > > > METRON-1809 Support Column Oriented Input with Batch Profiler > > > (nickwallen) closes apache/metron#1229 > > > METRON-1806: Upgrade Maven Shade Plugin version (mmiklavc via > > mmiklavc) > > > closes apache/metron#1224 > > > METRON-1792 Simplify Profile Definitions in Integration Tests > > > (nickwallen) closes apache/metron#1211 > > > METRON-1807 Auto populate the recommended values to some of the > > metron > > > config parameters (MohanDV via merrimanr) closes apache/metron#1227 > > > METRON-1808 Add Ansible created pyc to gitignore (justinleet) > closes > > > apache/metron#1228 > > > METRON-1695 Expose pcap properties through Ambari (anandsubbu) > closes > > > apache/metron#1207 > > > METRON-1771 Update REST endpoints to support eventually consistent > UI > > > updates (merrimanr) closes apache/metron#1190 > > > METRON-1791 Add GUID to Messages Produced by Profiler (nickwallen) > > > closes apache/metron#1210 > > > METRON-1804 Update version to 0.6.1 (justinleet) closes > > > apache/metron#1220 > > > METRON-1798 Add mpack support for parser aggregation (anandsubbu) > > > closes apache/metron#1215 > > > METRON-1750 Create Parser for Syslog RFC 5424 Messages > > (ottobackwards) > > > closes apache/metron#1175 > > > METRON-1794 Include User Details When Escalating Alerts > (nickwallen) > > > closes apache/metron#1212 > > > METRON-1782 Add Kafka Partition and Offset to Profiler Debug Logs > > > (nickwallen) closes apache/metron#1202 > > > METRON-1758 Add support for Ansible 2.6 in dev (JonZeolla via > > > jonzeolla) closes apache/metron#1179 > > > METRON-1784: Re-allow remote ssh and scp in Centos full dev > (mmiklavc > > > via mmiklavc) closes apache/metron#1204 > > > METRON-1787 Input Time Constraints for Batch Profiler (nickwallen) > > > closes apache/metron#1209 > > > METRON-1508 In Ubuntu14 Dev Indexing Fails to Write to > Elasticsearch > > > (nickwallen) closes apache/metron#1185 > > > METRON-1786 Pcap Topology Status Incorrect (MohanDV via nickwallen) > > > closes apache/metron#1206 > > > METRON-1709 Add controls to start / stop the PCAP topology from > > Ambari. > > > (MohanDV via nickwallen) closes apache/metron#1201 > > > METRON-1759 PCAP UI: Removing wrong Input annotations from pcap > panel > > > component (tiborm via nickwallen) closes apache/metron#1180 > > > METRON-1772 Support alternative input formats in the Batch Profiler > > > (nickwallen) closes apache/metron#1191 > > > METRON-1770 Add Docs for Running the Profiler with Spark on YARN > > > (nickwallen) closes apache/metron#1189 > > > METRON-1774 Allow user to configure JAAS client in Ambari > > (nickwallen) > > > closes apache/metron#1192 > > > METRON-1760 Kill PCAP job should prompt for confirmation (ruffle > via > > > nickwallen) closes apache/metron#1199 > > > METRON-1777: Fix Elasticsearch X-Pack sample pom in documentation > > > (mmiklavc via mmiklavc) closes apache/metron#1196 > > > METRON-1781 Fix RPM Spec File (nickwallen) closes > apache/metron#1200 > > > METRON-1780 Fix broken website images (justinleet) closes > > > apache/metron#1198 > > > METRON-1476 Update to Angular 6.1.3 (sardell via nickwallen) closes > > > apache/metron#1096 > > > METRON-1776 Update public web site to point at 0.6.0 new release > > > (justinleet) closes apache/metron#1195 > > > METRON-1775 Transient exception could prevent expired profiles from > > > being flushed (nickwallen) closes apache/metron#1194 > > > METRON-1717 Relocate Storm Profiler Code (nickwallen) closes > > > apache/metron#1187 > > > METRON-1748 Improve Storm Profiler Integration Test (nickwallen) > > closes > > > apache/metron#1174 > > > METRON-1741 Move REPL Port of Profiler to Separate Project > > (nickwallen) > > > closes apache/metron#1170 > > > METRON-1715 Create DEB Packaging for Batch Profiler (nickwallen) > > closes > > > apache/metron#1167 > > > METRON-1736 Enhance Batch Profiler Integration Test (nickwallen) > > closes > > > apache/metron#1162 > > > METRON-1714 Create RPM Packaging for the Batch Profiler > (nickwallen) > > > closes apache/metron#1163 > > > METRON-1708 Run the Batch Profiler in Spark (nickwallen) closes > > > apache/metron#1161 > > > METRON-1707 Port Profiler to Spark (nickwallen) closes > > > apache/metron#1150 > > > METRON-1705 Create ProfilePeriod Using Period ID (nickwallen) > closes > > > apache/metron#1148 > > > METRON-1706 HbaseClient.mutate should return the number of > mutations > > > (nickwallen) closes apache/metron#1147 > > > METRON-1704 Message Timestamp Logic Should be Shared (nickwallen) > > > closes apache/metron#1146 > > > METRON-1703 Make Core Profiler Components Serializable (nickwallen) > > > closes apache/metron#1145 > > > > > > *Metron-bro-kafka-plugin changelog* > > > METRON-1800 Increment metron-bro-plugin-kafka version (JonZeolla > via > > > jonzeolla) closes apache/metron-bro-plugin-kafka#10 > > > METRON-1773 Bro plugin docs should refer to Apache Metron project > > > (nickwallen) closes apache/metron-bro-plugin-kafka#9 > > > > > >