This is an automated email from the ASF dual-hosted git repository.
sardell pushed a change to branch feature/METRON-1856-parser-aggregation
in repository https://gitbox.apache.org/repos/asf/metron.git.
from 7333300 METRON-2251 Update with the latest master branch (sardell)
closes apache/metron#1507
add 57bbab2 METRON-2106 Escalation topic setting in Ambari has no effect
(merrimanr) closes apache/metron#1400
add d92e0a2 METRON-2075 Site book build support for MacOS that has GNU
sed installed (tigerquoll via mmiklavc) closes apache/metron#1384
add fb80e32 METRON-1989 Tooltip for ES mpack path_data is incorrect
(JonZeolla via mmiklavc) closes apache/metron#1329
add adf477d METRON-2089 [UI] Adding loading state to Alerts details view
(tiborm via sardell) closes apache/metron#1390
add 5a3fd55 METRON-2111 Update public web site to point at 0.7.1 new
release (justinleet) closes apache/metron#1406
add fcd681d METRON-1997 Replace Threat Triage Score Field Slider with
Text Box (ruffle1986 via sardell) closes apache/metron#1334
add b8df052 METRON-2107 Add architecture diagram item to PR checklist
(mmiklavc) closes apache/metron#1401
add 2653157 METRON-2058 UI: Actions -> Add to Alert can still be
selected from dropdown when no alerts are selected. (ruffle1986 via sardell)
closes apache/metron#1373
add 506c18c METRON-2085 [UI] Alerts UI Details Pane: naming meta alerts
is broken (ruffle1986 via sardell) closes apache/metron#1388
add 22cc622 METRON-2118 Added a LEEF parser (simonellistonball via
mmiklavc) closes apache/metron#1408
add 3b04460 METRON-1788 Batch profiler pull profile information from
zookeeper (tigerquoll via mmiklavc) closes apache/metron#1383
add a6281d3 METRON-2113 Update version to 0.7.2 (justinleet) closes
apache/metron#1407
add 373ac51 METRON-2109 Add option to use Metron GUID as the id in
Elasticsearch (merrimanr) closes apache/metron#1403
add 9b70adf METRON-2123 Expand Stellar JOIN to work on all Iterables
(mmiklavc) closes apache/metron#1416
add ccb5bec METRON-2143 Travis Build Fails to Download Maven (nickwallen)
closes apache/metron#1433
add bfe662d METRON-2128 LEEF config file is missing in RPM spec file
(simonellistonball via mmiklavc) closes apache/metron#1419
add b9a130c METRON-2087 Remove Storm dependency from metron-indexing
(merrimanr) closes apache/metron#1389
add 3754ff3 METRON-2112 Normalize parser original_string handling
(mmiklavc) closes apache/metron#1409
add 2dd753e METRON-2152 Add debug logging for when sensor batchTimeout
exceeds the calculated maximum (mmiklavc) closes apache/metron#1437
add a8f2d3a METRON-2083 Fix broken links in root metron README (mmiklavc)
closes apache/metron#1435
add dbf8bf9 METRON-2145 Clarify RPM build documentation (mmiklavc) closes
apache/metron#1434
add e16ff31 METRON-2127 Update Maven repositories to https (justinleet
via mmiklavc) closes apache/metron#1417
add a1487ec METRON-2153 ParserIntegrationTest should print failed
messages (merrimanr) closes apache/metron#1438
add 5bd7e01 METRON-2102 [UI] Adding click-through navigation to Alerts
table (tiborm via mmiklavc) closes apache/metron#1431
add 3c13173 METRON-2141 Cache REST API status update calls to the Storm
UI (mmiklavc) closes apache/metron#1439
add 9621ec7 METRON-2092 [UI] Config UI does not require you to set a grok
timestamp field by default (ruffle1986 via sardell) closes apache/metron#1393
add 38b8a78 METRON-2073 Create in-memory use case for enrichment with map
type and flatfile summarizer (merrimanr) closes apache/metron#1399
add ee1b2c3 METRON-1253 Manual pasting of timestamps into the timestamp
picker (ruffle1986 via sardell) closes apache/metron#1380
add 09bbdf3 METRON-2142 Install solar schema as metron user (MohanDV via
nickwallen) closes apache/metron#1432
add a2a46e6 METRON-2156 Remove Storm dependency from metron-hbase
(merrimanr) closes apache/metron#1441
add f2f3bb4 METRON-2155 Cache Maven in Travis CI Builds (nickwallen)
closes apache/metron#1445
add c9604c2 METRON-2166 FileFilterUtilTest.test_getPaths_leftEdge:116
expected:<1> but was:<2> (mmiklavc) closes apache/metron#1452
add 02f88a3 METRON-2164 Remove the Split-Join Enrichment Topology
(nickwallen) closes apache/metron#1448
add 8792882 METRON-2061 Solr documents with date fields cannot be updated
with Dao classes (merrimanr) closes apache/metron#1374
add c8f2c9a METRON-2084 Add documentation notice for MacOS Mojave users
for new security permissions (mmiklavc) closes apache/metron#1449
add bf673a2 METRON-2168 Elasticsearch Updates Not Tested in Integration
Test (nickwallen) closes apache/metron#1451
add 891ebd5 METRON-2150 [UI] User not able to filter by multiple values
of the same field on Alerts UI (tiborm via sardell) closes apache/metron#1443
add 42ce5ad METRON-2148 Stellar REST POST function (merrimanr) closes
apache/metron#1440
add f36bba7 Metron-2180 IS_DATE stellar function is lenient while parsing
date/time (MohanDV) closes apache/metron#1461
add 5425f8f METRON-2183 Update to Angular v7 (sardell) closes
apache/metron#1463
add b516a75 METRON-2161 [UI] CSS positioning bugs in Alerts and MGMT UI
(sardell) closes apache/metron#1446
add 753e8ea METRON-2174 [UI] Grouped alerts total can differ from search
alerts total (sardell) closes apache/metron#1455
add 7e39143 METRON-2079 Fix documentation for installing Ansible for
fulldev Centos 6 (mmiklavc) closes apache/metron#1450
add 43f74fc METRON-2185 Update Simple-Syslog dependency to fix error in
Structured Data (ottobackwards) closes apache/metron#1466
add ed63eac METRON-2172 Solr Updates Not Tested in Integration Test
(nickwallen) closes apache/metron#1465
add 5e1e3bd METRON-2140: [UI] Implement logic behind show/hide RESOLVE
and DISMISS items in Alerts UI (tiborm via mmiklavc) closes apache/metron#1459
add 65681a0 METRON-2129 [UI] Clearing the search bar resets alert filter
range to 'All Time' (ruffle1986 via mmiklavc) closes apache/metron#1420
add 6306c93 METRON-2130 [UI] Numeric steppers on the Management UI seems
broken (ruffle1986 via mmiklavc) closes apache/metron#1421
add 6256535 METRON-2191 [UI] Checkbox selector on Alerts UI is broken
(tiborm via sardell) closes apache/metron#1468
add 8a5e7e7 METRON-2192 [UI] "All time" time range is broken on
Alerts UI (tiborm via sardell) closes apache/metron#1469
add 855de4a METRON-2194 Update Ambari tooltip to specify single quotes
for parser names with hyphens (mmiklavc) closes apache/metron#1471
add 340827f METRON-2189 Optimize imports in mpack python scripts
(mmiklavc) closes apache/metron#1467
add 8c4b53d METRON-2197 Add debugging info output for Solr queries
(mmiklavc) closes apache/metron#1475
add 0239432 METRON-2202 Add parameter validation for the stellar field
validation functions (MohanDV via mmiklavc) closes apache/metron#1476
add 771d66b METRON-2195 Add defensive log level checks when constructing
logs is expensive (tigerquoll via mmiklavc) closes apache/metron#1473
add 3bea6ad METRON-2205 Cease querying on filter or time-range change
(tiborm via sardell) closes apache/metron#1478
add f6054a4 METRON-614: Eliminate use of the default Charset (justinleet)
closes apache/metron#1341
add 88f4d2c METRON-614: Eliminate use of the default Charset (mmiklavc
via justinleet) closes apache/metron#1341
add 5e93677 METRON-2076 Fixed up flakey stellar timezone test (tigerquoll
via mmiklavc) closes apache/metron#1487
add 7219606 METRON-2212 Add debugging developer docs to hbase-server
README (mmiklavc) closes apache/metron#1481
add 4ab1fdb METRON-2179 [UI] Make navigation in both UIs consistent
(sardell) closes apache/metron#1464
add e6ca3c7 METRON-2149 Shaded jar classifier is not consistent
(merrimanr) closes apache/metron#1436
add 1a6d77f METRON-2238 Streaming enrichments regression (merrimanr via
mmiklavc) closes apache/metron#1498
add 888c4bc METRON-2199 [UI] Add ability to turn off query building in
Alerts UI search input (sardell) closes apache/metron#1477
add edc449f METRON-2243 [UI] Update npm dependencies to resolve audit
warnings (sardell) closes apache/metron#1500
add 5eed666 METRON-2221 Notebook import fails through Zeppelin REST API
(anandsubbu) closes apache/metron#1489
add 67fa5a4 METRON-2227 Increase Kafka test harness timeout (tigerquoll
via mmiklavc) closes apache/metron#1493
add 3b96474 METRON-2201 The description for the IS_IP method default
behavior needs to corrected as per implementation (MohanDV via mmiklavc) closes
apache/metron#1474
add c402e64 METRON-2217 Migrate current HBase client from HTableInterface
to Table (mmiklavc) closes apache/metron#1483
add 722eb66 METRON-2211 [UI] Alerts UI should optionally render timestamp
in local time (sardell) closes apache/metron#1495
add b1536d7 METRON-2254 Intermittent Test Failure in
RestFunctionsIntegrationTest (nickwallen) closes apache/metron#1510
add 0e2eadf METRON-2247 rpm-docker: Provide an option to bypass running
rpmlint (tigerquoll via nickwallen) closes apache/metron#1503
add 92220ce METRON-2257 Metron-Alerts GUI testing failing on MacOS builds
(sardell) closes apache/metron#1513
add 3a666d5 METRON-2235 Increase server startup timeout (tigerquoll via
mmiklavc) closes apache/metron#1496
add eaee9f8 METRON-2266 REST debug instructions (merrimanr via
nickwallen) closes apache/metron#1520
add 080e074 METRON-2271 Reorganize Travis Build (nickwallen) closes
apache/metron#1522
add d693e28 METRON-2190 [UI] Alerts UI: Indicating loading and preventing
parallel requests (tiborm via sardell) closes apache/metron#1514
add 03e0977 METRON-2272 [UI] Performance: Switching manual filtering on
and off multiple times leads slow typing (ruffle1986 via sardell) closes
apache/metron#1524
add 895fe49 METRON-2274 Flatfile loader and summarizer mapreduce mode
broken (mmiklavc) closes apache/metron#1525
add 50b5c50 METRON-2278 "Metron on CentOS 6" Documentation is
outdated (subhashjha35 via sardell) closes apache/metron#1530
add bb9a244 METRON-2259 [UI] Hide Resolved and Hide Dismissed toggles not
works when filtering is in manual mode (tiborm via sardell) closes
apache/metron#1532
add 67b4d0b METRON-2280 PCAP queries no longer work (mmiklavc) closes
apache/metron#1537
add e645ffe METRON-2300 Fix Brad Kolarov's Apache ID (billierinaldi via
mmiklavc) closes apache/metron#1541
add 37a8e2e METRON-2303 Change Default HDFS Port for Batch Profiler
(nickwallen) closes apache/metron#1548
add d0d64d4 METRON-2291 [UI] Fixing and rephrasing warning messages on
Alerts UI (tiborm via sardell) closes apache/metron#1535
add 581a43f METRON-2294 [UI] Fixing Stale mode issue in Alert UI Manual
Query Mode (subhashjha35 via sardell) closes apache/metron#1540
add df6e181 METRON-2295 [UI] Displaying "No Data" message in
the Alerts UI screen (subhashjha35 via sardell) closes apache/metron#1543
add eb1dda6 METRON-2302 [UI] Change the default polling interval for
Alerts UI to longer time (tiborm via sardell) closes apache/metron#1547
add 6c064b7 METRON-2293 Fix some inaccuracies in the MaaS README
(mmiklavc) closes apache/metron#1536
add fb3986e METRON-2290 [UI] Delaying first auto polling request on app
start (tiborm via sardell) closes apache/metron#1534
add 8686f52 METRON-2284 Metron Profiler for Spark Doesn't Work as
Expected (nickwallen) closes apache/metron#1556
add 604a106 METRON-2310 Remove metron-integration-test from compile
dependencies (justinleet) closes apache/metron#1557
add 12e16df METRON-2308 Fix 'Degrees' Example Profile (nickwallen) closes
apache/metron#1555
add fca9ebf METRON-2239 Metron Automated backup and restore (mmiklavc)
closes apache/metron#1546
new 661391f METRON-2318 Merge master into feature branch (sardell) closes
apache/metron#1563
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
Upgrade_steps.md | 40 +
metron-analytics/metron-maas-service/README.md | 209 ++++-
metron-analytics/metron-profiler-common/README.md | 10 +-
.../src/main/config/batch-profiler.properties | 2 +-
.../metron/profiler/spark/BatchProfiler.java | 4 +-
.../spark/BatchProfilerIntegrationTest.java | 29 +-
metron-deployment/development/centos6/README.md | 7 +-
.../packaging/docker/rpm-docker/SPECS/metron.spec | 1 +
.../metron-alerts/cypress/fixtures/search-1.1.json | 102 +++
.../metron-alerts/cypress/fixtures/search-1.2.json | 102 +++
.../search/auto-polling.feature.spec.js | 98 +++
.../alerts/alerts-list/alerts-list.component.html | 52 +-
.../alerts/alerts-list/alerts-list.component.scss | 21 -
.../alerts-list/alerts-list.component.spec.ts | 493 +++++++++--
.../alerts/alerts-list/alerts-list.component.ts | 252 +++---
.../app/alerts/alerts-list/alerts-list.module.ts | 12 +-
.../auto-polling/auto-polling.component.html} | 17 +-
.../auto-polling/auto-polling.component.scss} | 79 +-
.../auto-polling/auto-polling.component.spec.ts | 80 ++
.../auto-polling/auto-polling.component.ts} | 28 +-
.../auto-polling/auto-polling.service.spec.ts | 530 ++++++++++++
.../auto-polling/auto-polling.service.ts | 186 +++++
.../app/alerts/alerts-list/query-builder.spec.ts | 124 ++-
.../src/app/alerts/alerts-list/query-builder.ts | 74 +-
.../table-view/table-view.component.html | 7 +
.../table-view/table-view.component.scss | 17 +
.../alerts-list/tree-view/tree-view.component.ts | 1 -
.../configure-rows/configure-rows.component.html | 34 +-
.../configure-rows/configure-rows.component.ts | 76 +-
.../show-hide-alert-entries.component.spec.ts | 43 +-
.../show-hide/show-hide-alert-entries.component.ts | 36 +-
.../show-hide/show-hide.service.spec.ts | 12 +-
.../configure-rows/show-hide/show-hide.service.ts | 6 +-
.../metron-alerts/src/app/model/search-response.ts | 2 +-
.../metron-alerts/src/app/model/table-metadata.ts | 10 +-
.../app/service/elasticsearch-localstorage-impl.ts | 6 +-
.../src/app/service/search.service.spec.ts | 78 ++
.../src/app/service/search.service.ts | 26 +-
.../shared/directives/alert-search.directive.ts | 118 +--
.../modal-loading-indicator.component.html} | 27 +-
.../modal-loading-indicator.component.scss | 25 +-
.../modal-loading-indicator.component.spec.ts} | 14 +-
.../modal-loading-indicator.component.ts | 29 +
.../src/app/shared/switch/switch.component.html | 4 +-
.../src/app/shared/switch/switch.component.scss | 9 +
.../src/app/shared/switch/switch.component.ts | 1 +
.../metron-alerts/src/app/utils/constants.ts | 2 +-
.../metron-alerts/src/app/utils/httpUtil.ts | 20 +-
.../metron-alerts/src/environments/environment.js | 27 -
.../src/environments/environment.prod.js | 21 -
metron-interface/metron-config/package-lock.json | 927 +++++++++++----------
.../src/app/model/sensor-parser-config.ts} | 47 +-
.../src/app/sensors/reducers/index.ts | 0
.../sensor-parser-config.component.ts | 8 +-
metron-interface/metron-rest/pom.xml | 22 +-
metron-platform/metron-common/README.md | 30 +
.../src/main/scripts/upgrade_helper.sh | 120 +++
.../src/main/scripts/flatfile_loader.sh | 7 +-
.../src/main/scripts/flatfile_summarizer.sh | 2 +
.../metron-elasticsearch-storm/pom.xml | 11 +
.../metron-indexing/metron-indexing-storm/pom.xml | 23 +-
metron-platform/metron-pcap-backend/pom.xml | 3 +-
.../metron-solr/metron-solr-storm/pom.xml | 6 +
site/community/index.md | 2 +-
64 files changed, 3287 insertions(+), 1124 deletions(-)
create mode 100644 Upgrade_steps.md
create mode 100644
metron-interface/metron-alerts/cypress/fixtures/search-1.1.json
create mode 100644
metron-interface/metron-alerts/cypress/fixtures/search-1.2.json
create mode 100644
metron-interface/metron-alerts/cypress/integration/search/auto-polling.feature.spec.js
mode change 100644 => 100755
metron-interface/metron-alerts/src/app/alerts/alerts-list/alerts-list.component.html
mode change 100644 => 100755
metron-interface/metron-alerts/src/app/alerts/alerts-list/alerts-list.component.ts
mode change 100644 => 100755
metron-interface/metron-alerts/src/app/alerts/alerts-list/alerts-list.module.ts
copy
metron-interface/{metron-config/src/app/shared/metron-modal/metron-modal.component.html
=>
metron-alerts/src/app/alerts/alerts-list/auto-polling/auto-polling.component.html}
(60%)
mode change 100644 => 100755
copy
metron-interface/metron-alerts/src/app/{pcap/pcap-filters/pcap-filters.component.scss
=> alerts/alerts-list/auto-polling/auto-polling.component.scss} (53%)
create mode 100644
metron-interface/metron-alerts/src/app/alerts/alerts-list/auto-polling/auto-polling.component.spec.ts
copy
metron-interface/{metron-rest-client/src/main/java/org/apache/metron/rest/model/PcapResponse.java
=>
metron-alerts/src/app/alerts/alerts-list/auto-polling/auto-polling.component.ts}
(63%)
mode change 100644 => 100755
create mode 100644
metron-interface/metron-alerts/src/app/alerts/alerts-list/auto-polling/auto-polling.service.spec.ts
create mode 100755
metron-interface/metron-alerts/src/app/alerts/alerts-list/auto-polling/auto-polling.service.ts
create mode 100644
metron-interface/metron-alerts/src/app/service/search.service.spec.ts
copy
metron-interface/metron-alerts/src/app/shared/{date-picker/date-picker.component.html
=> modal-loading-indicator/modal-loading-indicator.component.html} (61%)
copy
metron-platform/metron-data-management/src/main/java/org/apache/metron/dataloads/bulk/StartDateException.java
=>
metron-interface/metron-alerts/src/app/shared/modal-loading-indicator/modal-loading-indicator.component.scss
(76%)
copy
metron-interface/metron-alerts/src/app/shared/{metron-table/metron-table-pagination/metron-table-pagination.component.spec.ts
=> modal-loading-indicator/modal-loading-indicator.component.spec.ts} (73%)
create mode 100644
metron-interface/metron-alerts/src/app/shared/modal-loading-indicator/modal-loading-indicator.component.ts
delete mode 100644
metron-interface/metron-alerts/src/environments/environment.js
delete mode 100644
metron-interface/metron-alerts/src/environments/environment.prod.js
copy
metron-interface/{metron-alerts/src/app/alerts/configure-rows/timezone-config/timezone-config.service.ts
=> metron-config/src/app/model/sensor-parser-config.ts} (52%)
mode change 100644 => 100755
metron-interface/metron-config/src/app/sensors/reducers/index.ts
create mode 100755
metron-platform/metron-common/src/main/scripts/upgrade_helper.sh
