GitHub user mmiklavc opened a pull request:
https://github.com/apache/incubator-metron/pull/318
METRON-495: Upgrade Storm to 1.0.x
**Note:** @cestella and I picked up Justin's work while he's out, but
attribution for this PR should go to @justinleet.
Original testing plan
[here](https://docs.google.com/spreadsheets/d/1CPsEHgxiNP0ACZ1J88iDXGVnhoZgQYCYw89_pLfkvLw/edit#gid=0)
| Test Area | Sub area
| Script or
description
|
|------------------|---------------------------------------------------------------------------------------------------------------------|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| Smoke test |
| Ensure data
flows through the topologies to the index from a base full-dev install
|
| HBase Enrichment | Streaming Enrichment
|
https://github.com/apache/incubator-metron/pull/127#issuecomment-222364875
|
| | Batch Enrichment
|
https://github.com/apache/incubator-metron/pull/131#issuecomment-222363251
|
| | Stellar Enrichment
| Add
ENRICHMENT_GET calls in both the enrichment topology as well as a field
transformation in the parser
|
| MaaS | Ensure that in addition to this script, we also remove
the model and check that data errors out if no model exists. |
https://github.com/apache/incubator-metron/pull/210#issuecomment-239825715
|
| Pcap Ingest |
|
https://github.com/apache/incubator-metron/pull/256#issue-177345195
|
| Profiler |
| We will have to
create one from
https://github.com/apache/incubator-metron/tree/master/metron-analytics/metron-profiler
but at the least we should ensure that we can pull data that the profiler puts
in hbase from the enrichment topology. |
Big thanks to @ottobackwards for assisting with testing and verification.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mmiklavc/incubator-metron storm_1.0
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-metron/pull/318.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #318
----
commit dbf7ff19072cb44df66928920a70e0f1f1f8e4e8
Author: justinjleet <[email protected]>
Date: 2016-10-11T13:58:39Z
Initial move to Storm 1.0.1
commit 9796bf36fc4a19fbed5276166c305cb8fb815e00
Author: justinjleet <[email protected]>
Date: 2016-10-12T15:13:45Z
fixing more imports
commit 044b9d7113f3b7d2d367f2f58e40872ea372d75a
Author: justinjleet <[email protected]>
Date: 2016-10-13T19:56:27Z
changes to kakfa. WIP
commit ec157af245cfcac3a8eda390d145328d62dfb0ab
Author: justinjleet <[email protected]>
Date: 2016-10-13T19:56:43Z
Missing changes from last commit
commit 90321655055e9a290f64724c8e3bd8a013deebfc
Author: justinjleet <[email protected]>
Date: 2016-10-14T12:51:17Z
WIP changes with scala wrapper
commit f418f50958d9826c9307858914253f304a18d066
Author: justinjleet <[email protected]>
Date: 2016-10-14T16:22:59Z
More integration tests working
commit f445bfb9fef0583bbce444406227f96a4c506706
Author: justinjleet <[email protected]>
Date: 2016-10-14T19:24:41Z
cleanup
commit 3bcfa39bd296821b0f705061e062f03ee96f4719
Author: cstella <[email protected]>
Date: 2016-10-18T02:08:19Z
Fixed pcap and maas issues.
commit ab3f15305aa9e5ce9bca1f8a9c67f80c75536b72
Author: cstella <[email protected]>
Date: 2016-10-18T13:07:48Z
Merge branch 'master' into storm_1.0
commit 30f9e80005fa32c2bdef09d4863a5764085364f7
Author: cstella <[email protected]>
Date: 2016-10-19T14:01:21Z
updating
commit 5a5e9ac6782b7232c31a2f3f453f18143da0f935
Author: cstella <[email protected]>
Date: 2016-10-19T14:22:34Z
fixed metron-management
commit 996958d3bb889cac8af64587a75fbd184e4c86db
Author: cstella <[email protected]>
Date: 2016-10-19T15:00:20Z
removing logging
commit 3df30cda37612b73da0704732b79828c22208519
Author: cstella <[email protected]>
Date: 2016-10-19T19:11:59Z
flux fix.
commit 8eede3ebbdbf403aacc06531c652c0370164e1b8
Author: Michael Miklavcic <[email protected]>
Date: 2016-10-19T19:39:12Z
exclude hadoop-common deps from management pom
commit 3f780f7a0df279de2154840a0002cd81d1a0ede7
Author: Casey Stella <[email protected]>
Date: 2016-10-19T19:41:37Z
Merge pull request #2 from mmiklavc/storm_1.0
exclude hadoop-common deps from management pom
commit f1d97b38290afcadaba119c7207a15ba30959fc4
Author: cstella <[email protected]>
Date: 2016-10-19T20:20:23Z
removing 2.5.1
commit b62a28d0c8715f46690e74ecc76a488f697b13fc
Author: cstella <[email protected]>
Date: 2016-10-19T22:52:44Z
removed the remaining 2.5.1 dependencies
commit f89ab58e89e73c2e7b9395c7b0acb0e0370bda8d
Author: cstella <[email protected]>
Date: 2016-10-20T00:22:36Z
missed one
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
