[
https://issues.apache.org/jira/browse/METRON-1714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16580245#comment-16580245
]
ASF GitHub Bot commented on METRON-1714:
----------------------------------------
GitHub user nickwallen opened a pull request:
https://github.com/apache/metron/pull/1163
METRON-1714 Create RPM Packaging for the Batch Profiler
This creates an RPM that makes it simple to install the Batch Profiler.
There are now two separate RPM packages created for the Profiler; one for Storm
and another for Spark.
* metron-profiler-storm-*.rpm
* metron-profiler-spark-*.rpm
This is a pull request against the `METRON-1699-create-batch-profiler`
feature branch.
This is dependent on #1161 . By filtering on the last commit, this PR can
be reviewed before the others are reviewed and merged.
### Testing
1. Build Metron.
```
mvn clean package -DskipTests -T2C
```
1. Ensure that the RPMs were built.
```
$ cd metron-deployment/packaging/docker/rpm-docker/target
$ find ./ -name "*.rpm"
...
.//RPMS/noarch/metron-profiler-storm-0.5.1-201808141752.noarch.rpm
...
.//RPMS/noarch/metron-profiler-spark-0.5.1-201808141752.noarch.rpm
...
```
1. Stand-up a CentOS VM for testing the RPM.
```
vagrant init centos/6
vagrant up
```
1. Copy both Profiler RPMs to the VM.
```
vagrant scp
metron-deployment/packaging/docker/rpm-docker/RPMS/noarch/metron-profiler-spark-*.rpm
default:/tmp
vagrant scp
metron-deployment/packaging/docker/rpm-docker/RPMS/noarch/metron-profiler-storm-*.rpm
default:/tmp
```
1. Install the RPM on the VM.
```
[vagrant@localhost ~]$ sudo su -
[root@localhost ~]# rpm -ivh
/tmp/metron-profiler-spark-0.5.1-201808141752.noarch.rpm
Preparing... ###########################################
[100%]
1:metron-profiler-spark ###########################################
[100%]
```
```
[root@localhost ~]# rpm -ivh
/tmp/metron-profiler-storm-0.5.1-201808141752.noarch.rpm
Preparing... ###########################################
[100%]
1:metron-profiler-storm ###########################################
[100%]
```
1. Ensure that the following files have been installed in `${METRON_HOME}`.
```
/usr/metron/
└── 0.5.1
├── bin
│ ├── start_batch_profiler.sh
│ └── start_profiler_topology.sh
├── config
│ ├── batch-profiler.properties
│ └── profiler.properties
├── flux
│ └── profiler
│ └── remote.yaml
└── lib
├── metron-profiler-0.5.1-uber.jar
└── metron-profiler-spark-0.5.1.jar
```
## Pull Request Checklist
- [x] Have you included steps to reproduce the behavior or problem that is
being changed or addressed?
- [x] Have you included steps or a guide to how the change may be verified
and tested manually?
- [x] Have you ensured that the full suite of tests and checks have been
executed in the root metron folder via:
- [x] Have you written or updated unit tests and or integration tests to
verify your changes?
- [x] If adding new dependencies to the code, are these dependencies
licensed in a way that is compatible for inclusion under [ASF
2.0](http://www.apache.org/legal/resolved.html#category-a)?
- [x] Have you verified the basic functionality of the build by building
and running locally with Vagrant full-dev environment or the equivalent?
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/nickwallen/metron METRON-1714
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/metron/pull/1163.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1163
----
commit 6ce28594659928a8c87c57edddd22e1ab00d798d
Author: Nick Allen <nick@...>
Date: 2018-07-10T14:08:48Z
METRON-1703 Make Core Profiler Components Serializable
commit 0051359cbb277881de896526345bb4fce1d5139c
Author: Nick Allen <nick@...>
Date: 2018-07-10T19:42:19Z
METRON-1704 Message Timestamp Logic Should be Shared
commit 2413726bdf96221ec775a9c8de524e3ec92148b7
Author: Nick Allen <nick@...>
Date: 2018-07-27T17:20:15Z
METRON-1706: HbaseClient.mutate should return the number of mutations
commit 21980ca764b98ddb96c4c8732e0ef7a6c5ea2c56
Author: Nick Allen <nick@...>
Date: 2018-07-24T18:02:36Z
METRON-1705 Create ProfilePeriod Using Period ID
commit be15126419a2862864a7acd67349281b086f52cf
Author: Nick Allen <nick@...>
Date: 2018-07-31T19:26:20Z
METRON-1707 Port Profiler to Spark
commit c410e412c50f4510f8674cd4fa5d4481f28a4a13
Author: Nick Allen <nick@...>
Date: 2018-08-09T15:54:41Z
No need to handle packaging yet. That will come in a future PR
commit f1a8b49f99029e8d801dc62cfa9c2a0827a46cd8
Author: Nick Allen <nick@...>
Date: 2018-08-13T13:25:56Z
Renamed execute() to run()
commit 7f585e0afaa76386934f785407eecc5d65175d8c
Author: Nick Allen <nick@...>
Date: 2018-08-13T14:52:17Z
Reducing the size of the telemetry for the integration test. No need to
have so much data
commit 5d9cf3a34e196712c3d38f476514000faab3092b
Author: Nick Allen <nick@...>
Date: 2018-08-13T18:39:10Z
METRON-1708 Run the Batch Profiler in Spark
commit 14bee4f88e526a17c648eaa92681e2d6b891ed22
Author: Nick Allen <nick@...>
Date: 2018-08-14T14:53:30Z
No need to change this from what was done in METRON-1707
commit 9a5bf5e02b1580a21df51289385043233c1dcff3
Author: Nick Allen <nick@...>
Date: 2018-08-14T14:56:52Z
Revert "No need to change this from what was done in METRON-1707"
This reverts commit 14bee4f88e526a17c648eaa92681e2d6b891ed22.
commit 09cdf975de70f8381cc37e08d918813cc2e7e536
Author: Nick Allen <nick@...>
Date: 2018-08-14T14:35:55Z
Refactor BatchProfiler to make it simpler to grok hopefully.
commit 126b78d2a084a714ede5b5c8a7abe62efa05c9fc
Author: Nick Allen <nick@...>
Date: 2018-08-14T18:35:01Z
METRON-1714 Create RPM Packaging for the Batch Profiler
----
> Create RPM Packaging for the Batch Profiler
> -------------------------------------------
>
> Key: METRON-1714
> URL: https://issues.apache.org/jira/browse/METRON-1714
> Project: Metron
> Issue Type: Sub-task
> Reporter: Nick Allen
> Assignee: Nick Allen
> Priority: Major
>
> Create RPM packaging for the Batch Profiler
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
