[
https://issues.apache.org/jira/browse/METRON-2232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16918748#comment-16918748
]
Ryan Merriman edited comment on METRON-2232 at 8/29/19 4:10 PM:
----------------------------------------------------------------
I started working through this and have a branch
[commit|[https://github.com/merrimanr/incubator-metron/tree/hadoop-upgrade-3.1]]
. This
[https://github.com/merrimanr/incubator-metron/commit/0446bbb548b88de9df7289b526e2f3c86ff3f4c3]]
has the changes I made.
The changes mostly include reorganizing some Maven dependencies and a couple
code changes to match the newer Hadoop version. I initially ran into this
error and attempted to solve it by copying the source for
FanOutOneBlockAsyncDFSOutputHelper.java and
FanOutOneBlockAsyncDFSOutputSaslHelper.java into the test classpath of affected
modules. This worked for metron-hbase-common but I have not been able to get
it to work with metron-data-management. Strangely enough my machine reboots
every time I run tests for that module. Curious if this happens to others or
if tests pass. There are also some test failures in MaasIntegrationTest in the
metron-maas-service module. I don't know that module well so I have not been
able to troubleshoot or find a fix.
This work depends on the HBase upgrade so I have not been able to test this in
full dev yet because there is not a stable branch that has both the HBase
changes and MPack changes.
was (Author: rmerriman):
I started working through this and have a branch
[here|[https://github.com/merrimanr/incubator-metron/tree/hadoop-upgrade-3.1]].
This
[commit|[https://github.com/merrimanr/incubator-metron/commit/0446bbb548b88de9df7289b526e2f3c86ff3f4c3]]
has the changes I made.
The changes mostly include reorganizing some Maven dependencies and a couple
code changes to match the newer Hadoop version. I initially ran into this
[error|https://issues.apache.org/jira/browse/HBASE-22394] and attempted to
solve it by copying the source for FanOutOneBlockAsyncDFSOutputHelper.java and
FanOutOneBlockAsyncDFSOutputSaslHelper.java into the test classpath of affected
modules. This worked for metron-hbase-common but I have not been able to get
it to work with metron-data-management. Strangely enough my machine reboots
every time I run tests for that module. Curious if this happens to others or
if tests pass. There are also some test failures in MaasIntegrationTest in the
metron-maas-service module. I don't know that module well so I have not been
able to troubleshoot or find a fix.
This work depends on the HBase upgrade so I have not been able to test this in
full dev yet because there is not a stable branch that has both the HBase
changes and MPack changes.
> Upgrade Hadoop
> --------------
>
> Key: METRON-2232
> URL: https://issues.apache.org/jira/browse/METRON-2232
> Project: Metron
> Issue Type: Sub-task
> Reporter: Michael Miklavcic
> Priority: Major
>
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
