[
https://issues.apache.org/jira/browse/HADOOP-17472?focusedWorklogId=539588&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-539588
]
ASF GitHub Bot logged work on HADOOP-17472:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 22/Jan/21 05:46
Start Date: 22/Jan/21 05:46
Worklog Time Spent: 10m
Work Description: xkrogen edited a comment on pull request #2622:
URL: https://github.com/apache/hadoop/pull/2622#issuecomment-764039591
I haven't been able to make it this test run locally, I am getting errors
like:
```
[ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
15.284 s <<< FAILURE! - in
org.apache.hadoop.tools.dynamometer.TestDynamometerInfra
[ERROR] org.apache.hadoop.tools.dynamometer.TestDynamometerInfra Time
elapsed: 15.283 s <<< ERROR!
org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
java.lang.ExceptionInInitializerError
at
org.apache.hadoop.yarn.server.MiniYARNCluster.startResourceManager(MiniYARNCluster.java:378)
at
org.apache.hadoop.yarn.server.MiniYARNCluster.access$300(MiniYARNCluster.java:127)
at
org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper.serviceStart(MiniYARNCluster.java:494)
...
Caused by: java.lang.IllegalArgumentException: ReRegistration of rpcKind:
RPC_PROTOCOL_BUFFER
at
org.apache.hadoop.ipc.Server.registerProtocolEngine(Server.java:290)
at
org.apache.hadoop.ipc.ProtobufRpcEngine2.<clinit>(ProtobufRpcEngine2.java:64)
```
AFAICT it looks like both `ProtobufRpcEngine` and `ProtobufRpcEngine2` are
being loaded and their registrations are conflicting, but I don't know why.
Looks like others haven't been hitting this issue so I'm not sure what's wrong.
Regarding `TOTALINVALIDCOMMANDS`, 6 is all of them, so it looks like the
NameNode is starting up but something is wrong with it because all of the FS
calls to it are resulting in exceptions. This is probably related to why the
workload job isn't completing and so you're seeing a timeout. You should be
able to check the log files for the application, which end up within the
NodeManager log directories of the `MiniYARNCluster` -- the path is like:
```
./hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/target/org.apache.hadoop.tools.dynamometer.TestDynamometerInfra/org.apache.hadoop.tools.dynamometer.TestDynamometerInfra-logDir-nm*/*
```
This dir gets cleaned up by default when the test exits, so you may want to
comment out line 296 to avoid deleting it and losing the output.
Also re: `archive.apache.org`, I avoided using it initially because it's not
intended for much bandwidth. They have this message up on the home page, and if
I remember correctly it was previously more strongly worded about always using
a mirror instead:
> If you are looking for current software releases, please visit one of our
numerous mirrors. Do note that a daily limit of 5GB per IP is being enforced on
archive.apache.org, to prevent abuse.
The right long term fix should be HDFS-14412, which will use the local
Hadoop build instead of localizing it from the web... But not sure what to do
in the short term.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 539588)
Time Spent: 2h (was: 1h 50m)
> Upgrade hadoop default version in
> hadoop.tools.dynamometer.TestDynamometerInfra
> -------------------------------------------------------------------------------
>
> Key: HADOOP-17472
> URL: https://issues.apache.org/jira/browse/HADOOP-17472
> Project: Hadoop Common
> Issue Type: Test
> Reporter: L. C. Hsieh
> Priority: Major
> Labels: pull-request-available
> Time Spent: 2h
> Remaining Estimate: 0h
>
> Currently hadoop.tools.dynamometer.TestDynamometerInfra in trunk is failed.
> {code}
> [INFO] -------------------------------------------------------
> [INFO] T E S T S
> [INFO] -------------------------------------------------------
> [INFO] Running org.apache.hadoop.tools.dynamometer.TestDynamometerInfra
> [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.531
> s <<< FAILURE! - in org.apache.hadoop.tools.dynamometer.TestDynamometerInfra
> [ERROR] org.apache.hadoop.tools.dynamometer.TestDynamometerInfra Time
> elapsed: 0.53 s <<< ERROR!
> java.io.FileNotFoundException:
> http://mirrors.ocf.berkeley.edu/apache/hadoop/common/hadoop-3.1.3/hadoop-3.1.3.tar.gz
> at
> java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1923)
> at
> java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1523)
> at org.apache.commons.io.FileUtils.copyURLToFile(FileUtils.java:1506)
> at
> org.apache.hadoop.tools.dynamometer.DynoInfraUtils.fetchHadoopTarball(DynoInfraUtils.java:151)
> at
> org.apache.hadoop.tools.dynamometer.TestDynamometerInfra.setupClass(TestDynamometerInfra.java:176)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
