[
https://issues.apache.org/jira/browse/HDFS-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17240597#comment-17240597
]
Matteo Minardi edited comment on HDFS-5328 at 11/30/20, 9:27 AM:
-----------------------------------------------------------------
Any news on this? I get the same error.
In the code I still see:
{code:java}
public void waitClusterUp() throws IOException {
int i = 0;
if (numDataNodes > 0) {
while (!isClusterUp()) {
try {
LOG.warn("Waiting for the Mini HDFS Cluster to start...");
Thread.sleep(1000);
} catch (InterruptedException e) {
}
if (++i > 10) {
final String msg = "Timed out waiting for Mini HDFS Cluster to start";
LOG.error(msg);
throw new IOException(msg);
}
}
}
}
{code}
With 10 hardcoded
[~rvesse] [~tucu00]
was (Author: mino181295):
Any news on this? I get the same error.
In the code I still see:
{code:java}
public void waitClusterUp() throws IOException {
int i = 0;
if (numDataNodes > 0) {
while (!isClusterUp()) {
try {
LOG.warn("Waiting for the Mini HDFS Cluster to start...");
Thread.sleep(1000);
} catch (InterruptedException e) {
}
if (++i > 10) {
final String msg = "Timed out waiting for Mini HDFS Cluster to start";
LOG.error(msg);
throw new IOException(msg);
}
}
}
}
{code}
With 10 hardcoded
[~rvesse] [~tucu00]
> MiniDFSCluster times out at startup
> -----------------------------------
>
> Key: HDFS-5328
> URL: https://issues.apache.org/jira/browse/HDFS-5328
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: test
> Affects Versions: 2.1.1-beta, 2.7.1, 3.0.0-alpha1
> Reporter: Alejandro Abdelnur
> Priority: Major
> Attachments: HDFS-5328.001.patch, HDFS-5328.002.patch
>
>
> It seems MiniDFSCluster startup got slower lately and we are observing the
> following intermittent failure on startup in our jenkins boxes:
> {code}
> java.io.IOException: Timed out waiting for Mini HDFS Cluster to start
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.waitClusterUp(MiniDFSCluster.java:972)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:665)
> at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:585)
> at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:511)
> {code}
> By looking at the code the {{waitClusterUp()}} has a hardcoded 10secs timeout
> (10 1 sec waits).
> There are two things we should look at it, make the timeout configurable, and
> more important, see what has changed to make the startup slower.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]