John Doe created HDFS-14501:
-------------------------------
Summary: BenchmarkThroughput.writeFile hangs with misconfigured
BUFFER_SIZE
Key: HDFS-14501
URL: https://issues.apache.org/jira/browse/HDFS-14501
Project: Hadoop HDFS
Issue Type: Bug
Affects Versions: 2.5.0
Reporter: John Doe
When the configuration file is corrupted, reading BUFFER_SIZE from corrupted
conf can return 0.
The "for" loop in BenchmarkThroughput.writeLocalFile function hangs endlessly.
Here is the code snippet.
{code:java}
BUFFER_SIZE = conf.getInt("dfsthroughput.buffer.size", 4 * 1024);
private Path writeFile(FileSystem fs,
String name,
Configuration conf,
long total
) throws IOException {
Path f = dir.getLocalPathForWrite(name, total, conf);
System.out.print("Writing " + name);
resetMeasurements();
OutputStream out = fs.create(f);
byte[] data = new byte[BUFFER_SIZE];
for(long size = 0; size < total; size += BUFFER_SIZE) { //Bug!
out.write(data);
}
out.close();
printMeasurements();
return f;
}
{code}
This configuration error also affects HDFS-13513, HDFS-13514,
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
