Benoit Perroud created HDFS-7873:
------------------------------------
Summary: OIV webhdfs premature close channel issue
Key: HDFS-7873
URL: https://issues.apache.org/jira/browse/HDFS-7873
Project: Hadoop HDFS
Issue Type: Bug
Components: tools
Affects Versions: 2.5.2, 2.6.0
Reporter: Benoit Perroud
Assignee: Benoit Perroud
Priority: Minor
The new Offline Image Viewer (OIV) supports to load the FSImage and _emulate_ a
webhdfs server to explore the image without touching the NN.
This webhdfs server is not working with folders holding a significant number of
children (files or other folders):
{quote}
$ hadoop fs -ls webhdfs://127.0.0.1:5978/a/big/folder
15/03/03 04:28:19 WARN ssl.FileBasedKeyStoresFactory: The property
'ssl.client.truststore.location' has not been set, no TrustStore will be loaded
15/03/03 04:28:21 WARN security.UserGroupInformation:
PriviledgedActionException as:bperroud (auth:SIMPLE) cause:java.io.IOException:
Response decoding failure: java.lang.IllegalStateException: Expected one of '"}'
ls: Response decoding failure: java.lang.IllegalStateException: Expected one of
'"}'
{quote}
The error comes from an inappropriate usage of Netty.
{{e.getFuture().addListener(ChannelFutureListener.CLOSE)}} is closing the
channel too early because the future attached to the channel already sent the
header so the I/O operation succeeded.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)