[ 
https://issues.apache.org/jira/browse/HDFS-1965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13037355#comment-13037355
 ] 

Hudson commented on HDFS-1965:
------------------------------

Integrated in Hadoop-Hdfs-trunk #673 (See 
[https://builds.apache.org/hudson/job/Hadoop-Hdfs-trunk/673/])
    HDFS-1965. IPCs done using block token-based tickets can't reuse 
connections. Contributed by Todd Lipcon.

todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1125605
Files : 
* /hadoop/hdfs/trunk/src/test/hdfs/org/apache/hadoop/hdfs/DFSTestUtil.java
* 
/hadoop/hdfs/trunk/src/test/hdfs/org/apache/hadoop/hdfs/security/token/block/TestBlockToken.java
* /hadoop/hdfs/trunk/src/java/org/apache/hadoop/hdfs/DFSClient.java
* /hadoop/hdfs/trunk/CHANGES.txt


> IPCs done using block token-based tickets can't reuse connections
> -----------------------------------------------------------------
>
>                 Key: HDFS-1965
>                 URL: https://issues.apache.org/jira/browse/HDFS-1965
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: security
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>            Priority: Critical
>             Fix For: 0.22.0
>
>         Attachments: hdfs-1965-0.22.txt, hdfs-1965.txt, hdfs-1965.txt, 
> hdfs-1965.txt
>
>
> This is the reason that TestFileConcurrentReaders has been failing a lot. 
> Reproducing a comment from HDFS-1057:
> The test has a thread which continually re-opens the file which is being 
> written to. Since the file's in the middle of being written, it makes an RPC 
> to the DataNode in order to determine the visible length of the file. This 
> RPC is authenticated using the block token which came back in the 
> LocatedBlocks object as the security ticket.
> When this RPC hits the IPC layer, it looks at its existing connections and 
> sees none that can be re-used, since the block token differs between the two 
> requesters. Hence, it reconnects, and we end up with hundreds or thousands of 
> IPC connections to the datanode.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to