[
https://issues.apache.org/jira/browse/HADOOP-16881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17240971#comment-17240971
]
Wei-Chiu Chuang commented on HADOOP-16881:
------------------------------------------
Discussed this fix with [~vivekratnavel] [~swagle] and [~arp].
The fix is generally ok. It is clearly a connection leak which we should fix in
the authenticators library. Closing the connection explicitly may cause
latency, and the usage of kerberos authenticator will ultimately saturate KDC.
If the performance becomes a concern, it is up to the application to switch to
delegation token authenticator to avoid the bottleneck / or to reuse the
authenticated connection. At the library level, we should do what's correct
which is to close the leaked connection.
> PseudoAuthenticator does not disconnect HttpURLConnection leading to
> CLOSE_WAIT cnxns
> -------------------------------------------------------------------------------------
>
> Key: HADOOP-16881
> URL: https://issues.apache.org/jira/browse/HADOOP-16881
> Project: Hadoop Common
> Issue Type: Bug
> Components: auth, security
> Affects Versions: 3.3.0
> Reporter: Prabhu Joseph
> Assignee: Prabhu Joseph
> Priority: Major
>
> PseudoAuthenticator and KerberosAuthentication does not disconnect
> HttpURLConnection leading to lot of CLOSE_WAIT connections. YARN-8414 issue
> is observed due to this.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
