DomainSocket issues on Solaris

Now that the Hadoop native code builds on Solaris I've been chipping away at all the test failures. About 50% of the failures involve DomainSocket, either directly or indirectly. That seems to be mainly because the tests use DomainSocket to do single-node testing, whereas in production it

[jira] [Created] (HADOOP-12452) Fix tracing documention reflecting the update to htrace-4

Masatake Iwasaki created HADOOP-12452: - Summary: Fix tracing documention reflecting the update to htrace-4 Key: HADOOP-12452 URL: https://issues.apache.org/jira/browse/HADOOP-12452 Project: Hadoop

[jira] [Created] (HADOOP-12453) Support decoding KMS Delegation Token with its own Identifier

Xiaoyu Yao created HADOOP-12453: --- Summary: Support decoding KMS Delegation Token with its own Identifier Key: HADOOP-12453 URL: https://issues.apache.org/jira/browse/HADOOP-12453 Project: Hadoop Common

Build failed in Jenkins: Hadoop-Common-trunk #1778

See Changes: [cnauroth] HDFS-9175. Change scope of 'AccessTokenProvider.getAccessToken()' and -- [...truncated 8855 lines...] Generating

Re: DomainSocket issues on Solaris

That's an interesting find, though I don't think we'd be able to swap in INET sockets in this part of the code. We use Unix domain sockets to share an open file descriptor from the DataNode process to the HDFS client process, and then the client reads directly from that open file descriptor. I

Re: DomainSocket issues on Solaris

On 30/09/2015 17:23, Chris Nauroth wrote: I think file descriptor sharing is a capability of Unix domain sockets only, and not INET sockets. Yes, that's correct. -- Alan Burlison --

Re: DomainSocket issues on Solaris

On 30/09/2015 16:56, Chris Nauroth wrote: Alan, I also meant to say that I didn't understand the comment about "in production it seems that DomainSocket is less commonly used". The current implementation of short-circuit read definitely utilizes DomainSocket, and it's very common to enable

Re: DomainSocket issues on Solaris

Hello Alan, I think this sounds like a reasonable approach. I recommend that you file a JIRA with the proposal (copy-paste the content of your email into a comment) and then wait a few days before starting work in earnest to see if anyone else wants to discuss it first. I also recommend

Jenkins build is back to normal : Hadoop-Common-trunk #1776

See

Re: DomainSocket issues on Solaris

Alan, I also meant to say that I didn't understand the comment about "in production it seems that DomainSocket is less commonly used". The current implementation of short-circuit read definitely utilizes DomainSocket, and it's very common to enable this in production clusters. The documentation