[
https://issues.apache.org/jira/browse/HDFS-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15370975#comment-15370975
]
Vijay Srinivasaraghavan commented on HDFS-9213:
-----------------------------------------------
I was able to move forward by setting following configurations. There is aslo
couple of flags that you need to enable in MiniDFSCluster to support below
configurations.
Hadoop Configurations:
conf.set("dfs.datanode.address", "localhost:1002");
conf.set("dfs.datanode.hostname", "localhost");
conf.set("dfs.datanode.http.address", "localhost:1003");
DFSMiniCluster:
MiniDFSCluster.Builder builder = new MiniDFSCluster.Builder(conf);
builder.checkDataNodeAddrConfig(true);
builder.checkDataNodeHostConfig(true);
You also need to enable permissions to allow the java process to bind to these
privileged ports. For Ubuntu setup, I was using below command to enable it.
setcap 'cap_net_bind_service=+ep' /path/to/java
It looks like, with this setup we may not need additional patch?
> Minicluster with Kerberos generates some stacks when checking the ports
> -----------------------------------------------------------------------
>
> Key: HDFS-9213
> URL: https://issues.apache.org/jira/browse/HDFS-9213
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: security
> Affects Versions: 3.0.0-alpha1
> Reporter: Nicolas Liochon
> Assignee: Nicolas Liochon
> Priority: Minor
> Fix For: 3.0.0-alpha1
>
> Attachments: hdfs-9213.v1.patch, hdfs-9213.v1.patch
>
>
> When using the minicluster with kerberos the various checks in
> SecureDataNodeStarter fail because the ports are not fixed.
> Stacks like this one:
> {quote}
> java.lang.RuntimeException: Unable to bind on specified streaming port in
> secure context. Needed 0, got 49670
> at
> org.apache.hadoop.hdfs.server.datanode.SecureDataNodeStarter.getSecureResources(SecureDataNodeStarter.java:108)
> {quote}
> There is already a setting to desactivate this type of check for testing, it
> could be used here as well....
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
