[
https://issues.apache.org/jira/browse/HDFS-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741286#comment-14741286
]
James Clampffer commented on HDFS-9062:
---------------------------------------
Hi Chris,
Thanks for the suggestions and usage examples. I'd really like to avoid any
hard dependencies between libhdfs++ development and the cluster the tests run
against. That way the tests don't need to care if I'm starting up a
minidfscluster or if I'm pointing them at a rack of machines with a proper HDFS
installation.
The target workflow I have in mind is:
1) Generate a set of native executables that embed libhdfs++ to be used for
testing and profiling.
2) Start up a miniDFS cluster in an arbitrary location with path validation off.
3) Execute the binaries under valgrind and profiling tools and just point them
at the minidfs cluster.
Once it comes time to do large scale performance testing step 2 can be
substituted with a normal HDFS installation. I was thinking of turning off
path validation by using an extra command line flag to call
DomainSocket#disableBindPathValidation.
Admittedly I'm still very new to the Hadoop project's way of running tests so
I'm going to look into your suggestions and see if one of those existing
methods would apply here rather than add more knobs.
> Add a parameter to MiniDFSCluster to turn off security checks on the domain
> socked path
> ---------------------------------------------------------------------------------------
>
> Key: HDFS-9062
> URL: https://issues.apache.org/jira/browse/HDFS-9062
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: hdfs-client
> Reporter: James Clampffer
> Assignee: James Clampffer
> Priority: Blocker
>
> I'd like to add a command line parameter that allows the permission checks on
> dfs.domain.socket.path to be turned off.
> Right now a blocker, or at least major inconvenience, for short circuit
> reader development is getting the domain socket path set up with the correct
> permissions. I'm working on shared test machines where messing with things
> in /var/lib is discouraged.
> This should also make it easier to write tests for short circuit reads once
> completed.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
