[
https://issues.apache.org/jira/browse/HADOOP-4998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12664094#action_12664094
]
Steve Loughran commented on HADOOP-4998:
----------------------------------------
I agree; the memory use for an exec() is odd and needs to be looked at.
Incidentally, one thing we are fond of doing is exec-ing a long-lived shell
rather than running a shell script. This lets us use SSH to connect to nearby
hosts, or to boost from being untrusted to root, but it may also have memory
consumption benefits. You just need to keep that single shell connection open
and issue commands down its IO streams.
> Implement a native OS runtime for Hadoop
> ----------------------------------------
>
> Key: HADOOP-4998
> URL: https://issues.apache.org/jira/browse/HADOOP-4998
> Project: Hadoop Core
> Issue Type: New Feature
> Components: native
> Reporter: Arun C Murthy
> Assignee: Arun C Murthy
> Fix For: 0.21.0
>
>
> It would be useful to implement a JNI-based runtime for Hadoop to get access
> to the native OS runtime. This would allow us to stop relying on exec'ing
> bash to get access to information such as user-groups, process limits etc.
> and for features such as chown/chgrp (org.apache.hadoop.util.Shell).
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
