[HOD] Remove script option from the core hod framework
------------------------------------------------------
Key: HADOOP-2897
URL: https://issues.apache.org/jira/browse/HADOOP-2897
Project: Hadoop Core
Issue Type: Improvement
Components: contrib/hod
Affects Versions: 0.16.0
Reporter: Hemanth Yamijala
Fix For: 0.16.1
Hod currently allows the user to specify and run a hadoop script after
allocation, and deallocating as soon as the script is done. For e.g.
hod -m 3 -z ~/hadoop.script
allocates 3 nodes, and runs ~/hadoop.script, then deallocates
This is a convenient way single line wrapper around 4-5 commands that users
have to write themselves. We have this because:
- hod 0.3 does not provide an easy way to combine these into a single
operation, because of the HOD shell.
- even in hod 0.4, users have to carefully write some error checking code to
make sure their cluster is allocated successfully, before running the script
and their HADOOP_CONF_DIR should be set correctly.
- users can free up clusters as soon as they are done.
The requirements make sense. But having this as part of the core hod interface
seems incorrect. The interface should be an orthogonal set of commands that
each just do one thing well. The script option should be converted to a simple
wrapper that can be part of the hod project. This way, users can enjoy the
benefits of not having to write such a script themselves, while the hod
codebase can still be clean.
One disadvantage if we change this is that users will need to remember one more
command. But given hod 0.4 is a new interface anyway, it is better to address
now, rather than later. And we can alleviate this a bit by making sure options
are consistently named between hod and the wrapper script.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
