[
https://issues.apache.org/jira/browse/BIGTOP-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13918306#comment-13918306
]
jay vyas edited comment on BIGTOP-1235 at 3/5/14 3:43 AM:
----------------------------------------------------------
Update:
- Now there are patches in for BIGTOP-1200 and BIGTOP-952.
- I've integrated the "oozie straggler" commands which arent in BIGTOP-1200 as
pure shell calls. So no need for any extra commands in this JIRA.
- Once those go in they can serve as a prototypical replacement for
init-hdfs.sh,
Sp the main task in this JIRA will be:
- Update puppet provisioners
- Make sure that groovy and itest jar are available at setup time so that shell
commands can run from the groovy provisioner.
- Test it all by provisioning a hadoop system from scratch, without init-hdfs.sh
- delete init-hdfs.sh
- Implement usage of "HCFS_SUPER_USER" parameter so that permissions can
different depending on root_user value.
was (Author: jayunit100):
Update:
- Now there are patches in for BIGTOP-1200 and BIGTOP-952.
- I've integrated the "oozie straggler" commands which arent in BIGTOP-1200 as
pure shell calls. So no need for any extra commands in this JIRA.
- Once those go in they can serve as a prototypical replacement for
init-hdfs.sh,
Sp the main task in this JIRA will be:
- Update puppet provisioners
- Make sure that groovy and itest jar are available at setup time so that shell
commands can run from the groovy provisioner.
- Test it all by provisioning a hadoop system from scratch, without init-hdfs.sh
- delete init-hdfs.sh
> Combine BIGTOP-1200 and BIGTOP-952 with a few minor shell commands that will
> entirely replace init-hdfs.sh
> -----------------------------------------------------------------------------------------------------------
>
> Key: BIGTOP-1235
> URL: https://issues.apache.org/jira/browse/BIGTOP-1235
> Project: Bigtop
> Issue Type: Improvement
> Components: General
> Affects Versions: 0.7.0
> Reporter: jay vyas
>
> BIGTOP-1200 provides file schema in JSON format, for any HCFS related tool to
> read.
> BIGTOP-952 meanwhile give us fast provisioning by running in a single JVM
> (without multiple haoop fs -... commands_).
> Thus, when those two are finished, we can replace init-hdfs.sh (with the
> exception of a few extra shell commands in bottom of that script which still
> will need to be called).
> So this JIRA will:
> - create a new init-hcfs.groovy script which calls provision.groovy in
> BIGTOP-952, with init-hcfs.json as input.
> - add in the remaining straggler commands from init-hdfs.sh which dont fit
> into the generic json format as shell commands.
> - delete init-hdfs.sh entirely
> - update puppet scripts to use init-hcfs.groovy, calling them with the "hdfs"
> argument.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
