[
https://issues.apache.org/jira/browse/BIGTOP-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14299163#comment-14299163
]
jay vyas edited comment on BIGTOP-1235 at 1/30/15 8:07 PM:
-----------------------------------------------------------
makes sense. now, just thinking out loud, testing will be quite difficult.
ill try to outline steps here:
1) enable yum {{output/}} option for vagrant
2) run gradle to build bigtop packages for yarn, hadoop, and so on
3) spin up bigtop vms
4) confirm that init-hfcs is running
5) run smoke tests (4 and 5 will be automatically run from vagrant, but just
listing them for clarity.)
thanks for helping me with this. am quite distracted lots of snow and
traveling this wk so the I'm not 100% sure i remember the details of how it all
is working from the last time i worked on it.
was (Author: jayunit100):
makes sense. now, just thinking out loud, testing will be quite difficult.
ill try to outline steps here:
1) enable yum {{output/}} option for vagrant
2) run gradle to build bigtop packages for yarn, hadoop, and so on
3) spin up bigtop vms
4) confirm that init-hfcs is running
5) run smoke tests
thanks for helping me with this. am quite distracted lots of snow and
traveling this wk so the I'm not 100% sure i remember the details of how it all
is working from the last time i worked on it.
> Combine BIGTOP-1200 and BIGTOP-952 to speed-up init-hdfs.sh
> -----------------------------------------------------------
>
> Key: BIGTOP-1235
> URL: https://issues.apache.org/jira/browse/BIGTOP-1235
> Project: Bigtop
> Issue Type: Improvement
> Components: general
> Affects Versions: 0.7.0
> Reporter: jay vyas
> Assignee: jay vyas
> Priority: Critical
> Fix For: 0.9.0
>
> Attachments:
> 0001-BIGTOP-1235.-Combine-BIGTOP-1200-and-BIGTOP-952-to-s.patch,
> 0001-BIGTOP-1235.-Combine-BIGTOP-1200-and-BIGTOP-952-to-s.patch,
> BIGTOP-1235.first.patch, BIGTOP-1235.patch
>
>
> BIGTOP-1200 provides file schema in JSON format, for any HCFS related tool to
> read.
> BIGTOP-952 meanwhile give us fast provisioning by running in a single JVM
> (without multiple haoop fs -... commands_).
> Thus, when those two are finished, we can replace init-hdfs.sh (with the
> exception of a few extra shell commands in bottom of that script which still
> will need to be called).
> So this JIRA will:
> - create a new init-hcfs.groovy script which calls provision.groovy in
> BIGTOP-952, with init-hcfs.json as input.
> - add in the remaining straggler commands from init-hdfs.sh which dont fit
> into the generic json format as shell commands.
> - delete init-hdfs.sh entirely
> - update puppet scripts to use init-hcfs.groovy, calling them with the "hdfs"
> argument.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
