[
https://issues.apache.org/jira/browse/BIGTOP-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14199627#comment-14199627
]
jay vyas commented on BIGTOP-1235:
----------------------------------
[~cos] need some help : What way do you suggest to run the groovy hcfs file
system setup ? right now the only way is to manually add on classpath elements
.
{{groovy -classpath /usr/lib/hadoop/hadoop-common-2.0.6-alpha.jar
+ :/usr/lib/hadoop/lib/guava-11.0.2.jar
+ :/etc/hadoop/conf/:/usr/lib/hadoop/hadoop-common-2.0.6-alpha.jar
+ :/usr/lib/hadoop/lib/commons-configuration-1.6.jar
+ :/usr/lib/hadoop/lib/commons-lang-2.5.jar:/usr/lib/hadoop/hadoop-auth.jar
+ :/usr/lib/hadoop/lib/slf4j-api-1.6.1.jar
+ :/usr/lib/hadoop-hdfs/hadoop-hdfs.jar
+ :/usr/lib/hadoop/lib/protobuf-java-2.4.0a.jar /vagrant/provision.groovy
+ init-hcfs.json }}
any better ideas for the groovy classopath for file system provisioning?
> Combine BIGTOP-1200 and BIGTOP-952 with a few minor shell commands that will
> entirely replace init-hdfs.sh
> -----------------------------------------------------------------------------------------------------------
>
> Key: BIGTOP-1235
> URL: https://issues.apache.org/jira/browse/BIGTOP-1235
> Project: Bigtop
> Issue Type: Improvement
> Components: general
> Affects Versions: 0.7.0
> Reporter: jay vyas
> Assignee: jay vyas
> Priority: Critical
> Fix For: 0.9.0
>
> Attachments: BIGTOP-1235.first.patch, BIGTOP-1235.patch
>
>
> BIGTOP-1200 provides file schema in JSON format, for any HCFS related tool to
> read.
> BIGTOP-952 meanwhile give us fast provisioning by running in a single JVM
> (without multiple haoop fs -... commands_).
> Thus, when those two are finished, we can replace init-hdfs.sh (with the
> exception of a few extra shell commands in bottom of that script which still
> will need to be called).
> So this JIRA will:
> - create a new init-hcfs.groovy script which calls provision.groovy in
> BIGTOP-952, with init-hcfs.json as input.
> - add in the remaining straggler commands from init-hdfs.sh which dont fit
> into the generic json format as shell commands.
> - delete init-hdfs.sh entirely
> - update puppet scripts to use init-hcfs.groovy, calling them with the "hdfs"
> argument.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
