[
https://issues.apache.org/jira/browse/BIGTOP-1195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13909655#comment-13909655
]
jay vyas commented on BIGTOP-1195:
----------------------------------
TL;DR,
This JIRA has become quiet diverted from the original purpose in the email
thread
here:http://mail-archives.apache.org/mod_mbox/bigtop-user/201401.mbox/%3ccaau13zfcqppjeos6taf2ehwnae_hk6itmwaeeskpm997sdm...@mail.gmail.com%3E
I'd like to get this patch in as a script we all maintain for making running
bigtop smokes easy. It does the following:
- Declares all the enviornment varaibles, including maven/java ones
- compiles the tests
- runs the tests
- reports an error message
- prints Exceptions out directly, if any occur.
I've just tested it on a pseudo distributed cluster created via vagrant-puppet
modules and it works right out of the box in the current bigtop deployment :)
{noformat}
[root@vagrant bigtop]# ./runtests.sh
running tests as user : root
note you can use to compile (if first run, or hacking).
Setting hadoop_home, but shouldnt need it for hadoop 2x...
rmr: DEPRECATED: Please use 'rm -r' instead.
rmr: `/examples': No such file or directory
.........................
Now checking env vars....
.........................
rmr: DEPRECATED: Please use 'rm -r' instead.
rmr: `/-p*': No such file or directory
found PIG_HOME
found MAHOUT_HOME
found JAVA_HOME
found HADOOP_MAPRED_HOME
found HADOOP_CONF_DIR
found HIVE_HOME
.........
-------------------------------------------------------
T E S T S
-------------------------------------------------------
-------------------------------------------------------
T E S T S
-------------------------------------------------------
Running org.apache.bigtop.itest.hadoop.hdfs.TestDistCpIntra
14/02/23 02:58:51 TRACE shell.Shell: /bin/bash -s << __EOT__
date
__EOT__
....
{noformat}
And so on , so you get the idea. Easy to run smokes.
Once this goes we can iterate on this driver it with more logic like :
- options to compile the smokes or not.
- support for Cos' new gradle based perf tests if they are ready to run.
> Higher level interface to smokes.
> ---------------------------------
>
> Key: BIGTOP-1195
> URL: https://issues.apache.org/jira/browse/BIGTOP-1195
> Project: Bigtop
> Issue Type: Improvement
> Reporter: jay vyas
> Attachments: BIGTOP-1195.1.very-raw.patch, BIGTOP-1195.patch
>
>
> Running all the smokes with mvn verify is painful:
> 1) Diving into the XML files when stuff breaks
> 2) Remembering to use TRACE level logging
> 3) Leaving out export PIG_HOME , etc... leads to smokes failing late in the
> test run.
> 4) Hopefully we can specify more env variables to control size of smokes in
> the future. That will make a script for running the whole thing even more
> useful.
> 5) when hacking the groovy scripts:: To Compile or not to compile? Always
> forget to specify.
> A simple bash script could serve as a better tutorial/solution/template for
> users that want to run smokes. I'm attaching a very raw patch that we can
> rewrite in python and flesh out some more to do better error reporting, more
> verification, etc.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
