Author: buildbot
Date: Wed Nov 26 18:35:40 2014
New Revision: 930630
Log:
Staging update by buildbot for slider
Modified:
websites/staging/slider/trunk/content/ (props changed)
websites/staging/slider/trunk/content/developing/building.html
websites/staging/slider/trunk/content/developing/functional_tests.html
websites/staging/slider/trunk/content/developing/testing.html
Propchange: websites/staging/slider/trunk/content/
------------------------------------------------------------------------------
--- cms:source-revision (original)
+++ cms:source-revision Wed Nov 26 18:35:40 2014
@@ -1 +1 @@
-1641837
+1641881
Modified: websites/staging/slider/trunk/content/developing/building.html
==============================================================================
--- websites/staging/slider/trunk/content/developing/building.html (original)
+++ websites/staging/slider/trunk/content/developing/building.html Wed Nov 26
18:35:40 2014
@@ -481,53 +481,6 @@ in <code>slider-assembly/pom.xml</code>
by HDP installations. To target other installations, alternate maven profiles
will need to be defined.</p>
<h2 id="testing">Testing</h2>
-<h3 id="configuring-slider-to-locate-the-relevant-artifacts">Configuring
Slider to locate the relevant artifacts</h3>
-<p>You must have the file <code>src/test/resources/slider-test.xml</code> (this
-is ignored by git), declaring where HBase, accumulo, Hadoop and zookeeper
are:</p>
-<div class="codehilite"><pre><span class="nt"><configuration></span>
-
- <span class="nt"><property></span>
- <span class="nt"><name></span>slider.test.hbase.home<span
class="nt"></name></span>
- <span
class="nt"><value></span>/home/slider/hbase/hbase-assembly/target/hbase-0.98.0-SNAPSHOT<span
class="nt"></value></span>
- <span class="nt"><description></span>HBASE Home<span
class="nt"></description></span>
- <span class="nt"></property></span>
-
- <span class="nt"><property></span>
- <span class="nt"><name></span>slider.test.hbase.tar<span
class="nt"></name></span>
- <span
class="nt"><value></span>/home/slider/hbase/hbase-assembly/target/hbase-0.98.0-SNAPSHOT-bin.tar.gz<span
class="nt"></value></span>
- <span class="nt"><description></span>HBASE archive URI<span
class="nt"></description></span>
- <span class="nt"></property></span>
-
- <span class="nt"><property></span>
- <span class="nt"><name></span>slider.test.accumulo.home<span
class="nt"></name></span>
- <span
class="nt"><value></span>/home/slider/accumulo/assemble/target/accumulo-1.6.1/<span
class="nt"></value></span>
- <span class="nt"><description></span>Accumulo Home<span
class="nt"></description></span>
- <span class="nt"></property></span>
-
- <span class="nt"><property></span>
- <span class="nt"><name></span>slider.test.accumulo.tar<span
class="nt"></name></span>
- <span
class="nt"><value></span>/home/slider/accumulo/assemble/target/accumulo-1.6.1-bin.tar.gz<span
class="nt"></value></span>
- <span class="nt"><description></span>Accumulo archive URI<span
class="nt"></description></span>
- <span class="nt"></property></span>
-
- <span class="nt"><property></span>
- <span class="nt"><name></span>zk.home<span
class="nt"></name></span>
- <span class="nt"><value></span>
- /home/slider/Apps/zookeeper<span class="nt"></value></span>
- <span class="nt"><description></span>Zookeeper home dir on target
systems<span class="nt"></description></span>
- <span class="nt"></property></span>
-
- <span class="nt"><property></span>
- <span class="nt"><name></span>hadoop.home<span
class="nt"></name></span>
- <span class="nt"><value></span>
- /home/slider/hadoop-common/hadoop-dist/target/hadoop-2.3.0<span
class="nt"></value></span>
- <span class="nt"><description></span>Hadoop home dir on target
systems<span class="nt"></description></span>
- <span class="nt"></property></span>
-
-<span class="nt"></configuration></span>
-</pre></div>
-
-
<h2 id="debugging-a-failing-test">Debugging a failing test</h2>
<ol>
<li>
Modified: websites/staging/slider/trunk/content/developing/functional_tests.html
==============================================================================
--- websites/staging/slider/trunk/content/developing/functional_tests.html
(original)
+++ websites/staging/slider/trunk/content/developing/functional_tests.html Wed
Nov 26 18:35:40 2014
@@ -427,31 +427,8 @@ the tests appear to hang</p>
</pre></div>
-<h3 id="using-relative-paths-in-test-configurations">Using relative paths in
test configurations</h3>
-<p>When you are sharing configurations across machines via SCM or similar,
-its impossible to have absolute paths in the configuration options to
-the location of items in the local filesystem (e.g. configuration
directories).</p>
-<p>There's two techniques</p>
-<ol>
-<li>
-<p>Keep the data in HDFS and refer to it there. This works if there is a
shared,
-persistent HDFS cluster.</p>
-</li>
-<li>
-<p>Use the special property <code>SLIDER_CONF_DIR</code> that is set to the
path
-of the directory, and which can then be used to create an absolute path
-from paths relative to the configuration dir:</p>
-<p><property>
-<name>slider.test.hbase.appconf</name>
-<description>Path to the directory containing the HBase application
config</description>
-<value>file://${SLIDER_CONF_DIR}/../hbase</value>
- </property></p>
-</li>
-</ol>
-<p>If the actual XML file path is required, use the property
-<code>slider.test.conf.xml</code> </p>
<h2 id="parallel-execution">Parallel execution</h2>
-<p>Attempts to run test cases in parallel failed -even with a configuration
+<p>Attempts to run test cases in parallel failed âeven with a configuration
to run methods in a class sequentially, but separate classes independently.</p>
<p>Even after identifying and eliminating some unintended sharing of static
mutable variables, trying to run test cases in parallel seemed to hang
@@ -567,50 +544,7 @@ as the host OS.</p>
</pre></div>
-<h3 id="hbase-tests">HBase Tests</h3>
-<p>The HBase tests can be enabled or disabled</p>
-<div class="codehilite"><pre><span class="nt"><property></span>
- <span class="nt"><name></span>slider.test.hbase.enabled<span
class="nt"></name></span>
- <span class="nt"><description></span>Flag to enable/disable HBase
tests<span class="nt"></description></span>
- <span class="nt"><value></span>true<span
class="nt"></value></span>
-<span class="nt"></property></span>
-</pre></div>
-
-
-<p>Mandatory test parameters must be added to
<code>slider-client.xml</code></p>
-<div class="codehilite"><pre><span class="nt"><property></span>
- <span class="nt"><name></span>slider.test.hbase.tar<span
class="nt"></name></span>
- <span class="nt"><description></span>Path to the HBase Tar file in
HDFS<span class="nt"></description></span>
- <span
class="nt"><value></span>hdfs://sandbox:8020/user/slider/hbase.tar.gz<span
class="nt"></value></span>
-<span class="nt"></property></span>
-
-<span class="nt"><property></span>
- <span class="nt"><name></span>slider.test.hbase.appconf<span
class="nt"></name></span>
- <span class="nt"><description></span>Path to the directory containing
the HBase application config<span class="nt"></description></span>
- <span class="nt"><value></span>file://<span class="cp">${</span><span
class="err">$</span><span class="p">{</span><span
class="n">SLIDER_CONF_DIR</span><span class="cp">}</span>}/../hbase<span
class="nt"></value></span>
-<span class="nt"></property></span>
-</pre></div>
-
-
-<p>Optional parameters: </p>
-<div class="codehilite"><pre> <span class="nt"><property></span>
- <span
class="nt"><name></span>slider.test.hbase.launch.wait.seconds<span
class="nt"></name></span>
- <span class="nt"><description></span>Time to wait in seconds for HBase
to start<span class="nt"></description></span>
- <span class="nt"><value></span>1800<span
class="nt"></value></span>
-<span class="nt"></property></span>
-</pre></div>
-
-
<h4 id="accumulo-configuration-options">Accumulo configuration options</h4>
-<p>Enable/disable the tests</p>
-<div class="codehilite"><pre> <span class="nt"><property></span>
- <span class="nt"><name></span>slider.test.accumulo.enabled<span
class="nt"></name></span>
- <span class="nt"><description></span>Flag to enable/disable Accumulo
tests<span class="nt"></description></span>
- <span class="nt"><value></span>true<span
class="nt"></value></span>
- <span class="nt"></property></span>
-</pre></div>
-
-
<p>Optional parameters</p>
<div class="codehilite"><pre> <span class="nt"><property></span>
<span
class="nt"><name></span>slider.test.accumulo.launch.wait.seconds<span
class="nt"></name></span>
Modified: websites/staging/slider/trunk/content/developing/testing.html
==============================================================================
--- websites/staging/slider/trunk/content/developing/testing.html (original)
+++ websites/staging/slider/trunk/content/developing/testing.html Wed Nov 26
18:35:40 2014
@@ -190,162 +190,6 @@ Latest release: <strong>0.60.0-incubatin
using Hadoop's <code>MiniDFSCluster</code> and <code>MiniYARNCluster</code>
classes to create small,
one-node test clusters. All the YARN/HDFS code runs in the JUnit process; the
AM and spawned processeses run independently.</p>
-<h3 id="for-hbase-tests-in-slider-providershbase">For HBase Tests in
<code>slider-providers/hbase</code></h3>
-<p>Requirements
-<em> A copy of <code>hbase.tar.gz</code> in the local filesystem
-</em> A an expanded <code>hbase.tar.gz</code> in the local filesystem</p>
-<h3 id="for-accumulo-tests-in-slider-providersaccumulo">For Accumulo Tests in
<code>slider-providers/accumulo</code></h3>
-<ul>
-<li>A copy of <code>accumulo.tar.gz</code> in the local filesystem, </li>
-<li>An expanded <code>accumulo.tar.gz</code> in the local filesystem, </li>
-<li>an expanded Zookeeper installation</li>
-</ul>
-<p>All of these need to be defined in the file
<code>slider-core/src/test/resources/slider-test.xml</code></p>
-<p>Example:</p>
-<div class="codehilite"><pre><span class="nt"><configuration></span>
-
- <span class="nt"><property></span>
- <span class="nt"><name></span>slider.test.hbase.enabled<span
class="nt"></name></span>
- <span class="nt"><description></span>Flag to enable/disable HBase
tests<span class="nt"></description></span>
- <span class="nt"><value></span>true<span
class="nt"></value></span>
- <span class="nt"></property></span>
-
- <span class="nt"><property></span>
- <span class="nt"><name></span>slider.test.hbase.home<span
class="nt"></name></span>
- <span class="nt"><value></span>/home/slider/hbase-0.98.0<span
class="nt"></value></span>
- <span class="nt"><description></span>HBASE Home<span
class="nt"></description></span>
- <span class="nt"></property></span>
-
- <span class="nt"><property></span>
- <span class="nt"><name></span>slider.test.hbase.tar<span
class="nt"></name></span>
- <span
class="nt"><value></span>/home/slider/Projects/hbase-0.98.0-bin.tar.gz<span
class="nt"></value></span>
- <span class="nt"><description></span>HBASE archive URI<span
class="nt"></description></span>
- <span class="nt"></property></span>
-
- <span class="nt"><property></span>
- <span class="nt"><name></span>slider.test.accumulo.enabled<span
class="nt"></name></span>
- <span class="nt"><description></span>Flag to enable/disable Accumulo
tests<span class="nt"></description></span>
- <span class="nt"><value></span>true<span
class="nt"></value></span>
- <span class="nt"></property></span>
-
- <span class="nt"><property></span>
- <span class="nt"><name></span>slider.test.accumulo.home<span
class="nt"></name></span>
- <span class="nt"><value></span>
- /home/slider/accumulo-1.6.0-SNAPSHOT/<span
class="nt"></value></span>
- <span class="nt"><description></span>Accumulo Home<span
class="nt"></description></span>
- <span class="nt"></property></span>
-
- <span class="nt"><property></span>
- <span class="nt"><name></span>slider.test.accumulo.tar<span
class="nt"></name></span>
- <span
class="nt"><value></span>/home/slider/accumulo-1.6.0-SNAPSHOT-bin.tar<span
class="nt"></value></span>
- <span class="nt"><description></span>Accumulo archive URI<span
class="nt"></description></span>
- <span class="nt"></property></span>
-
- <span class="nt"><property></span>
- <span class="nt"><name></span>slider.test.am.restart.time<span
class="nt"></name></span>
- <span class="nt"><description></span>Time in millis to await an AM
restart<span class="nt"></description></span>
- <span class="nt"><value></span>30000<span
class="nt"></value></span>
- <span class="nt"></property></span>
-
- <span class="nt"><property></span>
- <span class="nt"><name></span>zk.home<span
class="nt"></name></span>
- <span class="nt"><value></span>/home/slider/zookeeper<span
class="nt"></value></span>
- <span class="nt"><description></span>Zookeeper home dir on target
systems<span class="nt"></description></span>
- <span class="nt"></property></span>
-
- <span class="nt"><property></span>
- <span class="nt"><name></span>hadoop.home<span
class="nt"></name></span>
- <span class="nt"><value></span>/home/slider/hadoop-2.6.0<span
class="nt"></value></span>
- <span class="nt"><description></span>Hadoop home dir on target
systems<span class="nt"></description></span>
- <span class="nt"></property></span>
-
-<span class="nt"></configuration></span>
-</pre></div>
-
-
-<p><em>Important:</em> For the local tests, a simple local filesystem path is
used for
-all the values. </p>
-<p>For the functional tests, the accumulo and hbase tar properties will
-need to be set to a URL of a tar file that is accessible to all the
-nodes in the cluster -which usually means HDFS, and so an <code>hdfs://</code>
URL</p>
-<h2 id="security">Security</h2>
-<div class="codehilite"><pre><span class="nt"><property></span>
- <span class="nt"><name></span>slider.am.login.keytab.name<span
class="nt"></name></span>
- <span class="nt"><value></value></span>
-<span class="nt"></property></span>
-<span class="nt"><property></span>
- <span class="nt"><name></span>slider.am.keytab.local.path<span
class="nt"></name></span>
- <span class="nt"><description></span>absolute path to keytab<span
class="nt"></description></span>
- <span class="nt"><value></value></span>
-<span class="nt"></property></span>
-<span class="nt"><property></span>
- <span class="nt"><name></span>slider.keytab.principal.name<span
class="nt"></name></span>
- <span class="nt"><value></value></span>
-<span class="nt"></property></span>
-</pre></div>
-
-
-<h2 id="provider-specific-parameters">Provider-specific parameters</h2>
-<p>An individual provider can pick up settings from their own
-<code>src/test/resources/slider-client.xml</code> file, or the one in
<code>slider-core</code>.
-We strongly advice placing all the values in the <code>slider-core</code>
file.</p>
-<ol>
-<li>All uncertainty about which file is picked up on the class path first goes
-away</li>
-<li>There's one place to keep all the configuration values in sync.</li>
-</ol>
-<h3 id="agent-tests">Agent Tests</h3>
-<h3 id="hbase-tests">HBase Tests</h3>
-<p>The HBase tests can be enabled or disabled</p>
-<div class="codehilite"><pre><span class="nt"><property></span>
- <span class="nt"><name></span>slider.test.hbase.enabled<span
class="nt"></name></span>
- <span class="nt"><description></span>Flag to enable/disable HBase
tests<span class="nt"></description></span>
- <span class="nt"><value></span>true<span
class="nt"></value></span>
-<span class="nt"></property></span>
-</pre></div>
-
-
-<p>Mandatory test parameters must be added to
<code>slider-client.xml</code></p>
-<div class="codehilite"><pre><span class="nt"><property></span>
- <span class="nt"><name></span>slider.test.hbase.tar<span
class="nt"></name></span>
- <span class="nt"><description></span>Path to the HBase Tar file in
HDFS<span class="nt"></description></span>
- <span
class="nt"><value></span>hdfs://sandbox:8020/user/slider/hbase.tar.gz<span
class="nt"></value></span>
-<span class="nt"></property></span>
-
-<span class="nt"><property></span>
- <span class="nt"><name></span>slider.test.hbase.appconf<span
class="nt"></name></span>
- <span class="nt"><description></span>Path to the directory containing
the HBase application config<span class="nt"></description></span>
- <span class="nt"><value></span>file://<span class="cp">${</span><span
class="n">user</span><span class="o">.</span><span class="n">dir</span><span
class="cp">}</span>/src/test/configs/sandbox/hbase<span
class="nt"></value></span>
-<span class="nt"></property></span>
-</pre></div>
-
-
-<p>Optional parameters: </p>
-<div class="codehilite"><pre> <span class="nt"><property></span>
- <span
class="nt"><name></span>slider.test.hbase.launch.wait.seconds<span
class="nt"></name></span>
- <span class="nt"><description></span>Time to wait in seconds for HBase
to start<span class="nt"></description></span>
- <span class="nt"><value></span>180000<span
class="nt"></value></span>
-<span class="nt"></property></span>
-</pre></div>
-
-
-<h4 id="accumulo-configuration-options">Accumulo configuration options</h4>
-<p>Enable/disable the tests</p>
-<div class="codehilite"><pre> <span class="nt"><property></span>
- <span class="nt"><name></span>slider.test.accumulo.enabled<span
class="nt"></name></span>
- <span class="nt"><description></span>Flag to enable/disable Accumulo
tests<span class="nt"></description></span>
- <span class="nt"><value></span>true<span
class="nt"></value></span>
- <span class="nt"></property></span>
-</pre></div>
-
-
-<p>Optional parameters</p>
-<div class="codehilite"><pre> <span class="nt"><property></span>
- <span
class="nt"><name></span>slider.test.accumulo.launch.wait.seconds<span
class="nt"></name></span>
- <span class="nt"><description></span>Time to wait in seconds for
Accumulo to start<span class="nt"></description></span>
- <span class="nt"><value></span>180000<span
class="nt"></value></span>
- <span class="err"><</span>/property
-</pre></div>
</div>
<div id="footer">
