Author: buildbot
Date: Mon Apr 13 06:05:29 2015
New Revision: 947374
Log:
Staging update by buildbot for slider
Modified:
websites/staging/slider/trunk/content/ (props changed)
websites/staging/slider/trunk/content/docs/slider_specs/hello_world_slider_app.html
Propchange: websites/staging/slider/trunk/content/
------------------------------------------------------------------------------
--- cms:source-revision (original)
+++ cms:source-revision Mon Apr 13 06:05:29 2015
@@ -1 +1 @@
-1672422
+1673115
Modified:
websites/staging/slider/trunk/content/docs/slider_specs/hello_world_slider_app.html
==============================================================================
---
websites/staging/slider/trunk/content/docs/slider_specs/hello_world_slider_app.html
(original)
+++
websites/staging/slider/trunk/content/docs/slider_specs/hello_world_slider_app.html
Mon Apr 13 06:05:29 2015
@@ -288,13 +288,10 @@ Add one more entry for the component <co
<ul>
<li><code>application.def</code> - location of the application definition
package in default FS (e.g. HDFS). <em>This is where the application package is
stored.</em></li>
<li><code>java_home</code> - location of java on target hosts</li>
-<li><code>package_list</code> - location of the app tarball in the app package
(relative path starting at <strong>files</strong>)</li>
-<li><code>config_types</code> - leave it as empty string</li>
-<li><code>site.global.app_user</code> - the user that is running the app (e.g.
"yarn")</li>
-<li><code>site.global.app_root</code> - location of app root, Slider extracts
the tarball at ${AGENT_WORK_ROOT}/app/install/, so append the relative path
based on the application tarball structure (e.g. jmemcached-1.0.0 for this
package)</li>
</ul>
<p>Add other parameters needed by the application itself. Currently we support
three parameters</p>
<ul>
+<li><code>site.global.additional_cp</code> - this package uses this variable
to provide the location of other helper jars - ones found in the hadoop client
jars location (e.g. /usr/lib/hadoop/lib, your deployment may have the jars in a
different location)</li>
<li><code>site.global.xmx_val</code> - value of Xmx</li>
<li><code>site.global.xms_val</code> - value of Xms</li>
<li><code>site.global.memory_val</code> - value of memory</li>
@@ -363,7 +360,6 @@ Add one more entry for the component <co
<span class="n">process_cmd</span> <span class="p">=</span> <span
class="n">format</span><span class="p">(</span>"<span
class="p">{</span><span class="n">java64_home</span><span
class="p">}</span><span class="o">/</span><span class="n">bin</span><span
class="o">/</span><span class="n">java</span> <span class="o">-</span><span
class="n">Xmx</span><span class="p">{</span><span class="n">xmx_val</span><span
class="p">}</span> <span class="o">-</span><span class="n">Xms</span><span
class="p">{</span><span class="n">xms_val</span><span class="p">}</span> <span
class="o">-</span><span class="n">classpath</span> <span
class="p">{</span><span class="n">app_root</span><span class="p">}</span><span
class="o">/*</span><span class="p">:{</span><span
class="n">additional_cp</span><span class="p">}</span> <span
class="n">com</span><span class="p">.</span><span
class="n">thimbleware</span><span class="p">.</span><span
class="n">jmemcached</span><span class="p">.</span><span class="n">Main
</span> <span class="o">--</span><span class="n">memory</span><span
class="p">={</span><span class="n">memory_val</span><span class="p">}</span>
<span class="o">--</span><span class="n">port</span><span
class="p">={</span><span class="n">port</span><span
class="p">}</span>"<span class="p">)</span>
<span class="n">Execute</span><span class="p">(</span><span
class="n">process_cmd</span><span class="p">,</span>
- <span class="n">user</span><span class="p">=</span><span
class="n">params</span><span class="p">.</span><span
class="n">app_user</span><span class="p">,</span>
<span class="n">logoutput</span><span class="p">=</span><span
class="n">False</span><span class="p">,</span>
<span class="n">wait_for_finish</span><span class="p">=</span><span
class="n">False</span><span class="p">,</span>
<span class="n">pid_file</span><span class="p">=</span><span
class="n">params</span><span class="p">.</span><span class="n">pid_file</span>
@@ -377,6 +373,9 @@ Add one more entry for the component <co
<span class="n">import</span> <span class="n">params</span>
<span class="n">env</span><span class="p">.</span><span
class="n">set_params</span><span class="p">(</span><span
class="n">params</span><span class="p">)</span>
<span class="n">check_process_status</span><span class="p">(</span><span
class="n">params</span><span class="p">.</span><span
class="n">pid_file</span><span class="p">)</span>
+
+ <span class="k">if</span> <span class="n">__name__</span> <span
class="o">==</span> "<span class="n">__main__</span>"<span
class="p">:</span>
+ <span class="n">Memcached</span><span class="p">().</span><span
class="n">execute</span><span class="p">()</span>
</pre></div>
@@ -387,6 +386,20 @@ Add one more entry for the component <co
<li>Executes the command to start jmemcached</li>
<li>Start writes the PID into a file that is used to check status of the
daemon</li>
</ul>
+<h2 id="debugging-tips">Debugging Tips</h2>
+<p>End of the day, the above package runs the following command - post
formatting</p>
+<div class="codehilite"><pre><span class="n">format</span><span
class="p">(</span>"<span class="p">{</span><span
class="n">java64_home</span><span class="p">}</span><span
class="o">/</span><span class="n">bin</span><span class="o">/</span><span
class="n">java</span> <span class="o">-</span><span class="n">Xmx</span><span
class="p">{</span><span class="n">xmx_val</span><span class="p">}</span> <span
class="o">-</span><span class="n">Xms</span><span class="p">{</span><span
class="n">xms_val</span><span class="p">}</span> <span class="o">-</span><span
class="n">classpath</span> <span class="p">{</span><span
class="n">app_root</span><span class="p">}</span><span class="o">/*</span><span
class="p">:{</span><span class="n">additional_cp</span><span class="p">}</span>
<span class="n">com</span><span class="p">.</span><span
class="n">thimbleware</span><span class="p">.</span><span
class="n">jmemcached</span><span class="p">.</span><span class="n">Main</span>
<span class="o">--</span><s
pan class="n">memory</span><span class="p">={</span><span
class="n">memory_val</span><span class="p">}</span> <span
class="o">--</span><span class="n">port</span><span class="p">={</span><span
class="n">port</span><span class="p">}</span>"<span class="p">)</span>
+</pre></div>
+
+
+<p>which, expands to</p>
+<div class="codehilite"><pre><span class="o">/</span><span
class="n">usr</span><span class="o">/</span><span class="n">jdk64</span><span
class="o">/</span><span class="n">jdk1</span><span class="p">.</span>7<span
class="p">.</span>0<span class="n">_67</span><span class="o">/</span><span
class="n">bin</span><span class="o">/</span><span class="n">java</span> <span
class="o">-</span><span class="n">Xmx256m</span> <span class="o">-</span><span
class="n">Xms128m</span> <span class="o">-</span><span
class="n">classpath</span> <span class="o">/</span><span
class="n">hadoop</span><span class="o">/</span><span class="n">yarn</span><span
class="o">/</span><span class="n">local</span><span class="o">/</span><span
class="n">usercache</span><span class="o">/</span><span
class="n">yarn</span><span class="o">/</span><span
class="n">appcache</span><span class="o">/</span><span
class="n">application_1428879923172_0003</span><span class="o">/</span><span
class="n">container_e01_1428879923172_0003_01
_000002</span><span class="o">/</span><span class="n">app</span><span
class="o">/</span><span class="n">install</span><span class="o">/*</span><span
class="p">:</span><span class="o">/</span><span class="n">usr</span><span
class="o">/</span><span class="n">lib</span><span class="o">/</span><span
class="n">hadoop</span><span class="o">/</span><span class="n">lib</span><span
class="o">/*</span> <span class="n">com</span><span class="p">.</span><span
class="n">thimbleware</span><span class="p">.</span><span
class="n">jmemcached</span><span class="p">.</span><span class="n">Main</span>
<span class="o">--</span><span class="n">memory</span><span
class="p">=</span>200<span class="n">M</span> <span class="o">--</span><span
class="n">port</span><span class="p">=</span>37539
+
+<span class="n">port</span> <span class="n">and</span> <span
class="n">memory</span> <span class="n">are</span> <span class="n">based</span>
<span class="n">on</span> <span class="n">the</span> <span
class="n">input</span> <span class="n">provided</span><span class="p">.</span>
<span class="n">And</span><span class="p">,</span> <span class="n">class</span>
<span class="n">path</span> <span class="n">includes</span> <span
class="n">YARN</span> <span class="n">container</span> <span
class="n">location</span> <span class="k">for</span> <span class="n">the</span>
<span class="n">active</span> <span class="n">container</span> <span
class="n">where</span> <span class="n">the</span> <span
class="n">tarball</span> <span class="n">got</span> <span
class="n">expanded</span><span class="p">.</span>
+</pre></div>
+
+
+<p>So, without Slider/YARN, one should be able to execute the command above
and see memcached up and running. It might be a better option to try the
command first to ensure that you have the right tarballs and environment to run
memcached.</p>
</div>
<div id="footer">
