Author: buildbot
Date: Fri Apr 3 23:04:50 2015
New Revision: 946254
Log:
Staging update by buildbot for mahout
Modified:
websites/staging/mahout/trunk/content/ (props changed)
websites/staging/mahout/trunk/content/users/environment/h2o-internals.html
Propchange: websites/staging/mahout/trunk/content/
------------------------------------------------------------------------------
--- cms:source-revision (original)
+++ cms:source-revision Fri Apr 3 23:04:50 2015
@@ -1 +1 @@
-1671202
+1671214
Modified:
websites/staging/mahout/trunk/content/users/environment/h2o-internals.html
==============================================================================
--- websites/staging/mahout/trunk/content/users/environment/h2o-internals.html
(original)
+++ websites/staging/mahout/trunk/content/users/environment/h2o-internals.html
Fri Apr 3 23:04:50 2015
@@ -267,14 +267,22 @@
<p>H2O provides a flexible execution framework called <code>MRTask</code>. The
<code>MRTask</code> framework typically executes over a Frame (or even a
Vector), supports various types of map() methods, can optionally modify the
Frame or Vector (though this never happens in the Mahout integration), and
optionally create a new Vector or set of Vectors (to combine them into a new
Frame, and consequently a new DRM).</p>
<h2 id="source-layout">Source Layout</h2>
<p>Within mahout.git, the top level directory, <code>h2o/</code> holds all the
source code related to the H2O backend engine. Part of the code (that
interfaces with the rest of the Mahout componenets) is in Scala, and part of
the code (that interfaces with h2o-core and implements algebraic operators) is
in Java. Here is a brief overview of what functionality can be found where
within <code>h2o/</code>.</p>
-<p>h2o/ - top level directory containing all H2O related code</p>
-<p>h2o/src/main/java/org/apache/mahout/h2obindings/ops/*.java - Physical
operator code for the various DSL algebra</p>
-<p>h2o/src/main/java/org/apache/mahout/h2obindings/drm/*.java - DRM backing
(onto Frame) and Broadcast implementation</p>
-<p>h2o/src/main/java/org/apache/mahout/h2obindings/H2OHdfs.java - Read / Write
between DRM (Frame) and files on HDFS</p>
-<p>h2o/src/main/java/org/apache/mahout/h2obindings/H2OBlockMatrix.java - A
vertical block matrix of DRM presented as a virtual copy-on-write in-core
Matrix. Used in mapBlock() API</p>
-<p>h2o/src/main/java/org/apache/mahout/h2obindings/H2OHelper.java - A
collection of various functionality and helpers. For e.g, convert between
in-core Matrix and DRM, various summary statistics on DRM/Frame.</p>
-<p>h2o/src/main/scala/org/apache/mahout/h2obindings/H2OEngine.scala - DSL
operator graph evaluator and various abstract API implementations for a
distributed engine</p>
-<p>h2o/src/main/scala/org/apache/mahout/h2obindings/* - Various abstract API
implementations ("glue work")</p>
+<div class="codehilite"><pre><span class="n">h2o</span><span
class="o">/</span> <span class="o">-</span> <span class="n">top</span> <span
class="n">level</span> <span class="n">directory</span> <span
class="n">containing</span> <span class="n">all</span> <span
class="n">H2O</span> <span class="n">related</span> <span class="n">code</span>
+
+<span class="n">h2o</span><span class="o">/</span><span
class="n">src</span><span class="o">/</span><span class="n">main</span><span
class="o">/</span><span class="n">java</span><span class="o">/</span><span
class="n">org</span><span class="o">/</span><span class="n">apache</span><span
class="o">/</span><span class="n">mahout</span><span class="o">/</span><span
class="n">h2obindings</span><span class="o">/</span><span
class="n">ops</span><span class="o">/*</span><span class="p">.</span><span
class="n">java</span> <span class="o">-</span> <span class="n">Physical</span>
<span class="n">operator</span> <span class="n">code</span> <span
class="k">for</span> <span class="n">the</span> <span class="n">various</span>
<span class="n">DSL</span> <span class="n">algebra</span>
+
+<span class="n">h2o</span><span class="o">/</span><span
class="n">src</span><span class="o">/</span><span class="n">main</span><span
class="o">/</span><span class="n">java</span><span class="o">/</span><span
class="n">org</span><span class="o">/</span><span class="n">apache</span><span
class="o">/</span><span class="n">mahout</span><span class="o">/</span><span
class="n">h2obindings</span><span class="o">/</span><span
class="n">drm</span><span class="o">/*</span><span class="p">.</span><span
class="n">java</span> <span class="o">-</span> <span class="n">DRM</span> <span
class="n">backing</span> <span class="p">(</span><span class="n">onto</span>
<span class="n">Frame</span><span class="p">)</span> <span class="n">and</span>
<span class="n">Broadcast</span> <span class="n">implementation</span>
+
+<span class="n">h2o</span><span class="o">/</span><span
class="n">src</span><span class="o">/</span><span class="n">main</span><span
class="o">/</span><span class="n">java</span><span class="o">/</span><span
class="n">org</span><span class="o">/</span><span class="n">apache</span><span
class="o">/</span><span class="n">mahout</span><span class="o">/</span><span
class="n">h2obindings</span><span class="o">/</span><span
class="n">H2OHdfs</span><span class="p">.</span><span class="n">java</span>
<span class="o">-</span> <span class="n">Read</span> <span class="o">/</span>
<span class="n">Write</span> <span class="n">between</span> <span
class="n">DRM</span> <span class="p">(</span><span class="n">Frame</span><span
class="p">)</span> <span class="n">and</span> <span class="n">files</span>
<span class="n">on</span> <span class="n">HDFS</span>
+
+<span class="n">h2o</span><span class="o">/</span><span
class="n">src</span><span class="o">/</span><span class="n">main</span><span
class="o">/</span><span class="n">java</span><span class="o">/</span><span
class="n">org</span><span class="o">/</span><span class="n">apache</span><span
class="o">/</span><span class="n">mahout</span><span class="o">/</span><span
class="n">h2obindings</span><span class="o">/</span><span
class="n">H2OBlockMatrix</span><span class="p">.</span><span
class="n">java</span> <span class="o">-</span> <span class="n">A</span> <span
class="n">vertical</span> <span class="n">block</span> <span
class="n">matrix</span> <span class="n">of</span> <span class="n">DRM</span>
<span class="n">presented</span> <span class="n">as</span> <span
class="n">a</span> <span class="n">virtual</span> <span
class="n">copy</span><span class="o">-</span><span class="n">on</span><span
class="o">-</span><span class="n">write</span> <span class="n">in</span><span
class="o">-</span><span
class="n">core</span> <span class="n">Matrix</span><span class="p">.</span>
<span class="n">Used</span> <span class="n">in</span> <span
class="n">mapBlock</span><span class="p">()</span> <span class="n">API</span>
+
+<span class="n">h2o</span><span class="o">/</span><span
class="n">src</span><span class="o">/</span><span class="n">main</span><span
class="o">/</span><span class="n">java</span><span class="o">/</span><span
class="n">org</span><span class="o">/</span><span class="n">apache</span><span
class="o">/</span><span class="n">mahout</span><span class="o">/</span><span
class="n">h2obindings</span><span class="o">/</span><span
class="n">H2OHelper</span><span class="p">.</span><span class="n">java</span>
<span class="o">-</span> <span class="n">A</span> <span
class="n">collection</span> <span class="n">of</span> <span
class="n">various</span> <span class="n">functionality</span> <span
class="n">and</span> <span class="n">helpers</span><span class="p">.</span>
<span class="n">For</span> <span class="n">e</span><span
class="p">.</span><span class="n">g</span><span class="p">,</span> <span
class="n">convert</span> <span class="n">between</span> <span
class="n">in</span><span class="o">-</span><s
pan class="n">core</span> <span class="n">Matrix</span> <span
class="n">and</span> <span class="n">DRM</span><span class="p">,</span> <span
class="n">various</span> <span class="n">summary</span> <span
class="n">statistics</span> <span class="n">on</span> <span
class="n">DRM</span><span class="o">/</span><span class="n">Frame</span><span
class="p">.</span>
+
+<span class="n">h2o</span><span class="o">/</span><span
class="n">src</span><span class="o">/</span><span class="n">main</span><span
class="o">/</span><span class="n">scala</span><span class="o">/</span><span
class="n">org</span><span class="o">/</span><span class="n">apache</span><span
class="o">/</span><span class="n">mahout</span><span class="o">/</span><span
class="n">h2obindings</span><span class="o">/</span><span
class="n">H2OEngine</span><span class="p">.</span><span class="n">scala</span>
<span class="o">-</span> <span class="n">DSL</span> <span
class="n">operator</span> <span class="n">graph</span> <span
class="n">evaluator</span> <span class="n">and</span> <span
class="n">various</span> <span class="n">abstract</span> <span
class="n">API</span> <span class="n">implementations</span> <span
class="k">for</span> <span class="n">a</span> <span
class="n">distributed</span> <span class="n">engine</span>
+
+<span class="n">h2o</span><span class="o">/</span><span
class="n">src</span><span class="o">/</span><span class="n">main</span><span
class="o">/</span><span class="n">scala</span><span class="o">/</span><span
class="n">org</span><span class="o">/</span><span class="n">apache</span><span
class="o">/</span><span class="n">mahout</span><span class="o">/</span><span
class="n">h2obindings</span><span class="o">/*</span> <span class="o">-</span>
<span class="n">Various</span> <span class="n">abstract</span> <span
class="n">API</span> <span class="n">implementations</span> <span
class="p">(</span>"<span class="n">glue</span> <span
class="n">work</span>"<span class="p">)</span>
+</pre></div>
</div>
</div>
</div>
