[
https://issues.apache.org/jira/browse/GIRAPH-153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13285166#comment-13285166
]
Hudson commented on GIRAPH-153:
-------------------------------
Integrated in Giraph-trunk-Commit #112 (See
[https://builds.apache.org/job/Giraph-trunk-Commit/112/])
GIRAPH-153: HBase/Accumulo Input and Output formats. (bfem via aching)
(Revision 1344020)
Result = SUCCESS
aching : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1344020
Files :
* /giraph/trunk/CHANGELOG
* /giraph/trunk/giraph-formats-contrib
* /giraph/trunk/giraph-formats-contrib/pom.xml
* /giraph/trunk/giraph-formats-contrib/src
* /giraph/trunk/giraph-formats-contrib/src/main
* /giraph/trunk/giraph-formats-contrib/src/main/assembly
* /giraph/trunk/giraph-formats-contrib/src/main/assembly/compile.xml
* /giraph/trunk/giraph-formats-contrib/src/main/java
* /giraph/trunk/giraph-formats-contrib/src/main/java/org
* /giraph/trunk/giraph-formats-contrib/src/main/java/org/apache
* /giraph/trunk/giraph-formats-contrib/src/main/java/org/apache/giraph
* /giraph/trunk/giraph-formats-contrib/src/main/java/org/apache/giraph/format
*
/giraph/trunk/giraph-formats-contrib/src/main/java/org/apache/giraph/format/accumulo
*
/giraph/trunk/giraph-formats-contrib/src/main/java/org/apache/giraph/format/accumulo/AccumuloVertexInputFormat.java
*
/giraph/trunk/giraph-formats-contrib/src/main/java/org/apache/giraph/format/accumulo/AccumuloVertexOutputFormat.java
*
/giraph/trunk/giraph-formats-contrib/src/main/java/org/apache/giraph/format/accumulo/package-info.java
*
/giraph/trunk/giraph-formats-contrib/src/main/java/org/apache/giraph/format/hbase
*
/giraph/trunk/giraph-formats-contrib/src/main/java/org/apache/giraph/format/hbase/HBaseVertexInputFormat.java
*
/giraph/trunk/giraph-formats-contrib/src/main/java/org/apache/giraph/format/hbase/HBaseVertexOutputFormat.java
*
/giraph/trunk/giraph-formats-contrib/src/main/java/org/apache/giraph/format/hbase/package-info.java
* /giraph/trunk/giraph-formats-contrib/src/test
* /giraph/trunk/giraph-formats-contrib/src/test/java
* /giraph/trunk/giraph-formats-contrib/src/test/java/org
* /giraph/trunk/giraph-formats-contrib/src/test/java/org/apache
* /giraph/trunk/giraph-formats-contrib/src/test/java/org/apache/giraph
*
/giraph/trunk/giraph-formats-contrib/src/test/java/org/apache/giraph/BspCase.java
* /giraph/trunk/giraph-formats-contrib/src/test/java/org/apache/giraph/format
*
/giraph/trunk/giraph-formats-contrib/src/test/java/org/apache/giraph/format/accumulo
*
/giraph/trunk/giraph-formats-contrib/src/test/java/org/apache/giraph/format/accumulo/TestAccumuloVertexFormat.java
*
/giraph/trunk/giraph-formats-contrib/src/test/java/org/apache/giraph/format/accumulo/edgemarker
*
/giraph/trunk/giraph-formats-contrib/src/test/java/org/apache/giraph/format/accumulo/edgemarker/AccumuloEdgeInputFormat.java
*
/giraph/trunk/giraph-formats-contrib/src/test/java/org/apache/giraph/format/accumulo/edgemarker/AccumuloEdgeOutputFormat.java
*
/giraph/trunk/giraph-formats-contrib/src/test/java/org/apache/giraph/format/hbase
*
/giraph/trunk/giraph-formats-contrib/src/test/java/org/apache/giraph/format/hbase/TestHBaseRootMarkerVertextFormat.java
*
/giraph/trunk/giraph-formats-contrib/src/test/java/org/apache/giraph/format/hbase/edgemarker
*
/giraph/trunk/giraph-formats-contrib/src/test/java/org/apache/giraph/format/hbase/edgemarker/TableEdgeInputFormat.java
*
/giraph/trunk/giraph-formats-contrib/src/test/java/org/apache/giraph/format/hbase/edgemarker/TableEdgeOutputFormat.java
> HBase/Accumulo Input and Output formats
> ---------------------------------------
>
> Key: GIRAPH-153
> URL: https://issues.apache.org/jira/browse/GIRAPH-153
> Project: Giraph
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.1.0
> Environment: Single host OSX 10.6.8 2.2Ghz Intel i7, 8GB
> Reporter: Brian Femiano
> Assignee: Brian Femiano
> Attachments: GIRAPH-153.1.patch, GIRAPH-153.2.patch,
> GIRAPH-153.3.patch, GIRAPH-153.patch
>
>
> Four abstract classes that wrap their respective delegate input/output
> formats for
> easy hooks into vertex input format subclasses. I've included some sample
> programs that show two very simple graph
> algorithms. I have a graph generator that builds out a very simple directed
> structure, starting with a few 'root' nodes.
> Root nodes are defined as nodes which are not listed as a child anywhere in
> the graph.
> Algorithm 1) AccumuloRootMarker.java --> Accumulo as read/write source.
> Every vertex starts thinking it's a root. At superstep 0, send a message down
> to each
> child as a non-root notification. After superstep 1, only root nodes will
> have never been messaged.
> Algorithm 2) TableRootMarker --> HBase as read/write source. Expands on A1 by
> bundling the notification logic followed by root node propagation. Once we've
> marked the appropriate nodes as roots, tell every child which roots it can be
> traced back to via one or more spanning trees. This will take N + 2
> supersteps where N is the maximum number of hops from any root to any leaf,
> plus 2 supersteps for the initial root flagging.
> I've included all relevant code plus DistributedCacheHelper.java for
> recursive cache file and archive searches. It is more hadoop centric than
> giraph, but these jobs use it so I figured why not commit here.
> These have been tested through local JobRunner, pseudo-distributed on the
> aforementioned hardware, and full distributed on EC2. More details in the
> comments.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
