[
https://issues.apache.org/jira/browse/GIRAPH-693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13693642#comment-13693642
]
Hudson commented on GIRAPH-693:
-------------------------------
Integrated in Giraph-trunk-Commit #1054 (See
[https://builds.apache.org/job/Giraph-trunk-Commit/1054/])
GIRAPH-693: Giraph-Hive check user code as soon as possible (nitay)
(Revision 8fbade6a7801afd6065007473585d9d2a761818a)
Result = FAILURE
nitay :
http://git-wip-us.apache.org/repos/asf?p=giraph.git&a=commit&h=8fbade6a7801afd6065007473585d9d2a761818a
Files :
* giraph-hive/src/test/java/org/apache/giraph/hive/input/HiveEdgeInputTest.java
*
giraph-core/src/main/java/org/apache/giraph/utils/InMemoryVertexInputFormat.java
* giraph-hive/src/test/java/org/apache/giraph/hive/output/CheckOutputTest.java
* giraph-core/src/main/java/org/apache/giraph/utils/InternalVertexRunner.java
*
giraph-hive/src/main/java/org/apache/giraph/hive/input/vertex/examples/HiveIntNullNullVertex.java
*
giraph-accumulo/src/test/java/org/apache/giraph/io/accumulo/edgemarker/AccumuloEdgeInputFormat.java
*
giraph-core/src/main/java/org/apache/giraph/io/internal/WrappedEdgeInputFormat.java
*
giraph-hive/src/main/java/org/apache/giraph/hive/output/SimpleVertexToHive.java
*
giraph-hive/src/main/java/org/apache/giraph/hive/output/HiveVertexOutputFormat.java
*
giraph-hbase/src/test/java/org/apache/giraph/io/hbase/edgemarker/TableEdgeInputFormat.java
*
giraph-core/src/main/java/org/apache/giraph/io/formats/GeneratedVertexInputFormat.java
* giraph-hive/src/test/java/org/apache/giraph/hive/input/CheckInputTest.java
*
giraph-core/src/main/java/org/apache/giraph/io/formats/TextEdgeInputFormat.java
*
giraph-core/src/main/java/org/apache/giraph/io/formats/PseudoRandomEdgeInputFormat.java
* giraph-core/src/main/java/org/apache/giraph/graph/GraphTaskManager.java
*
giraph-hive/src/main/java/org/apache/giraph/hive/input/vertex/HiveVertexReader.java
*
giraph-core/src/main/java/org/apache/giraph/io/formats/SequenceFileVertexInputFormat.java
* giraph-hive/src/main/java/org/apache/giraph/hive/common/HiveInputOptions.java
*
giraph-hive/src/main/java/org/apache/giraph/hive/input/edge/examples/HiveIntNullEdge.java
* giraph-hive/src/main/java/org/apache/giraph/hive/common/HiveParsing.java
* giraph-hive/src/test/java/org/apache/giraph/hive/output/HiveOutputTest.java
* giraph-hive/src/test/java/org/apache/giraph/hive/Helpers.java
*
giraph-hive/src/main/java/org/apache/giraph/hive/input/vertex/HiveVertexInputFormat.java
* giraph-hive/src/main/java/org/apache/giraph/hive/output/HiveVertexWriter.java
* giraph-hive/src/test/java/org/apache/giraph/hive/GiraphHiveTestBase.java
*
giraph-hive/src/test/java/org/apache/giraph/hive/input/HiveVertexInputTest.java
* giraph-hive/src/main/java/org/apache/giraph/hive/input/HiveInputChecker.java
* CHANGELOG
*
giraph-examples/src/main/java/org/apache/giraph/examples/AggregatorsTestComputation.java
*
giraph-hive/src/main/java/org/apache/giraph/hive/input/edge/HiveEdgeInputFormat.java
*
giraph-core/src/main/java/org/apache/giraph/io/formats/TextVertexValueInputFormat.java
*
giraph-core/src/main/java/org/apache/giraph/io/formats/PseudoRandomVertexInputFormat.java
*
giraph-hive/src/main/java/org/apache/giraph/hive/output/examples/HiveOutputIntIntVertex.java
* pom.xml
*
giraph-hive/src/main/java/org/apache/giraph/hive/input/vertex/HiveToVertex.java
*
giraph-core/src/main/java/org/apache/giraph/io/formats/TextVertexInputFormat.java
*
giraph-hive/src/main/java/org/apache/giraph/hive/input/edge/examples/HiveIntDoubleEdge.java
* giraph-hive/src/main/java/org/apache/giraph/hive/output/VertexToHive.java
*
giraph-core/src/main/java/org/apache/giraph/io/internal/WrappedVertexInputFormat.java
*
giraph-core/src/main/java/org/apache/giraph/io/formats/multi/MultiVertexInputFormat.java
* giraph-hive/src/main/java/org/apache/giraph/hive/common/HiveUtils.java
*
giraph-hive/src/main/java/org/apache/giraph/hive/input/edge/HiveEdgeReader.java
* giraph-core/src/main/java/org/apache/giraph/io/GiraphInputFormat.java
* giraph-hive/src/main/java/org/apache/giraph/hive/input/edge/HiveToEdge.java
*
giraph-core/src/main/java/org/apache/giraph/io/formats/PseudoRandomIntNullVertexInputFormat.java
*
giraph-core/src/main/java/org/apache/giraph/io/formats/multi/MultiEdgeInputFormat.java
*
giraph-hive/src/main/java/org/apache/giraph/hive/input/vertex/examples/HiveIntDoubleDoubleVertex.java
> Giraph-Hive check user code as soon as possible
> -----------------------------------------------
>
> Key: GIRAPH-693
> URL: https://issues.apache.org/jira/browse/GIRAPH-693
> Project: Giraph
> Issue Type: Bug
> Reporter: Nitay Joffe
> Assignee: Nitay Joffe
>
> We have a lot of cases of users running long jobs and then failing at the
> Hive output step because of some misconfigured schema or type mismatch. We'd
> like to move these errors as soon as possible.
> To make this happen I am adding check<In,Out>put methods to the
> HiveTo<Edge,Vertex> and VertexToHive API and letting the user do their
> checks. Look at the diff for examples and tests.
> https://reviews.apache.org/r/12080/
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
