[jira] [Commented] (FLINK-4823) org.apache.flink.types.NullFieldException: Field 0 is null, but expected to hold a value
[ https://issues.apache.org/jira/browse/FLINK-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17336847#comment-17336847 ] Flink Jira Bot commented on FLINK-4823: --- This issue was labeled "stale-major" 7 ago and has not received any updates so it is being deprioritized. If this ticket is actually Major, please raise the priority and ask a committer to assign you the issue or revive the public discussion. > org.apache.flink.types.NullFieldException: Field 0 is null, but expected to > hold a value > > > Key: FLINK-4823 > URL: https://issues.apache.org/jira/browse/FLINK-4823 > Project: Flink > Issue Type: Bug > Components: Library / Graph Processing (Gelly) >Affects Versions: 1.1.0 > Environment: RHEL 6.6 >Reporter: Sajeev Ramakrishnan >Priority: Major > Labels: stale-major > > Team, > We are getting NULL pointer exception while doing the vertex centric graph > traversal. > org.apache.flink.types.NullFieldException: Field 0 is null, but expected to > hold a value. > at > org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:126) > at > org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:30) > at > org.apache.flink.runtime.plugable.SerializationDelegate.write(SerializationDelegate.java:56) > at > org.apache.flink.runtime.io.network.api.serialization.SpanningRecordSerializer.addRecord(SpanningRecordSerializer.java:83) > at > org.apache.flink.runtime.io.network.api.writer.RecordWriter.emit(RecordWriter.java:85) > at > org.apache.flink.runtime.operators.shipping.OutputCollector.collect(OutputCollector.java:65) > at > org.apache.flink.api.java.operators.JoinOperator$DefaultJoin$WrappingFlatJoinFunction.join(JoinOperator.java:572) > at > org.apache.flink.runtime.operators.JoinWithSolutionSetFirstDriver.run(JoinWithSolutionSetFirstDriver.java:196) > at > org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:486) > at > org.apache.flink.runtime.iterative.task.AbstractIterativeTask.run(AbstractIterativeTask.java:146) > at > org.apache.flink.runtime.iterative.task.IterationIntermediateTask.run(IterationIntermediateTask.java:92) > at > org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:351) > at org.apache.flink.runtime.taskmanager.Task.run(Task.java:584) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.lang.NullPointerException > at > org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:122) > at > org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:30) > at > org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:124) > ... 13 more > All the parameters that I am passing for the vertex and edges are not null. > Not able to find out the root cause. > Thanks & Regards, > Sajeev Ramakrishnan -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-4823) org.apache.flink.types.NullFieldException: Field 0 is null, but expected to hold a value
[ https://issues.apache.org/jira/browse/FLINK-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17328887#comment-17328887 ] Flink Jira Bot commented on FLINK-4823: --- This major issue is unassigned and itself and all of its Sub-Tasks have not been updated for 30 days. So, it has been labeled "stale-major". If this ticket is indeed "major", please either assign yourself or give an update. Afterwards, please remove the label. In 7 days the issue will be deprioritized. > org.apache.flink.types.NullFieldException: Field 0 is null, but expected to > hold a value > > > Key: FLINK-4823 > URL: https://issues.apache.org/jira/browse/FLINK-4823 > Project: Flink > Issue Type: Bug > Components: Library / Graph Processing (Gelly) >Affects Versions: 1.1.0 > Environment: RHEL 6.6 >Reporter: Sajeev Ramakrishnan >Priority: Major > Labels: stale-major > > Team, > We are getting NULL pointer exception while doing the vertex centric graph > traversal. > org.apache.flink.types.NullFieldException: Field 0 is null, but expected to > hold a value. > at > org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:126) > at > org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:30) > at > org.apache.flink.runtime.plugable.SerializationDelegate.write(SerializationDelegate.java:56) > at > org.apache.flink.runtime.io.network.api.serialization.SpanningRecordSerializer.addRecord(SpanningRecordSerializer.java:83) > at > org.apache.flink.runtime.io.network.api.writer.RecordWriter.emit(RecordWriter.java:85) > at > org.apache.flink.runtime.operators.shipping.OutputCollector.collect(OutputCollector.java:65) > at > org.apache.flink.api.java.operators.JoinOperator$DefaultJoin$WrappingFlatJoinFunction.join(JoinOperator.java:572) > at > org.apache.flink.runtime.operators.JoinWithSolutionSetFirstDriver.run(JoinWithSolutionSetFirstDriver.java:196) > at > org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:486) > at > org.apache.flink.runtime.iterative.task.AbstractIterativeTask.run(AbstractIterativeTask.java:146) > at > org.apache.flink.runtime.iterative.task.IterationIntermediateTask.run(IterationIntermediateTask.java:92) > at > org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:351) > at org.apache.flink.runtime.taskmanager.Task.run(Task.java:584) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.lang.NullPointerException > at > org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:122) > at > org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:30) > at > org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:124) > ... 13 more > All the parameters that I am passing for the vertex and edges are not null. > Not able to find out the root cause. > Thanks & Regards, > Sajeev Ramakrishnan -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-4823) org.apache.flink.types.NullFieldException: Field 0 is null, but expected to hold a value
[
https://issues.apache.org/jira/browse/FLINK-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15612467#comment-15612467
]
Greg Hogan commented on FLINK-4823:
---
How are you creating your {{Graph}}? Each vertex represented in the edge set
should be in the vertex set.
Based on this exception we do need to add better error checking with a more
specific log message.
> org.apache.flink.types.NullFieldException: Field 0 is null, but expected to
> hold a value
>
>
> Key: FLINK-4823
> URL: https://issues.apache.org/jira/browse/FLINK-4823
> Project: Flink
> Issue Type: Bug
> Components: Gelly
>Affects Versions: 1.1.0
> Environment: RHEL 6.6
>Reporter: Sajeev Ramakrishnan
>
> Team,
> We are getting NULL pointer exception while doing the vertex centric graph
> traversal.
> org.apache.flink.types.NullFieldException: Field 0 is null, but expected to
> hold a value.
> at
> org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:126)
> at
> org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:30)
> at
> org.apache.flink.runtime.plugable.SerializationDelegate.write(SerializationDelegate.java:56)
> at
> org.apache.flink.runtime.io.network.api.serialization.SpanningRecordSerializer.addRecord(SpanningRecordSerializer.java:83)
> at
> org.apache.flink.runtime.io.network.api.writer.RecordWriter.emit(RecordWriter.java:85)
> at
> org.apache.flink.runtime.operators.shipping.OutputCollector.collect(OutputCollector.java:65)
> at
> org.apache.flink.api.java.operators.JoinOperator$DefaultJoin$WrappingFlatJoinFunction.join(JoinOperator.java:572)
> at
> org.apache.flink.runtime.operators.JoinWithSolutionSetFirstDriver.run(JoinWithSolutionSetFirstDriver.java:196)
> at
> org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:486)
> at
> org.apache.flink.runtime.iterative.task.AbstractIterativeTask.run(AbstractIterativeTask.java:146)
> at
> org.apache.flink.runtime.iterative.task.IterationIntermediateTask.run(IterationIntermediateTask.java:92)
> at
> org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:351)
> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:584)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NullPointerException
> at
> org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:122)
> at
> org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:30)
> at
> org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:124)
> ... 13 more
> All the parameters that I am passing for the vertex and edges are not null.
> Not able to find out the root cause.
> Thanks & Regards,
> Sajeev Ramakrishnan
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (FLINK-4823) org.apache.flink.types.NullFieldException: Field 0 is null, but expected to hold a value
[ https://issues.apache.org/jira/browse/FLINK-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15588046#comment-15588046 ] Sajeev Ramakrishnan commented on FLINK-4823: I could figure out the issue. This issue is coming when the keys in edges are not getting mapped with vertices. I think this can be handled in gelly api > org.apache.flink.types.NullFieldException: Field 0 is null, but expected to > hold a value > > > Key: FLINK-4823 > URL: https://issues.apache.org/jira/browse/FLINK-4823 > Project: Flink > Issue Type: Bug > Components: Gelly >Affects Versions: 1.1.0 > Environment: RHEL 6.6 >Reporter: Sajeev Ramakrishnan >Priority: Blocker > > Team, > We are getting NULL pointer exception while doing the vertex centric graph > traversal. > org.apache.flink.types.NullFieldException: Field 0 is null, but expected to > hold a value. > at > org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:126) > at > org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:30) > at > org.apache.flink.runtime.plugable.SerializationDelegate.write(SerializationDelegate.java:56) > at > org.apache.flink.runtime.io.network.api.serialization.SpanningRecordSerializer.addRecord(SpanningRecordSerializer.java:83) > at > org.apache.flink.runtime.io.network.api.writer.RecordWriter.emit(RecordWriter.java:85) > at > org.apache.flink.runtime.operators.shipping.OutputCollector.collect(OutputCollector.java:65) > at > org.apache.flink.api.java.operators.JoinOperator$DefaultJoin$WrappingFlatJoinFunction.join(JoinOperator.java:572) > at > org.apache.flink.runtime.operators.JoinWithSolutionSetFirstDriver.run(JoinWithSolutionSetFirstDriver.java:196) > at > org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:486) > at > org.apache.flink.runtime.iterative.task.AbstractIterativeTask.run(AbstractIterativeTask.java:146) > at > org.apache.flink.runtime.iterative.task.IterationIntermediateTask.run(IterationIntermediateTask.java:92) > at > org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:351) > at org.apache.flink.runtime.taskmanager.Task.run(Task.java:584) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.lang.NullPointerException > at > org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:122) > at > org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:30) > at > org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:124) > ... 13 more > All the parameters that I am passing for the vertex and edges are not null. > Not able to find out the root cause. > Thanks & Regards, > Sajeev Ramakrishnan -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-4823) org.apache.flink.types.NullFieldException: Field 0 is null, but expected to hold a value
[
https://issues.apache.org/jira/browse/FLINK-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572160#comment-15572160
]
Greg Hogan commented on FLINK-4823:
---
Adding \{code\} before and after this code block will format much more nicely.
> org.apache.flink.types.NullFieldException: Field 0 is null, but expected to
> hold a value
>
>
> Key: FLINK-4823
> URL: https://issues.apache.org/jira/browse/FLINK-4823
> Project: Flink
> Issue Type: Bug
> Components: Gelly
>Affects Versions: 1.1.0
> Environment: RHEL 6.6
>Reporter: Sajeev Ramakrishnan
>Priority: Blocker
>
> Team,
> We are getting NULL pointer exception while doing the vertex centric graph
> traversal.
> org.apache.flink.types.NullFieldException: Field 0 is null, but expected to
> hold a value.
> at
> org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:126)
> at
> org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:30)
> at
> org.apache.flink.runtime.plugable.SerializationDelegate.write(SerializationDelegate.java:56)
> at
> org.apache.flink.runtime.io.network.api.serialization.SpanningRecordSerializer.addRecord(SpanningRecordSerializer.java:83)
> at
> org.apache.flink.runtime.io.network.api.writer.RecordWriter.emit(RecordWriter.java:85)
> at
> org.apache.flink.runtime.operators.shipping.OutputCollector.collect(OutputCollector.java:65)
> at
> org.apache.flink.api.java.operators.JoinOperator$DefaultJoin$WrappingFlatJoinFunction.join(JoinOperator.java:572)
> at
> org.apache.flink.runtime.operators.JoinWithSolutionSetFirstDriver.run(JoinWithSolutionSetFirstDriver.java:196)
> at
> org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:486)
> at
> org.apache.flink.runtime.iterative.task.AbstractIterativeTask.run(AbstractIterativeTask.java:146)
> at
> org.apache.flink.runtime.iterative.task.IterationIntermediateTask.run(IterationIntermediateTask.java:92)
> at
> org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:351)
> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:584)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NullPointerException
> at
> org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:122)
> at
> org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:30)
> at
> org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:124)
> ... 13 more
> All the parameters that I am passing for the vertex and edges are not null.
> Not able to find out the root cause.
> Thanks & Regards,
> Sajeev Ramakrishnan
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (FLINK-4823) org.apache.flink.types.NullFieldException: Field 0 is null, but expected to hold a value
[
https://issues.apache.org/jira/browse/FLINK-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571746#comment-15571746
]
Sajeev Ramakrishnan commented on FLINK-4823:
DataSet> vertices1 =
group.flatMap(new MapToVertex());
DataSet> vertices2 = user.flatMap(new
MapToVertex());
DataSet> vertices =
vertices1.union(vertices2);
DataSet> edges =
member.flatMap(new MapToEdge());
Graph graph =
Graph.fromTupleDataSet(vertices,edges, env);
System.out.println("Vertices
"+graph.runVertexCentricIteration(new ComputeTraversal(expFile), null,
iterations).numberOfVertices());
static final class ComputeTraversal extends ComputeFunction {
private static final long serialVersionUID =
4883900514255635602L;
String fileExpd;
FileWriter fw;
String DD="|";
public ComputeTraversal(String file) { fileExpd = file; }
public void preSuperstep() throws Exception { fw = new
FileWriter(fileExpd,true); System.out.println("iteration
"+getSuperstepNumber());}
public void postSuperstep() throws Exception { fw.close(); }
public void compute(Vertex v,
MessageIterator msgIter) throws IOException {
List targets = new ArrayList();
if (getSuperstepNumber() == 1){
if (v.f1.visit && v.f1.type.equals("GROUP")){
if(v.f1.childList!=null &&
!v.f1.childList.isEmpty()){
for(String
child:v.f1.childList){
targets.add(child);
}
}
else
for (Edge e :
getEdges())
targets.add(e.getTarget());
sendMessageToMembers(v, targets, null);
}
}
else {
if(v.f1.childList!=null && !v.f1.childList.isEmpty()){
for(String child:v.f1.childList){
targets.add(child);
}
}
else
for (Edge e : getEdges())
targets.add(e.getTarget());
for (String msgIn : msgIter) {
if (!msgIn.contains(v.getId()+"\t")) { // prevent
cyclic graph
String msgOut =
sendMessageToMembers(v,targets,msgIn);
}
}
}
}
private String sendMessageToMembers(Vertex v,
List targets, String msgIn) {
String msgOut = (msgIn==null ? "" : msgIn+">") +
v.getId()+"\t"+v.getValue().domain+"/"+v.getValue().name;
for (String t : targets) sendMessageTo(t,msgOut);
return msgOut;
}
}
static final class MapToEdge implements FlatMapFunction> {
/**
*
*/
private static final long serialVersionUID =
1930826776772888046L;
@Override
public void flatMap(InputT mem,Collector> out) throws Exception {
Tuple3 e = new
Tuple3(mem.gKey+"",mem.mKey+"",mem.rKey+"");
out.collect(e);
}
}
// map combinedUserGroup data set to VertexDTO object
static final class MapToVertex implements FlatMapFunction> {
private static final long serialVersionUID =
170886364461479813L;
@Override
public void flatMap(InputT vertex, Collector> out) throws Exception {
VertexDTO VertexDTO = null;
//vertex.key is long. So making it as string
VertexDTO = new
VertexDTO(vertex.key+"",vertex.domain,vertex.accountName,vertex.memberType,vertex.childList,true);
out.collect(new Tuple2(VertexDTO.id,
VertexDTO));
}
}
static final cla
[jira] [Commented] (FLINK-4823) org.apache.flink.types.NullFieldException: Field 0 is null, but expected to hold a value
[ https://issues.apache.org/jira/browse/FLINK-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571691#comment-15571691 ] Greg Hogan commented on FLINK-4823: --- Thanks for reporting this. Is there code you could share to reproduce the issue? > org.apache.flink.types.NullFieldException: Field 0 is null, but expected to > hold a value > > > Key: FLINK-4823 > URL: https://issues.apache.org/jira/browse/FLINK-4823 > Project: Flink > Issue Type: Bug > Components: Gelly >Affects Versions: 1.1.0 > Environment: RHEL 6.6 >Reporter: Sajeev Ramakrishnan >Priority: Blocker > > Team, > We are getting NULL pointer exception while doing the vertex centric graph > traversal. > org.apache.flink.types.NullFieldException: Field 0 is null, but expected to > hold a value. > at > org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:126) > at > org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:30) > at > org.apache.flink.runtime.plugable.SerializationDelegate.write(SerializationDelegate.java:56) > at > org.apache.flink.runtime.io.network.api.serialization.SpanningRecordSerializer.addRecord(SpanningRecordSerializer.java:83) > at > org.apache.flink.runtime.io.network.api.writer.RecordWriter.emit(RecordWriter.java:85) > at > org.apache.flink.runtime.operators.shipping.OutputCollector.collect(OutputCollector.java:65) > at > org.apache.flink.api.java.operators.JoinOperator$DefaultJoin$WrappingFlatJoinFunction.join(JoinOperator.java:572) > at > org.apache.flink.runtime.operators.JoinWithSolutionSetFirstDriver.run(JoinWithSolutionSetFirstDriver.java:196) > at > org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:486) > at > org.apache.flink.runtime.iterative.task.AbstractIterativeTask.run(AbstractIterativeTask.java:146) > at > org.apache.flink.runtime.iterative.task.IterationIntermediateTask.run(IterationIntermediateTask.java:92) > at > org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:351) > at org.apache.flink.runtime.taskmanager.Task.run(Task.java:584) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.lang.NullPointerException > at > org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:122) > at > org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:30) > at > org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:124) > ... 13 more > All the parameters that I am passing for the vertex and edges are not null. > Not able to find out the root cause. > Thanks & Regards, > Sajeev Ramakrishnan -- This message was sent by Atlassian JIRA (v6.3.4#6332)
