Re: java.io.EOFException
Yeah, this is kind of annoying that it's hard to figure out where this happens. Unfortunately, this error happens in hadoop RPC, we don't have control of this code (it's from Apache Hadoop). I suppose we could add some generic vertex checking utilities in the unittests that could be easily extended. Maybe add this in the FAQ since it seems like a common error? Avery On 1/5/12 2:14 PM, "Christoph Böhm" wrote: Correct. I had an issue in readFields(DataInput in) for my vertex value type. Unfortunately, I never got to see the real exception until I wrote local tests (which one of course should do before). The error returned was java.io.EOFException at java.io.DataInputStream.readInt(DataInputStream.java:375) which was irritating since I don't call readInt() in any place ... Where is a good spot to fix this? -- i.e., add vertex value errors to user logs. Chr Original-Nachricht Datum: Tue, 03 Jan 2012 11:07:56 -0800 Von: Avery Ching An: giraph-user@incubator.apache.org Betreff: Re: java.io.EOFException It appears that you had a problem with the serialization/deserialization of your vertex and/or its types (I, E, V, M). You might want to try to test that out separately. Avery On 1/3/12 3:54 AM, "Christoph Böhm" wrote: Thanks! The next exception I cannot explain myself is the following. I have one input file of the form: [2095029,[[1100046950,-1],[952771928,-1]],[[1276522248,0.9829082],[322609086,0.013525307]]] [5146036,[[947366954,-1],[34019593,-1]],[[1199061143,0.573876],[1024309140,0.98412496]]] [5270429,[[800028028,-1],[1362541830,-1]],[[164325925,0.92203426],[148512084,0.65505975]]] ... and want to use say 5 workers. Then worker tenem05 reports what is below. Cheers. Christoph -- java.lang.RuntimeException: java.io.IOException: Call to tenem02//172.16.23.151:30003 failed on local exception: java.io.EOFException at org.apache.giraph.comm.BasicRPCCommunications.sendPartitionReq(BasicRPCCommunications.java:780) at org.apache.giraph.graph.BspServiceWorker.loadVertices(BspServiceWorker.java:304) at org.apache.giraph.graph.BspServiceWorker.setup(BspServiceWorker.java:569) at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:458) at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:630) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:369) at org.apache.hadoop.mapred.Child$4.run(Child.java:259) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059) at org.apache.hadoop.mapred.Child.main(Child.java:253) Caused by: java.io.IOException: Call to tenem02/172.16.23.151:30003 failed on local exception: java.io.EOFException at org.apache.hadoop.ipc.Client.wrapException(Client.java:1065) at org.apache.hadoop.ipc.Client.call(Client.java:1033) at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:224) at $Proxy3.putVertexList(Unknown Source) at org.apache.giraph.comm.BasicRPCCommunications.sendPartitionReq(BasicRPCCommunications.java:777) ... 11 more Caused by: java.io.EOFException at java.io.DataInputStream.readInt(DataInputStream.java:375) at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:767) at org.apache.hadoop.ipc.Client$Connection.run(Client.java:712) 2012-01-03 12:35:46,259 ERROR org.apache.giraph.graph.GraphMapper: setup: Caught exception just before end of setup java.lang.IllegalStateException: setup: loadVertices failed at org.apache.giraph.graph.BspServiceWorker.setup(BspServiceWorker.java:576) at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:458) at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:630) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:369) at org.apache.hadoop.mapred.Child$4.run(Child.java:259) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059) at org.apache.hadoop.mapred.Child.main(Child.java:253) Caused by: java.lang.RuntimeException: java.io.IOException: Call to tenem02/172.16.23.151:30003 failed on local exception: java.io.EOFException at org.apache.giraph.comm.BasicRPCCommunications.sendPartitionReq(BasicRPCCommunications.java:780) at org.apache.giraph.graph.BspServiceWorker.loadVertices(BspServiceWorker.java:304) at org.apache.giraph.graph.BspServiceWorker.setup(BspServiceWorker.java:569) ... 9 more
Re: java.io.EOFException
Correct. I had an issue in readFields(DataInput in) for my vertex value type. Unfortunately, I never got to see the real exception until I wrote local tests (which one of course should do before). The error returned was java.io.EOFException at java.io.DataInputStream.readInt(DataInputStream.java:375) which was irritating since I don't call readInt() in any place ... Where is a good spot to fix this? -- i.e., add vertex value errors to user logs. Chr Original-Nachricht > Datum: Tue, 03 Jan 2012 11:07:56 -0800 > Von: Avery Ching > An: giraph-user@incubator.apache.org > Betreff: Re: java.io.EOFException > It appears that you had a problem with the serialization/deserialization > of your vertex and/or its types (I, E, V, M). You might want to try to > test that out separately. > > Avery > > On 1/3/12 3:54 AM, "Christoph Böhm" wrote: > > Thanks! > > The next exception I cannot explain myself is the following. > > I have one input file of the form: > > > [2095029,[[1100046950,-1],[952771928,-1]],[[1276522248,0.9829082],[322609086,0.013525307]]] > > > [5146036,[[947366954,-1],[34019593,-1]],[[1199061143,0.573876],[1024309140,0.98412496]]] > > > [5270429,[[800028028,-1],[1362541830,-1]],[[164325925,0.92203426],[148512084,0.65505975]]] > > ... and want to use say 5 workers. > > Then worker tenem05 reports what is below. > > > > Cheers. > > Christoph > > > > -- > > java.lang.RuntimeException: java.io.IOException: Call to > tenem02//172.16.23.151:30003 failed on local exception: java.io.EOFException > > at > org.apache.giraph.comm.BasicRPCCommunications.sendPartitionReq(BasicRPCCommunications.java:780) > > at > org.apache.giraph.graph.BspServiceWorker.loadVertices(BspServiceWorker.java:304) > > at > org.apache.giraph.graph.BspServiceWorker.setup(BspServiceWorker.java:569) > > at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:458) > > at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:630) > > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) > > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:369) > > at org.apache.hadoop.mapred.Child$4.run(Child.java:259) > > at java.security.AccessController.doPrivileged(Native Method) > > at javax.security.auth.Subject.doAs(Subject.java:396) > > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059) > > at org.apache.hadoop.mapred.Child.main(Child.java:253) > > Caused by: java.io.IOException: Call to tenem02/172.16.23.151:30003 > failed on local exception: java.io.EOFException > > at org.apache.hadoop.ipc.Client.wrapException(Client.java:1065) > > at org.apache.hadoop.ipc.Client.call(Client.java:1033) > > at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:224) > > at $Proxy3.putVertexList(Unknown Source) > > at > org.apache.giraph.comm.BasicRPCCommunications.sendPartitionReq(BasicRPCCommunications.java:777) > > ... 11 more > > Caused by: java.io.EOFException > > at java.io.DataInputStream.readInt(DataInputStream.java:375) > > at > org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:767) > > at org.apache.hadoop.ipc.Client$Connection.run(Client.java:712) > > 2012-01-03 12:35:46,259 ERROR org.apache.giraph.graph.GraphMapper: > setup: Caught exception just before end of setup > > java.lang.IllegalStateException: setup: loadVertices failed > > at > org.apache.giraph.graph.BspServiceWorker.setup(BspServiceWorker.java:576) > > at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:458) > > at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:630) > > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) > > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:369) > > at org.apache.hadoop.mapred.Child$4.run(Child.java:259) > > at java.security.AccessController.doPrivileged(Native Method) > > at javax.security.auth.Subject.doAs(Subject.java:396) > > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059) > > at org.apache.hadoop.mapred.Child.main(Child.java:253) > > Caused by: java.lang.RuntimeException: java.io.IOException: Call to > tenem02/172.16.23.151:30003 failed on local exception: java.io.EOFException > > at > org.apache.giraph.comm.BasicRPCCommunications.sendPartitionReq(BasicRPCCommunications.java:780) > > at > org.apache.giraph.graph.BspServiceWorker.loadVertices(BspServiceWorker.java:304) > > at > org.apache.giraph.graph.BspServiceWo
Re: java.io.EOFException
It appears that you had a problem with the serialization/deserialization of your vertex and/or its types (I, E, V, M). You might want to try to test that out separately. Avery On 1/3/12 3:54 AM, "Christoph Böhm" wrote: Thanks! The next exception I cannot explain myself is the following. I have one input file of the form: [2095029,[[1100046950,-1],[952771928,-1]],[[1276522248,0.9829082],[322609086,0.013525307]]] [5146036,[[947366954,-1],[34019593,-1]],[[1199061143,0.573876],[1024309140,0.98412496]]] [5270429,[[800028028,-1],[1362541830,-1]],[[164325925,0.92203426],[148512084,0.65505975]]] ... and want to use say 5 workers. Then worker tenem05 reports what is below. Cheers. Christoph -- java.lang.RuntimeException: java.io.IOException: Call to tenem02//172.16.23.151:30003 failed on local exception: java.io.EOFException at org.apache.giraph.comm.BasicRPCCommunications.sendPartitionReq(BasicRPCCommunications.java:780) at org.apache.giraph.graph.BspServiceWorker.loadVertices(BspServiceWorker.java:304) at org.apache.giraph.graph.BspServiceWorker.setup(BspServiceWorker.java:569) at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:458) at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:630) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:369) at org.apache.hadoop.mapred.Child$4.run(Child.java:259) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059) at org.apache.hadoop.mapred.Child.main(Child.java:253) Caused by: java.io.IOException: Call to tenem02/172.16.23.151:30003 failed on local exception: java.io.EOFException at org.apache.hadoop.ipc.Client.wrapException(Client.java:1065) at org.apache.hadoop.ipc.Client.call(Client.java:1033) at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:224) at $Proxy3.putVertexList(Unknown Source) at org.apache.giraph.comm.BasicRPCCommunications.sendPartitionReq(BasicRPCCommunications.java:777) ... 11 more Caused by: java.io.EOFException at java.io.DataInputStream.readInt(DataInputStream.java:375) at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:767) at org.apache.hadoop.ipc.Client$Connection.run(Client.java:712) 2012-01-03 12:35:46,259 ERROR org.apache.giraph.graph.GraphMapper: setup: Caught exception just before end of setup java.lang.IllegalStateException: setup: loadVertices failed at org.apache.giraph.graph.BspServiceWorker.setup(BspServiceWorker.java:576) at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:458) at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:630) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:369) at org.apache.hadoop.mapred.Child$4.run(Child.java:259) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059) at org.apache.hadoop.mapred.Child.main(Child.java:253) Caused by: java.lang.RuntimeException: java.io.IOException: Call to tenem02/172.16.23.151:30003 failed on local exception: java.io.EOFException at org.apache.giraph.comm.BasicRPCCommunications.sendPartitionReq(BasicRPCCommunications.java:780) at org.apache.giraph.graph.BspServiceWorker.loadVertices(BspServiceWorker.java:304) at org.apache.giraph.graph.BspServiceWorker.setup(BspServiceWorker.java:569) ... 9 more Caused by: java.io.IOException: Call to tenem02/172.16.23.151:30003 failed on local exception: java.io.EOFException at org.apache.hadoop.ipc.Client.wrapException(Client.java:1065) at org.apache.hadoop.ipc.Client.call(Client.java:1033) at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:224) at $Proxy3.putVertexList(Unknown Source) at org.apache.giraph.comm.BasicRPCCommunications.sendPartitionReq(BasicRPCCommunications.java:777) ... 11 more Caused by: java.io.EOFException at java.io.DataInputStream.readInt(DataInputStream.java:375) at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:767) at org.apache.hadoop.ipc.Client$Connection.run(Client.java:712) 2012-01-03 12:35:46,260 ERROR org.apache.giraph.graph.BspServiceWorker: unregisterHealth: Got failure, unregistering health on /_hadoopBsp/job_201112231316_4347/_applicationAttemptsDir/0/_superstepDir/-1/_workerHealthyDir/tenem05_1 on superstep -1 2012-01-03 12:35:46,270 INFO org.apache.hadoop.mapred.TaskLogsTruncater: Initial
java.io.EOFException
Thanks! The next exception I cannot explain myself is the following. I have one input file of the form: [2095029,[[1100046950,-1],[952771928,-1]],[[1276522248,0.9829082],[322609086,0.013525307]]] [5146036,[[947366954,-1],[34019593,-1]],[[1199061143,0.573876],[1024309140,0.98412496]]] [5270429,[[800028028,-1],[1362541830,-1]],[[164325925,0.92203426],[148512084,0.65505975]]] ... and want to use say 5 workers. Then worker tenem05 reports what is below. Cheers. Christoph -- java.lang.RuntimeException: java.io.IOException: Call to tenem02//172.16.23.151:30003 failed on local exception: java.io.EOFException at org.apache.giraph.comm.BasicRPCCommunications.sendPartitionReq(BasicRPCCommunications.java:780) at org.apache.giraph.graph.BspServiceWorker.loadVertices(BspServiceWorker.java:304) at org.apache.giraph.graph.BspServiceWorker.setup(BspServiceWorker.java:569) at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:458) at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:630) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:369) at org.apache.hadoop.mapred.Child$4.run(Child.java:259) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059) at org.apache.hadoop.mapred.Child.main(Child.java:253) Caused by: java.io.IOException: Call to tenem02/172.16.23.151:30003 failed on local exception: java.io.EOFException at org.apache.hadoop.ipc.Client.wrapException(Client.java:1065) at org.apache.hadoop.ipc.Client.call(Client.java:1033) at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:224) at $Proxy3.putVertexList(Unknown Source) at org.apache.giraph.comm.BasicRPCCommunications.sendPartitionReq(BasicRPCCommunications.java:777) ... 11 more Caused by: java.io.EOFException at java.io.DataInputStream.readInt(DataInputStream.java:375) at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:767) at org.apache.hadoop.ipc.Client$Connection.run(Client.java:712) 2012-01-03 12:35:46,259 ERROR org.apache.giraph.graph.GraphMapper: setup: Caught exception just before end of setup java.lang.IllegalStateException: setup: loadVertices failed at org.apache.giraph.graph.BspServiceWorker.setup(BspServiceWorker.java:576) at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:458) at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:630) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:369) at org.apache.hadoop.mapred.Child$4.run(Child.java:259) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059) at org.apache.hadoop.mapred.Child.main(Child.java:253) Caused by: java.lang.RuntimeException: java.io.IOException: Call to tenem02/172.16.23.151:30003 failed on local exception: java.io.EOFException at org.apache.giraph.comm.BasicRPCCommunications.sendPartitionReq(BasicRPCCommunications.java:780) at org.apache.giraph.graph.BspServiceWorker.loadVertices(BspServiceWorker.java:304) at org.apache.giraph.graph.BspServiceWorker.setup(BspServiceWorker.java:569) ... 9 more Caused by: java.io.IOException: Call to tenem02/172.16.23.151:30003 failed on local exception: java.io.EOFException at org.apache.hadoop.ipc.Client.wrapException(Client.java:1065) at org.apache.hadoop.ipc.Client.call(Client.java:1033) at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:224) at $Proxy3.putVertexList(Unknown Source) at org.apache.giraph.comm.BasicRPCCommunications.sendPartitionReq(BasicRPCCommunications.java:777) ... 11 more Caused by: java.io.EOFException at java.io.DataInputStream.readInt(DataInputStream.java:375) at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:767) at org.apache.hadoop.ipc.Client$Connection.run(Client.java:712) 2012-01-03 12:35:46,260 ERROR org.apache.giraph.graph.BspServiceWorker: unregisterHealth: Got failure, unregistering health on /_hadoopBsp/job_201112231316_4347/_applicationAttemptsDir/0/_superstepDir/-1/_workerHealthyDir/tenem05_1 on superstep -1 2012-01-03 12:35:46,270 INFO org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1 2012-01-03 12:35:46,320 INFO org.apache.hadoop.io.nativeio.NativeIO: Initialized cache for UID to User mapping with a cache timeout of 14400 seconds. 2012-01-03 12:35:4
