Re: Propagation of exception message in GraphMapper

2012-03-29 Thread Dionysios Logothetis
Hi Avery,
You are right. I just though it'd be better if this message appeared in the
exception thrown by the GraphMapper, since this is the top one you see in
the stack. This would make it easier to find out what's going on as opposed
to have to search the stack trace. I think if you run a hadoop job and an
exception is thrown, in the console you see only the top of the stack
trace, not all of it. And then you have to look into the hadoop logs.

Dionysis.

On Thu, Mar 29, 2012 at 4:11 AM, Avery Ching  wrote:

> Dionysis,
>
> I'm a little confused.  The below message seems to explain the problem with
>
>
> Input path does not exist: hdfs://localhost:9000/x
>
>
> Am I missing something?
>
> Avery
>
>
> On 3/27/12 4:04 AM, Dionysis Logothetis wrote:
>
>> Hi all,
>>
>> I was running one of the example apps and I accidentally entered the
>> wrong input, so I ended up getting an exception from GraphMapper. But
>> I think the actual cause of the exception (directory missing) is not
>> propagated properly, which makes debugging a bit more difficult.
>> Perhaps the generateInputSplits() method should include the type of
>> exception in the message?
>>
>> Below I'm pasting the messages printed:
>>
>>
>>
>> 2012-03-27 12:50:03,925 FATAL org.apache.giraph.graph.**GraphMapper:
>> uncaughtException: OverrideExceptionHandler on thread
>> org.apache.giraph.graph.**MasterThread, msg = generateInputSplits: Got
>> IOException, exiting...
>> java.lang.**IllegalStateException: generateInputSplits: Got IOException
>>at org.apache.giraph.graph.**BspServiceMaster.**
>> generateInputSplits(**BspServiceMaster.java:249)
>>at org.apache.giraph.graph.**BspServiceMaster.**createInputSplits(
>> **BspServiceMaster.java:506)
>>at org.apache.giraph.graph.**MasterThread.run(MasterThread.**
>> java:98)
>> Caused by: org.apache.hadoop.mapreduce.**lib.input.**
>> InvalidInputException:
>> Input path does not exist: hdfs://localhost:9000/x
>>at org.apache.hadoop.mapreduce.**lib.input.FileInputFormat.**
>> listStatus(FileInputFormat.**java:231)
>>at org.apache.hadoop.mapreduce.**lib.input.FileInputFormat.**
>> getSplits(FileInputFormat.**java:248)
>>at org.apache.giraph.lib.**TextVertexInputFormat.**getSplits(**
>> TextVertexInputFormat.java:**120)
>>at org.apache.giraph.graph.**BspServiceMaster.**
>> generateInputSplits(**BspServiceMaster.java:229)
>>... 2 more
>> 2012-03-27 12:50:03,941 WARN org.apache.giraph.zk.**ZooKeeperManager:
>> onlineZooKeeperServers: Forced a shutdown hook kill of the ZooKeeper
>> process.
>>
>>
>


Re: Propagation of exception message in GraphMapper

2012-03-28 Thread Avery Ching

Dionysis,

I'm a little confused.  The below message seems to explain the problem with

Input path does not exist: hdfs://localhost:9000/x


Am I missing something?

Avery

On 3/27/12 4:04 AM, Dionysis Logothetis wrote:

Hi all,

I was running one of the example apps and I accidentally entered the
wrong input, so I ended up getting an exception from GraphMapper. But
I think the actual cause of the exception (directory missing) is not
propagated properly, which makes debugging a bit more difficult.
Perhaps the generateInputSplits() method should include the type of
exception in the message?

Below I'm pasting the messages printed:



2012-03-27 12:50:03,925 FATAL org.apache.giraph.graph.GraphMapper:
uncaughtException: OverrideExceptionHandler on thread
org.apache.giraph.graph.MasterThread, msg = generateInputSplits: Got
IOException, exiting...
java.lang.IllegalStateException: generateInputSplits: Got IOException
at 
org.apache.giraph.graph.BspServiceMaster.generateInputSplits(BspServiceMaster.java:249)
at 
org.apache.giraph.graph.BspServiceMaster.createInputSplits(BspServiceMaster.java:506)
at org.apache.giraph.graph.MasterThread.run(MasterThread.java:98)
Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException:
Input path does not exist: hdfs://localhost:9000/x
at 
org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:231)
at 
org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:248)
at 
org.apache.giraph.lib.TextVertexInputFormat.getSplits(TextVertexInputFormat.java:120)
at 
org.apache.giraph.graph.BspServiceMaster.generateInputSplits(BspServiceMaster.java:229)
... 2 more
2012-03-27 12:50:03,941 WARN org.apache.giraph.zk.ZooKeeperManager:
onlineZooKeeperServers: Forced a shutdown hook kill of the ZooKeeper
process.