Travis Brady
Thu, 20 Mar 2008 22:27:34 -0700
On Wed, Mar 12, 2008 at 3:54 PM, Gabriel Laden <[EMAIL PROTECTED]> wrote:
> [snip]
> Then, I started up pig with DEBUG and got the following output, the last
> couple lines show the connection not working:
>
> Has anyone figured this out yet? I've set up a two node hadoop cluster
according to the instructions on the hadoop wiki and the wordcount example
works nicely. I'm able to telnet, able to do "bin/hadoop dfs -ls" etc but
when trying to connect I get the same error encountered above. My
hadoop-site.xml is very minimal, could there be some setting I'm missing?
my output:
[EMAIL PROTECTED]:~/src/pig$ java -cp
pig.jar:/home/mochi/src/hadoop-core-trunk/conf org.apache.pig.Main -v
2008-03-20 21:11:13,928 [main] DEBUG org.apache.hadoop.conf.Configuration -
java.io.IOException: config()
at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:144)
at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:112)
at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine
.<init>(HExecutionEngine.java:88)
at org.apache.pig.impl.PigContext.connect(PigContext.java:190)
at org.apache.pig.PigServer.<init>(PigServer.java:132)
at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:41)
at org.apache.pig.Main.main(Main.java:251)
2008-03-20 21:11:14,012 [main] INFO
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting
to hadoop file system at: hdfs://vulture:54310
2008-03-20 21:11:14,014 [main] DEBUG org.apache.hadoop.conf.Configuration -
java.io.IOException: config()
at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:144)
at
org.apache.pig.backend.hadoop.datastorage.HConfiguration.getConfiguration(
HConfiguration.java:38)
at org.apache.pig.backend.hadoop.datastorage.HDataStorage.<init>(
HDataStorage.java:36)
at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(
HExecutionEngine.java:140)
at org.apache.pig.impl.PigContext.connect(PigContext.java:192)
at org.apache.pig.PigServer.<init>(PigServer.java:132)
at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:41)
at org.apache.pig.Main.main(Main.java:251)
2008-03-20 21:11:14,086 [main] DEBUG org.apache.hadoop.ipc.Client -
org.apache.hadoop.io.ObjectWritableConnection culler maxidletime= 1000ms
2008-03-20 21:11:14,087 [org.apache.hadoop.io.ObjectWritable Connection
Culler] DEBUG org.apache.hadoop.ipc.Client -
org.apache.hadoop.io.ObjectWritable Connection Culler: starting
2008-03-20 21:11:14,118 [IPC Client connection to
vulture/38.102.129.71:54310] DEBUG org.apache.hadoop.ipc.Client - IPC Client
connection to vulture/38.102.129.71:54310: starting
2008-03-20 21:11:14,123 [main] DEBUG org.apache.hadoop.ipc.Client - IPC
Client connection to vulture/38.102.129.71:54310 sending #0
2008-03-20 21:11:14,129 [IPC Client connection to
vulture/38.102.129.71:54310] DEBUG org.apache.hadoop.ipc.Client - IPC Client
connection to vulture/38.102.129.71:54310: closing
2008-03-20 21:12:14,137 [main] ERROR org.apache.pig.Main -
org.apache.pig.backend.executionengine.ExecException: Failed to create
DataStorage
Thanks to anyone who can help.
--
Travis Brady
www.mochiads.com