Re: Can't start pig

[Alan Gates]

For my clusters, I set all of the following in my hadoop-site.xml:
dfs.client.buffer.dir
hadoop.tmp.dir
mapred.system.dir
fs.default.name
dfs.data.dir
mapred.job.tracker

I'm don't think you need to set any of the dir values if you use the 
hadoop defaults, but if you've set all the others and are still having 
trouble you might try setting those as well.

Alan.

Travis Brady wrote:
On Wed, Mar 12, 2008 at 3:54 PM, Gabriel Laden <[EMAIL PROTECTED]> wrote:

  
[snip]
Then, I started up pig with DEBUG and got the following output, the last
couple lines show the connection not working:

Has anyone figured this out yet?  I've set up a two node hadoop cluster
    
according to the instructions on the hadoop wiki and the wordcount example
works nicely.  I'm able to telnet, able to do "bin/hadoop dfs -ls" etc but
when trying to connect I get the same error encountered above.  My
hadoop-site.xml is very minimal, could there be some setting I'm missing?

my output:

[EMAIL PROTECTED]:~/src/pig$ java -cp
pig.jar:/home/mochi/src/hadoop-core-trunk/conf org.apache.pig.Main -v
2008-03-20 21:11:13,928 [main] DEBUG org.apache.hadoop.conf.Configuration -
java.io.IOException: config()
    at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:144)
    at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:112)
    at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine
.<init>(HExecutionEngine.java:88)
    at org.apache.pig.impl.PigContext.connect(PigContext.java:190)
    at org.apache.pig.PigServer.<init>(PigServer.java:132)
    at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:41)
    at org.apache.pig.Main.main(Main.java:251)

2008-03-20 21:11:14,012 [main] INFO
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting
to hadoop file system at: hdfs://vulture:54310
2008-03-20 21:11:14,014 [main] DEBUG org.apache.hadoop.conf.Configuration -
java.io.IOException: config()
    at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:144)
    at
org.apache.pig.backend.hadoop.datastorage.HConfiguration.getConfiguration(
HConfiguration.java:38)
    at org.apache.pig.backend.hadoop.datastorage.HDataStorage.<init>(
HDataStorage.java:36)
    at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(
HExecutionEngine.java:140)
    at org.apache.pig.impl.PigContext.connect(PigContext.java:192)
    at org.apache.pig.PigServer.<init>(PigServer.java:132)
    at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:41)
    at org.apache.pig.Main.main(Main.java:251)

2008-03-20 21:11:14,086 [main] DEBUG org.apache.hadoop.ipc.Client -
org.apache.hadoop.io.ObjectWritableConnection culler maxidletime= 1000ms
2008-03-20 21:11:14,087 [org.apache.hadoop.io.ObjectWritable Connection
Culler] DEBUG org.apache.hadoop.ipc.Client -
org.apache.hadoop.io.ObjectWritable Connection Culler: starting
2008-03-20 21:11:14,118 [IPC Client connection to
vulture/38.102.129.71:54310] DEBUG org.apache.hadoop.ipc.Client - IPC Client
connection to vulture/38.102.129.71:54310: starting
2008-03-20 21:11:14,123 [main] DEBUG org.apache.hadoop.ipc.Client - IPC
Client connection to vulture/38.102.129.71:54310 sending #0
2008-03-20 21:11:14,129 [IPC Client connection to
vulture/38.102.129.71:54310] DEBUG org.apache.hadoop.ipc.Client - IPC Client
connection to vulture/38.102.129.71:54310: closing
2008-03-20 21:12:14,137 [main] ERROR org.apache.pig.Main -
org.apache.pig.backend.executionengine.ExecException: Failed to create
DataStorage

Thanks to anyone who can help.