pig-user  

RE: Can't start pig

Gabriel Laden
Wed, 12 Mar 2008 15:55:19 -0700

Thanks to everybody for your help. Here are the answers to replies:

hadoopm is the hostname of the hadoop master.

Both of these telnet commands open a connection:
telnet hadoopm 9000
telnet hadoopm 9001

Also, here's some more more detail. In my hadoop conf/hadoop-site.xml, I have 
this, is it the problem for pig?
 <property>
    <name>fs.default.name</name>
    <value>hadoopm:9000</value>
  </property>

Then, I started up pig with DEBUG and got the following output, the last couple 
lines show the connection not working:

[EMAIL PROTECTED] trunk]$ java -cp pig.jar:/usr/local/hadoop/conf 
org.apache.pig.Main -d DEBUG
2008-03-12 15:43:20,399 [main] DEBUG org.apache.hadoop.conf.Configuration - 
java.io.IOException: config()
        at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:144)
        at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:112)
        at 
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.<init>(HExecutionEngine.java:88)
        at org.apache.pig.impl.PigContext.connect(PigContext.java:179)
        at org.apache.pig.PigServer.<init>(PigServer.java:132)
        at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:41)
        at org.apache.pig.Main.main(Main.java:251)

2008-03-12 15:43:20,467 [main] INFO  
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to 
hadoop file system at: hadoopm:9000
2008-03-12 15:43:20,470 [main] DEBUG org.apache.hadoop.conf.Configuration - 
java.io.IOException: config()
        at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:144)
        at 
org.apache.pig.backend.hadoop.datastorage.HConfiguration.getConfiguration(HConfiguration.java:38)
        at 
org.apache.pig.backend.hadoop.datastorage.HDataStorage.<init>(HDataStorage.java:36)
        at 
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:140)
        at org.apache.pig.impl.PigContext.connect(PigContext.java:181)
        at org.apache.pig.PigServer.<init>(PigServer.java:132)
        at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:41)
        at org.apache.pig.Main.main(Main.java:251)

2008-03-12 15:43:20,531 [main] DEBUG org.apache.hadoop.ipc.Client - 
org.apache.hadoop.io.ObjectWritableConnection culler maxidletime= 1000ms
2008-03-12 15:43:20,534 [org.apache.hadoop.io.ObjectWritable Connection Culler] 
DEBUG org.apache.hadoop.ipc.Client - org.apache.hadoop.io.ObjectWritable 
Connection Culler: starting
2008-03-12 15:43:20,558 [IPC Client connection to hadoopm/10.11.6.230:9000] 
DEBUG org.apache.hadoop.ipc.Client - IPC Client connection to 
hadoopm/10.11.6.230:9000: starting
2008-03-12 15:43:20,561 [main] DEBUG org.apache.hadoop.ipc.Client - IPC Client 
connection to hadoopm/10.11.6.230:9000 sending #0
2008-03-12 15:43:20,566 [IPC Client connection to hadoopm/10.11.6.230:9000] 
DEBUG org.apache.hadoop.ipc.Client - IPC Client connection to 
hadoopm/10.11.6.230:9000: closing
2008-03-12 15:44:20,568 [main] ERROR org.apache.pig.Main - 
org.apache.pig.backend.executionengine.ExecException: Failed to create 
DataStorage


-Gabriel Laden


-----Original Message-----
From: Stefan Groschupf [EMAIL PROTECTED]
Sent: Wednesday, March 12, 2008 3:17 PM
To: pig-user@incubator.apache.org
Subject: Re: Can't start pig

> What is hadoopm?
I guess the name of his jobtracker / namenode server. :)
Gabriel, make sure that you can connect to this server from the
computer you lunch your pig.
try
telnet hostname 9000
telnet hostname 9001


Stefan