Gabriel Laden
Wed, 12 Mar 2008 15:55:19 -0700
Thanks to everybody for your help. Here are the answers to replies:
hadoopm is the hostname of the hadoop master.
Both of these telnet commands open a connection:
telnet hadoopm 9000
telnet hadoopm 9001
Also, here's some more more detail. In my hadoop conf/hadoop-site.xml, I have
this, is it the problem for pig?
<property>
<name>fs.default.name</name>
<value>hadoopm:9000</value>
</property>
Then, I started up pig with DEBUG and got the following output, the last couple
lines show the connection not working:
[EMAIL PROTECTED] trunk]$ java -cp pig.jar:/usr/local/hadoop/conf
org.apache.pig.Main -d DEBUG
2008-03-12 15:43:20,399 [main] DEBUG org.apache.hadoop.conf.Configuration -
java.io.IOException: config()
at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:144)
at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:112)
at
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.<init>(HExecutionEngine.java:88)
at org.apache.pig.impl.PigContext.connect(PigContext.java:179)
at org.apache.pig.PigServer.<init>(PigServer.java:132)
at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:41)
at org.apache.pig.Main.main(Main.java:251)
2008-03-12 15:43:20,467 [main] INFO
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to
hadoop file system at: hadoopm:9000
2008-03-12 15:43:20,470 [main] DEBUG org.apache.hadoop.conf.Configuration -
java.io.IOException: config()
at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:144)
at
org.apache.pig.backend.hadoop.datastorage.HConfiguration.getConfiguration(HConfiguration.java:38)
at
org.apache.pig.backend.hadoop.datastorage.HDataStorage.<init>(HDataStorage.java:36)
at
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:140)
at org.apache.pig.impl.PigContext.connect(PigContext.java:181)
at org.apache.pig.PigServer.<init>(PigServer.java:132)
at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:41)
at org.apache.pig.Main.main(Main.java:251)
2008-03-12 15:43:20,531 [main] DEBUG org.apache.hadoop.ipc.Client -
org.apache.hadoop.io.ObjectWritableConnection culler maxidletime= 1000ms
2008-03-12 15:43:20,534 [org.apache.hadoop.io.ObjectWritable Connection Culler]
DEBUG org.apache.hadoop.ipc.Client - org.apache.hadoop.io.ObjectWritable
Connection Culler: starting
2008-03-12 15:43:20,558 [IPC Client connection to hadoopm/10.11.6.230:9000]
DEBUG org.apache.hadoop.ipc.Client - IPC Client connection to
hadoopm/10.11.6.230:9000: starting
2008-03-12 15:43:20,561 [main] DEBUG org.apache.hadoop.ipc.Client - IPC Client
connection to hadoopm/10.11.6.230:9000 sending #0
2008-03-12 15:43:20,566 [IPC Client connection to hadoopm/10.11.6.230:9000]
DEBUG org.apache.hadoop.ipc.Client - IPC Client connection to
hadoopm/10.11.6.230:9000: closing
2008-03-12 15:44:20,568 [main] ERROR org.apache.pig.Main -
org.apache.pig.backend.executionengine.ExecException: Failed to create
DataStorage
-Gabriel Laden
-----Original Message-----
From: Stefan Groschupf [EMAIL PROTECTED]
Sent: Wednesday, March 12, 2008 3:17 PM
To: pig-user@incubator.apache.org
Subject: Re: Can't start pig
> What is hadoopm?
I guess the name of his jobtracker / namenode server. :)
Gabriel, make sure that you can connect to this server from the
computer you lunch your pig.
try
telnet hostname 9000
telnet hostname 9001
Stefan