[jira] [Commented] (PIG-4044) Pig should use avro-mapred-hadoop2.jar instead of avro-mapred.jar when compile with hadoop 2
[ https://issues.apache.org/jira/browse/PIG-4044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047409#comment-14047409 ] Cheolsoo Park commented on PIG-4044: +1 Pig should use avro-mapred-hadoop2.jar instead of avro-mapred.jar when compile with hadoop 2 Key: PIG-4044 URL: https://issues.apache.org/jira/browse/PIG-4044 Project: Pig Issue Type: Bug Components: impl Reporter: Daniel Dai Assignee: Daniel Dai Fix For: 0.14.0 Attachments: PIG-4044-1.patch We see the following stack when using AvroStorage when using hadoop 2: 2014-06-28 22:42:25,656 FATAL [main] org.apache.hadoop.mapred.YarnChild: Error running child : java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected at org.apache.avro.mapreduce.AvroRecordReaderBase.initialize(AvroRecordReaderBase.java:87) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader.initialize(PigRecordReader.java:192) at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:525) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:167) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1557) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162) -- This message was sent by Atlassian JIRA (v6.2#6252)
Re: Encounter DNS error during load hbase table via pig grunt
Make sure you can resolve 9.181.64.230 in cmd. use dig 9.181.64.230 to check. On Mon, Jun 30, 2014 at 4:14 PM, lulynn_2008 lulynn_2...@163.com wrote: Hi All, Following are the test case and error. Do you have any suggestion or comment? Thanks Test case: create hbase table in hbase shell: create 'employees', 'SN', 'department', 'address' put 'employees', 'Hong', 'address:country', 'China' load and dump the table in pig grunt: A = load 'hbase://employees' using org.apache.pig.backend.hadoop.hbase.HBaseStorage( 'address:country', '-loadKey true') as (SN:bytearray,country:bytearray); B = filter A by SN == 'Hong'; dump B; Error: 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.compiler=j9jit24 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.name=Linux 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.arch=amd64 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.version=2.6.32-358.el6.x86_64 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.name=pig 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.home=/home/pig 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.dir=/pig/bin 2014-06-30 15:23:50,073 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=hostname:2181 sessionTimeout=9 watcher=hconnection-0x363b363b 2014-06-30 15:23:50,083 INFO org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x363b363b connecting to ZooKeeper ensemble=hostname:2181 2014-06-30 15:23:50,086 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server hostname/9.181.64.230:2181. Will not attempt to authenticate using SASL (Unable to locate a login configuration) 2014-06-30 15:23:50,087 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to hostname/9.181.64.230:2181, initiating session 2014-06-30 15:23:50,097 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server hostname/9.181.64.230:2181, sessionid = 0x146eb9f0ee5005c, negotiated timeout = 4 2014-06-30 15:23:50,361 ERROR org.apache.hadoop.hbase.mapreduce.TableInputFormatBase: Cannot resolve the host name for hostname/9.181.64.230 because of javax.naming.CommunicationException: DNS error [Root exception is java.net.PortUnreachableException: ICMP Port Unreachable]; Remaining name: '230.64.181.9.in-addr.arpa' 2014-06-30 15:24:35,889 WARN org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher: Ooops! Some job has failed! Specify -stop_on_failure if you want Pig to stop immediately on failure. 2014-06-30 15:24:35,899 ERROR org.apache.pig.tools.pigstats.SimplePigStats: ERROR: java.io.IOException: Cannot create a record reader because of a previous error. Please look at the previous logs lines from the task's full log for more details. 2014-06-30 15:24:35,899 ERROR org.apache.pig.tools.pigstats.PigStatsUtil: 1 map reduce job(s) failed! 2014-06-30 15:24:35,931 ERROR org.apache.pig.tools.grunt.Grunt: ERROR 1066: Unable to open iterator for alias A. Backend error : java.io.IOException: Cannot create a record reader because of a previous error. Please look at the previous logs lines from the task's full log for more details. -- Regards Gordon Wang
Encounter DNS error during load hbase table via pig grunt
Hi All, Following are the test case and error. Do you have any suggestion or comment? Thanks Test case: create hbase table in hbase shell: create 'employees', 'SN', 'department', 'address' put 'employees', 'Hong', 'address:country', 'China' load and dump the table in pig grunt: A = load 'hbase://employees' using org.apache.pig.backend.hadoop.hbase.HBaseStorage( 'address:country', '-loadKey true') as (SN:bytearray,country:bytearray); B = filter A by SN == 'Hong'; dump B; Error: 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.compiler=j9jit24 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.name=Linux 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.arch=amd64 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.version=2.6.32-358.el6.x86_64 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.name=pig 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.home=/home/pig 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.dir=/pig/bin 2014-06-30 15:23:50,073 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=hostname:2181 sessionTimeout=9 watcher=hconnection-0x363b363b 2014-06-30 15:23:50,083 INFO org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x363b363b connecting to ZooKeeper ensemble=hostname:2181 2014-06-30 15:23:50,086 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server hostname/9.181.64.230:2181. Will not attempt to authenticate using SASL (Unable to locate a login configuration) 2014-06-30 15:23:50,087 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to hostname/9.181.64.230:2181, initiating session 2014-06-30 15:23:50,097 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server hostname/9.181.64.230:2181, sessionid = 0x146eb9f0ee5005c, negotiated timeout = 4 2014-06-30 15:23:50,361 ERROR org.apache.hadoop.hbase.mapreduce.TableInputFormatBase: Cannot resolve the host name for hostname/9.181.64.230 because of javax.naming.CommunicationException: DNS error [Root exception is java.net.PortUnreachableException: ICMP Port Unreachable]; Remaining name: '230.64.181.9.in-addr.arpa' 2014-06-30 15:24:35,889 WARN org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher: Ooops! Some job has failed! Specify -stop_on_failure if you want Pig to stop immediately on failure. 2014-06-30 15:24:35,899 ERROR org.apache.pig.tools.pigstats.SimplePigStats: ERROR: java.io.IOException: Cannot create a record reader because of a previous error. Please look at the previous logs lines from the task's full log for more details. 2014-06-30 15:24:35,899 ERROR org.apache.pig.tools.pigstats.PigStatsUtil: 1 map reduce job(s) failed! 2014-06-30 15:24:35,931 ERROR org.apache.pig.tools.grunt.Grunt: ERROR 1066: Unable to open iterator for alias A. Backend error : java.io.IOException: Cannot create a record reader because of a previous error. Please look at the previous logs lines from the task's full log for more details.
[jira] [Created] (PIG-4046) PiggyBank DBStorage DATETIME should use setTimestamp with java.sql.Timestamp
Timothy Friest created PIG-4046: --- Summary: PiggyBank DBStorage DATETIME should use setTimestamp with java.sql.Timestamp Key: PIG-4046 URL: https://issues.apache.org/jira/browse/PIG-4046 Project: Pig Issue Type: Bug Components: piggybank Affects Versions: 0.12.1 Environment: CentOS 6.5 Reporter: Timothy Friest Priority: Minor In Pig 0.12.1 PiggyBank DBStorage (contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/DBStorage.java), the code uses the wrong setter and Java data type for the SQL DATETIME datatype. DATETIME has both date and time, so should use java.sql.Timestamp instead of java.sql.Date (which zeros the time fields). replace line 121 case DataType.DATETIME: -ps.setDate(sqlPos, new Date(((DateTime) field).getMillis())); sqlPos++; break; with case DataType.DATETIME: +ps.setTimestamp(sqlPos, new Timestamp(((DateTime) field).getMillis( ))); sqlPos++; break; -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Resolved] (PIG-4044) Pig should use avro-mapred-hadoop2.jar instead of avro-mapred.jar when compile with hadoop 2
[ https://issues.apache.org/jira/browse/PIG-4044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4044. - Resolution: Fixed Hadoop Flags: Reviewed Patch committed to trunk. Thanks Cheolsoo for review! Pig should use avro-mapred-hadoop2.jar instead of avro-mapred.jar when compile with hadoop 2 Key: PIG-4044 URL: https://issues.apache.org/jira/browse/PIG-4044 Project: Pig Issue Type: Bug Components: impl Reporter: Daniel Dai Assignee: Daniel Dai Fix For: 0.14.0 Attachments: PIG-4044-1.patch We see the following stack when using AvroStorage when using hadoop 2: 2014-06-28 22:42:25,656 FATAL [main] org.apache.hadoop.mapred.YarnChild: Error running child : java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected at org.apache.avro.mapreduce.AvroRecordReaderBase.initialize(AvroRecordReaderBase.java:87) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader.initialize(PigRecordReader.java:192) at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:525) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:167) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1557) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162) -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (PIG-4045) Add e2e tests for AvroStorage
[ https://issues.apache.org/jira/browse/PIG-4045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048044#comment-14048044 ] Rohini Palaniswamy commented on PIG-4045: - We had some tests created internally. Will try to get our QE to clean it up and contribute a patch. Add e2e tests for AvroStorage - Key: PIG-4045 URL: https://issues.apache.org/jira/browse/PIG-4045 Project: Pig Issue Type: Improvement Components: e2e harness Reporter: Daniel Dai Assignee: Daniel Dai Fix For: 0.14.0 -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (PIG-4045) Add e2e tests for AvroStorage
[ https://issues.apache.org/jira/browse/PIG-4045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048072#comment-14048072 ] Daniel Dai commented on PIG-4045: - That will be great. If need my help with the clean up, let me know. Add e2e tests for AvroStorage - Key: PIG-4045 URL: https://issues.apache.org/jira/browse/PIG-4045 Project: Pig Issue Type: Improvement Components: e2e harness Reporter: Daniel Dai Assignee: Daniel Dai Fix For: 0.14.0 -- This message was sent by Atlassian JIRA (v6.2#6252)
Re: [VOTE] Release Pig 0.13.0 (candidate 1)
+1, checked the signatures, did a build and ran commit-test, ran some smoke tests, built piggy-bank and ran its unit tests. I did see one unit test failure in piggybank (PigDBStorage), though Daniel couldn't reproduce it in his environment. Alan. Daniel Dai mailto:da...@hortonworks.com June 29, 2014 at 2:50 AM Hi, I have created a candidate build for Pig 0.13.0. Keys used to sign the release are available at http://svn.apache.org/viewvc/pig/trunk/KEYS?view=markup. Please download, test, and try it out: http://people.apache.org/~daijy/pig-0.13.0-candidate-1/ Release notes and the rat report are available at the same location. Should we release this? Vote closes on Wednesday, July 2nd 2014. Thanks, Daniel -- Sent with Postbox http://www.getpostbox.com -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
[jira] Subscription: PIG patch available
Issue Subscription Filter: PIG patch available (14 issues) Subscriber: pigdaily Key Summary PIG-4008Pig code change to enable Tez Local mode https://issues.apache.org/jira/browse/PIG-4008 PIG-4004Upgrade the Pigmix queries from the (old) mapred API to mapreduce https://issues.apache.org/jira/browse/PIG-4004 PIG-4002Disable combiner when map-side aggregation is used https://issues.apache.org/jira/browse/PIG-4002 PIG-3952PigStorage accepts '-tagSplit' to return full split information https://issues.apache.org/jira/browse/PIG-3952 PIG-3911Define unique fields with @OutputSchema https://issues.apache.org/jira/browse/PIG-3911 PIG-3877Getting Geo Latitude/Longitude from Address Lines https://issues.apache.org/jira/browse/PIG-3877 PIG-3873Geo distance calculation using Haversine https://issues.apache.org/jira/browse/PIG-3873 PIG-3866Create ThreadLocal classloader per PigContext https://issues.apache.org/jira/browse/PIG-3866 PIG-3861duplicate jars get added to distributed cache https://issues.apache.org/jira/browse/PIG-3861 PIG-3668COR built-in function when atleast one of the coefficient values is NaN https://issues.apache.org/jira/browse/PIG-3668 PIG-3635Fix e2e tests for Hadoop 2.X on Windows https://issues.apache.org/jira/browse/PIG-3635 PIG-3587add functionality for rolling over dates https://issues.apache.org/jira/browse/PIG-3587 PIG-3441Allow Pig to use default resources from Configuration objects https://issues.apache.org/jira/browse/PIG-3441 PIG-3365Run as uber job if there is only one input split https://issues.apache.org/jira/browse/PIG-3365 You may edit this subscription at: https://issues.apache.org/jira/secure/FilterSubscription!default.jspa?subId=13225filterId=12322384
Re: Re: Encounter DNS error during load hbase table via pig grunt
In Hadoop environment, reverse DNS is needed. Eg. NameNode use reverse DNS to verify the DataNode is the right one. From the dig output, looks like DNS server is not configured properly. No DNS is found. On Tue, Jul 1, 2014 at 10:18 AM, lulynn_2008 lulynn_2...@163.com wrote: Hi Gordon, Thanks for your reply. Here is the dig result, this machine can not resolve this ip in cmd. Could you share why this requirement is needed? Is this needed for hbase/hadoop environment? Thanks [root@hostname ~]# dig 9.181.64.230 ; DiG 9.8.2rc1-RedHat-9.8.2-0.17.rc1.el6 9.181.64.230 ;; global options: +cmd ;; connection timed out; no servers could be reached At 2014-06-30 04:29:16, Gordon Wang gw...@gopivotal.com wrote: Make sure you can resolve 9.181.64.230 in cmd. use dig 9.181.64.230 to check. On Mon, Jun 30, 2014 at 4:14 PM, lulynn_2008 lulynn_2...@163.com wrote: Hi All, Following are the test case and error. Do you have any suggestion or comment? Thanks Test case: create hbase table in hbase shell: create 'employees', 'SN', 'department', 'address' put 'employees', 'Hong', 'address:country', 'China' load and dump the table in pig grunt: A = load 'hbase://employees' using org.apache.pig.backend.hadoop.hbase.HBaseStorage( 'address:country', '-loadKey true') as (SN:bytearray,country:bytearray); B = filter A by SN == 'Hong'; dump B; Error: 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.compiler=j9jit24 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.name=Linux 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.arch=amd64 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.version=2.6.32-358.el6.x86_64 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.name=pig 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.home=/home/pig 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.dir=/pig/bin 2014-06-30 15:23:50,073 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=hostname:2181 sessionTimeout=9 watcher=hconnection-0x363b363b 2014-06-30 15:23:50,083 INFO org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x363b363b connecting to ZooKeeper ensemble=hostname:2181 2014-06-30 15:23:50,086 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server hostname/9.181.64.230:2181. Will not attempt to authenticate using SASL (Unable to locate a login configuration) 2014-06-30 15:23:50,087 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to hostname/9.181.64.230:2181, initiating session 2014-06-30 15:23:50,097 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server hostname/9.181.64.230:2181, sessionid = 0x146eb9f0ee5005c, negotiated timeout = 4 2014-06-30 15:23:50,361 ERROR org.apache.hadoop.hbase.mapreduce.TableInputFormatBase: Cannot resolve the host name for hostname/9.181.64.230 because of javax.naming.CommunicationException: DNS error [Root exception is java.net.PortUnreachableException: ICMP Port Unreachable]; Remaining name: '230.64.181.9.in-addr.arpa' 2014-06-30 15:24:35,889 WARN org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher: Ooops! Some job has failed! Specify -stop_on_failure if you want Pig to stop immediately on failure. 2014-06-30 15:24:35,899 ERROR org.apache.pig.tools.pigstats.SimplePigStats: ERROR: java.io.IOException: Cannot create a record reader because of a previous error. Please look at the previous logs lines from the task's full log for more details. 2014-06-30 15:24:35,899 ERROR org.apache.pig.tools.pigstats.PigStatsUtil: 1 map reduce job(s) failed! 2014-06-30 15:24:35,931 ERROR org.apache.pig.tools.grunt.Grunt: ERROR 1066: Unable to open iterator for alias A. Backend error : java.io.IOException: Cannot create a record reader because of a previous error. Please look at the previous logs lines from the task's full log for more details. -- Regards Gordon Wang -- Regards Gordon Wang
Re:Re: Encounter DNS error during load hbase table via pig grunt
Hi Gordon, Thanks for your reply. Here is the dig result, this machine can not resolve this ip in cmd. Could you share why this requirement is needed? Is this needed for hbase/hadoop environment? Thanks [root@hostname ~]# dig 9.181.64.230 ; DiG 9.8.2rc1-RedHat-9.8.2-0.17.rc1.el6 9.181.64.230 ;; global options: +cmd ;; connection timed out; no servers could be reached At 2014-06-30 04:29:16, Gordon Wang gw...@gopivotal.com wrote: Make sure you can resolve 9.181.64.230 in cmd. use dig 9.181.64.230 to check. On Mon, Jun 30, 2014 at 4:14 PM, lulynn_2008 lulynn_2...@163.com wrote: Hi All, Following are the test case and error. Do you have any suggestion or comment? Thanks Test case: create hbase table in hbase shell: create 'employees', 'SN', 'department', 'address' put 'employees', 'Hong', 'address:country', 'China' load and dump the table in pig grunt: A = load 'hbase://employees' using org.apache.pig.backend.hadoop.hbase.HBaseStorage( 'address:country', '-loadKey true') as (SN:bytearray,country:bytearray); B = filter A by SN == 'Hong'; dump B; Error: 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.compiler=j9jit24 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.name=Linux 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.arch=amd64 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.version=2.6.32-358.el6.x86_64 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.name=pig 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.home=/home/pig 2014-06-30 15:23:50,072 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.dir=/pig/bin 2014-06-30 15:23:50,073 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=hostname:2181 sessionTimeout=9 watcher=hconnection-0x363b363b 2014-06-30 15:23:50,083 INFO org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x363b363b connecting to ZooKeeper ensemble=hostname:2181 2014-06-30 15:23:50,086 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server hostname/9.181.64.230:2181. Will not attempt to authenticate using SASL (Unable to locate a login configuration) 2014-06-30 15:23:50,087 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to hostname/9.181.64.230:2181, initiating session 2014-06-30 15:23:50,097 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server hostname/9.181.64.230:2181, sessionid = 0x146eb9f0ee5005c, negotiated timeout = 4 2014-06-30 15:23:50,361 ERROR org.apache.hadoop.hbase.mapreduce.TableInputFormatBase: Cannot resolve the host name for hostname/9.181.64.230 because of javax.naming.CommunicationException: DNS error [Root exception is java.net.PortUnreachableException: ICMP Port Unreachable]; Remaining name: '230.64.181.9.in-addr.arpa' 2014-06-30 15:24:35,889 WARN org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher: Ooops! Some job has failed! Specify -stop_on_failure if you want Pig to stop immediately on failure. 2014-06-30 15:24:35,899 ERROR org.apache.pig.tools.pigstats.SimplePigStats: ERROR: java.io.IOException: Cannot create a record reader because of a previous error. Please look at the previous logs lines from the task's full log for more details. 2014-06-30 15:24:35,899 ERROR org.apache.pig.tools.pigstats.PigStatsUtil: 1 map reduce job(s) failed! 2014-06-30 15:24:35,931 ERROR org.apache.pig.tools.grunt.Grunt: ERROR 1066: Unable to open iterator for alias A. Backend error : java.io.IOException: Cannot create a record reader because of a previous error. Please look at the previous logs lines from the task's full log for more details. -- Regards Gordon Wang
