Are you sure you don't have any other version of guava apart from the 11.0 from Pig and 11.0.2 from Tez? This is a very basic problem and the Pig release will not work for anyone if that is the case. None of us have encountered the error and no one else has reported in pig-usergroup or a pig jira.
-Rohini On Wed, Sep 2, 2015 at 5:18 AM, Sandeep Kumar <[email protected]> wrote: > Thanks for your responses. I was mistaken that there is any compatibility > issue. Its the same error when i run PIG-0.14.0 over Tez-0.5.2. > > HadoopVersion: > 2.6.0-cdh5.4.4 > > PigVersion: > 0.14.0 > > TezVersion: > 0.5.2 > > > PFA the exception stack trace. > > > On Wed, Sep 2, 2015 at 3:11 PM, Jianfeng (Jeff) Zhang < > [email protected]> wrote: > >> >>> I could not use tez-0.5.2 because it was not compatible with >> Hadoop-2.6.0. >> >> What incompatible do you see ? >> >> >> Best Regard, >> Jeff Zhang >> >> >> From: Sandeep Kumar <[email protected]> >> Reply-To: "[email protected]" <[email protected]> >> Date: Wednesday, September 2, 2015 at 5:18 PM >> >> To: "[email protected]" <[email protected]> >> Subject: Re: Pig(0.14.0) on Tez(0.7.0) >> >> Yes i did change PIG/ivy/libraries.propeties to compile it with tez-0.7.0 >> and also changed pig to compile with Hadoop-core-2.6.0. >> >> I could not use tez-0.5.2 because it was not compatible with >> Hadoop-2.6.0. >> >> I'm compiling my code of PIG using same command: ant clean jar >> -Dhadoopversion=23 >> >> >> >> On Wed, Sep 2, 2015 at 2:36 PM, Jianfeng (Jeff) Zhang < >> [email protected]> wrote: >> >>> >>> Not sure how did you compile pig with tez 0.7.0, did you change the tez >>> version in PIG/ivy/libraries.propeties ? >>> >>> And make sure you build pig with hadoop version, by default, pig build >>> with hadoop-1.x. Use the following command to build pig with hadoop-2.x >>> >>> >> ant clean jar -Dhadoopversion=23 >>> >>> >>> >>> Best Regard, >>> Jeff Zhang >>> >>> >>> From: Sandeep Kumar <[email protected]> >>> Reply-To: "[email protected]" <[email protected]> >>> Date: Wednesday, September 2, 2015 at 4:27 PM >>> To: "[email protected]" <[email protected]> >>> Subject: Re: Pig(0.14.0) on Tez(0.7.0) >>> >>> Hi Jeff, >>> >>> The cloudera Hadoop is using guava-11.0.2.jar. >>> I've also exported one environment variable before running pig: >>> >>> export HADOOP_USER_CLASSPATH_FIRST=true >>> >>> Should i recompile my PIG code with new guava jar? >>> >>> Regards, >>> Sandeep >>> >>> On Wed, Sep 2, 2015 at 1:20 PM, Jianfeng (Jeff) Zhang < >>> [email protected]> wrote: >>> >>>> >>>> It looks like classpath issue due guava version. Could you check the >>>> guava version CDH 5.4.4 is using ? AFAIK, Tez use guava 11.02 and pig use >>>> guava 11.0 >>>> >>>> >>>> >>>> Best Regard, >>>> Jeff Zhang >>>> >>>> >>>> From: Sandeep Kumar <[email protected]> >>>> Reply-To: "[email protected]" <[email protected]> >>>> Date: Wednesday, September 2, 2015 at 2:28 PM >>>> To: "[email protected]" <[email protected]> >>>> Subject: Pig(0.14.0) on Tez(0.7.0) >>>> >>>> Hi Guys, >>>> >>>> I've a pig script which is as follows: >>>> >>>> map = LOAD 'input/' using >>>> com.RawPigLoader('conf/Map.xml','conf/R360MapSignalling.json','csv'); >>>> normalized_map_data = foreach r360map generate flatten(com.Map($0..)); >>>> >>>> data_grouped_over_event_time = GROUP normalized_map_data by >>>> (((startTime/1000) / 3600) * 3600) PARTITION BY com.CustomTimePartitioner; >>>> final_data = foreach data_grouped_over_event_time generate flatten($1); >>>> >>>> store final_data into 'tmp/200MB' using com.StorageModel(); >>>> >>>> >>>> I'm trying to run my Pig job using Tez but i'm facing an exception >>>> which is attached. I searched over net and found some vague solutions. I've >>>> only two configuration entries in my tez-site.xml which are as follows: >>>> >>>> <property> >>>> <name>tez.lib.uris</name> >>>> <value>hdfs://node3:8020/user/hdfs/tez-0.7.0.tar.gz</value> >>>> </property> >>>> <property> >>>> <description>URL for where the Tez UI is hosted</description> >>>> <name>tez.tez-ui.history-url.base</name> >>>> <value>http://node4:9999/tez-ui/</value> >>>> </property> >>>> >>>> Is there anything else which i'm missing and supposed to be added in >>>> Tez configuration file. >>>> I've compiled PIG-0.14.0 manually with Tez-0.7.0 whereas it provided >>>> with Tez-0.5.2 but the exception is coming in both the versions of tez. >>>> >>>> Following are the version of softwares i'm using. >>>> >>>> HadoopVersion: >>>> 2.6.0-cdh5.4.4 >>>> >>>> PigVersion: >>>> 0.14.0-SNAPSHOT >>>> >>>> TezVersion: >>>> 0.7.0 >>>> >>>> >>>> >>>> >>>> Regards, >>>> Sandeep >>>> >>> >>> >> >
