hi yes, it is the official apache pig (0.14). My test was executed by copying the files belonging to tez-0.6.0 next to the tez-0.5.2. After I removed the 0.5.2 file, my test completed successfully.
Thanks for your help! best regards, -------------------------------------------- On Wed, 3/18/15, Jianfeng (Jeff) Zhang <[email protected]> wrote: Subject: Re: error after installation - TezSession has already shutdown To: "[email protected]" <[email protected]> Received: Wednesday, March 18, 2015, 12:05 AM Are you using the offical apache pig distribution ? And have you deleted tez-0.5.2 from lib/h2 ? Make sure you h2 directory looks like this -rw-r--r-- 1 jzhang staff 170570 Nov 17 10:03 avro-mapred-1.7.5-hadoop2.jar -rw-r--r-- 1 jzhang staff 610259 Nov 17 10:03 commons-collections4-4.0.jar -rw-r--r-- 1 jzhang staff 825853 Nov 17 10:03 hbase-client-0.96.0-hadoop2.jar -rw-r--r-- 1 jzhang staff 354844 Nov 17 10:03 hbase-common-0.96.0-hadoop2.jar -rw-r--r-- 1 jzhang staff 32096 Nov 17 10:03 hbase-hadoop-compat-0.96.0-hadoop2.jar -rw-r--r-- 1 jzhang staff 72765 Nov 17 10:03 hbase-hadoop2-compat-0.96.0-hadoop2.jar -rw-r--r-- 1 jzhang staff 3134214 Nov 17 10:03 hbase-protocol-0.96.0-hadoop2.jar -rw-r--r-- 1 jzhang staff 3058804 Nov 17 10:03 hbase-server-0.96.0-hadoop2.jar -rw-r--r-- 1 jzhang staff 48345 Nov 17 10:03 hive-shims-0.23-0.14.0.jar -rw-r--r-- 1 jzhang staff 820380 Mar 18 12:00 tez-api-0.6.0.jar -rw-r--r-- 1 jzhang staff 39763 Mar 18 12:00 tez-common-0.6.0.jar -rw-r--r-- 1 jzhang staff 1137658 Mar 18 12:00 tez-dag-0.6.0.jar -rw-r--r-- 1 jzhang staff 49274 Mar 18 12:00 tez-examples-0.6.0.jar -rw-r--r-- 1 jzhang staff 275924 Mar 18 12:00 tez-mapreduce-0.6.0.jar -rw-r--r-- 1 jzhang staff 3936 Mar 18 12:00 tez-mbeans-resource-calculator-0.6.0.jar -rw-r--r-- 1 jzhang staff 117310 Mar 18 12:00 tez-runtime-internals-0.6.0.jar -rw-r--r-- 1 jzhang staff 517534 Mar 18 12:00 tez-runtime-library-0.6.0.jar -rw-r--r-- 1 jzhang staff 149955 Mar 18 12:00 tez-tests-0.6.0.jar -rw-r--r-- 1 jzhang staff 1399032 Mar 18 12:00 tez-ui-0.6.0.war -rw-r--r-- 1 jzhang staff 23753 Mar 18 12:00 tez-yarn-timeline-history-with-acls-0.6.0.jar Best Regard, Jeff Zhang On 3/18/15, 10:34 AM, "dagriq" <[email protected]> wrote: >hi > >and thanks for the hint. >I've done it and it works fine now. The client (in my case Pig) has the >(default) libraires from tez-0.5.2. > >I did another test , I copied all libraries from 0.6.0 to the Pig folder >(/usr/local/pig/lib/h2) and I updated the tez-site.xml file to the >initial version (pointing to tez-0.6.0) but it did not work.... >It worked fine with 0.5.2 but not with 0.6.0. > >thank you! > > > >-------------------------------------------- >On Tue, 3/17/15, Jianfeng (Jeff) Zhang <[email protected]> wrote: > > Subject: Re: error after installation - TezSession has already shutdown > To: "[email protected]" <[email protected]> > Received: Tuesday, March 17, 2015, 9:04 PM > > You should use tez-0.5.2 instead of > tez-0.6 on hdfs. > > Download it from here http://www.apache.org/dyn/closer.cgi/tez/0.5.2/ > > > > Best Regard, > Jeff Zhang > > > > > > On 3/18/15, 8:53 AM, "dagriq" <[email protected]> > wrote: > > >hi > > > >i have added the necessary folder and the true flag in > the yarn-site.xml > >file. I re-executed the steps, the log file is > attached. > >Also a screenshot from the RM, you are correct > "Incompatible versions > >found, clientVersion=0.5.2, AMVersion=0.6.0 " is > displayed.... > >What is wrong? ..how to fix it?? > > > >thanks for your help! > > > >-------------------------------------------- > >On Tue, 3/17/15, Hitesh Shah <[email protected]> > wrote: > > > > Subject: Re: error after installation - TezSession has > already shutdown > > To: [email protected] > > Received: Tuesday, March 17, 2015, 7:10 PM > > > > You have yarn configured with log > > aggregation disabled ( yarn.log-aggregation-enable to > false > > ). In this scenario, the logs are on the NodeManager > where > > the AM was launched. For this, find the log-dirs > property > > configured in yarn-site.xml and use that to find the > logs > > for your application. If this is a multi-node cluster, > you > > will need to find logs from all nodes in your cluster. > YARN > > logs aggregation if enabled does this automatically > and > > stores all logs in HDFS. > > > > In any case, based on your earlier logs: > > > > > 2015-03-16 23:39:01,576 [PigTezLauncher-0] INFO > > org.apache.tez.client.TezClient - Tez Client Version: > [ > > component=tez-api, version=0.5.2, > > revision=5d728786b681e549a6f33375991dcce97cbf79f3, > > > SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, > > buildTIme=20141104-1809 ] > > > > > > and > > > > > > > > org.apache.tez.client.TezClientUtils - Using > > tez.lib.uris > > > value from configuration: > > > > > > hdfs://localhost:9000/apps/tez-0.6.0-SNAPSHOT/tez-0.6.0.tar.gz > > > > I think the inconsistency of versions might be the > reason > > why things are failing. Please check the > ResourceManager UI > > for the application in question and see if the > diagnostics > > message points to a version issue. > > > > thanks > > ‹ Hitesh > > > > > > On Mar 17, 2015, at 3:51 PM, dagriq <[email protected]> > > wrote: > > > > > hi > > > > > > and thanks for the quick reply. > > > I have tried the hint that you gave me but it was > > nothing written. > > > Please open the attached screenshot; I issed the > > command after error was raised... > > > > > > > > > regards > > > > > > > > > -------------------------------------------- > > > On Tue, 3/17/15, Hitesh Shah <[email protected]> > > wrote: > > > > > > Subject: Re: error after installation - TezSession > has > > already shutdown > > > To: [email protected] > > > Received: Tuesday, March 17, 2015, 11:30 AM > > > > > > Hello > > > > > > First issue from the stack > > > trace: > "org.apache.tez.dag.api.TezUncheckedException: > > > Invalid configuration of tez jars, tez.lib.uris is > not > > > defined in the configuration². It looks like > your > > first > > > run failed due to this. The second run seemed to > be > > > configured correctly but failed for a different > reason. > > For > > > this, look for a line along the lines of > > > > "org.apache.hadoop.yarn.client.api.impl.YarnClientImpl > > > - Submitted application > > application_1426563447689_0001² to > > > find the application ID. Now, invoke ³bin/yarn > logs > > > -applicationId <appId>² to get all the > logs > > and > > > attach it to your email to this list so that we > can > > take a > > > look to see if there are other issues. > > > > > > Actually, my guess is that you have 2 different > > > versions of tez in use. Based on the stack trace, > you > > seem > > > to be using tez-0.5.2 on the client machine but > your > > tarball > > > on HDFS is tez-0.6.0. Both of these need to have > > matching > > > versions. If you go to the ResourceManager and > look at > > the > > > UI for the applicationId, its diagnostics might > likely > > tell > > > you that the AM was incompatible with the client. > If > > you see > > > a different error, please send across the logs > from > > the > > > above command and we can help further. > > > > > > thanks > > > ‹ HItesh > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On > > > Mar 17, 2015, at 6:27 AM, dagriq <[email protected]> > > > wrote: > > > > > >> hi > > >> > > >> I have downloaded > > > and compiled Tez and I received one error when I > tried > > at > > > the bash shell: [ pig -x tez myscript.pig ]. > > >> > > >> I executed all steps > > > from the [ http://tez.apache.org/install.html ] > > and > > > I have a new folder in /usr/local/apache-tez. > > >> I added one more subfolder called conf > > > where I stored the new file tez-site.xml. > > >> My first error message is copied below: > > >> > > >> > > >> 2015-03-16 23:39:00,463 [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler > > > - For vertex - scope-34: parallelism=1, > memory=1024, > > java > > > opts=-Djava.net.preferIPv4Stack=true > > > -Dhadoop.metrics.log.level=WARN -Xmx200m > > > > -Dlog4j.configuration=tez-container-log4j.properties > > > -Dyarn.app.container.log.dir=<LOG_DIR> > > > -Dtez.root.logger=INFO,CLA > > >> 2015-03-16 > > > 23:39:00,862 [PigTezLauncher-0] INFO > > > org.apache.pig.tools.pigstats.tez.TezScriptState - > Pig > > > script settings are added to the job > > >> > > > 2015-03-16 23:39:01,576 [PigTezLauncher-0] INFO > > > org.apache.tez.client.TezClient - Tez Client > Version: > > [ > > > component=tez-api, version=0.5.2, > > > > revision=5d728786b681e549a6f33375991dcce97cbf79f3, > > > > > > SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, > > > buildTIme=20141104-1809 ] > > >> > > > 2015-03-16 23:39:01,757 [PigTezLauncher-0] INFO > > > org.apache.hadoop.yarn.client.RMProxy - Connecting > to > > > ResourceManager at /0.0.0.0:8032 > > >> > > > 2015-03-16 23:39:02,798 [PigTezLauncher-0] INFO > > > org.apache.tez.client.TezClient - Session mode. > > Starting > > > session. > > >> > > >> > > > 2015-03-16 23:39:02,800 [PigTezLauncher-0] ERROR > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.TezJob - > > > Cannot submit DAG > > >> > > >> > > > org.apache.tez.dag.api.TezUncheckedException: > Invalid > > > configuration of tez jars, tez.lib.uris is not > defined > > in > > > the configuration > > >> > > >> at > > > > > > >>org.apache.tez.client.TezClientUtils.setupTezJarsLocalResources(TezClient >>U > >tils.java:162) > > >> at > > > > > > org.apache.tez.client.TezClient.getTezJarResources(TezClient.java:711) > > >> at > > > > > > org.apache.tez.client.TezClient.start(TezClient.java:294) > > >> at > > > > > > >>org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.creat >>e > >Session(TezSessionManager.java:95) > > >> at > > > > > > >>org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.getCl >>i > >ent(TezSessionManager.java:195) > > >> at > > > > > > >>org.apache.pig.backend.hadoop.executionengine.tez.TezJob.run(TezJob.java: >>1 > >59) > > >> at > > > > > > >>org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher$1.run(TezLa >>u > >ncher.java:167) > > >> at > > > > > > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > > >> at > > > > > > java.util.concurrent.FutureTask.run(FutureTask.java:262) > > >> at > > > > > > >>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java >>: > >1145) > > >> at > > > > > > >>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.jav >>a > >:615) > > >> at > > > java.lang.Thread.run(Thread.java:745) > > >> > > > > > >> 2015-03-16 23:39:03,758 [main] INFO > > > > org.apache.pig.tools.pigstats.tez.TezPigScriptStats - > > Script > > > Statistics: > > >> > > >> > > > HadoopVersion: 2.6.0 > > > > > > > > > > > > > > > > > > > > > > > > > >> > > > PigVersion: 0.14.0 > > > > > > > > > > > > > > > > > > > > > >> > > TezVersion: 0.5.2 > > > > > > > > > > > > > > > > > > > > > > > > > >> > > > UserId: dagriq > > > > > > > > > > > > > > > > > > > > > > >> > > FileName: > > > dev2/email4.pig > > > > > > > > > > > > > > > > > > > > > > >> > > > StartedAt: 2015-03-16 > > 23:38:55 > > > > > > > > > > > > > > > > > > > > > >> > > > FinishedAt: 2015-03-16 23:39:03 > > > > > > > > > > > > > > > > > > > >> > > Features: FILTER > > > > > > > > > > > > > > > > > > > > > > > >> > > >> > > > Failed! > > >> > > >> DAG > > > PigLatin:dummy data-0_scope-0: > > >> > > > ApplicationId: null > > > > > > > > > > > > > > > > > > > > > > >> TotalLaunchedTasks: -1 > > > > > > > > > > > > > > > > > > > > > > > > > >> > > > FileBytesRead: -1 > > > > > > > > > > > > > > > > > > > > > > >> FileBytesWritten: -1 > > > > > > > > > > > > > > > > > > > > > > > > > >> > > > HdfsBytesRead: 0 > > > > > > > > > > > > > > > > > > > > > > > > > >> HdfsBytesWritten: > > > 0 > > > > > > > > > > > > > > > > > > > > > > > >> > > > > > >> Input(s): > > >> > > >> Output(s): > > >> > > >> 2015-03-16 23:39:03,781 [main] ERROR > > > org.apache.pig.tools.grunt.GruntParser - ERROR > 2244: > > Job > > > failed, hadoop does not return any error message > > >> Details at logfile: > > > /usr/local/pig/logs/pig-err.log > > >> > > > 2015-03-16 23:39:03,860 [main] INFO > > org.apache.pig.Main - > > > Pig script completed in 19 seconds and 936 > > milliseconds > > > (19936 ms) > > >> 2015-03-16 23:39:03,860 > > > [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher > > > - Shutting down thread pool > > >> > > >> So I copied the tez-site.xml to the hadoop > > > files and I re-executed the above mentioned > command: > > pig -x > > > tez myscript.pig. I received another error , I am > > copying it > > > below: > > >> > > >> 2015-03-16 > > > 23:40:28,679 [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.plan.TezCompiler > > > - File concatenation threshold: 100 optimistic? > false > > >> 2015-03-16 23:40:28,805 [main] INFO > > > org.apache.hadoop.conf.Configuration.deprecation > - > > > mapreduce.inputformat.class is deprecated. > Instead, > > use > > > mapreduce.job.inputformat.class > > >> > > > 2015-03-16 23:40:29,050 [main] INFO > > > org.apache.tez.mapreduce.hadoop.MRInputHelpers - > > Generating > > > mapreduce api input splits > > >> 2015-03-16 > > > 23:40:29,276 [main] INFO > > > > org.apache.hadoop.mapreduce.lib.input.FileInputFormat > > - > > > Total input paths to process : 4 > > >> > > > 2015-03-16 23:40:29,280 [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil > > > - Total input paths to process : 4 > > >> > > > 2015-03-16 23:40:29,449 [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil > > > - Total input paths (combined) to process : 1 > > >> 2015-03-16 23:40:29,602 [main] INFO > > > org.apache.tez.mapreduce.hadoop.MRInputHelpers - > > NumSplits: > > > 1, SerializedSize: 614 > > >> 2015-03-16 > > > 23:40:31,773 [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler > > > - Local resource: joda-time-2.1.jar > > >> > > > 2015-03-16 23:40:31,773 [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler > > > - Local resource: guava-11.0.2.jar > > >> > > > 2015-03-16 23:40:31,774 [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler > > > - Local resource: pig-0.14.0-core-h2.jar > > >> 2015-03-16 23:40:31,774 [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler > > > - Local resource: antlr-runtime-3.4.jar > > >> > > > 2015-03-16 23:40:31,775 [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler > > > - Local resource: automaton-1.11-8.jar > > >> > > > 2015-03-16 23:40:31,884 [main] INFO > > > org.apache.hadoop.conf.Configuration.deprecation > - > > > fs.default.name is deprecated. Instead, use > > fs.defaultFS > > >> 2015-03-16 23:40:32,359 [main] INFO > > > org.apache.hadoop.conf.Configuration.deprecation > - > > > mapred.output.compress is deprecated. Instead, > use > > > mapreduce.output.fileoutputformat.compress > > >> 2015-03-16 23:40:32,365 [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper > > > - Setting tez.runtime.shuffle.merge.percent to > 0.66 > > from MR > > > setting mapreduce.reduce.shuffle.merge.percent > > >> 2015-03-16 23:40:32,366 [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper > > > - Setting tez.runtime.shuffle.fetch.buffer.percent > to > > 0.70 > > > from MR setting > > > mapreduce.reduce.shuffle.input.buffer.percent > > >> 2015-03-16 23:40:32,367 [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper > > > - Setting tez.runtime.io.sort.mb to 100 from MR > > setting > > > mapreduce.task.io.sort.mb > > >> 2015-03-16 > > > 23:40:32,367 [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper > > > - Setting tez.runtime.shuffle.memory.limit.percent > to > > 0.25 > > > from MR setting > > > mapreduce.reduce.shuffle.memory.limit.percent > > >> 2015-03-16 23:40:32,368 [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper > > > - Setting tez.runtime.io.sort.factor to 10 from > MR > > setting > > > mapreduce.task.io.sort.factor > > >> > > > 2015-03-16 23:40:32,368 [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper > > > - Setting tez.runtime.shuffle.connect.timeout to > 180000 > > from > > > MR setting > mapreduce.reduce.shuffle.connect.timeout > > >> 2015-03-16 23:40:32,369 [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper > > > - Setting tez.runtime.internal.sorter.class to > > > org.apache.hadoop.util.QuickSort from MR setting > > > map.sort.class > > >> 2015-03-16 23:40:32,370 > > > [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper > > > - Setting tez.runtime.merge.progress.records to > 10000 > > from > > > MR setting mapreduce.task.merge.progress.records > > >> 2015-03-16 23:40:32,370 [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper > > > - Setting tez.runtime.compress to false from MR > > setting > > > mapreduce.map.output.compress > > >> > > > 2015-03-16 23:40:32,371 [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper > > > - Setting tez.runtime.sort.spill.percent to 0.80 > from > > MR > > > setting mapreduce.map.sort.spill.percent > > >> 2015-03-16 23:40:32,372 [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper > > > - Setting tez.runtime.shuffle.ssl.enable to false > from > > MR > > > setting mapreduce.shuffle.ssl.enabled > > >> > > > 2015-03-16 23:40:32,373 [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper > > > - Setting tez.runtime.ifile.readahead to true from > MR > > > setting mapreduce.ifile.readahead > > >> > > > 2015-03-16 23:40:32,373 [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper > > > - Setting tez.runtime.shuffle.parallel.copies to 5 > from > > MR > > > setting mapreduce.reduce.shuffle.parallelcopies > > >> 2015-03-16 23:40:32,374 [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper > > > - Setting tez.runtime.ifile.readahead.bytes to > 4194304 > > from > > > MR setting mapreduce.ifile.readahead.bytes > > >> 2015-03-16 23:40:32,374 [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper > > > - Setting > > tez.runtime.task.input.post-merge.buffer.percent > > > to 0.0 from MR setting > > > mapreduce.reduce.input.buffer.percent > > >> > > > 2015-03-16 23:40:32,375 [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper > > > - Setting tez.runtime.shuffle.read.timeout to > 180000 > > from MR > > > setting mapreduce.reduce.shuffle.read.timeout > > >> 2015-03-16 23:40:32,375 [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper > > > - Setting tez.runtime.compress.codec to > > > org.apache.hadoop.io.compress.DefaultCodec from > MR > > setting > > > mapreduce.map.output.compress.codec > > >> > > > 2015-03-16 23:40:32,707 [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler > > > - For vertex - scope-34: parallelism=1, > memory=1024, > > java > > > opts=-Djava.net.preferIPv4Stack=true > > > -Dhadoop.metrics.log.level=WARN -Xmx200m > > > > -Dlog4j.configuration=tez-container-log4j.properties > > > -Dyarn.app.container.log.dir=<LOG_DIR> > > > -Dtez.root.logger=INFO,CLA > > >> 2015-03-16 > > > 23:40:33,187 [PigTezLauncher-0] INFO > > > org.apache.pig.tools.pigstats.tez.TezScriptState - > Pig > > > script settings are added to the job > > >> > > > 2015-03-16 23:40:33,899 [PigTezLauncher-0] INFO > > > org.apache.tez.client.TezClient - Tez Client > Version: > > [ > > > component=tez-api, version=0.5.2, > > > > revision=5d728786b681e549a6f33375991dcce97cbf79f3, > > > > > > SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, > > > buildTIme=20141104-1809 ] > > >> > > > 2015-03-16 23:40:34,098 [PigTezLauncher-0] INFO > > > org.apache.hadoop.yarn.client.RMProxy - Connecting > to > > > ResourceManager at /0.0.0.0:8032 > > >> > > > 2015-03-16 23:40:34,923 [PigTezLauncher-0] INFO > > > org.apache.tez.client.TezClient - Session mode. > > Starting > > > session. > > >> 2015-03-16 23:40:34,923 > > > [PigTezLauncher-0] INFO > > org.apache.tez.client.TezClient - > > > Session mode. Starting session. > > >> > > > 2015-03-16 23:40:34,924 [PigTezLauncher-0] INFO > > > org.apache.tez.client.TezClientUtils - Using > > tez.lib.uris > > > value from configuration: > > > > > > hdfs://localhost:9000/apps/tez-0.6.0-SNAPSHOT/tez-0.6.0.tar.gz > > >> 2015-03-16 23:40:35,129 [PigTezLauncher-0] > > > INFO org.apache.tez.client.TezClient - Tez > system > > stage > > > directory > > > > > > >>hdfs://localhost:9000/tmp/temp-1303134320/.tez/application_1426563447689_ >>0 > >001 > > > doesn't exist and is created > > >> > > > 2015-03-16 23:40:36,048 [PigTezLauncher-0] INFO > > > > org.apache.hadoop.yarn.client.api.impl.YarnClientImpl > > - > > > Submitted application > application_1426563447689_0001 > > >> 2015-03-16 23:40:36,055 [PigTezLauncher-0] > > > INFO org.apache.tez.client.TezClient - The > url to > > track > > > the Tez Session: > >http://optimf:8088/proxy/application_1426563447689_0001/ > > >> > > >> 2015-03-16 > > > 23:40:59,709 [PigTezLauncher-0] ERROR > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.TezJob - > > > Cannot submit DAG > > >> > > > org.apache.tez.dag.api.SessionNotRunning: > TezSession > > has > > > already shutdown > > >> at > > > > > > org.apache.tez.client.TezClient.waitTillReady(TezClient.java:603) > > >> at > > > > > > >>org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.creat >>e > >Session(TezSessionManager.java:100) > > >> at > > > > > > >>org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.getCl >>i > >ent(TezSessionManager.java:195) > > >> at > > > > > > >>org.apache.pig.backend.hadoop.executionengine.tez.TezJob.run(TezJob.java: >>1 > >59) > > >> at > > > > > > >>org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher$1.run(TezLa >>u > >ncher.java:167) > > >> at > > > > > > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > > >> at > > > > > > java.util.concurrent.FutureTask.run(FutureTask.java:262) > > >> at > > > > > > >>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java >>: > >1145) > > >> at > > > > > > >>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.jav >>a > >:615) > > >> at > > > java.lang.Thread.run(Thread.java:745) > > >> > > > 2015-03-16 23:41:00,014 [main] INFO > > > > org.apache.pig.tools.pigstats.tez.TezPigScriptStats - > > Script > > > Statistics: > > >> > > >> > > > HadoopVersion: 2.6.0 > > > > > > > > > > > > > > > > > > > > > > > > > >> > > > PigVersion: 0.14.0 > > > > > > > > > > > > > > > > > > > > > >> > > TezVersion: 0.5.2 > > > > > > > > > > > > > > > > > > > > > > > > > >> > > > UserId: dagriq > > > > > > > > > > > > > > > > > > > > > > >> > > FileName: > > > dev2/email4.pig > > > > > > > > > > > > > > > > > > > > > > >> > > > StartedAt: 2015-03-16 > > 23:40:28 > > > > > > > > > > > > > > > > > > > > > >> > > > FinishedAt: 2015-03-16 23:41:00 > > > > > > > > > > > > > > > > > > > >> > > Features: FILTER > > > > > > > > > > > > > > > > > > > > > > > >> > > >> > > > Failed! > > >> > > >> > > >> DAG PigLatin:dummy data-0_scope-0: > > >> ApplicationId: > null > > > > > > > > > > > > > > > > > > > > > > > > > >> > > > TotalLaunchedTasks: -1 > > > > > > > > > > > > > > > > > > > > > > > >> FileBytesRead: > > -1 > > > > > > > > > > > > > > > > > > > > > > > > > >> > > > FileBytesWritten: -1 > > > > > > > > > > > > > > > > > > > > > > > >> HdfsBytesRead: > > 0 > > > > > > > > > > > > > > > > > > > > > > > > > > >> > > > HdfsBytesWritten: 0 > > > > > > > > > > > > > > > > > > > > > > >> > > >> Input(s): > > >> > > >> Output(s): > > >> > > >> 2015-03-16 > > > 23:41:00,036 [main] ERROR > > > org.apache.pig.tools.grunt.GruntParser - ERROR > 2244: > > Job > > > failed, hadoop does not return any error message > > >> Details at logfile: > > > /usr/local/pig/logs/pig-err.log > > >> > > > 2015-03-16 23:41:00,146 [main] INFO > > org.apache.pig.Main - > > > Pig script completed in 42 seconds and 897 > > milliseconds > > > (42897 ms) > > >> 2015-03-16 23:41:00,147 > > > [main] INFO > > > > > > org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher > > > - Shutting down thread pool > > >> > > >> > > >> What is wrong in my > > > installation ? > > >> Thank you for your > > > help! > > >> > > > <2015-03-17-184721_1280x1024_scrot.png> >
