Re: error after installation - TezSession has already shutdown
http://pig.apache.org/docs/r0.14.0/start.html#Running+the+Pig+Scripts+in+Mapreduce+Mode+or+Tez+Mode Do you have the directory containing tez-site.xml added to the pig classpath? That is most likely the cause for the error. Regards, Rohini On Tue, Mar 17, 2015 at 4:10 PM, Hitesh Shah hit...@apache.org wrote: You have yarn configured with log aggregation disabled ( yarn.log-aggregation-enable to false ). In this scenario, the logs are on the NodeManager where the AM was launched. For this, find the log-dirs property configured in yarn-site.xml and use that to find the logs for your application. If this is a multi-node cluster, you will need to find logs from all nodes in your cluster. YARN logs aggregation if enabled does this automatically and stores all logs in HDFS. In any case, based on your earlier logs: 2015-03-16 23:39:01,576 [PigTezLauncher-0] INFO org.apache.tez.client.TezClient - Tez Client Version: [ component=tez-api, version=0.5.2, revision=5d728786b681e549a6f33375991dcce97cbf79f3, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTIme=20141104-1809 ] and org.apache.tez.client.TezClientUtils - Using tez.lib.uris value from configuration: hdfs://localhost:9000/apps/tez-0.6.0-SNAPSHOT/tez-0.6.0.tar.gz I think the inconsistency of versions might be the reason why things are failing. Please check the ResourceManager UI for the application in question and see if the diagnostics message points to a version issue. thanks — Hitesh On Mar 17, 2015, at 3:51 PM, dagriq dag...@yahoo.ca wrote: hi and thanks for the quick reply. I have tried the hint that you gave me but it was nothing written. Please open the attached screenshot; I issed the command after error was raised... regards On Tue, 3/17/15, Hitesh Shah hit...@apache.org wrote: Subject: Re: error after installation - TezSession has already shutdown To: user@tez.apache.org Received: Tuesday, March 17, 2015, 11:30 AM Hello First issue from the stack trace: org.apache.tez.dag.api.TezUncheckedException: Invalid configuration of tez jars, tez.lib.uris is not defined in the configuration”. It looks like your first run failed due to this. The second run seemed to be configured correctly but failed for a different reason. For this, look for a line along the lines of org.apache.hadoop.yarn.client.api.impl.YarnClientImpl - Submitted application application_1426563447689_0001” to find the application ID. Now, invoke “bin/yarn logs -applicationId appId” to get all the logs and attach it to your email to this list so that we can take a look to see if there are other issues. Actually, my guess is that you have 2 different versions of tez in use. Based on the stack trace, you seem to be using tez-0.5.2 on the client machine but your tarball on HDFS is tez-0.6.0. Both of these need to have matching versions. If you go to the ResourceManager and look at the UI for the applicationId, its diagnostics might likely tell you that the AM was incompatible with the client. If you see a different error, please send across the logs from the above command and we can help further. thanks — HItesh On Mar 17, 2015, at 6:27 AM, dagriq dag...@yahoo.ca wrote: hi I have downloaded and compiled Tez and I received one error when I tried at the bash shell: [ pig -x tez myscript.pig ]. I executed all steps from the [ http://tez.apache.org/install.html ] and I have a new folder in /usr/local/apache-tez. I added one more subfolder called conf where I stored the new file tez-site.xml. My first error message is copied below: 2015-03-16 23:39:00,463 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler - For vertex - scope-34: parallelism=1, memory=1024, java opts=-Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -Xmx200m -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=LOG_DIR -Dtez.root.logger=INFO,CLA 2015-03-16 23:39:00,862 [PigTezLauncher-0] INFO org.apache.pig.tools.pigstats.tez.TezScriptState - Pig script settings are added to the job 2015-03-16 23:39:01,576 [PigTezLauncher-0] INFO org.apache.tez.client.TezClient - Tez Client Version: [ component=tez-api, version=0.5.2, revision=5d728786b681e549a6f33375991dcce97cbf79f3, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTIme=20141104-1809 ] 2015-03-16 23:39:01,757 [PigTezLauncher-0] INFO org.apache.hadoop.yarn.client.RMProxy - Connecting to ResourceManager at /0.0.0.0:8032 2015-03-16 23:39:02,798 [PigTezLauncher-0] INFO org.apache.tez.client.TezClient - Session mode. Starting session. 2015-03-16 23:39:02,800 [PigTezLauncher-0] ERROR org.apache.pig.backend.hadoop.executionengine.tez.TezJob - Cannot submit DAG
Re: error after installation - TezSession has already shutdown
You have yarn configured with log aggregation disabled ( yarn.log-aggregation-enable to false ). In this scenario, the logs are on the NodeManager where the AM was launched. For this, find the log-dirs property configured in yarn-site.xml and use that to find the logs for your application. If this is a multi-node cluster, you will need to find logs from all nodes in your cluster. YARN logs aggregation if enabled does this automatically and stores all logs in HDFS. In any case, based on your earlier logs: 2015-03-16 23:39:01,576 [PigTezLauncher-0] INFO org.apache.tez.client.TezClient - Tez Client Version: [ component=tez-api, version=0.5.2, revision=5d728786b681e549a6f33375991dcce97cbf79f3, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTIme=20141104-1809 ] and org.apache.tez.client.TezClientUtils - Using tez.lib.uris value from configuration: hdfs://localhost:9000/apps/tez-0.6.0-SNAPSHOT/tez-0.6.0.tar.gz I think the inconsistency of versions might be the reason why things are failing. Please check the ResourceManager UI for the application in question and see if the diagnostics message points to a version issue. thanks — Hitesh On Mar 17, 2015, at 3:51 PM, dagriq dag...@yahoo.ca wrote: hi and thanks for the quick reply. I have tried the hint that you gave me but it was nothing written. Please open the attached screenshot; I issed the command after error was raised... regards On Tue, 3/17/15, Hitesh Shah hit...@apache.org wrote: Subject: Re: error after installation - TezSession has already shutdown To: user@tez.apache.org Received: Tuesday, March 17, 2015, 11:30 AM Hello First issue from the stack trace: org.apache.tez.dag.api.TezUncheckedException: Invalid configuration of tez jars, tez.lib.uris is not defined in the configuration”. It looks like your first run failed due to this. The second run seemed to be configured correctly but failed for a different reason. For this, look for a line along the lines of org.apache.hadoop.yarn.client.api.impl.YarnClientImpl - Submitted application application_1426563447689_0001” to find the application ID. Now, invoke “bin/yarn logs -applicationId appId” to get all the logs and attach it to your email to this list so that we can take a look to see if there are other issues. Actually, my guess is that you have 2 different versions of tez in use. Based on the stack trace, you seem to be using tez-0.5.2 on the client machine but your tarball on HDFS is tez-0.6.0. Both of these need to have matching versions. If you go to the ResourceManager and look at the UI for the applicationId, its diagnostics might likely tell you that the AM was incompatible with the client. If you see a different error, please send across the logs from the above command and we can help further. thanks — HItesh On Mar 17, 2015, at 6:27 AM, dagriq dag...@yahoo.ca wrote: hi I have downloaded and compiled Tez and I received one error when I tried at the bash shell: [ pig -x tez myscript.pig ]. I executed all steps from the [ http://tez.apache.org/install.html ] and I have a new folder in /usr/local/apache-tez. I added one more subfolder called conf where I stored the new file tez-site.xml. My first error message is copied below: 2015-03-16 23:39:00,463 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler - For vertex - scope-34: parallelism=1, memory=1024, java opts=-Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -Xmx200m -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=LOG_DIR -Dtez.root.logger=INFO,CLA 2015-03-16 23:39:00,862 [PigTezLauncher-0] INFO org.apache.pig.tools.pigstats.tez.TezScriptState - Pig script settings are added to the job 2015-03-16 23:39:01,576 [PigTezLauncher-0] INFO org.apache.tez.client.TezClient - Tez Client Version: [ component=tez-api, version=0.5.2, revision=5d728786b681e549a6f33375991dcce97cbf79f3, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTIme=20141104-1809 ] 2015-03-16 23:39:01,757 [PigTezLauncher-0] INFO org.apache.hadoop.yarn.client.RMProxy - Connecting to ResourceManager at /0.0.0.0:8032 2015-03-16 23:39:02,798 [PigTezLauncher-0] INFO org.apache.tez.client.TezClient - Session mode. Starting session. 2015-03-16 23:39:02,800 [PigTezLauncher-0] ERROR org.apache.pig.backend.hadoop.executionengine.tez.TezJob - Cannot submit DAG org.apache.tez.dag.api.TezUncheckedException: Invalid configuration of tez jars, tez.lib.uris is not defined in the configuration at org.apache.tez.client.TezClientUtils.setupTezJarsLocalResources(TezClientUtils.java:162) at org.apache.tez.client.TezClient.getTezJarResources(TezClient.java:711) at org.apache.tez.client.TezClient.start(TezClient.java:294)
error after installation - TezSession has already shutdown
hi I have downloaded and compiled Tez and I received one error when I tried at the bash shell: [ pig -x tez myscript.pig ]. I executed all steps from the [ http://tez.apache.org/install.html ] and I have a new folder in /usr/local/apache-tez. I added one more subfolder called conf where I stored the new file tez-site.xml. My first error message is copied below: 2015-03-16 23:39:00,463 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler - For vertex - scope-34: parallelism=1, memory=1024, java opts=-Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -Xmx200m -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=LOG_DIR -Dtez.root.logger=INFO,CLA 2015-03-16 23:39:00,862 [PigTezLauncher-0] INFO org.apache.pig.tools.pigstats.tez.TezScriptState - Pig script settings are added to the job 2015-03-16 23:39:01,576 [PigTezLauncher-0] INFO org.apache.tez.client.TezClient - Tez Client Version: [ component=tez-api, version=0.5.2, revision=5d728786b681e549a6f33375991dcce97cbf79f3, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTIme=20141104-1809 ] 2015-03-16 23:39:01,757 [PigTezLauncher-0] INFO org.apache.hadoop.yarn.client.RMProxy - Connecting to ResourceManager at /0.0.0.0:8032 2015-03-16 23:39:02,798 [PigTezLauncher-0] INFO org.apache.tez.client.TezClient - Session mode. Starting session. 2015-03-16 23:39:02,800 [PigTezLauncher-0] ERROR org.apache.pig.backend.hadoop.executionengine.tez.TezJob - Cannot submit DAG org.apache.tez.dag.api.TezUncheckedException: Invalid configuration of tez jars, tez.lib.uris is not defined in the configuration at org.apache.tez.client.TezClientUtils.setupTezJarsLocalResources(TezClientUtils.java:162) at org.apache.tez.client.TezClient.getTezJarResources(TezClient.java:711) at org.apache.tez.client.TezClient.start(TezClient.java:294) at org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.createSession(TezSessionManager.java:95) at org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.getClient(TezSessionManager.java:195) at org.apache.pig.backend.hadoop.executionengine.tez.TezJob.run(TezJob.java:159) at org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher$1.run(TezLauncher.java:167) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 2015-03-16 23:39:03,758 [main] INFO org.apache.pig.tools.pigstats.tez.TezPigScriptStats - Script Statistics: HadoopVersion: 2.6.0 PigVersion: 0.14.0 TezVersion: 0.5.2 UserId: dagriq FileName: dev2/email4.pig StartedAt: 2015-03-16 23:38:55 FinishedAt: 2015-03-16 23:39:03 Features: FILTER Failed! DAG PigLatin:dummy data-0_scope-0: ApplicationId: null TotalLaunchedTasks: -1 FileBytesRead: -1 FileBytesWritten: -1 HdfsBytesRead: 0 HdfsBytesWritten: 0 Input(s): Output(s): 2015-03-16 23:39:03,781 [main] ERROR org.apache.pig.tools.grunt.GruntParser - ERROR 2244: Job failed, hadoop does not return any error message Details at logfile: /usr/local/pig/logs/pig-err.log 2015-03-16 23:39:03,860 [main] INFO org.apache.pig.Main - Pig script completed in 19 seconds and 936 milliseconds (19936 ms) 2015-03-16
