Re: error after installation - TezSession has already shutdown
hi yes, it is the official apache pig (0.14). My test was executed by copying the files belonging to tez-0.6.0 next to the tez-0.5.2. After I removed the 0.5.2 file, my test completed successfully. Thanks for your help! best regards, On Wed, 3/18/15, Jianfeng (Jeff) Zhang jzh...@hortonworks.com wrote: Subject: Re: error after installation - TezSession has already shutdown To: user@tez.apache.org user@tez.apache.org Received: Wednesday, March 18, 2015, 12:05 AM Are you using the offical apache pig distribution ? And have you deleted tez-0.5.2 from lib/h2 ? Make sure you h2 directory looks like this -rw-r--r-- 1 jzhang staff 170570 Nov 17 10:03 avro-mapred-1.7.5-hadoop2.jar -rw-r--r-- 1 jzhang staff 610259 Nov 17 10:03 commons-collections4-4.0.jar -rw-r--r-- 1 jzhang staff 825853 Nov 17 10:03 hbase-client-0.96.0-hadoop2.jar -rw-r--r-- 1 jzhang staff 354844 Nov 17 10:03 hbase-common-0.96.0-hadoop2.jar -rw-r--r-- 1 jzhang staff 32096 Nov 17 10:03 hbase-hadoop-compat-0.96.0-hadoop2.jar -rw-r--r-- 1 jzhang staff 72765 Nov 17 10:03 hbase-hadoop2-compat-0.96.0-hadoop2.jar -rw-r--r-- 1 jzhang staff 3134214 Nov 17 10:03 hbase-protocol-0.96.0-hadoop2.jar -rw-r--r-- 1 jzhang staff 3058804 Nov 17 10:03 hbase-server-0.96.0-hadoop2.jar -rw-r--r-- 1 jzhang staff 48345 Nov 17 10:03 hive-shims-0.23-0.14.0.jar -rw-r--r-- 1 jzhang staff 820380 Mar 18 12:00 tez-api-0.6.0.jar -rw-r--r-- 1 jzhang staff 39763 Mar 18 12:00 tez-common-0.6.0.jar -rw-r--r-- 1 jzhang staff 1137658 Mar 18 12:00 tez-dag-0.6.0.jar -rw-r--r-- 1 jzhang staff 49274 Mar 18 12:00 tez-examples-0.6.0.jar -rw-r--r-- 1 jzhang staff 275924 Mar 18 12:00 tez-mapreduce-0.6.0.jar -rw-r--r-- 1 jzhang staff 3936 Mar 18 12:00 tez-mbeans-resource-calculator-0.6.0.jar -rw-r--r-- 1 jzhang staff 117310 Mar 18 12:00 tez-runtime-internals-0.6.0.jar -rw-r--r-- 1 jzhang staff 517534 Mar 18 12:00 tez-runtime-library-0.6.0.jar -rw-r--r-- 1 jzhang staff 149955 Mar 18 12:00 tez-tests-0.6.0.jar -rw-r--r-- 1 jzhang staff 1399032 Mar 18 12:00 tez-ui-0.6.0.war -rw-r--r-- 1 jzhang staff 23753 Mar 18 12:00 tez-yarn-timeline-history-with-acls-0.6.0.jar Best Regard, Jeff Zhang On 3/18/15, 10:34 AM, dagriq dag...@yahoo.ca wrote: hi and thanks for the hint. I've done it and it works fine now. The client (in my case Pig) has the (default) libraires from tez-0.5.2. I did another test , I copied all libraries from 0.6.0 to the Pig folder (/usr/local/pig/lib/h2) and I updated the tez-site.xml file to the initial version (pointing to tez-0.6.0) but it did not work It worked fine with 0.5.2 but not with 0.6.0. thank you! On Tue, 3/17/15, Jianfeng (Jeff) Zhang jzh...@hortonworks.com wrote: Subject: Re: error after installation - TezSession has already shutdown To: user@tez.apache.org user@tez.apache.org Received: Tuesday, March 17, 2015, 9:04 PM You should use tez-0.5.2 instead of tez-0.6 on hdfs. Download it from here http://www.apache.org/dyn/closer.cgi/tez/0.5.2/ Best Regard, Jeff Zhang On 3/18/15, 8:53 AM, dagriq dag...@yahoo.ca wrote: hi i have added the necessary folder and the true flag in the yarn-site.xml file. I re-executed the steps, the log file is attached. Also a screenshot from the RM, you are correct Incompatible versions found, clientVersion=0.5.2, AMVersion=0.6.0 is displayed What is wrong? ..how to fix it?? thanks for your help! On Tue, 3/17/15, Hitesh Shah hit...@apache.org wrote: Subject: Re: error after installation - TezSession has already shutdown To: user@tez.apache.org Received: Tuesday, March 17, 2015, 7:10 PM You have yarn configured with log aggregation disabled ( yarn.log-aggregation-enable to false ). In this scenario, the logs are on the NodeManager where the AM was launched. For this, find the log-dirs property configured in yarn-site.xml and use that to find the logs for your application. If this is a multi-node cluster, you will need to find logs from all nodes in your cluster. YARN logs aggregation if enabled does this automatically and stores all logs in HDFS. In any case, based on your earlier logs: 2015-03-16 23:39:01,576 [PigTezLauncher-0] INFO org.apache.tez.client.TezClient - Tez Client Version: [ component=tez-api, version=0.5.2, revision=5d728786b681e549a6f33375991dcce97cbf79f3, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTIme=20141104-1809 ] and org.apache.tez.client.TezClientUtils - Using tez.lib.uris value from configuration: hdfs
Re: error after installation - TezSession has already shutdown
http://pig.apache.org/docs/r0.14.0/start.html#Running+the+Pig+Scripts+in+Mapreduce+Mode+or+Tez+Mode Do you have the directory containing tez-site.xml added to the pig classpath? That is most likely the cause for the error. Regards, Rohini On Tue, Mar 17, 2015 at 4:10 PM, Hitesh Shah hit...@apache.org wrote: You have yarn configured with log aggregation disabled ( yarn.log-aggregation-enable to false ). In this scenario, the logs are on the NodeManager where the AM was launched. For this, find the log-dirs property configured in yarn-site.xml and use that to find the logs for your application. If this is a multi-node cluster, you will need to find logs from all nodes in your cluster. YARN logs aggregation if enabled does this automatically and stores all logs in HDFS. In any case, based on your earlier logs: 2015-03-16 23:39:01,576 [PigTezLauncher-0] INFO org.apache.tez.client.TezClient - Tez Client Version: [ component=tez-api, version=0.5.2, revision=5d728786b681e549a6f33375991dcce97cbf79f3, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTIme=20141104-1809 ] and org.apache.tez.client.TezClientUtils - Using tez.lib.uris value from configuration: hdfs://localhost:9000/apps/tez-0.6.0-SNAPSHOT/tez-0.6.0.tar.gz I think the inconsistency of versions might be the reason why things are failing. Please check the ResourceManager UI for the application in question and see if the diagnostics message points to a version issue. thanks — Hitesh On Mar 17, 2015, at 3:51 PM, dagriq dag...@yahoo.ca wrote: hi and thanks for the quick reply. I have tried the hint that you gave me but it was nothing written. Please open the attached screenshot; I issed the command after error was raised... regards On Tue, 3/17/15, Hitesh Shah hit...@apache.org wrote: Subject: Re: error after installation - TezSession has already shutdown To: user@tez.apache.org Received: Tuesday, March 17, 2015, 11:30 AM Hello First issue from the stack trace: org.apache.tez.dag.api.TezUncheckedException: Invalid configuration of tez jars, tez.lib.uris is not defined in the configuration”. It looks like your first run failed due to this. The second run seemed to be configured correctly but failed for a different reason. For this, look for a line along the lines of org.apache.hadoop.yarn.client.api.impl.YarnClientImpl - Submitted application application_1426563447689_0001” to find the application ID. Now, invoke “bin/yarn logs -applicationId appId” to get all the logs and attach it to your email to this list so that we can take a look to see if there are other issues. Actually, my guess is that you have 2 different versions of tez in use. Based on the stack trace, you seem to be using tez-0.5.2 on the client machine but your tarball on HDFS is tez-0.6.0. Both of these need to have matching versions. If you go to the ResourceManager and look at the UI for the applicationId, its diagnostics might likely tell you that the AM was incompatible with the client. If you see a different error, please send across the logs from the above command and we can help further. thanks — HItesh On Mar 17, 2015, at 6:27 AM, dagriq dag...@yahoo.ca wrote: hi I have downloaded and compiled Tez and I received one error when I tried at the bash shell: [ pig -x tez myscript.pig ]. I executed all steps from the [ http://tez.apache.org/install.html ] and I have a new folder in /usr/local/apache-tez. I added one more subfolder called conf where I stored the new file tez-site.xml. My first error message is copied below: 2015-03-16 23:39:00,463 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler - For vertex - scope-34: parallelism=1, memory=1024, java opts=-Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -Xmx200m -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=LOG_DIR -Dtez.root.logger=INFO,CLA 2015-03-16 23:39:00,862 [PigTezLauncher-0] INFO org.apache.pig.tools.pigstats.tez.TezScriptState - Pig script settings are added to the job 2015-03-16 23:39:01,576 [PigTezLauncher-0] INFO org.apache.tez.client.TezClient - Tez Client Version: [ component=tez-api, version=0.5.2, revision=5d728786b681e549a6f33375991dcce97cbf79f3, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTIme=20141104-1809 ] 2015-03-16 23:39:01,757 [PigTezLauncher-0] INFO org.apache.hadoop.yarn.client.RMProxy - Connecting to ResourceManager at /0.0.0.0:8032 2015-03-16 23:39:02,798 [PigTezLauncher-0] INFO org.apache.tez.client.TezClient - Session mode. Starting session. 2015-03-16 23:39:02,800 [PigTezLauncher-0] ERROR org.apache.pig.backend.hadoop.executionengine.tez.TezJob - Cannot submit DAG
Re: error after installation - TezSession has already shutdown
You have yarn configured with log aggregation disabled ( yarn.log-aggregation-enable to false ). In this scenario, the logs are on the NodeManager where the AM was launched. For this, find the log-dirs property configured in yarn-site.xml and use that to find the logs for your application. If this is a multi-node cluster, you will need to find logs from all nodes in your cluster. YARN logs aggregation if enabled does this automatically and stores all logs in HDFS. In any case, based on your earlier logs: 2015-03-16 23:39:01,576 [PigTezLauncher-0] INFO org.apache.tez.client.TezClient - Tez Client Version: [ component=tez-api, version=0.5.2, revision=5d728786b681e549a6f33375991dcce97cbf79f3, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTIme=20141104-1809 ] and org.apache.tez.client.TezClientUtils - Using tez.lib.uris value from configuration: hdfs://localhost:9000/apps/tez-0.6.0-SNAPSHOT/tez-0.6.0.tar.gz I think the inconsistency of versions might be the reason why things are failing. Please check the ResourceManager UI for the application in question and see if the diagnostics message points to a version issue. thanks — Hitesh On Mar 17, 2015, at 3:51 PM, dagriq dag...@yahoo.ca wrote: hi and thanks for the quick reply. I have tried the hint that you gave me but it was nothing written. Please open the attached screenshot; I issed the command after error was raised... regards On Tue, 3/17/15, Hitesh Shah hit...@apache.org wrote: Subject: Re: error after installation - TezSession has already shutdown To: user@tez.apache.org Received: Tuesday, March 17, 2015, 11:30 AM Hello First issue from the stack trace: org.apache.tez.dag.api.TezUncheckedException: Invalid configuration of tez jars, tez.lib.uris is not defined in the configuration”. It looks like your first run failed due to this. The second run seemed to be configured correctly but failed for a different reason. For this, look for a line along the lines of org.apache.hadoop.yarn.client.api.impl.YarnClientImpl - Submitted application application_1426563447689_0001” to find the application ID. Now, invoke “bin/yarn logs -applicationId appId” to get all the logs and attach it to your email to this list so that we can take a look to see if there are other issues. Actually, my guess is that you have 2 different versions of tez in use. Based on the stack trace, you seem to be using tez-0.5.2 on the client machine but your tarball on HDFS is tez-0.6.0. Both of these need to have matching versions. If you go to the ResourceManager and look at the UI for the applicationId, its diagnostics might likely tell you that the AM was incompatible with the client. If you see a different error, please send across the logs from the above command and we can help further. thanks — HItesh On Mar 17, 2015, at 6:27 AM, dagriq dag...@yahoo.ca wrote: hi I have downloaded and compiled Tez and I received one error when I tried at the bash shell: [ pig -x tez myscript.pig ]. I executed all steps from the [ http://tez.apache.org/install.html ] and I have a new folder in /usr/local/apache-tez. I added one more subfolder called conf where I stored the new file tez-site.xml. My first error message is copied below: 2015-03-16 23:39:00,463 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler - For vertex - scope-34: parallelism=1, memory=1024, java opts=-Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -Xmx200m -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=LOG_DIR -Dtez.root.logger=INFO,CLA 2015-03-16 23:39:00,862 [PigTezLauncher-0] INFO org.apache.pig.tools.pigstats.tez.TezScriptState - Pig script settings are added to the job 2015-03-16 23:39:01,576 [PigTezLauncher-0] INFO org.apache.tez.client.TezClient - Tez Client Version: [ component=tez-api, version=0.5.2, revision=5d728786b681e549a6f33375991dcce97cbf79f3, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTIme=20141104-1809 ] 2015-03-16 23:39:01,757 [PigTezLauncher-0] INFO org.apache.hadoop.yarn.client.RMProxy - Connecting to ResourceManager at /0.0.0.0:8032 2015-03-16 23:39:02,798 [PigTezLauncher-0] INFO org.apache.tez.client.TezClient - Session mode. Starting session. 2015-03-16 23:39:02,800 [PigTezLauncher-0] ERROR org.apache.pig.backend.hadoop.executionengine.tez.TezJob - Cannot submit DAG org.apache.tez.dag.api.TezUncheckedException: Invalid configuration of tez jars, tez.lib.uris is not defined in the configuration at org.apache.tez.client.TezClientUtils.setupTezJarsLocalResources(TezClientUtils.java:162) at org.apache.tez.client.TezClient.getTezJarResources(TezClient.java:711) at org.apache.tez.client.TezClient.start(TezClient.java:294
error after installation - TezSession has already shutdown
hi I have downloaded and compiled Tez and I received one error when I tried at the bash shell: [ pig -x tez myscript.pig ]. I executed all steps from the [ http://tez.apache.org/install.html ] and I have a new folder in /usr/local/apache-tez. I added one more subfolder called conf where I stored the new file tez-site.xml. My first error message is copied below: 2015-03-16 23:39:00,463 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler - For vertex - scope-34: parallelism=1, memory=1024, java opts=-Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -Xmx200m -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=LOG_DIR -Dtez.root.logger=INFO,CLA 2015-03-16 23:39:00,862 [PigTezLauncher-0] INFO org.apache.pig.tools.pigstats.tez.TezScriptState - Pig script settings are added to the job 2015-03-16 23:39:01,576 [PigTezLauncher-0] INFO org.apache.tez.client.TezClient - Tez Client Version: [ component=tez-api, version=0.5.2, revision=5d728786b681e549a6f33375991dcce97cbf79f3, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTIme=20141104-1809 ] 2015-03-16 23:39:01,757 [PigTezLauncher-0] INFO org.apache.hadoop.yarn.client.RMProxy - Connecting to ResourceManager at /0.0.0.0:8032 2015-03-16 23:39:02,798 [PigTezLauncher-0] INFO org.apache.tez.client.TezClient - Session mode. Starting session. 2015-03-16 23:39:02,800 [PigTezLauncher-0] ERROR org.apache.pig.backend.hadoop.executionengine.tez.TezJob - Cannot submit DAG org.apache.tez.dag.api.TezUncheckedException: Invalid configuration of tez jars, tez.lib.uris is not defined in the configuration at org.apache.tez.client.TezClientUtils.setupTezJarsLocalResources(TezClientUtils.java:162) at org.apache.tez.client.TezClient.getTezJarResources(TezClient.java:711) at org.apache.tez.client.TezClient.start(TezClient.java:294) at org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.createSession(TezSessionManager.java:95) at org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.getClient(TezSessionManager.java:195) at org.apache.pig.backend.hadoop.executionengine.tez.TezJob.run(TezJob.java:159) at org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher$1.run(TezLauncher.java:167) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 2015-03-16 23:39:03,758 [main] INFO org.apache.pig.tools.pigstats.tez.TezPigScriptStats - Script Statistics: HadoopVersion: 2.6.0 PigVersion: 0.14.0 TezVersion: 0.5.2 UserId: dagriq FileName: dev2/email4.pig StartedAt: 2015-03-16 23:38:55 FinishedAt: 2015-03-16 23:39:03 Features: FILTER Failed! DAG PigLatin:dummy data-0_scope-0: ApplicationId: null TotalLaunchedTasks: -1 FileBytesRead: -1 FileBytesWritten: -1 HdfsBytesRead: 0 HdfsBytesWritten: 0 Input(s): Output(s): 2015-03-16 23:39:03,781 [main] ERROR org.apache.pig.tools.grunt.GruntParser - ERROR 2244: Job failed, hadoop does not return any error message Details at logfile: /usr/local/pig/logs/pig-err.log 2015-03-16 23:39:03,860 [main] INFO org.apache.pig.Main - Pig script completed in 19 seconds and 936 milliseconds (19936 ms) 2015-03-16
