By default it should add "LD_LIBRARY_PATH" in the container (ref: https://github.com/apache/tez/blob/abfc8bfb0a8620d31697a31ad516674a8d3f9f7c/tez-api/src/main/java/org/apache/tez/dag/api/TezConfiguration.java#L358) . In case your snappy native libs are present elsewhere in the cluster deployment, you can override using "tez.task.launch.env" and "tez.am.launch.env" (refer: https://github.com/apache/tez/blob/abfc8bfb0a8620d31697a31ad516674a8d3f9f7c/tez-api/src/main/java/org/apache/tez/dag/api/TezConfiguration.java#L412 )
~Rajesh.B On Tue, Jan 5, 2016 at 5:45 AM, Mich Talebzadeh <m...@peridale.co.uk> wrote: > Thanks Rajesh. > > > > Done that and progressed > > > > Got another error L > > > > 0: jdbc:hive2://rhes564:10010/default> set hive.execution.engine=tez; > > No rows affected (0.003 seconds) > > 0: jdbc:hive2://rhes564:10010/default> select count(1) from sales; > > INFO : Tez session hasn't been created yet. Opening session > > INFO : > > > > INFO : Status: Running (Executing on YARN cluster with App id > application_1451778329897_0084) > > > > INFO : Map 1: -/- Reducer 2: 0/1 > > INFO : Map 1: 0/1 Reducer 2: 0/1 > > INFO : Map 1: 0(+1)/1 Reducer 2: 0/1 > > INFO : Map 1: 0(+1,-1)/1 Reducer 2: 0/1 > > INFO : Map 1: 0(+1,-1)/1 Reducer 2: 0/1 > > INFO : Map 1: 0(+1,-2)/1 Reducer 2: 0/1 > > INFO : Map 1: 0(+1,-2)/1 Reducer 2: 0/1 > > INFO : Map 1: 0(+1,-3)/1 Reducer 2: 0/1 > > INFO : Map 1: 0(+1,-3)/1 Reducer 2: 0/1 > > ERROR : Status: Failed > > ERROR : Vertex failed, vertexName=Map 1, > vertexId=vertex_1451778329897_0084_1_00, diagnostics=[Task failed, > taskId=task_1451778329897_0084_1_00_000000, diagnostics=[TaskAttempt 0 > failed, info=[Error: Failure while running task:java.lang.RuntimeException: > java.lang.UnsatisfiedLinkError: > org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z > > > > Dr Mich Talebzadeh > > > > LinkedIn * > https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* > > > > *Sybase ASE 15 Gold Medal Award 2008* > > A Winning Strategy: Running the most Critical Financial Data on ASE 15 > > > http://login.sybase.com/files/Product_Overviews/ASE-Winning-Strategy-091908.pdf > > Author of the books* "A Practitioner’s Guide to Upgrading to Sybase ASE > 15", ISBN 978-0-9563693-0-7*. > > co-author *"Sybase Transact SQL Guidelines Best Practices", ISBN > 978-0-9759693-0-4* > > *Publications due shortly:* > > *Complex Event Processing in Heterogeneous Environments*, ISBN: > 978-0-9563693-3-8 > > *Oracle and Sybase, Concepts and Contrasts*, ISBN: 978-0-9563693-1-4, volume > one out shortly > > > > http://talebzadehmich.wordpress.com > > > > NOTE: The information in this email is proprietary and confidential. This > message is for the designated recipient only, if you are not the intended > recipient, you should destroy it immediately. Any information in this > message shall not be understood as given or endorsed by Peridale Technology > Ltd, its subsidiaries or their employees, unless expressly so stated. It is > the responsibility of the recipient to ensure that this email is virus > free, therefore neither Peridale Ltd, its subsidiaries nor their employees > accept any responsibility. > > > > *From:* Rajesh Balamohan [mailto:rajesh.balamo...@gmail.com] > *Sent:* 05 January 2016 00:07 > *To:* user@hive.apache.org > *Subject:* Re: Hive on TEZ fails starting > > > > Can you try removing double-quotes for "tez.lib.uris" in tez-site.xml (i.e > just use > hdfs://rhes564:9000/apps/tez-0.7.1-SNAPSHOT/tez-0.7.1-SNAPSHOT.tar.gz)? > > > > ~Rajesh.B > > > > > > > > On Tue, Jan 5, 2016 at 5:30 AM, Mich Talebzadeh <m...@peridale.co.uk> > wrote: > > Hi, > > > > Trying to run Hive on TEZ for the first time. Getting the error below > > > > > > > > 0: jdbc:hive2://rhes564:10010/default> set hive.execution.engine=tez; > > No rows affected (0.001 seconds) > > 0: jdbc:hive2://rhes564:10010/default> use oraclehadoop; > > No rows affected (0.018 seconds) > > 0: jdbc:hive2://rhes564:10010/default> select count(1) from sales; > > INFO : Tez session hasn't been created yet. Opening session > > ERROR : Failed to execute tez graph. > > java.lang.IllegalArgumentException: java.net.URISyntaxException: Illegal > character in scheme name at index 0: > "hdfs://rhes564:9000/apps/tez-0.7.1-SNAPSHOT/tez-0.7.1-SNAPSHOT.tar.gz%22 > > at org.apache.hadoop.fs.Path.initialize(Path.java:206) > > at org.apache.hadoop.fs.Path.<init>(Path.java:172) > > at > org.apache.tez.client.TezClientUtils.checkAncestorPermissionsForAllUsers(TezClientUtils.java:964) > > at > org.apache.tez.client.TezClientUtils.addLocalResources(TezClientUtils.java:228) > > at > org.apache.tez.client.TezClientUtils.setupTezJarsLocalResources(TezClientUtils.java:203) > > at > org.apache.tez.client.TezClient.getTezJarResources(TezClient.java:883) > > at org.apache.tez.client.TezClient.start(TezClient.java:365) > > at > org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:184) > > at > org.apache.hadoop.hive.ql.exec.tez.TezTask.updateSession(TezTask.java:239) > > at > org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:137) > > at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) > > at > org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) > > at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1653) > > at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1412) > > at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1195) > > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) > > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1054) > > at > org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:154) > > at > org.apache.hive.service.cli.operation.SQLOperation.access$100(SQLOperation.java:71) > > at > org.apache.hive.service.cli.operation.SQLOperation$1$1.run(SQLOperation.java:206) > > at java.security.AccessController.doPrivileged(Native Method) > > at javax.security.auth.Subject.doAs(Subject.java:415) > > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) > > at > org.apache.hive.service.cli.operation.SQLOperation$1.run(SQLOperation.java:218) > > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > > at > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > > at java.lang.Thread.run(Thread.java:724) > > Caused by: java.net.URISyntaxException: Illegal character in scheme name > at index 0: > "hdfs://rhes564:9000/apps/tez-0.7.1-SNAPSHOT/tez-0.7.1-SNAPSHOT.tar.gz%22 > > at java.net.URI$Parser.fail(URI.java:2829) > > at java.net.URI$Parser.checkChars(URI.java:3002) > > at java.net.URI$Parser.checkChar(URI.java:3012) > > at java.net.URI$Parser.parse(URI.java:3028) > > at java.net.URI.<init>(URI.java:753) > > at org.apache.hadoop.fs.Path.initialize(Path.java:203) > > > > > > Anything wrong with my configuration for TEZ? > > > > Dr Mich Talebzadeh > > > > LinkedIn * > https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* > > > > *Sybase ASE 15 Gold Medal Award 2008* > > A Winning Strategy: Running the most Critical Financial Data on ASE 15 > > > http://login.sybase.com/files/Product_Overviews/ASE-Winning-Strategy-091908.pdf > > Author of the books* "A Practitioner’s Guide to Upgrading to Sybase ASE > 15", ISBN 978-0-9563693-0-7*. > > co-author *"Sybase Transact SQL Guidelines Best Practices", ISBN > 978-0-9759693-0-4* > > *Publications due shortly:* > > *Complex Event Processing in Heterogeneous Environments*, ISBN: > 978-0-9563693-3-8 > > *Oracle and Sybase, Concepts and Contrasts*, ISBN: 978-0-9563693-1-4, volume > one out shortly > > > > http://talebzadehmich.wordpress.com > > > > NOTE: The information in this email is proprietary and confidential. This > message is for the designated recipient only, if you are not the intended > recipient, you should destroy it immediately. Any information in this > message shall not be understood as given or endorsed by Peridale Technology > Ltd, its subsidiaries or their employees, unless expressly so stated. It is > the responsibility of the recipient to ensure that this email is virus > free, therefore neither Peridale Ltd, its subsidiaries nor their employees > accept any responsibility. > > > > > > > > -- > > ~Rajesh.B > -- ~Rajesh.B
