Sergey Shelukhin created HIVE-12072:
---------------------------------------

             Summary: scriptfile1 test on MiniTez fails (due to session reuse?)
                 Key: HIVE-12072
                 URL: https://issues.apache.org/jira/browse/HIVE-12072
             Project: Hive
          Issue Type: Bug
            Reporter: Sergey Shelukhin


I can repro by running the following combination of tests with this feature 
enabled (but it doesn't repro for me if I run the entire MiniTez test, or just 
one test)
{noformat}
mvn test -Phadoop-2 -Dtest=TestMiniTezCliDriver 
-Dqfile=alter_merge_orc.q,auto_join30.q,auto_sortmerge_join_11.q,filter_join_breaktask.q,insert_into1.q,mergejoin.q,metadata_only_queries_with_filters.q,scriptfile1.q
{noformat}
It fails as follows:
{noformat}
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error 
while processing row {"key":"238","value":"val_238"}
        at 
org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:520)
        at 
org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:86)
        ... 17 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: [Error 20000]: 
Unable to initialize custom script.
        at 
org.apache.hadoop.hive.ql.exec.ScriptOperator.process(ScriptOperator.java:416)
        at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:852)
        at 
org.apache.hadoop.hive.ql.exec.SelectOperator.process(SelectOperator.java:87)
        at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:852)
        at 
org.apache.hadoop.hive.ql.exec.TableScanOperator.process(TableScanOperator.java:97)
        at 
org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.forward(MapOperator.java:164)
        at 
org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:510)
        ... 18 more
Caused by: java.io.IOException: Cannot run program 
"/grid/5/sershe/tez-autobuild/hive/itests/qtest/target/hive/hive-localDir-nm-1_2/usercache/sershe/appcache/application_1444328939776_0001/container_1444328939776_0001_01_000004/./testgrep":
 error=13, Permission denied
        at java.lang.ProcessBuilder.start(ProcessBuilder.java:1047)
        at 
org.apache.hadoop.hive.ql.exec.ScriptOperator.process(ScriptOperator.java:374)
        ... 24 more
Caused by: java.io.IOException: error=13, Permission denied
        at java.lang.UNIXProcess.forkAndExec(Native Method)
        at java.lang.UNIXProcess.<init>(UNIXProcess.java:186)
        at java.lang.ProcessImpl.start(ProcessImpl.java:130)
        at java.lang.ProcessBuilder.start(ProcessBuilder.java:1028)
        ... 25 more
{noformat}

I didn't dig deeper (i.e. minimizing what tests cause it), but it doesn't look 
like any of these tests use this file.

It passes (or at least doesn't fail the same way) with the feature disabled.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to