Alexandre Linte created PIG-5042:

             Summary: Pig with Tez requires a staging directory with submitter 
                 Key: PIG-5042
             Project: Pig
          Issue Type: Bug
          Components: tez
    Affects Versions: 0.16.0
         Environment: Hadoop 2.7.2, Pig 0.16.0, Tez 0.8.4
            Reporter: Alexandre Linte

With Pig 0.15.0, I have been able to work using the Tez execution engine 
without issues. After upgrading Pig to 0.16.0, I haven't been able to submit my 

Since the beginning, the tez-site.xml is configured as below:
  <description>String value to a file path. The location of the Tez libraries 
which will be localized for DAGs. This follows the following 
  <description>String value. Specifies a directory where Tez can create 
temporary job artifacts.</description>

The staging directory was set up with 777 rights, including a sticky bit:
[root@spark01 ~]# hadoop fs -ls /Products/TEZ/
Found 3 items
drwxrwxrwt+  - hdfs hadoop          0 2014-11-27 10:31 /Products/TEZ/staging
-rw-r--r--   3 hdfs hadoop   46518370 2016-09-02 11:06 

Pig 0.16.0 seems to need a staging directory with submitter directory, even if 
the staging directory has full access to "other" like my previous 
This issue looks like a regression to me, compared to Pig 0.15.0. Can you check 
that point?

This message was sent by Atlassian JIRA

Reply via email to