-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/51121/#review146010
-----------------------------------------------------------




ambari-common/src/main/python/resource_management/libraries/providers/hdfs_resource.py
 (line 337)
<https://reviews.apache.org/r/51121/#comment212370>

    What's happening is that I have a call to copy the contents of an entire 
directory from the local FS to HFDS, say /user/share/oozie/share/lib/hive/
    which is currently owned by oozie:hdfs (which is correct).
    
    The copy command is actually running as "hdfs" user. Without this change, 
the files/dirs copied inside will be owned by hdfs:hdfs instead of oozie:hdfs 
(which is the ownership of the parent directory).
    
    Therefore, I'm passing recursive_chown=True to fix it.
    
    Right now, only Falcon and Zeppelin call HdfsResource with 
recursive_chown=True
    For this reason, I think this is the right behavior, recursive_chown=True 
does need to go through every file/dir inside and set the correct ownership.


- Alejandro Fernandez


On Aug. 17, 2016, 1 a.m., Alejandro Fernandez wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/51121/
> -----------------------------------------------------------
> 
> (Updated Aug. 17, 2016, 1 a.m.)
> 
> 
> Review request for Ambari, Andrew Onischuk, Sumit Mohanty, and Venkat 
> Ranganathan.
> 
> 
> Bugs: AMBARI-18151
>     https://issues.apache.org/jira/browse/AMBARI-18151
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> Whenever Oozie submits Hive actions, they fail and the application logs show 
> "Internal Error: 
> java.lang.ClassNotFoundException(org.apache.atlas.hive.hook.HiveHook"
> 
> This is because whenever Atlas is installed, the Hive Hook (which is 
> installed via the Oozie RPM too, in /usr/$stack/$version/atlas/hook/hive/) 
> needs to be copied to the Oozie Share lib in HDFS (e.g., 
> hdfs:///user/oozie/share/lib/lib_$timestamp/hive)
> 
> Further, need to save atlas-application.properties used for Hive to 
> hdfs:///user/oozie/share/lib/lib_$timestamp/hive/
> 
> Lastly, remove the atlas.rest.address property from hive-site.xml
> 
> 
> Diffs
> -----
> 
>   
> ambari-common/src/main/python/resource_management/libraries/functions/constants.py
>  c5cbb3f 
>   
> ambari-common/src/main/python/resource_management/libraries/providers/hdfs_resource.py
>  7abdf5c 
>   
> ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie.py
>  dd3a692 
>   
> ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie_service.py
>  e330cb5 
>   
> ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/params_linux.py
>  db048bb 
>   
> ambari-server/src/main/resources/stacks/HDP/2.0.6/properties/stack_features.json
>  ed995b2 
>   
> ambari-server/src/main/resources/stacks/HDP/2.5/services/HIVE/configuration/hive-site.xml
>  PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/51121/diff/
> 
> 
> Testing
> -------
> 
> Verified on a live cluster with HDP 2.5 and Oozie, Hive, Atlas
> 
> Python unit tests passed,
> 
> OK
> ----------------------------------------------------------------------
> Total run:1034
> Total errors:0
> Total failures:0
> OK
> 
> 
> Thanks,
> 
> Alejandro Fernandez
> 
>

Reply via email to