-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/34846/
-----------------------------------------------------------

Review request for Ambari and Dmytro Sen.


Bugs: AMBARI-11558
    https://issues.apache.org/jira/browse/AMBARI-11558


Repository: ambari


Description
-------

Currently Oozie Start task takes ~3 minutes. Which includes some time-
expensive actions like:  
1\. Extracting a big tar archive  
2\. Execute prepare-war fom it  
3\. Checking for hdfs directory via hadoop binary.

1 and 2 can be avoid on the non-first starts, by saving checksum of archive
which was extracted, and not re-extracting it unless the checksum changed, or
the unextracted folder is gone.

3 can benefit from using fast WebHDFS calls.

**As a result for me for non-first Oozie start this reduced time of start from 
180 seconds to 13-30 seconds.**


Diffs
-----

  ambari-common/src/main/python/resource_management/core/logger.py c060753 
  
ambari-common/src/main/python/resource_management/libraries/providers/hdfs_resource.py
 25f0cd5 
  
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie.py
 c773fca 
  
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie_service.py
 ef721ba 
  
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/params_linux.py
 6963410 
  ambari-server/src/test/python/stacks/2.0.6/OOZIE/test_oozie_server.py 284f392 
  ambari-server/src/test/python/stacks/utils/RMFTestCase.py 2f608c4 

Diff: https://reviews.apache.org/r/34846/diff/


Testing
-------

mvn clean test


Thanks,

Andrew Onischuk

Reply via email to