-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/34846/
-----------------------------------------------------------
Review request for Ambari and Dmytro Sen.
Bugs: AMBARI-11558
https://issues.apache.org/jira/browse/AMBARI-11558
Repository: ambari
Description
-------
Currently Oozie Start task takes ~3 minutes. Which includes some time-
expensive actions like:
1\. Extracting a big tar archive
2\. Execute prepare-war fom it
3\. Checking for hdfs directory via hadoop binary.
1 and 2 can be avoid on the non-first starts, by saving checksum of archive
which was extracted, and not re-extracting it unless the checksum changed, or
the unextracted folder is gone.
3 can benefit from using fast WebHDFS calls.
**As a result for me for non-first Oozie start this reduced time of start from
180 seconds to 13-30 seconds.**
Diffs
-----
ambari-common/src/main/python/resource_management/core/logger.py c060753
ambari-common/src/main/python/resource_management/libraries/providers/hdfs_resource.py
25f0cd5
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie.py
c773fca
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie_service.py
ef721ba
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/params_linux.py
6963410
ambari-server/src/test/python/stacks/2.0.6/OOZIE/test_oozie_server.py 284f392
ambari-server/src/test/python/stacks/utils/RMFTestCase.py 2f608c4
Diff: https://reviews.apache.org/r/34846/diff/
Testing
-------
mvn clean test
Thanks,
Andrew Onischuk