[
https://issues.apache.org/jira/browse/AMBARI-23766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16464842#comment-16464842
]
Hudson commented on AMBARI-23766:
---------------------------------
FAILURE: Integrated in Jenkins build Ambari-branch-2.6 #684 (See
[https://builds.apache.org/job/Ambari-branch-2.6/684/])
AMBARI-23766. Corrupt mapreduce/tez tar.gz may be uploaded to HDFS if (github:
[https://gitbox.apache.org/repos/asf?p=ambari.git&a=commit&h=4d9924261b1a70c0891c48b335a01532bd066a39])
* (edit)
ambari-common/src/main/python/resource_management/libraries/functions/copy_tarball.py
* (add) ambari-agent/src/test/python/resource_management/TestTarArchive.py
* (edit)
ambari-common/src/main/python/resource_management/libraries/functions/tar_archive.py
> Corrupt mapreduce/tez tar.gz may be uploaded to HDFS if parallel execution is
> enabled
> -------------------------------------------------------------------------------------
>
> Key: AMBARI-23766
> URL: https://issues.apache.org/jira/browse/AMBARI-23766
> Project: Ambari
> Issue Type: Bug
> Components: ambari-agent
> Affects Versions: 2.6.0
> Reporter: Doroszlai, Attila
> Assignee: Doroszlai, Attila
> Priority: Major
> Labels: pull-request-available
> Fix For: 2.7.0
>
> Time Spent: 3h
> Remaining Estimate: 0h
>
> If parallel_execution on Ambari Agent is enabled, two components (History
> Server and Hive Server) may create and upload the MapReduce and Tez archives
> concurrently. This could result in a corrupt uploaded file, preventing Hive
> Server from starting.
> {noformat:title=output-32.txt}
> 2018-05-04 07:24:40,421 - Creating a new Tez tarball at
> /var/lib/ambari-agent/tmp/tez-native-tarball-staging/tez-native.tar.gz
> ...
> 2018-05-04 07:24:49,751 - Creating new file
> /hdp/apps/2.6.4.5-2/tez/tez.tar.gz in DFS
> 2018-05-04 07:24:49,753 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c
> 'curl -sS -L -w '"'"'%{http_code}'"'"' -X PUT --data-binary
> @/var/lib/ambari-agent/tmp/tez-native-tarball-staging/tez-native.tar.gz -H
> '"'"'Content-Type: application/octet-stream'"'"'
> '"'"'http://localhost:50070/webhdfs/v1/hdp/apps/2.6.4.5-2/tez/tez.tar.gz?op=CREATE&user.name=hdfs&overwrite=True&permission=444'"'"'
> 1>/tmp/tmpoEINHo 2>/tmp/tmpkjlNxP''] {'logoutput': None, 'quiet': False}
> 2018-05-04 07:24:51,629 - call returned (0, '')
> {noformat}
> {noformat:title=output-30.txt}
> 2018-05-04 07:24:46,818 - Creating a new Tez tarball at
> /var/lib/ambari-agent/tmp/tez-native-tarball-staging/tez-native.tar.gz
> ...
> 2018-05-04 07:24:54,117 - DFS file /hdp/apps/2.6.4.5-2/tez/tez.tar.gz is
> identical to
> /var/lib/ambari-agent/tmp/tez-native-tarball-staging/tez-native.tar.gz,
> skipping the copying
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
