[jira] [Commented] (AMBARI-22953) Heartbeat gets lost due to subprocess lock
[ https://issues.apache.org/jira/browse/AMBARI-22953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16514712#comment-16514712 ] Hudson commented on AMBARI-22953: - FAILURE: Integrated in Jenkins build Ambari-branch-2.6 #689 (See [https://builds.apache.org/job/Ambari-branch-2.6/689/]) AMBARI-22953. Some package scripts use subprocess instead of (github: [https://gitbox.apache.org/repos/asf?p=ambari.git&a=commit&h=c033ed0048563bf829b0209b03e0dbd8a004ca2c]) * (edit) ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/YARN/package/files/validateYarnComponentStatus.py * (edit) ambari-server/src/main/resources/common-services/KERBEROS/1.10.3-10/package/scripts/kerberos_common.py * (edit) ambari-server/src/main/resources/common-services/R4ML/0.8.0/package/scripts/service_check.py * (edit) ambari-server/src/main/resources/stacks/BigInsights/4.0/services/SOLR/package/scripts/service_check.py * (edit) ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/stack_advisor.py * (edit) ambari-server/src/main/resources/stacks/BigInsights/4.0/services/SPARK/package/scripts/service_check.py * (edit) ambari-server/src/main/resources/stacks/BigInsights/4.0/services/HIVE/package/alerts/alert_webhcat_server.py * (edit) ambari-server/src/main/resources/stacks/BigInsights/4.2/services/YARN/package/scripts/nodemanager_upgrade.py * (edit) ambari-common/src/main/python/resource_management/core/providers/package/apt.py * (edit) ambari-server/src/main/resources/common-services/SYSTEMML/0.10.0/package/scripts/service_check.py * (edit) ambari-server/src/main/resources/stacks/BigInsights/4.0/services/KERBEROS/package/scripts/kerberos_common.py * (edit) ambari-server/src/main/resources/stacks/BigInsights/4.0/services/YARN/package/scripts/nodemanager_upgrade.py * (edit) ambari-common/src/main/python/resource_management/libraries/functions/packages_analyzer.py * (edit) ambari-server/src/main/resources/stacks/BigInsights/4.2/services/KERBEROS/package/scripts/kerberos_common.py * (edit) ambari-server/src/main/resources/stacks/BigInsights/4.2/services/SOLR/package/scripts/service_check.py * (edit) ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/WEBHCAT/package/files/alert_webhcat_server.py * (edit) ambari-server/src/main/resources/stacks/BigInsights/4.2/services/SYSTEMML/package/scripts/service_check.py * (edit) ambari-server/src/main/resources/stacks/BigInsights/4.2/services/HDFS/package/scripts/hdfs_nfsgateway.py * (edit) ambari-agent/src/test/python/ambari_agent/TestHeartbeat.py * (edit) ambari-server/src/main/resources/stacks/BigInsights/4.2/services/YARN/package/scripts/service_check.py * (edit) ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/hdfs_nfsgateway.py * (edit) ambari-server/src/main/resources/stacks/BigInsights/4.2/services/KAFKA/package/scripts/service_check.py * (edit) ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/HDFS/package/scripts/namenode.py * (edit) ambari-server/src/main/resources/stacks/BigInsights/4.0/services/YARN/package/files/validateYarnComponentStatus.py * (edit) ambari-agent/src/main/python/ambari_agent/main.py * (edit) ambari-agent/src/test/python/ambari_agent/TestController.py * (edit) ambari-server/src/main/resources/common-services/R4ML/0.8.0/package/scripts/r4ml_client.py * (edit) ambari-server/src/main/resources/stacks/BigInsights/4.2/services/SPARK/package/scripts/service_check.py * (edit) ambari-server/src/main/resources/stacks/BigInsights/4.2/services/YARN/package/files/validateYarnComponentStatus.py * (edit) ambari-server/src/main/resources/stacks/BigInsights/4.0/services/HDFS/package/scripts/hdfs_nfsgateway.py > Heartbeat gets lost due to subprocess lock > -- > > Key: AMBARI-22953 > URL: https://issues.apache.org/jira/browse/AMBARI-22953 > Project: Ambari > Issue Type: Bug >Reporter: Andrew Onischuk >Assignee: Andrew Onischuk >Priority: Major > Labels: pull-request-available > Fix For: 2.6.2 > > Attachments: AMBARI-22953.patch > > Time Spent: 2.5h > Remaining Estimate: 0h > > Subprocess has problem when run in multithreaded environment. As stated by > developers it should not be used in such env. > As a result Ambari done multiple patches to subprocess. However still we are > having multithreading problems with it. > This jira targets moving from Subprocess to Subprocess32 (a port of Python3.0 > subprocess) which support multithreaded execution. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AMBARI-22953) Heartbeat gets lost due to subprocess lock
[ https://issues.apache.org/jira/browse/AMBARI-22953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359338#comment-16359338 ] Hudson commented on AMBARI-22953: - SUCCESS: Integrated in Jenkins build Ambari-trunk-Commit #8705 (See [https://builds.apache.org/job/Ambari-trunk-Commit/8705/]) AMBARI-22953. Heartbeat gets lost due to subprocess lock (aonishuk) (6454655+adoroszlai: [https://gitbox.apache.org/repos/asf?p=ambari.git&a=commit&h=e7bae5b3e2286cda53acac65f1c2d1b508414395]) * (edit) ambari-agent/src/main/python/ambari_agent/PythonExecutor.py * (edit) ambari-common/src/main/python/ambari_commons/os_windows.py * (edit) ambari-common/src/main/python/resource_management/core/resources/system.py * (edit) ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive_server_interactive.py * (edit) ambari-agent/src/main/python/ambari_agent/HostInfo.py * (edit) ambari-agent/src/test/python/ambari_agent/TestPingPortListener.py * (edit) ambari-metrics/ambari-metrics-timelineservice/src/main/python/embedded_hbase_service.py * (edit) ambari-server/src/main/resources/common-services/SPARK2/2.0.0/package/scripts/service_check.py * (edit) ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/alerts/alert_llap_app_status.py * (edit) ambari-server/src/test/python/TestSetupAgent.py * (edit) ambari-metrics/ambari-metrics-timelineservice/conf/unix/sqlline/sqlline.py * (edit) ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/_pssunos.py * (edit) ambari-common/src/main/python/resource_management/core/resources/jcepolicyinfo.py * (edit) ambari-common/src/main/python/resource_management/core/providers/windows/system.py * (edit) ambari-server/src/main/python/ambari_server/serverSetup.py * (edit) ambari-server/src/test/python/custom_actions/TestRemoveBits.py * (edit) ambari-agent/src/test/python/ambari_agent/TestSecurity.py * (edit) ambari-server/src/main/python/bootstrap.py * (edit) ambari-shell/ambari-python-shell/src/main/python/ambari_shell/ambari_shell.py * (edit) ambari-server/src/test/python/TestResourceFilesKeeper.py * (edit) ambari-server/src/main/python/ambari_server_main.py * (edit) ambari-agent/src/main/python/ambari_agent/Register.py * (edit) ambari-agent/src/test/python/ambari_agent/TestRegistration.py * (edit) ambari-server/src/main/resources/stacks/HDP/2.0.6.GlusterFS/services/YARN/package/files/validateYarnComponentStatus.py * (edit) ambari-common/src/main/python/ambari_commons/firewall.py * (edit) ambari-server/src/main/resources/common-services/SPARK/1.2.1/package/scripts/service_check.py * (edit) ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/files/validateYarnComponentStatusWindows.py * (edit) ambari-agent/src/main/python/ambari_agent/PingPortListener.py * (edit) ambari-common/src/main/python/ambari_commons/shell.py * (edit) ambari-server/src/test/python/TestAmbariServer.py * (edit) ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/__init__.py * (edit) ambari-server/src/main/resources/common-services/PXF/3.0.0/package/scripts/pxf_utils.py * (edit) ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/hdfs_nfsgateway.py * (edit) ambari-agent/src/main/python/ambari_agent/main.py * (edit) ambari-common/src/main/python/resource_management/libraries/functions/conf_select.py * (edit) ambari-agent/src/test/python/ambari_agent/TestPythonExecutor.py * (edit) ambari-agent/src/main/python/ambari_agent/security.py * (edit) ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/service_check.py * (edit) ambari-server/src/test/python/TestBootstrap.py * (edit) ambari-server/src/main/python/ambari_server/dbConfiguration_linux.py * (edit) ambari-agent/src/main/python/ambari_agent/Facter.py * (edit) ambari-common/src/main/python/resource_management/core/shell.py * (edit) ambari-metrics/ambari-metrics-timelineservice/conf/unix/sqlline/phoenix_utils.py * (edit) ambari-server/src/main/resources/scripts/Ambaripreupload.py * (edit) ambari-metrics/ambari-metrics-timelineservice/src/main/python/main.py * (edit) ambari-agent/src/main/python/ambari_agent/Hardware.py * (edit) ambari-agent/src/test/python/ambari_agent/TestAmbariAgent.py * (edit) ambari-common/src/main/python/ambari_commons/os_linux.py * (edit) ambari-server/src/main/resources/common-services/HAWQ/2.0.0/package/scripts/utils.py * (edit) ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/nodemanager_upgrade.py * (edit) ambari-agent/src/test/python/resource_management/TestUserResource.py * (edit) ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/build.py * (edit) ambari-agent/src/main/python/ambari_agent/HostCleanup.py * (edit) ambari-agent/src/main/python/ambari_agent/AmbariAgent.py * (edit) ambari-common/src/main/python/resource_management/core/prov
[jira] [Commented] (AMBARI-22953) Heartbeat gets lost due to subprocess lock
[ https://issues.apache.org/jira/browse/AMBARI-22953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16358973#comment-16358973 ] Hudson commented on AMBARI-22953: - SUCCESS: Integrated in Jenkins build Ambari-branch-2.6 #600 (See [https://builds.apache.org/job/Ambari-branch-2.6/600/]) AMBARI-22953. Heartbeat gets lost due to subprocess lock (aonishuk) (6454655+adoroszlai: [https://gitbox.apache.org/repos/asf?p=ambari.git&a=commit&h=ada11278e50c8b0c4f8e8c6097db6864dfa0281b]) * (edit) ambari-agent/src/main/python/ambari_agent/HostCleanup.py * (add) ambari-common/src/main/python/ambari_commons/subprocess32.py * (edit) ambari-metrics/ambari-metrics-timelineservice/src/main/python/main.py * (edit) ambari-shell/ambari-python-shell/src/main/python/ambari_shell/ambari_shell.py * (edit) ambari-agent/src/test/python/ambari_agent/TestRegistration.py * (edit) ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/build.py * (edit) ambari-server/src/main/python/ambari_server/utils.py * (edit) ambari-agent/src/main/python/ambari_agent/Facter.py * (edit) ambari-common/src/main/python/resource_management/core/sudo.py * (edit) ambari-server/src/test/python/TestResourceFilesKeeper.py * (edit) ambari-agent/src/main/python/ambari_agent/PythonExecutor.py * (edit) ambari-common/src/main/python/resource_management/libraries/providers/hdfs_resource.py * (edit) ambari-server/src/main/python/ambari_server_main.py * (edit) ambari-common/src/main/python/ambari_commons/shell.py * (edit) ambari-common/src/main/python/resource_management/libraries/functions/copy_tarball.py * (edit) ambari-server/src/main/python/ambari_server/serverSetup.py * (edit) ambari-server/src/main/resources/common-services/SPARK/1.2.1/package/scripts/service_check.py * (edit) ambari-metrics/ambari-metrics-timelineservice/src/main/python/embedded_hbase_service.py * (edit) ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/service_check.py * (edit) ambari-agent/src/main/python/ambari_agent/Hardware.py * (edit) ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/hdfs_nfsgateway.py * (edit) ambari-agent/src/main/python/ambari_agent/Register.py * (edit) ambari-server/src/main/resources/common-services/SPARK2/2.0.0/package/scripts/service_check.py * (edit) ambari-agent/conf/unix/agent-multiplier.py * (edit) ambari-agent/src/test/python/resource_management/TestUserResource.py * (edit) ambari-server/src/main/resources/common-services/PXF/3.0.0/package/scripts/pxf_utils.py * (edit) ambari-common/src/main/python/resource_management/libraries/script/hook.py * (edit) ambari-server/src/test/python/TestBootstrap.py * (edit) ambari-agent/src/main/python/ambari_agent/HostInfo.py * (edit) ambari-server/src/main/resources/stacks/HDP/2.1.GlusterFS/services/YARN/package/files/validateYarnComponentStatus.py * (edit) ambari-common/src/main/python/ambari_commons/firewall.py * (edit) ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/nodemanager_upgrade.py * (edit) ambari-server/src/test/python/custom_actions/TestRemoveBits.py * (edit) ambari-common/src/main/python/resource_management/core/resources/jcepolicyinfo.py * (edit) ambari-agent/src/main/python/ambari_agent/hostname.py * (edit) ambari-common/src/main/python/ambari_commons/os_linux.py * (edit) ambari-common/src/main/python/ambari_commons/os_windows.py * (edit) ambari-server/src/test/python/custom_actions/TestInstallPackages.py * (edit) ambari-agent/src/main/python/ambari_agent/Controller.py * (edit) ambari-agent/src/main/python/ambari_agent/CustomServiceOrchestrator.py * (edit) ambari-metrics/ambari-metrics-timelineservice/conf/unix/sqlline/sqlline.py * (edit) ambari-server/src/main/python/setupAgent.py * (edit) ambari-server/src/main/python/ambari_server/dbConfiguration_linux.py * (edit) ambari-server/src/main/resources/scripts/check_ambari_permissions.py * (edit) ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py * (edit) ambari-agent/src/test/python/ambari_agent/TestPingPortListener.py * (edit) ambari-agent/src/test/python/ambari_agent/TestPythonExecutor.py * (edit) ambari-metrics/ambari-metrics-timelineservice/conf/unix/sqlline/phoenix_utils.py * (edit) ambari-server/src/main/resources/stacks/HDP/2.0.6.GlusterFS/services/YARN/package/files/validateYarnComponentStatus.py * (edit) ambari-agent/src/main/python/ambari_agent/PythonReflectiveExecutor.py * (edit) ambari-common/src/main/repo/install_ambari_tarball.py * (edit) ambari-agent/src/test/python/ambari_agent/TestSecurity.py * (edit) ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/_pssunos.py * (edit) ambari-agent/src/test/python/resource_management/TestExecuteResource.py * (edit) ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/service_check.py * (edit) ambari-server/src/main/resources/common-servi