John Cheng created AIRFLOW-3320:
-----------------------------------
Summary: Sagemaker operator never ends when having "Stopped" status
Key: AIRFLOW-3320
URL: https://issues.apache.org/jira/browse/AIRFLOW-3320
Project: Apache Airflow
Issue Type: Bug
Components: aws
Reporter: John Cheng
Assignee: Yang Yu
Sagemaker operator never ends when having "Stopped" status.
{code:java}
[2018-11-08 20:15:27,864] {logging_mixin.py:95} INFO - [2018-11-08
20:15:27,864] {sagemaker_hook.py:129} INFO - Job still running for 2690
seconds... current status is InProgress
[2018-11-08 20:15:32,917] {logging_mixin.py:95} INFO - [2018-11-08
20:15:32,917] {sagemaker_hook.py:129} INFO - Job still running for 2695
seconds... current status is Stopping
[2018-11-08 20:15:37,963] {logging_mixin.py:95} INFO - [2018-11-08
20:15:37,963] {sagemaker_hook.py:129} INFO - Job still running for 2700
seconds... current status is Stopping
[2018-11-08 20:15:43,012] {logging_mixin.py:95} INFO - [2018-11-08
20:15:43,012] {sagemaker_hook.py:129} INFO - Job still running for 2705
seconds... current status is Stopping
[2018-11-08 20:15:48,060] {logging_mixin.py:95} INFO - [2018-11-08
20:15:48,060] {sagemaker_hook.py:129} INFO - Job still running for 2710
seconds... current status is Stopping
[2018-11-08 20:15:53,108] {logging_mixin.py:95} INFO - [2018-11-08
20:15:53,108] {sagemaker_hook.py:129} INFO - Job still running for 2715
seconds... current status is Stopping
[2018-11-08 20:15:58,153] {logging_mixin.py:95} INFO - [2018-11-08
20:15:58,153] {sagemaker_hook.py:129} INFO - Job still running for 2720
seconds... current status is Stopping
[2018-11-08 20:16:03,206] {logging_mixin.py:95} INFO - [2018-11-08
20:16:03,206] {sagemaker_hook.py:129} INFO - Job still running for 2725
seconds... current status is Stopping
[2018-11-08 20:16:08,255] {logging_mixin.py:95} INFO - [2018-11-08
20:16:08,255] {sagemaker_hook.py:129} INFO - Job still running for 2730
seconds... current status is Stopping
[2018-11-08 20:16:13,298] {logging_mixin.py:95} INFO - [2018-11-08
20:16:13,298] {sagemaker_hook.py:129} INFO - Job still running for 2735
seconds... current status is Stopping
[2018-11-08 20:16:18,349] {logging_mixin.py:95} INFO - [2018-11-08
20:16:18,349] {sagemaker_hook.py:129} INFO - Job still running for 2740
seconds... current status is Stopping
[2018-11-08 20:16:23,398] {logging_mixin.py:95} INFO - [2018-11-08
20:16:23,398] {sagemaker_hook.py:129} INFO - Job still running for 2745
seconds... current status is Stopping
[2018-11-08 20:16:28,445] {logging_mixin.py:95} INFO - [2018-11-08
20:16:28,445] {sagemaker_hook.py:129} INFO - Job still running for 2750
seconds... current status is Stopping
[2018-11-08 20:16:33,497] {logging_mixin.py:95} INFO - [2018-11-08
20:16:33,497] {sagemaker_hook.py:129} INFO - Job still running for 2755
seconds... current status is Stopping
[2018-11-08 20:16:38,545] {logging_mixin.py:95} INFO - [2018-11-08
20:16:38,545] {sagemaker_hook.py:129} INFO - Job still running for 2760
seconds... current status is Stopping
[2018-11-08 20:16:43,593] {logging_mixin.py:95} INFO - [2018-11-08
20:16:43,593] {sagemaker_hook.py:129} INFO - Job still running for 2765
seconds... current status is Stopping
[2018-11-08 20:16:48,639] {logging_mixin.py:95} INFO - [2018-11-08
20:16:48,639] {sagemaker_hook.py:129} INFO - Job still running for 2770
seconds... current status is Stopping
[2018-11-08 20:16:53,724] {logging_mixin.py:95} INFO - [2018-11-08
20:16:53,724] {sagemaker_hook.py:129} INFO - Job still running for 2775
seconds... current status is Stopping
[2018-11-08 20:16:58,773] {logging_mixin.py:95} INFO - [2018-11-08
20:16:58,773] {sagemaker_hook.py:129} INFO - Job still running for 2780
seconds... current status is Stopping
[2018-11-08 20:17:03,835] {logging_mixin.py:95} INFO - [2018-11-08
20:17:03,835] {sagemaker_hook.py:129} INFO - Job still running for 2785
seconds... current status is Stopping
[2018-11-08 20:17:08,880] {logging_mixin.py:95} INFO - [2018-11-08
20:17:08,880] {sagemaker_hook.py:129} INFO - Job still running for 2790
seconds... current status is Stopping
[2018-11-08 20:17:13,931] {logging_mixin.py:95} INFO - [2018-11-08
20:17:13,931] {sagemaker_hook.py:129} INFO - Job still running for 2795
seconds... current status is Stopping
[2018-11-08 20:17:18,976] {logging_mixin.py:95} INFO - [2018-11-08
20:17:18,976] {sagemaker_hook.py:129} INFO - Job still running for 2800
seconds... current status is Stopping
[2018-11-08 20:17:24,020] {logging_mixin.py:95} INFO - [2018-11-08
20:17:24,020] {sagemaker_hook.py:129} INFO - Job still running for 2805
seconds... current status is Stopping
[2018-11-08 20:17:29,070] {logging_mixin.py:95} INFO - [2018-11-08
20:17:29,070] {sagemaker_hook.py:129} INFO - Job still running for 2810
seconds... current status is Stopping
[2018-11-08 20:17:34,119] {logging_mixin.py:95} INFO - [2018-11-08
20:17:34,119] {sagemaker_hook.py:129} INFO - Job still running for 2815
seconds... current status is Stopping
[2018-11-08 20:17:39,125] {logging_mixin.py:95} INFO - [2018-11-08
20:17:39,125] {connectionpool.py:238} INFO - Resetting dropped connection:
api.sagemaker.us-west-2.amazonaws.com
[2018-11-08 20:17:39,254] {logging_mixin.py:95} INFO - [2018-11-08
20:17:39,253] {sagemaker_hook.py:129} INFO - Job still running for 2820
seconds... current status is Stopping
[2018-11-08 20:17:44,302] {logging_mixin.py:95} INFO - [2018-11-08
20:17:44,302] {sagemaker_hook.py:129} INFO - Job still running for 2825
seconds... current status is Stopping
[2018-11-08 20:17:49,344] {logging_mixin.py:95} INFO - [2018-11-08
20:17:49,343] {sagemaker_hook.py:129} INFO - Job still running for 2830
seconds... current status is Stopping
[2018-11-08 20:17:54,391] {logging_mixin.py:95} INFO - [2018-11-08
20:17:54,390] {sagemaker_hook.py:129} INFO - Job still running for 2835
seconds... current status is Stopped
[2018-11-08 20:17:59,440] {logging_mixin.py:95} INFO - [2018-11-08
20:17:59,440] {sagemaker_hook.py:129} INFO - Job still running for 2840
seconds... current status is Stopped
[2018-11-08 20:18:04,489] {logging_mixin.py:95} INFO - [2018-11-08
20:18:04,489] {sagemaker_hook.py:129} INFO - Job still running for 2845
seconds... current status is Stopped
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
