Hi George,
Yes that's correct - I mentioned both issues as they were (in my view)
related somewhat.
The relevant snipped in the log file pertaining to the timed-out deployment
is below (following successful build):
2018-02-27 23:12:20,489 DEBUG root Received operation:
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
2018-02-27 23:12:20,489 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:12:20,490 INFO ___FILE_ONLY___ Updating service [default]
(this may take several minutes)...
2018-02-27 23:12:21,669 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:12:27,827 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:12:33,253 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:12:39,161 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:12:44,540 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:12:50,597 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:12:56,205 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:13:02,243 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:13:07,426 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:13:12,910 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:13:18,292 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:13:24,153 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:13:29,641 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:13:35,097 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:13:41,127 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:13:47,087 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:13:52,316 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:13:58,013 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:14:03,792 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:14:09,905 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:14:15,471 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:14:21,112 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:14:27,082 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:14:32,376 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:14:38,369 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:14:44,091 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:14:49,423 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:14:55,468 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:15:00,775 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:15:06,669 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:15:12,318 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:15:17,672 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:15:22,901 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:15:28,599 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:15:34,520 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:15:40,532 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:15:46,130 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:15:51,964 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:15:57,935 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:16:03,752 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:16:09,361 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:16:15,323 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:16:20,783 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:16:26,143 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:16:31,957 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:16:37,380 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:16:43,312 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:16:49,063 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:16:55,010 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:17:00,907 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:17:06,446 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:17:11,842 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:17:17,097 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:17:23,039 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:17:28,458 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:17:34,363 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:17:40,623 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:17:46,405 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:17:51,717 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:17:57,410 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:18:02,891 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:18:08,478 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:18:13,838 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:18:19,063 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:18:24,489 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:18:29,919 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:18:36,086 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:18:41,708 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:18:47,712 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:18:53,435 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:18:59,040 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:19:04,339 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:19:10,190 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:19:16,118 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:19:22,266 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:19:28,166 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:19:34,012 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:19:39,325 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:19:45,022 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:19:50,668 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:19:56,417 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:20:02,011 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:20:08,047 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:20:13,417 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:20:19,657 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:20:25,190 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:20:31,112 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:20:37,078 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:20:42,549 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:20:48,145 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:20:54,017 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:20:59,950 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:21:05,856 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:21:11,471 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:21:17,635 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:21:23,520 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:21:29,313 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:21:35,395 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:21:41,236 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:21:46,963 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:21:52,770 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:21:58,571 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:22:04,473 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:22:10,337 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:22:16,270 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:22:22,117 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:22:28,240 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:22:33,877 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:22:39,587 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:22:45,639 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:22:50,801 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:22:56,562 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:23:01,931 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:23:08,089 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:23:13,903 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:23:19,752 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:23:25,543 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:23:31,611 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:23:36,861 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:23:42,185 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:23:47,666 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:23:53,787 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:23:59,383 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:24:04,860 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:24:10,503 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:24:15,872 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:24:21,134 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:24:27,085 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:24:32,437 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:24:38,316 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:24:44,152 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:24:49,866 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:24:55,286 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:25:01,063 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:25:06,555 INFO oauth2client.transport Refreshing due to a
401 (attempt 1/2)
2018-02-27 23:25:06,558 INFO oauth2client.client Refreshing access_token
2018-02-27 23:25:07,012 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:25:12,438 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:25:17,832 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:25:23,813 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:25:29,577 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:25:35,395 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:25:41,036 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:25:46,967 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:25:52,434 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:25:58,297 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:26:04,128 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:26:10,154 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:26:15,768 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:26:20,956 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:26:26,992 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:26:32,247 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:26:37,696 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:26:42,997 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:26:48,851 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:26:54,329 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:26:59,667 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:27:05,212 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:27:11,361 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:27:16,664 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:27:22,265 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:27:28,282 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:27:33,609 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:27:39,085 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:27:44,672 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:27:50,030 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:27:55,425 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:28:01,528 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:28:06,794 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:28:12,105 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:28:17,419 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:28:22,710 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:28:28,850 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:28:34,687 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:28:40,154 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:28:46,268 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:28:51,962 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:28:57,233 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:29:03,017 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:29:08,311 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:29:14,167 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:29:19,415 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:29:25,389 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:29:30,805 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:29:36,666 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:29:41,879 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:29:47,650 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:29:52,884 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:29:58,908 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:30:04,360 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:30:10,239 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:30:15,753 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:30:21,478 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:30:27,536 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:30:33,043 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:30:38,958 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:30:44,826 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:30:50,851 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:30:56,503 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:31:01,954 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:31:07,333 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:31:12,511 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:31:18,109 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:31:24,125 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:31:29,991 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:31:35,441 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:31:41,271 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:31:47,329 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:31:53,459 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:31:59,260 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:32:04,781 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:32:10,426 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:32:15,934 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:32:21,192 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:32:27,348 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:32:32,637 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:32:38,404 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:32:44,467 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:32:50,259 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:32:56,169 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:33:01,536 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:33:07,246 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:33:12,493 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:33:17,764 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:33:23,491 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:33:29,386 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:33:34,746 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:33:40,319 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:33:45,612 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:33:51,579 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:33:57,747 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:34:03,906 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:34:09,787 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:34:15,724 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:34:21,136 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:34:26,531 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:34:32,343 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:34:38,118 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:34:44,138 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:34:49,574 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:34:55,434 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:35:01,057 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:35:06,315 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:35:11,750 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:35:17,658 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:35:23,659 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:35:29,131 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:35:34,851 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:35:40,208 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:35:46,051 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:35:52,168 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:35:57,369 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:36:02,614 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:36:07,954 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:36:13,654 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:36:18,941 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:36:24,856 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:36:30,255 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:36:35,516 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:36:41,328 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:36:47,301 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:36:53,135 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:36:59,124 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:37:05,131 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:37:10,500 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:37:15,840 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:37:21,959 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:37:27,368 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:37:32,746 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:37:38,548 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:37:43,733 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:37:49,713 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:37:55,481 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:38:01,468 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:38:07,246 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:38:13,340 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:38:18,761 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:38:24,588 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:38:30,625 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:38:36,718 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:38:41,928 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:38:47,161 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:38:52,753 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:38:58,798 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:39:04,040 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:39:09,507 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:39:14,775 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:39:20,841 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:39:26,202 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:39:31,676 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:39:37,269 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:39:43,430 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:39:48,742 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:39:54,695 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:39:59,969 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:40:05,171 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:40:11,321 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:40:16,693 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:40:22,068 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:40:28,024 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:40:33,773 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:40:39,272 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:40:44,544 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:40:50,174 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:40:55,968 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:41:01,923 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:41:07,802 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:41:13,917 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:41:19,968 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:41:26,106 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:41:31,554 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:41:37,274 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:41:43,285 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:41:49,062 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:41:54,429 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:41:59,886 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:42:06,039 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:42:12,026 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:42:18,021 DEBUG root Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
not complete. Waiting to retry.
2018-02-27 23:42:18,813 DEBUG root (gcloud.app.deploy)
Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
timed out. This operation may still be underway.
Traceback (most recent call last):
File "/usr/lib/google-cloud-sdk/lib/googlecloudsdk/calliope/cli.py", line
797, in Execute
resources = calliope_command.Run(cli=self, args=args)
File "/usr/lib/google-cloud-sdk/lib/googlecloudsdk/calliope/backend.py",
line 757, in Run
resources = command_instance.Run(args)
File "/usr/lib/google-cloud-sdk/lib/surface/app/deploy.py", line 79, in
Run
parallel_build=False)
File
"/usr/lib/google-cloud-sdk/lib/googlecloudsdk/command_lib/app/deploy_util.py",
line 588, in RunDeploy
flex_image_build_option=flex_image_build_option)
File
"/usr/lib/google-cloud-sdk/lib/googlecloudsdk/command_lib/app/deploy_util.py",
line 394, in Deploy
extra_config_settings)
File
"/usr/lib/google-cloud-sdk/lib/googlecloudsdk/api_lib/app/appengine_api_client.py",
line 187, in DeployService
message=message)
File
"/usr/lib/google-cloud-sdk/lib/googlecloudsdk/api_lib/app/operations_util.py",
line 250, in WaitForOperation
operation.name))
OperationTimeoutError: Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
timed out. This operation may still be underway.
2018-02-27 23:42:18,820 ERROR root (gcloud.app.deploy)
Operation
[apps/onkho-web-app-live/operations/550b30eb-403c-411a-999b-fa1599657542]
timed out. This operation may still be underway.
These logs that I see locally coincide with the previous log snippets that
I obtained from the VM instance on Stackdriver. The reason the operation
failed is because the VM failed to boot.
Note: Deployments did sometimes work (same docker image). It was indeed
very hit-and-miss.
The reason I suggest the two issues are related is because when the VM was
shutdown due to apaprent maintenance on Monday 26th Feb (I still don't know
why?) it failed to boot up again. It failed to boot because of the same
error error message previously posted above that I obtained from
StackDriver. This is where I saw the 'perpetual reboot' cycle. Unlike the
deployment that eventually times out, the unexpected reboot on Monday 26th
Feb continued in this cycle until I shut it down and deleted the instance
and started it again manually. In the meantime of course I had to boot up a
previous instance of the app to minimise downtime.
Hope that helps - I apologise if I'm not explaining this clearly?
Thanks,
Karl
On Saturday, March 3, 2018 at 8:35:00 PM UTC, George (Cloud Platform
Support) wrote:
>
> Hi Karl,
>
> In your initial post on this thread, you wrote that you "experienced
> delays in deploying our PHP flexible app whereby "gcloud deploy" times-out
> waiting for the new instance to start". A proper start-up process is
> essential to instance management. You also mention making use of PHP
> extensions not on the list of the extensions implemented for the app
> engine. What is the output of the gcloud app deploy command with the
> --verbosity debug parameter? This is significant when the deployment
> actually fails, so more insight may be gained in the reasons of failure.
>
> For coding-related issues, stackoverflow or similar forums offer the
> important advantage of getting you replies from expert programmers.
>
--
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit
https://groups.google.com/d/msgid/google-appengine/c57e56af-f9a4-4280-bd30-1a570d5cb759%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
