Hamed created AIRFLOW-1174:
------------------------------
Summary: backfill does not have progress after finishing a few
subtasks
Key: AIRFLOW-1174
URL: https://issues.apache.org/jira/browse/AIRFLOW-1174
Project: Apache Airflow
Issue Type: Bug
Reporter: Hamed
I am trying to backfill for a task in airflow which has multiple subtasks.
After I stated it and finishing a few subtask seems like it does not do
anything. that is the log from console. I dont see any error anywhere in here:
{code}
[2017-05-05 16:56:15,053] {jobs.py:997} INFO - [backfill progress] | waiting: 3
| succeeded: 4 | kicked_off: 6 | failed: 0 | skipped: 0 | deadlocked: 0
[2017-05-05 16:56:20,051] {jobs.py:997} INFO - [backfill progress] | waiting: 3
| succeeded: 4 | kicked_off: 6 | failed: 0 | skipped: 0 | deadlocked: 0
[2017-05-05 16:56:25,058] {jobs.py:997} INFO - [backfill progress] | waiting: 3
| succeeded: 4 | kicked_off: 6 | failed: 0 | skipped: 0 | deadlocked: 0
[2017-05-05 16:56:30,053] {jobs.py:997} INFO - [backfill progress] | waiting: 3
| succeeded: 4 | kicked_off: 6 | failed: 0 | skipped: 0 | deadlocked: 0
[2017-05-05 16:56:35,088] {jobs.py:997} INFO - [backfill progress] | waiting: 3
| succeeded: 4 | kicked_off: 6 | failed: 0 | skipped: 0 | deadlocked: 0
[2017-05-05 16:56:40,066] {jobs.py:997} INFO - [backfill progress] | waiting: 3
| succeeded: 4 | kicked_off: 6 | failed: 0 | skipped: 0 | deadlocked: 0
[2017-05-05 16:56:45,059] {jobs.py:997} INFO - [backfill progress] | waiting: 3
| succeeded: 4 | kicked_off: 6 | failed: 0 | skipped: 0 | deadlocked: 0
[2017-05-05 16:56:50,056] {jobs.py:997} INFO - [backfill progress] | waiting: 3
| succeeded: 4 | kicked_off: 6 | failed: 0 | skipped: 0 | deadlocked: 0
[2017-05-05 16:56:55,055] {jobs.py:997} INFO - [backfill progress] | waiting: 3
| succeeded: 4 | kicked_off: 6 | failed: 0 | skipped: 0 | deadlocked: 0
[2017-05-05 16:57:00,063] {jobs.py:997} INFO - [backfill progress] | waiting: 3
| succeeded: 4 | kicked_off: 6 | failed: 0 | skipped: 0 | deadlocked: 0
{code}
I looked at webservice in debug mode and I can see this error:
{code}
[2017-05-05 16:48:54,034] {logging.py:80} ERROR - Could not read logs from
s3://...
{code}
I have proper access to s3 as I can see some logs for other tasks.
any hint on where did it go wrong?
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
