[
https://issues.apache.org/jira/browse/AIRFLOW-1174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16004501#comment-16004501
]
Hamed commented on AIRFLOW-1174:
--------------------------------
Not sure but I am suspecting on mysql connection used for celery..because when
I change the executor to sequential it works fine.
and in the above case when I interrupt the above backfill it throws SQL has
gone away error. seems like reconnecting to SQL issue.
Any hint on any log that traces the progress?
> backfill does not have progress after finishing a few subtasks
> --------------------------------------------------------------
>
> Key: AIRFLOW-1174
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1174
> Project: Apache Airflow
> Issue Type: Bug
> Reporter: Hamed
> Priority: Minor
>
> I am trying to backfill for a task in airflow which has multiple subtasks.
> After I stated it and finishing a few subtask seems like it does not do
> anything. that is the log from console. I dont see any error anywhere in here:
> {code}
> [2017-05-05 16:56:15,053] {jobs.py:997} INFO - [backfill progress] | waiting:
> 3 | succeeded: 4 | kicked_off: 6 | failed: 0 | skipped: 0 | deadlocked: 0
> [2017-05-05 16:56:20,051] {jobs.py:997} INFO - [backfill progress] | waiting:
> 3 | succeeded: 4 | kicked_off: 6 | failed: 0 | skipped: 0 | deadlocked: 0
> [2017-05-05 16:56:25,058] {jobs.py:997} INFO - [backfill progress] | waiting:
> 3 | succeeded: 4 | kicked_off: 6 | failed: 0 | skipped: 0 | deadlocked: 0
> [2017-05-05 16:56:30,053] {jobs.py:997} INFO - [backfill progress] | waiting:
> 3 | succeeded: 4 | kicked_off: 6 | failed: 0 | skipped: 0 | deadlocked: 0
> [2017-05-05 16:56:35,088] {jobs.py:997} INFO - [backfill progress] | waiting:
> 3 | succeeded: 4 | kicked_off: 6 | failed: 0 | skipped: 0 | deadlocked: 0
> [2017-05-05 16:56:40,066] {jobs.py:997} INFO - [backfill progress] | waiting:
> 3 | succeeded: 4 | kicked_off: 6 | failed: 0 | skipped: 0 | deadlocked: 0
> [2017-05-05 16:56:45,059] {jobs.py:997} INFO - [backfill progress] | waiting:
> 3 | succeeded: 4 | kicked_off: 6 | failed: 0 | skipped: 0 | deadlocked: 0
> [2017-05-05 16:56:50,056] {jobs.py:997} INFO - [backfill progress] | waiting:
> 3 | succeeded: 4 | kicked_off: 6 | failed: 0 | skipped: 0 | deadlocked: 0
> [2017-05-05 16:56:55,055] {jobs.py:997} INFO - [backfill progress] | waiting:
> 3 | succeeded: 4 | kicked_off: 6 | failed: 0 | skipped: 0 | deadlocked: 0
> [2017-05-05 16:57:00,063] {jobs.py:997} INFO - [backfill progress] | waiting:
> 3 | succeeded: 4 | kicked_off: 6 | failed: 0 | skipped: 0 | deadlocked: 0
> {code}
> I looked at webservice in debug mode and I can see this error:
> {code}
> [2017-05-05 16:48:54,034] {logging.py:80} ERROR - Could not read logs from
> s3://...
> {code}
> I have proper access to s3 as I can see some logs for other tasks.
> any hint on where did it go wrong?
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
