[
https://issues.apache.org/jira/browse/AIRFLOW-4077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aizhamal Nurmamat kyzy updated AIRFLOW-4077:
--------------------------------------------
Labels: S3 gevent logging webapp worker (was: S3 gevent logging
worker)
Component/s: (was: worker)
(was: webapp)
(was: logging)
ui
Moving to ui component as part of component refactor. Webapp component will be
removed.
> Using gevent worker class breaks reading remote log from s3
> -----------------------------------------------------------
>
> Key: AIRFLOW-4077
> URL: https://issues.apache.org/jira/browse/AIRFLOW-4077
> Project: Apache Airflow
> Issue Type: Bug
> Components: ui
> Affects Versions: 1.10.2
> Environment: Local - Ubuntu
> Production - AWS Elastic Beanstalk
> Reporter: Sanjay Hallan
> Assignee: Tom
> Priority: Major
> Labels: S3, gevent, logging, webapp, worker
>
> We have been writing our airflow logs to S3 for quite sometime now
> successfully, using the worker class 'sync' which is the default. Viewing
> logs via the airflow UI works perfectly, in the sense that logs are read from
> the remote s3 location.
> When switching the worker class to gevent, the airflow UI no longer attempts
> to read the logs from the remote s3 location, rather it always attempts to
> read the logs from the file and as we are using a containerized environment
> reading log files in this way fails.
> Switching only the worker class back to sync and leaving all other airflow
> configuration untouched resolves this issue.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
