[
https://issues.apache.org/jira/browse/AIRFLOW-3567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16728998#comment-16728998
]
ASF GitHub Bot commented on AIRFLOW-3567:
-----------------------------------------
spektom commented on pull request #4372: AIRFLOW-3567 Show an error in case
logs can't be fetched from S3
URL: https://github.com/apache/incubator-airflow/pull/4372
Make sure you have checked _all_ steps below.
### Jira
This PR relates to:
- https://issues.apache.org/jira/browse/AIRFLOW-3567
### Description
- This change allows actually seeing what's wrong in the S3 logging
configuration
### Tests
- No tests required
### Commits
- Show an error in case logs can't be fetched from S3
### Documentation
- No documentation needed
### Code Quality
- Passes `flake8`
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Logs are not fetched from S3 when using AIM policy
> --------------------------------------------------
>
> Key: AIRFLOW-3567
> URL: https://issues.apache.org/jira/browse/AIRFLOW-3567
> Project: Apache Airflow
> Issue Type: Bug
> Components: logging
> Affects Versions: 1.10.1
> Reporter: Michael Spector
> Priority: Major
>
> The remote logging is configured as follows:
> {code:python}
> remote_logging=True
> remote_log_conn_id=''
> remote_base_log_folder='s3://logs-bucket/airflow/analytics-airflow'
> encrypt_s3_logs=False
> {code}
> Logs on S3 are created successfully, however when trying to access them via
> UI we're getting something like this:
> {code:bash}
> Log file does not exist:
> /var/lib/airflow/logs/jobname/taskname/2018-12-25T03:00:00+00:00/1.log
> Fetching from:
> http://10.118.19.142:50192/log/jobname/taskname/2018-12-25T03:00:00+00:00/1.log
> {code}
> Which means that logs fetcher falls back to FileTaskHandler.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
