[GitHub] [airflow] hsnprsd opened a new issue #16001: Can't view running tasks logs using KubernetesExecutor.

[GitBox]

hsnprsd opened a new issue #16001:
URL: https://github.com/apache/airflow/issues/16001


   **Description**
   
   I want to be able to see logs for running tasks in airflow web UI when I'm 
using "KubernetesExecutor".
   Airflow tries to read logs of worker pod which does not contain my task logs 
because "airflow tasks run" command redirects all stdout/stderr to log file.
   
   Here is what I see when I try to read logs of running tasks:
   ```
   *** Falling back to local log
   *** Trying to get logs (last 100 lines) from worker pod 
datainfraexporterhourlydagwaitforpublishedpostdump.a825336790e24b40ad43b2411ef617c5
 ***
   
   BACKEND=postgres
   
DB_HOST=divar-infra-db-cluster-master-service.skubel-76f219d5-eb73-4f23-96b3-a8cf4ab4f00a
   DB_PORT=5432
   
   [2021-05-22 19:00:30,157] {dagbag.py:451} INFO - 
Filling up the DagBag from /git/airflow/dags/data_infra/exporter/hourly.py
   ```
   
   **Use case / motivation**
   
   It's not convenient to wait for tasks to finish in order to read their logs.
   
   **Are you willing to submit a PR?**
   
   I can help.
   
   **Related Issues**
   
   I don't think so.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org