nirutgupta opened a new issue #20779:
URL: https://github.com/apache/airflow/issues/20779
### Description
Provide any configuration, or a sidecar container to achieve task logs
streaming in kubernetes executor to webserver UI when task are in running state.
### Use case/motivation
Moving out from celery executor where I can see the running logs , it is
very difficult for me to have the patience when using kubernetes executor for
seeing task logs of long running tasks since they will only come up after the
task succeeds or fails.
### Related issues
Using kubernetes executor. When I run a DAG, I am only able to see the logs
when task is in running state, only thing I can see is.
```
*** Falling back to local log
*** Trying to get logs (last 100 lines) from worker pod
sleeptestsleeptest.dda6a168c2ad40f4b8bc933779db1732 ***
/home/airflow/.local/lib/python3.8/site-packages/airflow/configuration.py:357
DeprecationWarning: The dag_concurrency option in [core] has been renamed to
max_active_tasks_per_dag - the old setting has been used, but please update
your config.
[2022-01-06, 12:00:07 UTC] {dagbag.py:500} INFO - Filling up the DagBag from
/opt/***/dags/repo/qainfra/sample_dags/1.0/hang_debug.py
```
### Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
