chuxiangfeng commented on issue #31054:
URL: https://github.com/apache/airflow/issues/31054#issuecomment-1600517291
> Reopened. Can you please see if you can provide fresh logs/more details
@chuxiangfeng ? CC: @dstandish - possibly worth taking a look.
```
*** Found local files:
*** *
/opt/airflow/logs/dag_id=d_crawler_bond_chinabond/run_id=scheduled__2023-06-19T18:00:00+00:00/task_id=t_crawler_bond_chinabond_request/attempt=1.log
[2023-06-21, 02:00:04 CST] {taskinstance.py:1103} INFO - Dependencies all
met for dep_context=non-requeueable deps ti=<TaskInstance:
d_crawler_bond_chinabond.t_crawler_bond_chinabond_request
scheduled__2023-06-19T18:00:00+00:00 [queued]>
[2023-06-21, 02:00:04 CST] {taskinstance.py:1103} INFO - Dependencies all
met for dep_context=requeueable deps ti=<TaskInstance:
d_crawler_bond_chinabond.t_crawler_bond_chinabond_request
scheduled__2023-06-19T18:00:00+00:00 [queued]>
[2023-06-21, 02:00:04 CST] {taskinstance.py:1308} INFO - Starting attempt 1
of 4
[2023-06-21, 02:00:04 CST] {taskinstance.py:1327} INFO - Executing
<Task(CustomKubernetesPodOperator): t_crawler_bond_chinabond_request> on
2023-06-19 18:00:00+00:00
[2023-06-21, 02:00:04 CST] {standard_task_runner.py:57} INFO - Started
process 2021068 to run task
[2023-06-21, 02:00:04 CST] {standard_task_runner.py:84} INFO - Running:
['airflow', 'tasks', 'run', 'd_crawler_bond_chinabond',
't_crawler_bond_chinabond_request', 'scheduled__2023-06-19T18:00:00+00:00',
'--job-id', '36560', '--raw', '--subdir',
'DAGS_FOLDER/wudao/custom_dags/to_ods_dags/crawler/bond_chinabond/crawler_bond_chinabond.py',
'--cfg-path', '/tmp/tmpgdv7ctnx']
[2023-06-21, 02:00:04 CST] {standard_task_runner.py:85} INFO - Job 36560:
Subtask t_crawler_bond_chinabond_request
[2023-06-21, 02:00:04 CST] {task_command.py:410} INFO - Running
<TaskInstance: d_crawler_bond_chinabond.t_crawler_bond_chinabond_request
scheduled__2023-06-19T18:00:00+00:00 [running]> on host
airflow-scheduler-0.airflow-scheduler.airflow-schedule.svc.cluster.local
[2023-06-21, 02:00:05 CST] {taskinstance.py:1547} INFO - Exporting env vars:
AIRFLOW_CTX_DAG_OWNER='airflow' AIRFLOW_CTX_DAG_ID='d_crawler_bond_chinabond'
AIRFLOW_CTX_TASK_ID='t_crawler_bond_chinabond_request'
AIRFLOW_CTX_EXECUTION_DATE='2023-06-19T18:00:00+00:00'
AIRFLOW_CTX_TRY_NUMBER='1'
AIRFLOW_CTX_DAG_RUN_ID='scheduled__2023-06-19T18:00:00+00:00'
[2023-06-21, 02:00:05 CST] {pod.py:850} INFO - Building pod
t-crawler-bond-chinabond-request-86p5zmlg with labels: {'dag_id':
'd_crawler_bond_chinabond', 'task_id': 't_crawler_bond_chinabond_request',
'run_id': 'scheduled__2023-06-19T1800000000-3697f8a44',
'kubernetes_pod_operator': 'True', 'try_number': '1'}
[2023-06-21, 02:00:05 CST] {base.py:73} INFO - Using connection ID
'kubernetes_default' for task execution.
[2023-06-21, 02:00:05 CST] {pod.py:489} INFO - Found matching pod
t-crawler-bond-chinabond-request-86p5zmlg with labels
{'airflow_kpo_in_cluster': 'True', 'airflow_version': '2.6.1', 'dag_id':
'd_crawler_bond_chinabond', 'kubernetes_pod_operator': 'True', 'run_id':
'scheduled__2023-06-19T1800000000-3697f8a44', 'task_id':
't_crawler_bond_chinabond_request', 'try_number': '1'}
[2023-06-21, 02:00:05 CST] {pod.py:490} INFO - `try_number` of
task_instance: 1
[2023-06-21, 02:00:05 CST] {pod.py:491} INFO - `try_number` of pod: 1
[2023-06-21, 02:00:05 CST] {pod_manager.py:285} WARNING - Pod not yet
started: t-crawler-bond-chinabond-request-86p5zmlg
[2023-06-21, 02:00:06 CST] {pod_manager.py:285} WARNING - Pod not yet
started: t-crawler-bond-chinabond-request-86p5zmlg
[2023-06-21, 02:00:07 CST] {pod_manager.py:285} WARNING - Pod not yet
started: t-crawler-bond-chinabond-request-86p5zmlg
[2023-06-21, 05:40:11 CST] {pod_manager.py:397} INFO - Pod
t-crawler-bond-chinabond-request-86p5zmlg has phase Running
[2023-06-21, 05:40:13 CST] {airflow_extends.py:248} INFO - Deleting pod:
t-crawler-bond-chinabond-request-86p5zmlg
[2023-06-21, 05:40:13 CST] {logging_mixin.py:149} WARNING -
/home/airflow/.local/lib/python3.7/site-packages/airflow/models/baseoperator.py:1453
RemovedInAirflow3Warning: Passing 'execution_date' to
'TaskInstance.xcom_push()' is deprecated.
[2023-06-21, 05:40:13 CST] {taskinstance.py:1350} INFO - Marking task as
SUCCESS. dag_id=d_crawler_bond_chinabond,
task_id=t_crawler_bond_chinabond_request, execution_date=20230619T180000,
start_date=20230620T180004, end_date=20230620T214013
[2023-06-21, 05:40:13 CST] {local_task_job_runner.py:225} INFO - Task exited
with return code 0
[2023-06-21, 05:40:14 CST] {taskinstance.py:2651} INFO - 1 downstream tasks
scheduled from follow-on schedule check
```
this is all log show in ui, from 2023-06-21, 02:00:05 CST to 2023-06-21,
02:00:07 CST, pod is running, but the logs are always in loading state in ui,
after pod end, after the pod runs, the ui logs are printed `[2023-06-21,
05:40:11 CST] {pod_manager.py:397} INFO - Pod
t-crawler-bond-chinabond-request-86p5zmlg has phase Running`, no logs are
printed for three hours during the running period, and ui logs are always
loading.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
