ClassyLion commented on issue #13805:
URL: https://github.com/apache/airflow/issues/13805#issuecomment-768180676
> Can you post your DAG please? Does other DAGs run ? Can you post the logs
from the Scheduler too with DEBUG level logging.
>
> Did you unpause the DAG too?
```
____________ _____________
____ |__( )_________ __/__ /________ __
____ /| |_ /__ ___/_ /_ __ /_ __ \_ | /| / /
___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ /
_/_/ |_/_/ /_/ /_/ /_/ \____/____/|__/
[2021-01-27 10:07:10,148] {scheduler_job.py:1241} INFO - Starting the
scheduler
[2021-01-27 10:07:10,149] {scheduler_job.py:1246} INFO - Processing each
file at most -1 times
[2021-01-27 10:07:10,150] {kubernetes_executor.py:491} INFO - Start
Kubernetes executor
[2021-01-27 10:07:10,186] {kubernetes_executor.py:462} INFO - When executor
started up, found 0 queued task instances
[2021-01-27 10:07:10,192] {dag_processing.py:250} INFO - Launched
DagFileProcessorManager with pid: 42
[2021-01-27 10:07:10,193] {scheduler_job.py:1751} INFO - Resetting orphaned
tasks for active dag runs
[2021-01-27 10:07:10,193] {kubernetes_executor.py:126} INFO - Event: and now
my watch begins starting at resource_version: 0
[2021-01-27 10:07:10,211] {settings.py:52} INFO - Configured default
timezone Timezone('UTC')
[2021-01-27 10:11:15,626] {scheduler_job.py:938} INFO - 2 tasks up for
execution:
<TaskInstance: test.monthly.weekly.trigger.test_task 2021-01-26
16:58:38.208907+00:00 [scheduled]>
<TaskInstance: test.monthly.weekly.trigger.test_task 2021-01-27
10:11:06.043581+00:00 [scheduled]>
[2021-01-27 10:11:15,635] {scheduler_job.py:967} INFO - Figuring out tasks
to run in Pool(name=default_pool) with 128 open slots and 2 task instances
ready to be queued
[2021-01-27 10:11:15,635] {scheduler_job.py:995} INFO - DAG
test.monthly.weekly.trigger has 0/16 running and queued tasks
[2021-01-27 10:11:15,635] {scheduler_job.py:995} INFO - DAG
test.monthly.weekly.trigger has 1/16 running and queued tasks
[2021-01-27 10:11:15,636] {scheduler_job.py:1060} INFO - Setting the
following tasks to queued state:
<TaskInstance: test.monthly.weekly.trigger.test_task 2021-01-26
16:58:38.208907+00:00 [scheduled]>
<TaskInstance: test.monthly.weekly.trigger.test_task 2021-01-27
10:11:06.043581+00:00 [scheduled]>
[2021-01-27 10:11:15,639] {scheduler_job.py:1102} INFO - Sending
TaskInstanceKey(dag_id='test.monthly.weekly.trigger', task_id='test_task',
execution_date=datetime.datetime(2021, 1, 26, 16, 58, 38, 208907,
tzinfo=Timezone('UTC')), try_number=1) to executor with priority 1 and queue
default
[2021-01-27 10:11:15,640] {base_executor.py:79} INFO - Adding to queue:
['airflow', 'tasks', 'run', 'test.monthly.weekly.trigger', 'test_task',
'2021-01-26T16:58:38.208907+00:00', '--local', '--pool', 'default_pool',
'--subdir', '/usr/local/airflow/dags/repo/dags/test.monthly.weekly.trigger.py']
[2021-01-27 10:11:15,640] {scheduler_job.py:1102} INFO - Sending
TaskInstanceKey(dag_id='test.monthly.weekly.trigger', task_id='test_task',
execution_date=datetime.datetime(2021, 1, 27, 10, 11, 6, 43581,
tzinfo=Timezone('UTC')), try_number=1) to executor with priority 1 and queue
default
[2021-01-27 10:11:15,640] {base_executor.py:79} INFO - Adding to queue:
['airflow', 'tasks', 'run', 'test.monthly.weekly.trigger', 'test_task',
'2021-01-27T10:11:06.043581+00:00', '--local', '--pool', 'default_pool',
'--subdir', '/usr/local/airflow/dags/repo/dags/test.monthly.weekly.trigger.py']
[2021-01-27 10:11:15,684] {kubernetes_executor.py:510} INFO - Add task
TaskInstanceKey(dag_id='test.monthly.weekly.trigger', task_id='test_task',
execution_date=datetime.datetime(2021, 1, 26, 16, 58, 38, 208907,
tzinfo=Timezone('UTC')), try_number=1) with command ['airflow', 'tasks', 'run',
'test.monthly.weekly.trigger', 'test_task', '2021-01-26T16:58:38.208907+00:00',
'--local', '--pool', 'default_pool', '--subdir',
'/usr/local/airflow/dags/repo/dags/test.monthly.weekly.trigger.py'] with
executor_config {'KubernetesExecutor': {'request_memory': '256Mi',
'limit_memory': '512Mi'}}
/usr/local/lib/python3.8/site-packages/airflow/kubernetes/pod_generator.py:193
DeprecationWarning: Using a dictionary for the executor_config is deprecated
and will soon be removed.please use a `kubernetes.client.models.V1Pod` class
with a "pod_override" key instead.
[2021-01-27 10:11:15,901] {kubernetes_executor.py:510} INFO - Add task
TaskInstanceKey(dag_id='test.monthly.weekly.trigger', task_id='test_task',
execution_date=datetime.datetime(2021, 1, 27, 10, 11, 6, 43581,
tzinfo=Timezone('UTC')), try_number=1) with command ['airflow', 'tasks', 'run',
'test.monthly.weekly.trigger', 'test_task', '2021-01-27T10:11:06.043581+00:00',
'--local', '--pool', 'default_pool', '--subdir',
'/usr/local/airflow/dags/repo/dags/test.monthly.weekly.trigger.py'] with
executor_config {'KubernetesExecutor': {'request_memory': '256Mi',
'limit_memory': '512Mi'}}
[2021-01-27 10:11:15,906] {kubernetes_executor.py:277} INFO - Kubernetes job
is (TaskInstanceKey(dag_id='test.monthly.weekly.trigger', task_id='test_task',
execution_date=datetime.datetime(2021, 1, 26, 16, 58, 38, 208907,
tzinfo=Timezone('UTC')), try_number=1), ['airflow', 'tasks', 'run',
'test.monthly.weekly.trigger', 'test_task', '2021-01-26T16:58:38.208907+00:00',
'--local', '--pool', 'default_pool', '--subdir',
'/usr/local/airflow/dags/repo/dags/test.monthly.weekly.trigger.py'],
{'api_version': 'v1',
'kind': 'Pod',
'metadata': {'annotations': None,
'cluster_name': None,
'creation_timestamp': None,
'deletion_grace_period_seconds': None,
'deletion_timestamp': None,
'finalizers': None,
'generate_name': None,
'generation': None,
'initializers': None,
'labels': None,
'managed_fields': None,
'name': None,
'namespace': None,
'owner_references': None,
'resource_version': None,
'self_link': None,
'uid': None},
'spec': {'active_deadline_seconds': None,
'affinity': None,
'automount_service_account_token': None,
'containers': [{'args': [],
'command': [],
'env': [],
'env_from': [],
'image': None,
'image_pull_policy': None,
'lifecycle': None,
'liveness_probe': None,
'name': 'base',
'ports': [],
'readiness_probe': None,
'resources': {'limits': {'memory': '512Mi'},
'requests': {'memory': '256Mi'}},
'security_context': None,
'stdin': None,
'stdin_once': None,
'termination_message_path': None,
'termination_message_policy': None,
'tty': None,
'volume_devices': None,
'volume_mounts': [],
'working_dir': None}],
'dns_config': None,
'dns_policy': None,
'enable_service_links': None,
'host_aliases': None,
'host_ipc': None,
'host_network': False,
'host_pid': None,
'hostname': None,
'image_pull_secrets': [],
'init_containers': None,
'node_name': None,
'node_selector': None,
'preemption_policy': None,
'priority': None,
'priority_class_name': None,
'readiness_gates': None,
'restart_policy': None,
'runtime_class_name': None,
'scheduler_name': None,
'security_context': None,
'service_account': None,
'service_account_name': None,
'share_process_namespace': None,
'subdomain': None,
'termination_grace_period_seconds': None,
'tolerations': None,
'volumes': []},
'status': None}, None)
[2021-01-27 10:11:15,984] {scheduler_job.py:1193} INFO - Executor reports
execution of test.monthly.weekly.trigger.test_task execution_date=2021-01-26
16:58:38.208907+00:00 exited with status queued for try_number 1
[2021-01-27 10:11:15,984] {scheduler_job.py:1193} INFO - Executor reports
execution of test.monthly.weekly.trigger.test_task execution_date=2021-01-27
10:11:06.043581+00:00 exited with status queued for try_number 1
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
