satyarthn commented on issue #9486:
URL: https://github.com/apache/airflow/issues/9486#issuecomment-919597341
Folks,
I went through this entire thread, but not able to troubleshoot the issue. I
am having the same issue.
So I can see CloudWatch has my logs
```
CloudWatch
Log groups
/ecs/airflow-aws-gcp
ecs/airflow-aws-gcp/ad93daaa94db48f0bd278c780e946f64
```
Note the Stream Name is
`ecs/airflow-aws-gcp/ad93daaa94db48f0bd278c780e946f64`
In my AirFlow ECSOperator Definition, I am providing
```
ECS_AWSLOGS_GROUP = '/ecs/airflow-aws-gcp'
ECS_AWSLOGS_STREAM_PREFIX = 'ecs/airflow-aws-gcp'
```
In the AirFlow logs, I see
[2021-09-14 23:46:03,310] {{ecs.py:257}} INFO - ECS Task started: {'tasks':
[{'attachments': [{'id': '8fdb6419-df5f-4f61-a5d8-9388bb523695', 'type':
'ElasticNetworkInterface', 'status': 'PRECREATED', ......'containers':
[{'containerArn':
'arn:aws:ecs:us-east-1:{ACCOUNT_ID}:container/airflow-ecs/ad93daaa94db48f0bd278c780e946f64/02114c6b-5925-45dd-a595-b9608157bdb6
....
Am I reading it right that,
1. ECS Task id is `8fdb6419-df5f-4f61-a5d8-9388bb523695`
2. But Log Stream that is generated has the name
`ecs/airflow-aws-gcp/ad93daaa94db48f0bd278c780e946f64`
Why the discrepancy? I am assuming that the
`ad93daaa94db48f0bd278c780e946f64` is the container instance id and not really
the ECS Task Id. Am I configuring my ECS Task definition wrong?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
