HemanthKumar8124 commented on issue #21605:
URL: https://github.com/apache/airflow/issues/21605#issuecomment-1521584387
Hi Team,
Even with Airflow MWAA 2.4.3 version with Kubernetes POD Operator task, we
are seeing the below issue in Airflow logs.
kubernetes version - 1.24
{{pod_manager.py:410}} ERROR - Error parsing timestamp (no timestamp in
message ''). Will continue execution but won't update timestamp
{{logging_mixin.py:137}} WARNING -
/usr/local/airflow/.local/lib/python3.10/site-packages/watchtower/__init__.py:349
WatchtowerWarning: Received empty message. Empty messages cannot be sent to
CloudWatch Logs
{{logging_mixin.py:137}} WARNING - Traceback (most recent call last):
{{logging_mixin.py:137}} WARNING - File
"/usr/local/airflow/config/cloudwatch_logging.py", line 161, in emit
self.sniff_errors(record)
{{logging_mixin.py:137}} WARNING - File
"/usr/local/airflow/config/cloudwatch_logging.py", line 211, in sniff_errors
if pattern.search(record.message):
{{logging_mixin.py:137}} WARNING - AttributeError: 'LogRecord' object has no
attribute 'message'
I don't see any issue with POD logs when I manually checked using kubectl
client. Each line contains timestamp in it. But the above warning message
appears in Airflow logs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
