potiuk commented on issue #10435: URL: https://github.com/apache/airflow/issues/10435#issuecomment-2160604871
> I'm seeing the same issue on GCP Composer, the job is running on Dataproc Serverless batches and Composer version is 2.6.6 (Airflow - 2.5.3) .. job completes file but i still get error -> Task exited with error Negsignal.SIGKILL You need to track the root cause of it - it's outside of Airlfow. SIGKILL is always a sign that something terrible happened and the task was killed in "hard" way. But the nature of this error is that you can't get more information about the cause, because sigkill is always causing immediate shutdown of a process and you have no chance to do anything with it. So you should try to guess what triggers it, look at the logs of K8S in GCP Composer and see if you can figure out what task and why is causing it, but you will not get more "generic" help with it. You can also open an issue to the Composer team, because they might have some additional insights. Usually things like excessive memory usage, resources, or even hardware errors, deadlocks on accessing resources are root cause of the issues - sometimes bugs in libraries and code you are using. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
