huozhanfeng commented on pull request #15537:
URL: https://github.com/apache/airflow/pull/15537#issuecomment-864013121
> > The PR will cause dags that use hive operations to fail because they
can't get the right PID.
> > the hive task process info like these
> > 1、airflow 20391 20170 11 17:41 ? 00:00:00 airflow task supervisor:
['airflow...
> > 2、root 20394 20391 0 17:41 ? 00:00:00 sudo -E -H -u user airflow tasks
run ...
> > 3、user+ 20396 20394 61 17:41 ? 00:00:02 /usr/local/python3/bin/python3.7
/bin/airflow tasks run...
> > 4、user+ 20407 20396 99 17:41 ? 00:00:04 /usr/local/java/bin/java
-Xmx1024m -Dhdp.version=2.6.5.0-292 -Djava.net.preferIPv4...
> > The error log as follows:
> > [2021-06-15 16:40:10,222] {hive.py:256} INFO - Logging initialized using
configuration in file:/etc/hive/2.6.5.0-292/0/hive-log4j.properties
> > [2021-06-15 16:40:11,871] {local_task_job.py:193} WARNING - Recorded pid
30962 does not match the current pid 30960
> > [2021-06-15 16:40:11,877] {process_utils.py:100} INFO - Sending
Signals.SIGTERM to GPID 30960
> > [2021-06-15 16:40:11,901] {taskinstance.py:1264} ERROR - Received
SIGTERM. Terminating subprocesses.
> > [2021-06-15 16:40:11,902] {logging_mixin.py:104} INFO - Killing the Hive
job
> > The demo with hive operation runs success after deleting all the code of
this PR. So please consider improving the PR or repeal it.
>
> Interesting. cc: @ashb
@ashb hello, could you please help to take a look? thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
