clumzzey commented on issue #1614: [AIRFLOW-264] Adding workload management for Hive URL: https://github.com/apache/airflow/pull/1614#issuecomment-578669609 Hi, It looks like this this part breaks the hive execution on our HW 3. The error we get is the following: [2020-01-09 16:14:10,000] {base_task_runner.py:98} INFO - Subtask: [2020-01-09 16:14:10,000] {hive_hooks.py:216} INFO - Error: Could not open client transport for any of the Server URI's in ZooKeeper: Failed to open new session: java.lang.IllegalArgumentException: Cannot modify airflow.ctx.task.task_id at runtime. It is not in list of params that are allowed to be modified at runtime (state=08S01,code=0) I did ask our Infra team to add the airflow specific hiveconf to the whitelist of variables allowad to be modified on runtime but they seem to be reluctant to do that. Since it is not related to hive itself but an external application, the arguments should be passed as hivevar as hiveconf, so is claimed. If so, can this please be fixed?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
