tirkarthi opened a new issue, #49099:
URL: https://github.com/apache/airflow/issues/49099

   ### Apache Airflow version
   
   main (development)
   
   ### If "Other Airflow 2 version" selected, which one?
   
   _No response_
   
   ### What happened?
   
   `get_json_error` checks for status to be of the series 4xx or 5xx and if not 
returns None. In case of redirections like 301 through corporate proxy it 
returns 3xx status code. Thus `get_json_error` returns None and 
`response.raise_for_status` raises HTTPStatusError which is not pickleable and 
scheduler crashes similar to #47873 
   
   
https://github.com/apache/airflow/blob/9b1a507483a86aa87e4f70621dd9af8afb1f1f21/task-sdk/src/airflow/sdk/api/client.py#L114-L123
   
   ### What you think should happen instead?
   
   _No response_
   
   ### How to reproduce
   
   1. Run scheduler in a proxy environment where 3xx might be returned.
   2. Create a dagrun.
   3. Scheduler crashes with `HTTPStatusError` which is not pickleable
   
   ### Operating System
   
   Ubuntu 20.04
   
   ### Versions of Apache Airflow Providers
   
   _No response_
   
   ### Deployment
   
   Virtualenv installation
   
   ### Deployment details
   
   _No response_
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to