Re: [PR] Refactor cloudpickle support in Python operators/decorators [airflow]

2024-05-04 Thread via GitHub
Taragolis merged PR #39270: URL: https://github.com/apache/airflow/pull/39270 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Refactor cloudpickle support in Python operators/decorators [airflow]

2024-04-26 Thread via GitHub
Taragolis commented on code in PR #39270: URL: https://github.com/apache/airflow/pull/39270#discussion_r1580837257 ## airflow/operators/python.py: ## @@ -350,6 +343,36 @@ def get_tasks_to_skip(): return condition +def _load_pickle(): +import pickle + +

Re: [PR] Refactor cloudpickle support in Python operators/decorators [airflow]

2024-04-26 Thread via GitHub
Taragolis commented on code in PR #39270: URL: https://github.com/apache/airflow/pull/39270#discussion_r1580742279 ## airflow/operators/python.py: ## @@ -350,6 +343,36 @@ def get_tasks_to_skip(): return condition +def _load_pickle(): +import pickle + +

Re: [PR] Refactor cloudpickle support in Python operators/decorators [airflow]

2024-04-26 Thread via GitHub
uranusjr commented on code in PR #39270: URL: https://github.com/apache/airflow/pull/39270#discussion_r1580686884 ## airflow/operators/python.py: ## @@ -350,6 +343,36 @@ def get_tasks_to_skip(): return condition +def _load_pickle(): +import pickle + +return

Re: [PR] Refactor cloudpickle support in Python operators/decorators [airflow]

2024-04-26 Thread via GitHub
Taragolis commented on code in PR #39270: URL: https://github.com/apache/airflow/pull/39270#discussion_r1580581663 ## tests/operators/test_python.py: ## @@ -1159,64 +1201,36 @@ def f(a): # context using cloudpickle (which is slow apparently).

Re: [PR] Refactor cloudpickle support in Python operators/decorators [airflow]

2024-04-26 Thread via GitHub
Taragolis commented on code in PR #39270: URL: https://github.com/apache/airflow/pull/39270#discussion_r1580569241 ## airflow/operators/python.py: ## @@ -350,6 +343,36 @@ def get_tasks_to_skip(): return condition +def _load_pickle(): +import pickle + +

Re: [PR] Refactor cloudpickle support in Python operators/decorators [airflow]

2024-04-26 Thread via GitHub
Taragolis commented on code in PR #39270: URL: https://github.com/apache/airflow/pull/39270#discussion_r1580581663 ## tests/operators/test_python.py: ## @@ -1159,64 +1201,36 @@ def f(a): # context using cloudpickle (which is slow apparently).

Re: [PR] Refactor cloudpickle support in Python operators/decorators [airflow]

2024-04-26 Thread via GitHub
Taragolis commented on code in PR #39270: URL: https://github.com/apache/airflow/pull/39270#discussion_r1580570825 ## airflow/operators/python.py: ## @@ -350,6 +343,36 @@ def get_tasks_to_skip(): return condition +def _load_pickle(): +import pickle + +

Re: [PR] Refactor cloudpickle support in Python operators/decorators [airflow]

2024-04-26 Thread via GitHub
Taragolis commented on code in PR #39270: URL: https://github.com/apache/airflow/pull/39270#discussion_r1580569241 ## airflow/operators/python.py: ## @@ -350,6 +343,36 @@ def get_tasks_to_skip(): return condition +def _load_pickle(): +import pickle + +

Re: [PR] Refactor cloudpickle support in Python operators/decorators [airflow]

2024-04-26 Thread via GitHub
Taragolis commented on code in PR #39270: URL: https://github.com/apache/airflow/pull/39270#discussion_r1580560702 ## airflow/operators/python.py: ## @@ -350,6 +343,36 @@ def get_tasks_to_skip(): return condition +def _load_pickle(): +import pickle + +

Re: [PR] Refactor cloudpickle support in Python operators/decorators [airflow]

2024-04-26 Thread via GitHub
Taragolis commented on code in PR #39270: URL: https://github.com/apache/airflow/pull/39270#discussion_r1580556503 ## airflow/operators/python.py: ## @@ -350,6 +343,36 @@ def get_tasks_to_skip(): return condition +def _load_pickle(): +import pickle + +

Re: [PR] Refactor cloudpickle support in Python operators/decorators [airflow]

2024-04-26 Thread via GitHub
uranusjr commented on code in PR #39270: URL: https://github.com/apache/airflow/pull/39270#discussion_r1580542424 ## airflow/operators/python.py: ## @@ -350,6 +343,36 @@ def get_tasks_to_skip(): return condition +def _load_pickle(): +import pickle + +return

Re: [PR] Refactor cloudpickle support in Python operators/decorators [airflow]

2024-04-26 Thread via GitHub
Taragolis commented on code in PR #39270: URL: https://github.com/apache/airflow/pull/39270#discussion_r1580529944 ## airflow/operators/python.py: ## @@ -350,6 +343,36 @@ def get_tasks_to_skip(): return condition +def _load_pickle(): +import pickle + +

Re: [PR] Refactor cloudpickle support in Python operators/decorators [airflow]

2024-04-26 Thread via GitHub
Taragolis commented on code in PR #39270: URL: https://github.com/apache/airflow/pull/39270#discussion_r1580529944 ## airflow/operators/python.py: ## @@ -350,6 +343,36 @@ def get_tasks_to_skip(): return condition +def _load_pickle(): +import pickle + +

Re: [PR] Refactor cloudpickle support in Python operators/decorators [airflow]

2024-04-25 Thread via GitHub
dstandish commented on code in PR #39270: URL: https://github.com/apache/airflow/pull/39270#discussion_r1580420376 ## airflow/operators/python.py: ## @@ -350,6 +343,36 @@ def get_tasks_to_skip(): return condition +def _load_pickle(): +import pickle + +

Re: [PR] Refactor cloudpickle support in Python operators/decorators [airflow]

2024-04-25 Thread via GitHub
uranusjr commented on code in PR #39270: URL: https://github.com/apache/airflow/pull/39270#discussion_r1580419537 ## airflow/operators/python.py: ## @@ -350,6 +343,36 @@ def get_tasks_to_skip(): return condition +def _load_pickle(): +import pickle + +return

[PR] Refactor cloudpickle support in Python operators/decorators [airflow]

2024-04-25 Thread via GitHub
Taragolis opened a new pull request, #39270: URL: https://github.com/apache/airflow/pull/39270 Some refactor cloudpickle support which added into the https://github.com/apache/airflow/pull/38531 Use new `serializer` parameter for specify serialiser, this one for avoid