[jira] [Commented] (FLINK-25418) The dir_cache is specified in the flick task. When there is no network, you will still download the python third-party library

2021-12-22 Thread Dian Fu (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-25418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464254#comment-17464254
 ] 

Dian Fu commented on FLINK-25418:
-

[~ana4] Thanks for taking care of this issue. Have assigned the issue to you. 
The solution makes sense to me and looking forward to the PR~

> The dir_cache is specified in the flick task. When there is no network, you 
> will still download the python third-party library
> --
>
> Key: FLINK-25418
> URL: https://issues.apache.org/jira/browse/FLINK-25418
> Project: Flink
>  Issue Type: Bug
>  Components: API / Python
>Affects Versions: 1.13.1
> Environment: python3.7
> flink1.13.1
>Reporter: yangcai
>Assignee: Ada Wong
>Priority: Major
>
> Specified in Python code 
> set_python_requirements(requirements_cache_dir=dir_cache)
> During task execution, priority will be given to downloading Python 
> third-party packages from the network,Can I directly use the python package 
> in the cache I specify when I specify the cache value and don't want the task 
> task to download the python package from the network



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Commented] (FLINK-25418) The dir_cache is specified in the flick task. When there is no network, you will still download the python third-party library

2021-12-22 Thread Ada Wong (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-25418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17463766#comment-17463766
 ] 

Ada Wong commented on FLINK-25418:
--

cc [~dianfu] I want to fix this.  I will add the '--no-index' option in 
PythonEnvironmentManagerUtils#pipInstallRequirements method, when the 
requirementsCacheDir is not null.

When we set '--no-index', it will only install with offline, never download 
from the internet.

When we do not set '--no-index', it will first download from the internet, and 
then install with offline.

> The dir_cache is specified in the flick task. When there is no network, you 
> will still download the python third-party library
> --
>
> Key: FLINK-25418
> URL: https://issues.apache.org/jira/browse/FLINK-25418
> Project: Flink
>  Issue Type: Bug
>  Components: API / Python
>Affects Versions: 1.13.1
> Environment: python3.7
> flink1.13.1
>Reporter: yangcai
>Priority: Major
>
> Specified in Python code 
> set_python_requirements(requirements_cache_dir=dir_cache)
> During task execution, priority will be given to downloading Python 
> third-party packages from the network,Can I directly use the python package 
> in the cache I specify when I specify the cache value and don't want the task 
> task to download the python package from the network



--
This message was sent by Atlassian Jira
(v8.20.1#820001)