[jira] [Commented] (FLINK-25418) The dir_cache is specified in the flick task. When there is no network, you will still download the python third-party library
[ https://issues.apache.org/jira/browse/FLINK-25418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464254#comment-17464254 ] Dian Fu commented on FLINK-25418: - [~ana4] Thanks for taking care of this issue. Have assigned the issue to you. The solution makes sense to me and looking forward to the PR~ > The dir_cache is specified in the flick task. When there is no network, you > will still download the python third-party library > -- > > Key: FLINK-25418 > URL: https://issues.apache.org/jira/browse/FLINK-25418 > Project: Flink > Issue Type: Bug > Components: API / Python >Affects Versions: 1.13.1 > Environment: python3.7 > flink1.13.1 >Reporter: yangcai >Assignee: Ada Wong >Priority: Major > > Specified in Python code > set_python_requirements(requirements_cache_dir=dir_cache) > During task execution, priority will be given to downloading Python > third-party packages from the network,Can I directly use the python package > in the cache I specify when I specify the cache value and don't want the task > task to download the python package from the network -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (FLINK-25418) The dir_cache is specified in the flick task. When there is no network, you will still download the python third-party library
[ https://issues.apache.org/jira/browse/FLINK-25418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17463766#comment-17463766 ] Ada Wong commented on FLINK-25418: -- cc [~dianfu] I want to fix this. I will add the '--no-index' option in PythonEnvironmentManagerUtils#pipInstallRequirements method, when the requirementsCacheDir is not null. When we set '--no-index', it will only install with offline, never download from the internet. When we do not set '--no-index', it will first download from the internet, and then install with offline. > The dir_cache is specified in the flick task. When there is no network, you > will still download the python third-party library > -- > > Key: FLINK-25418 > URL: https://issues.apache.org/jira/browse/FLINK-25418 > Project: Flink > Issue Type: Bug > Components: API / Python >Affects Versions: 1.13.1 > Environment: python3.7 > flink1.13.1 >Reporter: yangcai >Priority: Major > > Specified in Python code > set_python_requirements(requirements_cache_dir=dir_cache) > During task execution, priority will be given to downloading Python > third-party packages from the network,Can I directly use the python package > in the cache I specify when I specify the cache value and don't want the task > task to download the python package from the network -- This message was sent by Atlassian Jira (v8.20.1#820001)