[
https://issues.apache.org/jira/browse/FLINK-8620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16380439#comment-16380439
]
ASF GitHub Bot commented on FLINK-8620:
---------------------------------------
Github user dawidwys commented on the issue:
https://github.com/apache/flink/pull/5580
@zentol I've tried changing the behaviour of `registerCachedFile` to always
distribute files via BlobServer, but I've stumbled across problem with python
API. Right now whole directories can be distributed via DFS. Unfortunately we
can upload only single files under a single key to BlobServer. I wonder what
should be better solution for it:
1. Extend BlobClient to enable uploading whole directories under a single
key
2. Upload python directories as plain files (with apropriately adjusted
keys e.g. path/to/filename) and later on restore structure on access
What do you think?
> Enable shipping custom artifacts to BlobStore and accessing them through
> DistributedCache
> -----------------------------------------------------------------------------------------
>
> Key: FLINK-8620
> URL: https://issues.apache.org/jira/browse/FLINK-8620
> Project: Flink
> Issue Type: New Feature
> Reporter: Dawid Wysakowicz
> Assignee: Dawid Wysakowicz
> Priority: Major
>
> We should be able to distribute custom files to taskmanagers. To do that we
> can store those files in BlobStore and later on access them in TaskManagers
> through DistributedCache.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
