[
https://issues.apache.org/jira/browse/FLINK-9366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16500019#comment-16500019
]
ASF GitHub Bot commented on FLINK-9366:
---------------------------------------
Github user zentol commented on a diff in the pull request:
https://github.com/apache/flink/pull/6107#discussion_r192691637
--- Diff:
flink-streaming-scala/src/main/scala/org/apache/flink/streaming/api/scala/StreamExecutionEnvironment.scala
---
@@ -690,12 +690,11 @@ class StreamExecutionEnvironment(javaEnv: JavaEnv) {
f
}
-
/**
* Registers a file at the distributed cache under the given name. The
file will be accessible
* from any user-defined function in the (distributed) runtime under a
local path. Files
- * may be local files (as long as all relevant workers have access to
it), or files in a
- * distributed file system. The runtime will copy the files temporarily
to a local cache,
+ * may be local files (will be distributed via BlobServer), or files in
a distributed file
--- End diff --
add `which` before `will` for better flow`. Also applies to other instances
of this method.
> Distribute Cache only works for client-accessible files
> -------------------------------------------------------
>
> Key: FLINK-9366
> URL: https://issues.apache.org/jira/browse/FLINK-9366
> Project: Flink
> Issue Type: Bug
> Components: Client, Local Runtime
> Affects Versions: 1.6.0
> Reporter: Chesnay Schepler
> Assignee: Dawid Wysakowicz
> Priority: Blocker
> Fix For: 1.6.0
>
>
> In FLINK-8620 the distributed cache was modified to the distribute files via
> the blob store, instead of downloading them from a distributed filesystem.
> Previously, taskmanagers would download requested files from the DFS. Now,
> they retrieve it form the blob store. This requires the client to
> preemptively upload all files used with distributed cache.
> As a result it is no longer possible to use the distributed cache for files
> that reside in a cluster-internal DFS, as the client cannot download it. This
> is a regression from the previous behavior and may break existing setups.
> [~aljoscha] [~dawidwys]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
