[
https://issues.apache.org/jira/browse/FLINK-11464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chesnay Schepler closed FLINK-11464.
------------------------------------
Fix Version/s: 1.10.0
Resolution: Fixed
master: f0be1623fdc5fb45f8ef27ee9985842ea27da400
> Implement DownloadCache
> -----------------------
>
> Key: FLINK-11464
> URL: https://issues.apache.org/jira/browse/FLINK-11464
> Project: Flink
> Issue Type: Sub-task
> Components: Test Infrastructure
> Reporter: Chesnay Schepler
> Assignee: Chesnay Schepler
> Priority: Major
> Fix For: 1.10.0
>
>
> h4. Problem
> Several tests download archives for setting up systems, like Kafka of
> Elasticsearch. We currently do not cache downloads in any way, resulting in
> less stable tests (as mirrors aren't always available) and overall increased
> test duration (since the downloads at times are quite slow). The duration
> issue becomes especially apparent when running tests in a loop for debugging
> or release-testing purposes.
> Finally, it also puts unnecessary strain on the download mirrors.
> h4. Proposal
> Add a {{DownloadCache}} interface with a single {{Path getOrDownload(String
> url, Path targetDir)}} method.
> Access to and loading of implementations are handled like resources (see
> above).
> The caching behavior is implementation-dependent.
> A reasonable implementation should allow files may be cached in a
> user-provided directory, with an optional time-to-live for long-term setups.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
