further focus on them in
specific PRs considering the feasibility in next 1.9 release.
Best,
Zhijiang
--
From:Andrey Zagrebin
Send Time:2019年3月29日(星期五) 18:38
To:dev
Subject:[Proposal] Shuffle resources lifecycle management
Hi All
Hi All,
While working on pluggable shuffle architecture, looking into interactive
programming and fine-grained recovery efforts, we released that lifecycle
management of intermediate result partitions needs more detailed
discussion to enable envisioned use cases.
Here I prepared a design
