Hi, I don’t think that this is currently supported. If you see a use case for this (over creating different root directories for checkpoint data and result data) then I suggest that you open a JIRA issue with a new feature request.
Best, Stefan > Am 23.08.2017 um 20:17 schrieb Vijay Srinivasaraghavan <vijikar...@yahoo.com>: > > Hi Ted, > > I believe HDFS-6584 is more of an HDFS feature supporting archive use case > through some policy configurations. > > My ask is that I have two distinct HCFS File systems which are independent > but the Flink job will decide which one to use for sink while the Flink > infrastructure is by default configured with one of these HCFS as state > backend store. > > Hope this helps. > > Regards > Vijay > > > On Wednesday, August 23, 2017 11:06 AM, Ted Yu <yuzhih...@gmail.com> wrote: > > > Would HDFS-6584 help with your use case ? > > On Wed, Aug 23, 2017 at 11:00 AM, Vijay Srinivasaraghavan < > vijikar...@yahoo.com.invalid <mailto:vijikar...@yahoo.com.invalid>> wrote: > > > Hello, > > Is it possible for a Flink cluster to use multiple HDFS repository (HDFS-1 > > for managing Flink state backend, HDFS-2 for syncing results from user > > job)? > > The scenario can be viewed in the context of running some jobs that are > > meant to push the results to an archive repository (cold storage). > > Since the hadoop configuration is static, I am thinking it is hard to > > achieve this but I could be wrong. > > Please share any thoughts. > > RegardsVijay > >
