All, This is a theoretical question at this point of time. Wanted to pose this question, before spending too much time to figure it out. Advance apologies if this is not the right forum to ask this question.
Use-case: - Migration from one cluster manager to another (for ex. Spark stand-alone to YARN). OR support for running jobs in a two-cluster-manager environment Q1: Wondering if it would be possible to setup two clusters (one of each type) and route jobs, based on some configuration, between these two clusters. Essentially requiring communication between two cluster managers. Q2: Has anyone done similar thing in a non-Spark environment? If so, can share some thoughts? Is this a proper way to think about? If not, what are the best practices for this use-case? Thanks in advance, Vasu.
