Hi William, I would use a very light webserver listening for SparkJob submitting request, then I would just run a sub-process running: spark-submit –master yarn ….
The above process should be enabled only and only if Livy is not available. Thanks, Enrico On 4/30/18, 3:48 PM, "William Guo" <[email protected]> wrote: hi all, In some cluster environment, administrator doesn't install livy in their cluster. How can we support these users, should we support it by launching spark jobs by CLI? What are your comments for this issue? Thanks, William
