Re: submit a spark code on google cloud

Getting to the Spark web UI when Spark is running on Dataproc is not that straightforward. Connecting to that web interface is a two step process: 1. create an SSH tunnel 2. configure the browser to use a SOCKS proxy to connect The above steps are described here:

Re: submit a spark code on google cloud

Hi, I know nothing about Spark in GCP so answering this for a pure Spark. Can you use web UI and Executors tab or a SparkListener? Jacek On 7 Feb 2017 5:33 p.m., "Anahita Talebi" wrote: Hello Friends, I am trying to run a spark code on multiple machines. To this

submit a spark code on google cloud

Hello Friends, I am trying to run a spark code on multiple machines. To this aim, I submit a spark code on submit job on google cloud platform. https://cloud.google.com/dataproc/docs/guides/submit-job I have created a cluster with 6 nodes. Does anyone know how I can realize which nodes are