Config your spark master web ui you can set env SPARK_MASTER_WEBUI_PORT=xxxx You can running cmd netstat –nao|grep 4040 to check 4040 is in using
——————— I am not sure why Spark web UI keeps changing its port every time I restart a cluster? how can I make it run always on one port? I did make sure there is no process running on 4040(spark default web ui port) however it still starts at 8080. any ideas? MasterWebUI: Bound MasterWebUI to 0.0.0.0, and started at http://x.x.x.x:8080 Thanks!
