I am fairly new to spark. I configured 3 machines(2 slaves) on a standalone cluster. I just wanted to know what exactly is the meaning of: [Stage 0:======> (25 + 4) / 500] This gets printed to the terminal when I submit my app. I understand that 500 is the number in which my data has been partitioned. What exactly does 25 and 4 mean? Here usually 4 remains fixed while 25 keeps on increasing until they both add upto 500. Does this mean that only one machine is doing most of the computation?
-- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Interpreting-what-gets-printed-as-one-submits-spark-application-tp23357.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
