I notice there’s a dependency on Spark 2.1+ that didn’t get resolved per this JIRA (https://issues.apache.org/jira/projects/SPOT/issues/SPOT-266). I propose adding a check in this script to verify the user’s version of Spark and if it's not at least 2.1 the script will exit and indicate that the user should upgrade their version of Spark. We also need to replace spark-submit with spark-submit2. Any thoughts for/against updating this script?
Also would anyone be willing to update the documentation on the Spot website to reflect the correct required version of Spark to run Spot? Thank you, Tadd Wood
