Is this the part where I say Julia-Spark again? I think this is pretty doable in time. It will likely be more or less a port of PySpark <https://github.com/apache/spark/tree/master/python/pyspark> since Julia and Python are similar in capability. I think I counted about 6K lines (including comments).
According to the pyspark presentation <https://www.youtube.com/watch?v=xc7Lc8RA8wE>, they relied on a 3rd party to containerize a Python program for transmission -- I think I'm remembering this right. That might be a problem to overcome.
