Nicholas Chammas created SPARK-6218:
---------------------------------------
Summary: Upgrade spark-ec2 from optparse to argparse
Key: SPARK-6218
URL: https://issues.apache.org/jira/browse/SPARK-6218
Project: Spark
Issue Type: Improvement
Components: EC2
Reporter: Nicholas Chammas
Priority: Minor
spark-ec2 [currently uses
optparse|https://github.com/apache/spark/blob/55b1b32dc8b9b25deea8e5864b53fe802bb92741/ec2/spark_ec2.py#L43].
In Python 2.7, optparse was [deprecated in favor of
argparse|https://docs.python.org/2/library/optparse.html]. This is the main
motivation for moving away from optparse.
Additionally, upgrading to argparse provides some [additional benefits noted in
the
docs|https://argparse.googlecode.com/svn/trunk/doc/argparse-vs-optparse.html].
The one we are mostly likely to benefit from is the better input validation.
argparse is not include with Python 2.6, which is currently the minimum version
of Python we support in Spark, but it can easily be downloaded by spark-ec2
with the work that has already been done in SPARK-6191.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
