Liwei Lin created SPARK-16620:
---------------------------------
Summary: RDD.pipe(command: String) in Spark 2.0 should be
compatible with Spark 1.6
Key: SPARK-16620
URL: https://issues.apache.org/jira/browse/SPARK-16620
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 2.0.0
Reporter: Liwei Lin
Currently in Spark 2.0 {{RDD.pipe(command: String)}}:
- works only with a single command with no option specified, such as
{{RDD.pipe("wc")}}
- *does not work* when command is specified with some options, such as
{{RDD.pipe("wc -l")}}
This is a regression from Spark 1.6.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
