[
https://issues.apache.org/jira/browse/SPARK-16620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liwei Lin updated SPARK-16620:
------------------------------
Summary: RDD.pipe(command: String) in Spark 2.0 does not work when command
is specified with some options (was: RDD.pipe(command: String) in Spark 2.0
should be compatible with Spark 1.6)
> RDD.pipe(command: String) in Spark 2.0 does not work when command is
> specified with some options
> ------------------------------------------------------------------------------------------------
>
> Key: SPARK-16620
> URL: https://issues.apache.org/jira/browse/SPARK-16620
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 2.0.0
> Reporter: Liwei Lin
>
> Currently in Spark 2.0 {{RDD.pipe(command: String)}}:
> - works only with a single command with no option specified, such as
> {{RDD.pipe("wc")}}
> - *does not work* when command is specified with some options, such as
> {{RDD.pipe("wc -l")}}
> This is a regression from Spark 1.6.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
