[
https://issues.apache.org/jira/browse/SPARK-16620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liwei Lin updated SPARK-16620:
------------------------------
Description:
Currently {{RDD.pipe(command: String)}}:
- works only when the command is specified without any options, such as
{{RDD.pipe("wc")}}
- does NOT work when the command is specified with some options, such as
{{RDD.pipe("wc -l")}}
This is a regression from Spark 1.6.
was:
Currently in Spark 2.0 {{RDD.pipe(command: String)}}:
- works only with a single command with no option specified, such as
{{RDD.pipe("wc")}}
- *does not work* when command is specified with some options, such as
{{RDD.pipe("wc -l")}}
This is a regression from Spark 1.6.
> RDD.pipe(command: String) in Spark 2.0 does not work when command is
> specified with some options
> ------------------------------------------------------------------------------------------------
>
> Key: SPARK-16620
> URL: https://issues.apache.org/jira/browse/SPARK-16620
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 2.0.0
> Reporter: Liwei Lin
>
> Currently {{RDD.pipe(command: String)}}:
> - works only when the command is specified without any options, such as
> {{RDD.pipe("wc")}}
> - does NOT work when the command is specified with some options, such as
> {{RDD.pipe("wc -l")}}
> This is a regression from Spark 1.6.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
