[
https://issues.apache.org/jira/browse/SPARK-16620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-16620:
------------------------------
Target Version/s: 2.0.0
Priority: Blocker (was: Major)
I'm calling this a Blocker just because a big part of the pipe() functionality
was broken by an earlier commit for 2.0
> RDD.pipe(command: String) in Spark 2.0 does not work when command is
> specified with some options
> ------------------------------------------------------------------------------------------------
>
> Key: SPARK-16620
> URL: https://issues.apache.org/jira/browse/SPARK-16620
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 2.0.0
> Reporter: Liwei Lin
> Priority: Blocker
>
> Currently {{RDD.pipe(command: String)}}:
> - works only when the command is specified without any options, such as
> {{RDD.pipe("wc")}}
> - does NOT work when the command is specified with some options, such as
> {{RDD.pipe("wc -l")}}
> This is a regression from Spark 1.6.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]