Github user silasdavis commented on the pull request:
https://github.com/apache/spark/pull/4895#issuecomment-133078691
I am trying to get this re-opened, please see:
https://issues.apache.org/jira/browse/SPARK-3533
I have a prototype implementation that allows you to write multiple outputs
using Hadoop 2 multiple outputs for arbitrary OutputFormats not just Text (I
have implemented saveAsMultipleTextFiles, saveAsMultipleAvroFiles, and
saveAsMultipleParquetFiles, but other underlying ouput formats should be
straight-forward) linked to from the ticket at this gist:
https://gist.github.com/silasdavis/d1d1f1f7ab78249af462. It works with the
current Spark API and doesn't require any changes but I think it would be
better to integrate it. It looks like we need to get a Spark committer
interested to drive it forward.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
