[GitHub] spark pull request: add support for zipping a sequence of RDDs
Github user mohitjaggi commented on the pull request: https://github.com/apache/spark/pull/2429#issuecomment-96791360 closing on sean's request. i have a workaround. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: add support for zipping a sequence of RDDs
Github user mohitjaggi closed the pull request at: https://github.com/apache/spark/pull/2429 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: add support for zipping a sequence of RDDs
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2429#issuecomment-96770214 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: add support for zipping a sequence of RDDs
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/2429#issuecomment-96773808 Do you mind closing this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: add support for zipping a sequence of RDDs
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/2429#issuecomment-75371138 Ah right, I was looking at `zip` rather than `zipPartitions`. Yes the overloads are already there for `zipPartitions` and I don't see value in adding more. At best, add overloads for `zip`? but I also wonder about the use case, since you can still achieve this if really needed by calling `zipPartitions` overloads to make your own `zip`. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: add support for zipping a sequence of RDDs
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/2429#issuecomment-75310348 @srowen We already have versions of zipPartitions for zipping together up to 4 RDDs. Is there a common enough use case for this feature that we would want to expose this non-type-safe API? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: add support for zipping a sequence of RDDs
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/2429#issuecomment-73492643 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: add support for zipping a sequence of RDDs
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/2429#issuecomment-73492801 (This would need a JIRA, if it proceeds.) How strong is the need for this? you can always zip several RDDs together directly with several calls. It gets unwieldy with a lot of RDDs, but do you need to do that? you lose type safety in this method. I wonder if, is there a common need to zip an RDD with 2-3 others, we can just add utility overloads for that, that preserve type safety too. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: add support for zipping a sequence of RDDs
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2429#issuecomment-73492971 [Test build #27098 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27098/consoleFull) for PR 2429 at commit [`21bdd19`](https://github.com/apache/spark/commit/21bdd19f23208ebdee03c8b0f7f4e4c93cd908ba). * This patch merges cleanly. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: add support for zipping a sequence of RDDs
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2429#issuecomment-73501049 [Test build #27098 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27098/consoleFull) for PR 2429 at commit [`21bdd19`](https://github.com/apache/spark/commit/21bdd19f23208ebdee03c8b0f7f4e4c93cd908ba). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: add support for zipping a sequence of RDDs
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2429#issuecomment-73501054 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/27098/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: add support for zipping a sequence of RDDs
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2429#issuecomment-71951971 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: add support for zipping a sequence of RDDs
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2429#issuecomment-61559864 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: add support for zipping a sequence of RDDs
GitHub user mohitjaggi opened a pull request: https://github.com/apache/spark/pull/2429 add support for zipping a sequence of RDDs a proposed fix for https://issues.apache.org/jira/browse/SPARK-3489 You can merge this pull request into a Git repository by running: $ git pull https://github.com/AyasdiOpenSource/spark master Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/2429.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2429 commit ff0ae81ccd1549db9aa58f5152871c34d23d7c22 Author: Mohit Jaggi mo...@ayasdi.com Date: 2014-09-17T13:55:07Z add support for zipping a sequence of RDDs --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: add support for zipping a sequence of RDDs
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2429#issuecomment-55896797 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
