[GitHub] spark pull request #19816: [WIP][SPARK-21693][FOLLOWUP][R] Reduce shuffle pa...

2017-11-24 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/19816#discussion_r153021587 --- Diff: R/pkg/tests/fulltests/test_sparkSQL.R --- @@ -3021,41 +3021,54 @@ test_that("dapplyCollect() on DataFrame with a binary column", { })

[GitHub] spark pull request #19816: [WIP][SPARK-21693][FOLLOWUP][R] Reduce shuffle pa...

2017-11-24 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/19816#discussion_r153021622 --- Diff: R/pkg/tests/fulltests/test_sparkSQL.R --- @@ -3078,101 +3091,117 @@ test_that("coalesce, repartition, numPartitions", { })

[GitHub] spark pull request #19816: [WIP][SPARK-21693][FOLLOWUP][R] Reduce shuffle pa...

2017-11-24 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/19816#discussion_r153001382 --- Diff: R/pkg/tests/fulltests/test_sparkSQL.R --- @@ -3078,101 +3091,117 @@ test_that("coalesce, repartition, numPartitions", { })

[GitHub] spark pull request #19816: [WIP][SPARK-21693][FOLLOWUP][R] Reduce shuffle pa...

2017-11-24 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/19816#discussion_r153001109 --- Diff: R/pkg/tests/fulltests/test_sparkSQL.R --- @@ -3021,41 +3021,54 @@ test_that("dapplyCollect() on DataFrame with a binary column", { })

[GitHub] spark pull request #19816: [WIP][SPARK-21693][FOLLOWUP][R] Reduce shuffle pa...

2017-11-24 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/19816#discussion_r153001070 --- Diff: R/pkg/tests/fulltests/test_sparkSQL.R --- @@ -3078,101 +3091,117 @@ test_that("coalesce, repartition, numPartitions", { })

[GitHub] spark pull request #19816: [WIP][SPARK-21693][FOLLOWUP][R] Reduce shuffle pa...

2017-11-24 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/19816#discussion_r153000843 --- Diff: R/pkg/tests/fulltests/test_sparkSQL.R --- @@ -3021,41 +3021,54 @@ test_that("dapplyCollect() on DataFrame with a binary column", { })

[GitHub] spark pull request #19816: [WIP][SPARK-21693][FOLLOWUP][R] Reduce shuffle pa...

2017-11-24 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/19816 [WIP][SPARK-21693][FOLLOWUP][R] Reduce shuffle partitions running R worker in few tests to speed up ## What changes were proposed in this pull request? This is a followup to reduce