[GitHub] spark issue #19218: [SPARK-21786][SQL] The 'spark.sql.parquet.compression.co...

2017-09-27 Thread fjh100456
Github user fjh100456 commented on the issue: https://github.com/apache/spark/pull/19218 @dongjoon-hyun @gatorsmile I'd fix them. Could you help me to review it again? Thanks. --- - To unsubscribe, e-mail:

[GitHub] spark issue #19287: [SPARK-22074][Core] Task killed by other attempt task sh...

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19287 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19287: [SPARK-22074][Core] Task killed by other attempt task sh...

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19287 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82262/ Test PASSed. ---

[GitHub] spark issue #19287: [SPARK-22074][Core] Task killed by other attempt task sh...

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19287 **[Test build #82262 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82262/testReport)** for PR 19287 at commit

[GitHub] spark issue #19294: [SPARK-21549][CORE] Respect OutputFormats with no output...

2017-09-27 Thread mridulm
Github user mridulm commented on the issue: https://github.com/apache/spark/pull/19294 @szhem Did you resolve issues with newTaskTempFile, newTaskTempFileAbsPath, etc potentially still throwing NPE due to path being null ? I saw multiple invocations in spark sql which are calling

[GitHub] spark issue #16578: [SPARK-4502][SQL] Parquet nested column pruning

2017-09-27 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16578 @mallman For the problem https://github.com/apache/spark/pull/16578#issuecomment-327797222 identified by @snir, I've submitted a fix at https://github.com/VideoAmp/spark-public/pull/8. I think it

[GitHub] spark issue #19330: [SPARK-18134][SQL] Orderable MapType

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19330 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82264/ Test FAILed. ---

[GitHub] spark issue #19330: [SPARK-18134][SQL] Orderable MapType

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19330 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19330: [SPARK-18134][SQL] Orderable MapType

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19330 **[Test build #82264 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82264/testReport)** for PR 19330 at commit

[GitHub] spark issue #19222: [SPARK-10399][CORE][SQL] Introduce multiple MemoryBlocks...

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19222 **[Test build #82267 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82267/testReport)** for PR 19222 at commit

[GitHub] spark issue #19376: [SPARK-22153][SQL] Rename ShuffleExchange -> ShuffleExch...

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19376 **[Test build #82266 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82266/testReport)** for PR 19376 at commit

[GitHub] spark issue #19218: [SPARK-21786][SQL] The 'spark.sql.parquet.compression.co...

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19218 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19363: [Minor]Override toString of KeyValueGroupedDataset

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19363 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19218: [SPARK-21786][SQL] The 'spark.sql.parquet.compression.co...

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19218 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82261/ Test PASSed. ---

[GitHub] spark issue #19363: [Minor]Override toString of KeyValueGroupedDataset

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19363 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82259/ Test PASSed. ---

[GitHub] spark issue #19376: [SPARK-22153][SQL] Rename ShuffleExchange -> ShuffleExch...

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19376 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82265/ Test FAILed. ---

[GitHub] spark issue #19376: [SPARK-22153][SQL] Rename ShuffleExchange -> ShuffleExch...

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19376 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19376: [SPARK-22153][SQL] Rename ShuffleExchange -> ShuffleExch...

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19376 **[Test build #82265 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82265/testReport)** for PR 19376 at commit

[GitHub] spark issue #19218: [SPARK-21786][SQL] The 'spark.sql.parquet.compression.co...

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19218 **[Test build #82261 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82261/testReport)** for PR 19218 at commit

[GitHub] spark issue #19363: [Minor]Override toString of KeyValueGroupedDataset

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19363 **[Test build #82259 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82259/testReport)** for PR 19363 at commit

[GitHub] spark issue #19376: [SPARK-22153][SQL] Rename ShuffleExchange -> ShuffleExch...

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19376 **[Test build #82265 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82265/testReport)** for PR 19376 at commit

[GitHub] spark pull request #19376: [SPARK-22153][SQL] Rename ShuffleExchange -> Shuf...

2017-09-27 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/19376 [SPARK-22153][SQL] Rename ShuffleExchange -> ShuffleExchangeExec ## What changes were proposed in this pull request? For some reason when we added the Exec suffix to all physical operators, we

[GitHub] spark pull request #19344: [SPARK-22122][SQL] Respect WITH clauses to count ...

2017-09-27 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/19344#discussion_r141522496 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/TPCDSQueryBenchmark.scala --- @@ -66,25 +68,23 @@ object TPCDSQueryBenchmark

[GitHub] spark issue #19330: [SPARK-18134][SQL] Orderable MapType

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19330 **[Test build #82264 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82264/testReport)** for PR 19330 at commit

[GitHub] spark issue #19272: [Spark-21842][Mesos] Support Kerberos ticket renewal and...

2017-09-27 Thread ArtRand
Github user ArtRand commented on the issue: https://github.com/apache/spark/pull/19272 Hey @kalvinnchau thanks for having the patience to try this. This is a curious error though. If you look at the `addAll` method called by `UserGroupInformation.addCredentials()` it should

[GitHub] spark issue #19370: [SPARK-18136] Fix setup of SPARK_HOME variable on Window...

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19370 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82258/ Test PASSed. ---

[GitHub] spark issue #19370: [SPARK-18136] Fix setup of SPARK_HOME variable on Window...

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19370 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19370: [SPARK-18136] Fix setup of SPARK_HOME variable on Window...

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19370 **[Test build #82258 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82258/testReport)** for PR 19370 at commit

[GitHub] spark issue #19222: [SPARK-10399][CORE][SQL] Introduce multiple MemoryBlocks...

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19222 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82263/ Test FAILed. ---

[GitHub] spark issue #19222: [SPARK-10399][CORE][SQL] Introduce multiple MemoryBlocks...

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19222 **[Test build #82263 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82263/testReport)** for PR 19222 at commit

[GitHub] spark issue #19222: [SPARK-10399][CORE][SQL] Introduce multiple MemoryBlocks...

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19222 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19222: [SPARK-10399][CORE][SQL] Introduce multiple MemoryBlocks...

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19222 **[Test build #82263 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82263/testReport)** for PR 19222 at commit

[GitHub] spark pull request #19344: [SPARK-22122][SQL] Respect WITH clauses to count ...

2017-09-27 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/19344#discussion_r141520921 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/TPCDSQueryBenchmark.scala --- @@ -66,25 +68,23 @@ object TPCDSQueryBenchmark

[GitHub] spark pull request #19344: [SPARK-22122][SQL] Respect WITH clauses to count ...

2017-09-27 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/19344#discussion_r141520163 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/TPCDSQueryBenchmark.scala --- @@ -66,25 +68,23 @@ object TPCDSQueryBenchmark

[GitHub] spark pull request #19361: [SPARK-22140] Add TPCDSQuerySuite

2017-09-27 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/19361#discussion_r141519844 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/TPCDSQuerySuite.scala --- @@ -0,0 +1,348 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #19287: [SPARK-22074][Core] Task killed by other attempt task sh...

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19287 **[Test build #82262 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82262/testReport)** for PR 19287 at commit

[GitHub] spark issue #19344: [SPARK-22122][SQL] Respect WITH clauses to count input r...

2017-09-27 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/19344 ping --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19218: [SPARK-21786][SQL] The 'spark.sql.parquet.compression.co...

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19218 **[Test build #82261 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82261/testReport)** for PR 19218 at commit

[GitHub] spark pull request #19287: [SPARK-22074][Core] Task killed by other attempt ...

2017-09-27 Thread xuanyuanking
Github user xuanyuanking commented on a diff in the pull request: https://github.com/apache/spark/pull/19287#discussion_r141513379 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskInfo.scala --- @@ -74,6 +81,10 @@ class TaskInfo( gettingResultTime = time

[GitHub] spark issue #19218: [SPARK-21786][SQL] The 'spark.sql.parquet.compression.co...

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19218 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82260/ Test FAILed. ---

[GitHub] spark issue #19218: [SPARK-21786][SQL] The 'spark.sql.parquet.compression.co...

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19218 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19218: [SPARK-21786][SQL] The 'spark.sql.parquet.compression.co...

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19218 **[Test build #82260 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82260/testReport)** for PR 19218 at commit

[GitHub] spark issue #19218: [SPARK-21786][SQL] The 'spark.sql.parquet.compression.co...

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19218 **[Test build #82260 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82260/testReport)** for PR 19218 at commit

[GitHub] spark pull request #19287: [SPARK-22074][Core] Task killed by other attempt ...

2017-09-27 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/19287#discussion_r141510861 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskInfo.scala --- @@ -74,6 +81,10 @@ class TaskInfo( gettingResultTime = time }

[GitHub] spark issue #19363: [Minor]Override toString of KeyValueGroupedDataset

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19363 **[Test build #82259 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82259/testReport)** for PR 19363 at commit

[GitHub] spark issue #19374: [SPARK-22145][MESOS] fix supervise with checkpointing on...

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19374 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19374: [SPARK-22145][MESOS] fix supervise with checkpointing on...

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19374 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82256/ Test PASSed. ---

[GitHub] spark issue #19374: [SPARK-22145][MESOS] fix supervise with checkpointing on...

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19374 **[Test build #82256 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82256/testReport)** for PR 19374 at commit

[GitHub] spark pull request #19363: [Minor]Override toString of KeyValueGroupedDatase...

2017-09-27 Thread yaooqinn
Github user yaooqinn commented on a diff in the pull request: https://github.com/apache/spark/pull/19363#discussion_r141509523 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/KeyValueGroupedDataset.scala --- @@ -54,6 +55,14 @@ class KeyValueGroupedDataset[K, V]

[GitHub] spark issue #19374: [SPARK-22145][MESOS] fix supervise with checkpointing on...

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19374 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19374: [SPARK-22145][MESOS] fix supervise with checkpointing on...

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19374 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82255/ Test PASSed. ---

[GitHub] spark issue #19374: [SPARK-22145][MESOS] fix supervise with checkpointing on...

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19374 **[Test build #82255 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82255/testReport)** for PR 19374 at commit

[GitHub] spark issue #19374: [SPARK-22145][MESOS] fix supervise with checkpointing on...

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19374 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19374: [SPARK-22145][MESOS] fix supervise with checkpointing on...

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19374 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82254/ Test PASSed. ---

[GitHub] spark issue #19358: [SPARK-22135] [MESOS] metrics in spark-dispatcher not be...

2017-09-27 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/19358 LGTM. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19374: [SPARK-22145][MESOS] fix supervise with checkpointing on...

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19374 **[Test build #82254 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82254/testReport)** for PR 19374 at commit

[GitHub] spark pull request #19338: [SPARK-22123][CORE] Add latest failure reason for...

2017-09-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/19338 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #19375: [MINOR] Fixed up pandas_udf related docs and form...

2017-09-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/19375 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #19375: [MINOR] Fixed up pandas_udf related docs and formatting

2017-09-27 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19375 Merged to master. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19338: [SPARK-22123][CORE] Add latest failure reason for task s...

2017-09-27 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/19338 lGTM, merging to master. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19090: [SPARK-21877][DEPLOY, WINDOWS] Handle quotes in Windows ...

2017-09-27 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19090 @jsnowacki, would you mind if I ask double check this PR when you have some time? --- - To unsubscribe, e-mail:

[GitHub] spark issue #19370: [SPARK-18136] Fix setup of SPARK_HOME variable on Window...

2017-09-27 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19370 cc @holdenk, @felixcheung and @ueshin who I believe are interested in this. --- - To unsubscribe, e-mail:

[GitHub] spark pull request #19370: [SPARK-18136] Fix setup of SPARK_HOME variable on...

2017-09-27 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/19370#discussion_r141503492 --- Diff: bin/pyspark2.cmd --- @@ -18,7 +18,12 @@ rem limitations under the License. rem rem Figure out where the Spark framework is

[GitHub] spark issue #19370: [SPARK-18136] Fix setup of SPARK_HOME variable on Window...

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19370 **[Test build #82258 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82258/testReport)** for PR 19370 at commit

[GitHub] spark issue #19374: [SPARK-22145][MESOS] fix supervise with checkpointing on...

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19374 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82253/ Test FAILed. ---

[GitHub] spark issue #19374: [SPARK-22145][MESOS] fix supervise with checkpointing on...

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19374 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19374: [SPARK-22145][MESOS] fix supervise with checkpointing on...

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19374 **[Test build #82253 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82253/testReport)** for PR 19374 at commit

[GitHub] spark issue #19370: [SPARK-18136] Fix setup of SPARK_HOME variable on Window...

2017-09-27 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19370 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #19361: [SPARK-22140] Add TPCDSQuerySuite

2017-09-27 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/19361#discussion_r141501351 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/TPCDSQuerySuite.scala --- @@ -0,0 +1,348 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #19267: [WIP][SPARK-20628][CORE] Blacklist nodes when they trans...

2017-09-27 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/19267 @juanrh do you plan on working more on this before removing the "WIP"? Not sure what's your expectation here. People generally look over "WIP"s with so many other PRs to look at. ---

[GitHub] spark pull request #19362: [SPARK-22141][SQL] Propagate empty relation befor...

2017-09-27 Thread caneGuy
Github user caneGuy commented on a diff in the pull request: https://github.com/apache/spark/pull/19362#discussion_r141301509 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -136,6 +134,8 @@ abstract class

[GitHub] spark issue #19375: [MINOR] Fixed up pandas_udf related docs and formatting

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19375 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82257/ Test PASSed. ---

[GitHub] spark issue #19375: [MINOR] Fixed up pandas_udf related docs and formatting

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19375 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19375: [MINOR] Fixed up pandas_udf related docs and formatting

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19375 **[Test build #82257 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82257/testReport)** for PR 19375 at commit

[GitHub] spark pull request #19361: [SPARK-22140] Add TPCDSQuerySuite

2017-09-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/19361 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #19361: [SPARK-22140] Add TPCDSQuerySuite

2017-09-27 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/19361 Thanks! Merged to master/2.2 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #19375: [MINOR] Fixed up pandas_udf related docs and formatting

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19375 **[Test build #82257 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82257/testReport)** for PR 19375 at commit

[GitHub] spark issue #19375: [MINOR] Fixed up pandas_udf related docs and formatting

2017-09-27 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/19375 @HyukjinKwon @ueshin hopefully this is ok to do without a related JIRA, just some minor cleanup. Thanks! --- - To

[GitHub] spark pull request #19375: [MINOR] Fixed up pandas_udf related docs and form...

2017-09-27 Thread BryanCutler
GitHub user BryanCutler opened a pull request: https://github.com/apache/spark/pull/19375 [MINOR] Fixed up pandas_udf related docs and formatting ## What changes were proposed in this pull request? Fixed some minor issues with pandas_udf related docs and formatting.

[GitHub] spark issue #19374: [SPARK-22145][MESOS] fix supervise with checkpointing on...

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19374 **[Test build #82256 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82256/testReport)** for PR 19374 at commit

[GitHub] spark issue #19374: [SPARK-22145][MESOS] fix supervise with checkpointing on...

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19374 **[Test build #82255 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82255/testReport)** for PR 19374 at commit

[GitHub] spark issue #19374: [SPARK-22145][MESOS] fix supervise with checkpointing on...

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19374 **[Test build #82254 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82254/testReport)** for PR 19374 at commit

[GitHub] spark issue #19354: [SPARK-20992][Scheduler] Add links in documentation to N...

2017-09-27 Thread rcgenova
Github user rcgenova commented on the issue: https://github.com/apache/spark/pull/19354 We don't see much in the way of Kubernetes pull requests against Spark. Can you elaborate on exactly what you mean by "it's being integrated now"? ---

[GitHub] spark pull request #19194: [SPARK-20589] Allow limiting task concurrency per...

2017-09-27 Thread dhruve
Github user dhruve commented on a diff in the pull request: https://github.com/apache/spark/pull/19194#discussion_r141482741 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -512,6 +535,9 @@ private[spark] class TaskSetManager(

[GitHub] spark issue #19374: [SPARK-22145][MESOS] fix supervise with checkpointing on...

2017-09-27 Thread skonto
Github user skonto commented on the issue: https://github.com/apache/spark/pull/19374 @ArtRand @susanxhuynh pls review. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #19374: [SPARK-22145][MESOS] fix supervise with checkpointing on...

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19374 **[Test build #82253 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82253/testReport)** for PR 19374 at commit

[GitHub] spark issue #19194: [SPARK-20589] Allow limiting task concurrency per stage

2017-09-27 Thread dhruve
Github user dhruve commented on the issue: https://github.com/apache/spark/pull/19194 Configuring at the stage level seems to be the appropriate and more deterministic choice. If we agree on changing the API, we can start another effort looking in that direction. Till then we can

[GitHub] spark pull request #19374: [SPARK-22145][MESOS] fix supervise with checkpoin...

2017-09-27 Thread skonto
GitHub user skonto opened a pull request: https://github.com/apache/spark/pull/19374 [SPARK-22145][MESOS] fix supervise with checkpointing on mesos ## What changes were proposed in this pull request? - Fixes the issue with frameworkId being recovered by checkpointed data.

[GitHub] spark issue #19270: [SPARK-21809] : Change Stage Page to use datatables to s...

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19270 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82252/ Test PASSed. ---

[GitHub] spark issue #19270: [SPARK-21809] : Change Stage Page to use datatables to s...

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19270 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19270: [SPARK-21809] : Change Stage Page to use datatables to s...

2017-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19270 **[Test build #82252 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82252/testReport)** for PR 19270 at commit

[GitHub] spark issue #19359: [SPARK-22129][SPARK-22138] Release script improvements

2017-09-27 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19359 Looks fine to me, just few questions. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #19359: [SPARK-22129][SPARK-22138] Release script improve...

2017-09-27 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/19359#discussion_r141479571 --- Diff: dev/create-release/release-build.sh --- @@ -345,16 +345,14 @@ if [[ "$1" == "publish-snapshot" ]]; then # -DskipTests

[GitHub] spark issue #19373: [SPARK-22150][CORE] PeriodicCheckpointer fails in case o...

2017-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19373 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #19373: [SPARK-22150][CORE] PeriodicCheckpointer fails in...

2017-09-27 Thread szhem
GitHub user szhem opened a pull request: https://github.com/apache/spark/pull/19373 [SPARK-22150][CORE] PeriodicCheckpointer fails in case of dependant RDDs ## What changes were proposed in this pull request? Fix for

[GitHub] spark pull request #19359: [SPARK-22129][SPARK-22138] Release script improve...

2017-09-27 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/19359#discussion_r141477144 --- Diff: dev/create-release/release-build.sh --- @@ -74,7 +74,7 @@ GIT_REF=${GIT_REF:-master} # Destination directory parent on remote server

[GitHub] spark pull request #19194: [SPARK-20589] Allow limiting task concurrency per...

2017-09-27 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/19194#discussion_r141475205 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -512,6 +535,9 @@ private[spark] class TaskSetManager(

[GitHub] spark pull request #19368: [SPARK-22146] FileNotFoundException while reading...

2017-09-27 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/19368#discussion_r141470912 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/MetastoreDataSourcesSuite.scala --- @@ -1345,6 +1344,17 @@ class MetastoreDataSourcesSuite

[GitHub] spark issue #19194: [SPARK-20589] Allow limiting task concurrency per stage

2017-09-27 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/19194 btw I'm not opposed to this feature, just want to make sure that given (a) complexity and (b) the fact that it doesn't quite meet the original ask anyway (configuring at the stage & no need to break

[GitHub] spark pull request #19367: [SPARK-22143][SQL] Fix memory leak in OffHeapColu...

2017-09-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/19367 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

  1   2   3   4   >