[GitHub] spark issue #19776: [SPARK-22548][SQL] Incorrect nested AND expression pushe...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19776 **[Test build #84018 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84018/testReport)** for PR 19776 at commit

[GitHub] spark issue #19780: [SPARK-22551][SQL][WIP] Prevent possible 64kb compile er...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19780 **[Test build #84000 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84000/testReport)** for PR 19780 at commit

[GitHub] spark issue #19390: [SPARK-18935][MESOS] Fix dynamic reservations on mesos

2017-11-19 Thread skonto
Github user skonto commented on the issue: https://github.com/apache/spark/pull/19390 @susanxhuynh @ArtRand. In order to deal with stripping allocation info for non multi-role schedulers: https://www.mail-archive.com/dev@mesos.apache.org/msg38329.html I suggest to go with

[GitHub] spark pull request #19370: [SPARK-22495] Fix setup of SPARK_HOME variable on...

2017-11-19 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/19370#discussion_r151865048 --- Diff: bin/find-spark-home.cmd --- @@ -0,0 +1,49 @@ +@echo off + +rem +rem Licensed to the Apache Software Foundation (ASF) under one

[GitHub] spark issue #19630: [SPARK-22409] Introduce function type argument in pandas...

2017-11-19 Thread icexelloss
Github user icexelloss commented on the issue: https://github.com/apache/spark/pull/19630 Thanks @HyukjinKwon! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19780: [SPARK-22551][SQL][WIP] Prevent possible 64kb compile er...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19780 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84000/ Test PASSed. ---

[GitHub] spark issue #19780: [SPARK-22551][SQL][WIP] Prevent possible 64kb compile er...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19780 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #19370: [SPARK-22495] Fix setup of SPARK_HOME variable on...

2017-11-19 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/19370#discussion_r151864995 --- Diff: bin/find-spark-home.cmd --- @@ -0,0 +1,49 @@ +@echo off + +rem +rem Licensed to the Apache Software Foundation (ASF) under one

[GitHub] spark pull request #19683: [SPARK-21657][SQL] optimize explode quadratic mem...

2017-11-19 Thread uzadude
Github user uzadude commented on a diff in the pull request: https://github.com/apache/spark/pull/19683#discussion_r151868042 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/GenerateExec.scala --- @@ -59,15 +61,23 @@ case class GenerateExec( generator:

[GitHub] spark issue #19683: [SPARK-21657][SQL] optimize explode quadratic memory con...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19683 **[Test build #84001 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84001/testReport)** for PR 19683 at commit

[GitHub] spark issue #19388: [SPARK-22162] Executors and the driver should use consis...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19388 **[Test build #84002 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84002/testReport)** for PR 19388 at commit

[GitHub] spark pull request #19370: [SPARK-22495] Fix setup of SPARK_HOME variable on...

2017-11-19 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/19370#discussion_r151880938 --- Diff: bin/find-spark-home.cmd --- @@ -0,0 +1,49 @@ +@echo off + +rem +rem Licensed to the Apache Software Foundation (ASF) under one

[GitHub] spark issue #19683: [SPARK-21657][SQL] optimize explode quadratic memory con...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19683 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84001/ Test PASSed. ---

[GitHub] spark issue #19683: [SPARK-21657][SQL] optimize explode quadratic memory con...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19683 **[Test build #84001 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84001/testReport)** for PR 19683 at commit

[GitHub] spark issue #19357: [SPARK-21322][SQL][WIP] support histogram in filter card...

2017-11-19 Thread ron8hu
Github user ron8hu commented on the issue: https://github.com/apache/spark/pull/19357 This pull request was created while there were several dependencies that had not been defined yet. As a result, it has caused many conflicts. I decided to close this pull request and start a clean

[GitHub] spark pull request #19370: [SPARK-22495] Fix setup of SPARK_HOME variable on...

2017-11-19 Thread jsnowacki
Github user jsnowacki commented on a diff in the pull request: https://github.com/apache/spark/pull/19370#discussion_r151876330 --- Diff: bin/find-spark-home.cmd --- @@ -0,0 +1,49 @@ +@echo off + +rem +rem Licensed to the Apache Software Foundation (ASF) under one

[GitHub] spark issue #19388: [SPARK-22162] Executors and the driver should use consis...

2017-11-19 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/19388 Retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #19783: support histogram in filter cardinality estimatio...

2017-11-19 Thread ron8hu
GitHub user ron8hu opened a pull request: https://github.com/apache/spark/pull/19783 support histogram in filter cardinality estimation ## What changes were proposed in this pull request? Histogram is effective in dealing with skewed distribution. After we generate

[GitHub] spark pull request #19357: [SPARK-21322][SQL][WIP] support histogram in filt...

2017-11-19 Thread ron8hu
Github user ron8hu closed the pull request at: https://github.com/apache/spark/pull/19357 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #19370: [SPARK-22495] Fix setup of SPARK_HOME variable on Window...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19370 **[Test build #84004 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84004/testReport)** for PR 19370 at commit

[GitHub] spark issue #19783: [SPARK-21322][SQL] support histogram in filter cardinali...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19783 **[Test build #84003 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84003/testReport)** for PR 19783 at commit

[GitHub] spark issue #19783: [SPARK-21322][SQL] support histogram in filter cardinali...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19783 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19783: [SPARK-21322][SQL] support histogram in filter cardinali...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19783 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84003/ Test PASSed. ---

[GitHub] spark issue #19683: [SPARK-21657][SQL] optimize explode quadratic memory con...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19683 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19783: [SPARK-21322][SQL] support histogram in filter cardinali...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19783 **[Test build #84003 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84003/testReport)** for PR 19783 at commit

[GitHub] spark issue #19388: [SPARK-22162] Executors and the driver should use consis...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19388 **[Test build #84002 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84002/testReport)** for PR 19388 at commit

[GitHub] spark issue #19388: [SPARK-22162] Executors and the driver should use consis...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19388 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19388: [SPARK-22162] Executors and the driver should use consis...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19388 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84002/ Test FAILed. ---

[GitHub] spark issue #19782: [SPARK-22554][PYTHON] Add a config to control if PySpark...

2017-11-19 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/19782 Looks like a fair config as we seems don't have a way to disable daemon usage. --- - To unsubscribe, e-mail:

[GitHub] spark pull request #19390: [SPARK-18935][MESOS] Fix dynamic reservations on ...

2017-11-19 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/19390#discussion_r151862273 --- Diff: resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala --- @@ -228,24 +254,15 @@ trait

[GitHub] spark issue #19782: [SPARK-22554][PYTHON] Add a config to control if PySpark...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19782 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83993/ Test FAILed. ---

[GitHub] spark issue #19782: [SPARK-22554][PYTHON] Add a config to control if PySpark...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19782 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19782: [SPARK-22554][PYTHON] Add a config to control if PySpark...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19782 **[Test build #83993 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83993/testReport)** for PR 19782 at commit

[GitHub] spark issue #19782: [SPARK-22554][PYTHON] Add a config to control if PySpark...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19782 **[Test build #83999 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83999/testReport)** for PR 19782 at commit

[GitHub] spark issue #19767: [SPARK-22543][SQL] fix java 64kb compile error for deepl...

2017-11-19 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/19767 Would it be better to replace `"SPARK-"` in test case for (#15620 #18972 #18641) with this JIRA number? --- - To unsubscribe,

[GitHub] spark issue #19780: [SPARK-22551][SQL][WIP] Prevent possible 64kb compile er...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19780 **[Test build #84000 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84000/testReport)** for PR 19780 at commit

[GitHub] spark issue #19780: [SPARK-22551][SQL][WIP] Prevent possible 64kb compile er...

2017-11-19 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/19780 cc @cloud-fan @kiszk --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19780: [SPARK-22551][SQL][WIP] Prevent possible 64kb compile er...

2017-11-19 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/19780 Can you add a test case? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19782: [SPARK-22554][PYTHON] Add a config to control if PySpark...

2017-11-19 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/19782 retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19780: [SPARK-22551][SQL][WIP] Prevent possible 64kb compile er...

2017-11-19 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/19780 @kiszk I added a test. But I think after #19767 is merged, the generated codes will be changed too. I may need to adjust the test case after that. ---

[GitHub] spark issue #19782: [SPARK-22554][PYTHON] Add a config to control if PySpark...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19782 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19782: [SPARK-22554][PYTHON] Add a config to control if PySpark...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19782 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83999/ Test PASSed. ---

[GitHub] spark issue #19782: [SPARK-22554][PYTHON] Add a config to control if PySpark...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19782 **[Test build #83999 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83999/testReport)** for PR 19782 at commit

[GitHub] spark issue #19782: [SPARK-22554][PYTHON] Add a config to control if PySpark...

2017-11-19 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19782 Thank you @viirya and @ueshin. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark pull request #19763: [SPARK-22537][core] Aggregation of map output sta...

2017-11-19 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/19763#discussion_r151901370 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -485,4 +485,13 @@ package object config { "array in the

[GitHub] spark pull request #19779: [SPARK-17920][SPARK-19580][SPARK-19878][SQL] Supp...

2017-11-19 Thread vinodkc
Github user vinodkc commented on a diff in the pull request: https://github.com/apache/spark/pull/19779#discussion_r151902033 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveFileFormat.scala --- @@ -89,6 +90,8 @@ class HiveFileFormat(fileSinkConf:

[GitHub] spark issue #19776: [SPARK-22548][SQL] Incorrect nested AND expression pushe...

2017-11-19 Thread jliwork
Github user jliwork commented on the issue: https://github.com/apache/spark/pull/19776 @viirya I'm fine with backport to 2.2 unless anyone objects. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

[GitHub] spark issue #19779: [SPARK-17920][SPARK-19580][SPARK-19878][SQL] Support wri...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19779 **[Test build #84011 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84011/testReport)** for PR 19779 at commit

[GitHub] spark issue #19776: [SPARK-22548][SQL] Incorrect nested AND expression pushe...

2017-11-19 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/19776 @jliwork Let's see what @cloud-fan @felixcheung think about it. --- - To unsubscribe, e-mail:

[GitHub] spark issue #19780: [SPARK-22551][SQL] Prevent possible 64kb compile error f...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19780 **[Test build #84008 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84008/testReport)** for PR 19780 at commit

[GitHub] spark issue #19780: [SPARK-22551][SQL] Prevent possible 64kb compile error f...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19780 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19741: [SPARK-14228][CORE][YARN] Lost executor of RPC disassoci...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19741 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19741: [SPARK-14228][CORE][YARN] Lost executor of RPC disassoci...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19741 **[Test build #84007 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84007/testReport)** for PR 19741 at commit

[GitHub] spark issue #19741: [SPARK-14228][CORE][YARN] Lost executor of RPC disassoci...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19741 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84007/ Test PASSed. ---

[GitHub] spark pull request #19769: [SPARK-12297][SQL] Adjust timezone for int96 data...

2017-11-19 Thread ueshin
Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/19769#discussion_r151909614 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/VectorizedColumnReader.java --- @@ -298,7 +304,10 @@ private void

[GitHub] spark issue #19750: [SPARK-20650][core] Remove JobProgressListener.

2017-11-19 Thread gengliangwang
Github user gengliangwang commented on the issue: https://github.com/apache/spark/pull/19750 lgtm --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19776: [SPARK-22548][SQL] Incorrect nested AND expression pushe...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19776 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84010/ Test PASSed. ---

[GitHub] spark issue #19776: [SPARK-22548][SQL] Incorrect nested AND expression pushe...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19776 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #19786: [SPARK-22559][CORE]history server: handle excepti...

2017-11-19 Thread gengliangwang
GitHub user gengliangwang opened a pull request: https://github.com/apache/spark/pull/19786 [SPARK-22559][CORE]history server: handle exception on opening corrupted listing.ldb ## What changes were proposed in this pull request? Currently history server v2 failed to start if

[GitHub] spark issue #19776: [SPARK-22548][SQL] Incorrect nested AND expression pushe...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19776 **[Test build #84017 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84017/testReport)** for PR 19776 at commit

[GitHub] spark pull request #19784: [SPARK-22557][TESTS] Use ThreadSignaler explicitl...

2017-11-19 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/19784 [SPARK-22557][TESTS] Use ThreadSignaler explicitly ## What changes were proposed in this pull request? ScalaTest 3.0 uses an implicit `Signaler`. This PR makes it sure all Spark

[GitHub] spark issue #19388: [SPARK-22162] Executors and the driver should use consis...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19388 **[Test build #84006 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84006/testReport)** for PR 19388 at commit

[GitHub] spark pull request #19774: [SPARK-22475][SQL] show histogram in DESC COLUMN ...

2017-11-19 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/19774#discussion_r151892351 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -689,6 +689,11 @@ case class DescribeColumnCommand(

[GitHub] spark issue #19388: [SPARK-22162] Executors and the driver should use consis...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19388 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84006/ Test FAILed. ---

[GitHub] spark issue #19388: [SPARK-22162] Executors and the driver should use consis...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19388 **[Test build #84006 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84006/testReport)** for PR 19388 at commit

[GitHub] spark issue #19388: [SPARK-22162] Executors and the driver should use consis...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19388 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19782: [SPARK-22554][PYTHON] Add a config to control if PySpark...

2017-11-19 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19782 Merged to master. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #19784: [SPARK-22557][TEST] Use ThreadSignaler explicitly

2017-11-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/19784 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #19776: [SPARK-22548][SQL] Incorrect nested AND expression pushe...

2017-11-19 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/19776 This affects correctness, should we also backport to 2.2? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark pull request #19782: [SPARK-22554][PYTHON] Add a config to control if ...

2017-11-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/19782 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #19773: [SPARK-22546][SQL] Supporting for changing column dataTy...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19773 **[Test build #84012 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84012/testReport)** for PR 19773 at commit

[GitHub] spark issue #19607: [WIP][SPARK-22395][SQL][PYTHON] Fix the behavior of time...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19607 **[Test build #84013 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84013/testReport)** for PR 19607 at commit

[GitHub] spark issue #19780: [SPARK-22551][SQL] Prevent possible 64kb compile error f...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19780 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84008/ Test PASSed. ---

[GitHub] spark issue #19785: [MINOR][doc] The left navigation bar should be fixed wit...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19785 **[Test build #84014 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84014/testReport)** for PR 19785 at commit

[GitHub] spark pull request #19785: [MINOR][doc] The left navigation bar should be fi...

2017-11-19 Thread ScrapCodes
GitHub user ScrapCodes opened a pull request: https://github.com/apache/spark/pull/19785 [MINOR][doc] The left navigation bar should be fixed with respect to scrolling. ## What changes were proposed in this pull request? A minor CSS style change to make Left navigation bar

[GitHub] spark issue #19780: [SPARK-22551][SQL] Prevent possible 64kb compile error f...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19780 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19780: [SPARK-22551][SQL] Prevent possible 64kb compile error f...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19780 **[Test build #84009 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84009/testReport)** for PR 19780 at commit

[GitHub] spark pull request #19769: [SPARK-12297][SQL] Adjust timezone for int96 data...

2017-11-19 Thread ueshin
Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/19769#discussion_r151908974 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetInteroperabilitySuite.scala --- @@ -87,4 +95,109 @@ class

[GitHub] spark issue #19780: [SPARK-22551][SQL] Prevent possible 64kb compile error f...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19780 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84009/ Test PASSed. ---

[GitHub] spark issue #19779: [SPARK-17920][SPARK-19580][SPARK-19878][SQL] Support wri...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19779 **[Test build #84011 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84011/testReport)** for PR 19779 at commit

[GitHub] spark issue #19773: [SPARK-22546][SQL] Supporting for changing column dataTy...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19773 **[Test build #84012 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84012/testReport)** for PR 19773 at commit

[GitHub] spark issue #10572: SPARK-12619 Combine small files in a hadoop directory in...

2017-11-19 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/10572 @HyukjinKwon To merge small files, should I tune `spark.sql.files.maxPartitionBytes`? But IIUC it only works for `FileSourceScanExec`. So when I select from hive table, it doesn't work.

[GitHub] spark issue #19776: [SPARK-22548][SQL] Incorrect nested AND expression pushe...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19776 **[Test build #84010 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84010/testReport)** for PR 19776 at commit

[GitHub] spark issue #19786: [SPARK-22559][CORE]history server: handle exception on o...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19786 **[Test build #84015 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84015/testReport)** for PR 19786 at commit

[GitHub] spark pull request #19787: [SPARK-22541][SQL] Explicitly claim that Python u...

2017-11-19 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/19787 [SPARK-22541][SQL] Explicitly claim that Python udfs can't be conditional executed with short-curcuit evaluation ## What changes were proposed in this pull request? Besides conditional

[GitHub] spark issue #19787: [SPARK-22541][SQL] Explicitly claim that Python udfs can...

2017-11-19 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/19787 cc @HyukjinKwon @cloud-fan --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19787: [SPARK-22541][SQL] Explicitly claim that Python udfs can...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19787 **[Test build #84016 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84016/testReport)** for PR 19787 at commit

[GitHub] spark pull request #19788: [SPARK-9853][Core] Optimize shuffle fetch of cont...

2017-11-19 Thread yucai
GitHub user yucai opened a pull request: https://github.com/apache/spark/pull/19788 [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs ## What changes were proposed in this pull request? Optimize shuffle fetch of contiguous partition IDs ## How

[GitHub] spark issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous ...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19788 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #19776: [SPARK-22548][SQL] Incorrect nested AND expressio...

2017-11-19 Thread jliwork
Github user jliwork commented on a diff in the pull request: https://github.com/apache/spark/pull/19776#discussion_r151920126 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceStrategy.scala --- @@ -497,7 +497,11 @@ object DataSourceStrategy {

[GitHub] spark pull request #19776: [SPARK-22548][SQL] Incorrect nested AND expressio...

2017-11-19 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/19776#discussion_r151920212 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceStrategy.scala --- @@ -497,7 +497,11 @@ object DataSourceStrategy {

[GitHub] spark pull request #19776: [SPARK-22548][SQL] Incorrect nested AND expressio...

2017-11-19 Thread jliwork
Github user jliwork commented on a diff in the pull request: https://github.com/apache/spark/pull/19776#discussion_r151901160 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceStrategy.scala --- @@ -497,7 +497,10 @@ object DataSourceStrategy {

[GitHub] spark issue #19607: [WIP][SPARK-22395][SQL][PYTHON] Fix the behavior of time...

2017-11-19 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19607 Seems there is no explicit objection for dropping it. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #19784: [SPARK-22557][TEST] Use ThreadSignaler explicitly

2017-11-19 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/19784 Oh, thank you so much, @HyukjinKwon , @srowen , and @jiangxb1987 . Yes. This will make our build more stable. --- - To

[GitHub] spark issue #19785: [MINOR][doc] The left navigation bar should be fixed wit...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19785 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19785: [MINOR][doc] The left navigation bar should be fixed wit...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19785 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84014/ Test PASSed. ---

[GitHub] spark issue #19785: [MINOR][doc] The left navigation bar should be fixed wit...

2017-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19785 **[Test build #84014 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84014/testReport)** for PR 19785 at commit

[GitHub] spark issue #19779: [SPARK-17920][SPARK-19580][SPARK-19878][SQL] Support wri...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19779 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19779: [SPARK-17920][SPARK-19580][SPARK-19878][SQL] Support wri...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19779 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84011/ Test PASSed. ---

[GitHub] spark issue #19773: [SPARK-22546][SQL] Supporting for changing column dataTy...

2017-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19773 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

  1   2   >