[GitHub] spark issue #21289: [SPARK-24240] Add a config to control whether InMemoryFi...

2018-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21289 **[Test build #90447 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90447/testReport)** for PR 21289 at commit

[GitHub] spark pull request #21155: [SPARK-23927][SQL] Add "sequence" expression

2018-05-10 Thread wajda
Github user wajda commented on a diff in the pull request: https://github.com/apache/spark/pull/21155#discussion_r187277937 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -1468,3 +1472,388 @@ case class

[GitHub] spark pull request #21276: [SPARK-24216][SQL] Spark TypedAggregateExpression...

2018-05-10 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21276#discussion_r187282260 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -2715,6 +2715,66 @@ private[spark] object Utils extends Logging {

[GitHub] spark issue #21288: [SPARK-24206][SQL] Improve FilterPushdownBenchmark bench...

2018-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21288 **[Test build #90454 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90454/testReport)** for PR 21288 at commit

[GitHub] spark pull request #21155: [SPARK-23927][SQL] Add "sequence" expression

2018-05-10 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/21155#discussion_r187288741 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -1468,3 +1472,388 @@ case class

[GitHub] spark pull request #21291: [SPARK-24242][SQL] RangeExec should have correct ...

2018-05-10 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/21291 [SPARK-24242][SQL] RangeExec should have correct outputOrdering ## What changes were proposed in this pull request? Logical `Range` node has been added with `outputOrdering` recently. It's

[GitHub] spark issue #21276: [SPARK-24216][SQL] Spark TypedAggregateExpression uses g...

2018-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21276 **[Test build #90449 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90449/testReport)** for PR 21276 at commit

[GitHub] spark pull request #21267: [SPARK-21945][YARN][PYTHON] Make --py-files work ...

2018-05-10 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/21267#discussion_r187274278 --- Diff: python/pyspark/context.py --- @@ -211,9 +211,23 @@ def _do_init(self, master, appName, sparkHome, pyFiles, environment, batchSize,

[GitHub] spark pull request #21287: [SPARK-1849][Core]Add encoding customization supp...

2018-05-10 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/21287#discussion_r187275950 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -816,14 +816,25 @@ class SparkContext(config: SparkConf) extends Logging {

[GitHub] spark pull request #21155: [SPARK-23927][SQL] Add "sequence" expression

2018-05-10 Thread wajda
Github user wajda commented on a diff in the pull request: https://github.com/apache/spark/pull/21155#discussion_r187280683 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -1468,3 +1472,388 @@ case class

[GitHub] spark pull request #21282: [SPARK-23934][SQL] Adding map_from_entries functi...

2018-05-10 Thread mn-mikke
Github user mn-mikke commented on a diff in the pull request: https://github.com/apache/spark/pull/21282#discussion_r187282249 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -118,6 +120,229 @@ case class

[GitHub] spark issue #21288: [SPARK-24206][SQL] Improve FilterPushdownBenchmark bench...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21288 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3102/

[GitHub] spark issue #21288: [SPARK-24206][SQL] Improve FilterPushdownBenchmark bench...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21288 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21291: [SPARK-24242][SQL] RangeExec should have correct outputO...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21291 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21291: [SPARK-24242][SQL] RangeExec should have correct outputO...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21291 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3103/

[GitHub] spark issue #21247: [SPARK-24190] Separating JSONOptions for read

2018-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21247 **[Test build #90448 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90448/testReport)** for PR 21247 at commit

[GitHub] spark issue #21247: [SPARK-24190] Separating JSONOptions for read

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21247 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21247: [SPARK-24190] Separating JSONOptions for read

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21247 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90448/ Test FAILed. ---

[GitHub] spark issue #16677: [SPARK-19355][SQL] Use map output statistics to improve ...

2018-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16677 **[Test build #90452 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90452/testReport)** for PR 16677 at commit

[GitHub] spark issue #16677: [SPARK-19355][SQL] Use map output statistics to improve ...

2018-05-10 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16677 @hvanhovell @cloud-fan Will we consider to include this feature? --- - To unsubscribe, e-mail:

[GitHub] spark issue #21290: [SPARK-24241][Submit]Do not fail fast when dynamic resou...

2018-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21290 **[Test build #90450 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90450/testReport)** for PR 21290 at commit

[GitHub] spark issue #21276: [SPARK-24216][SQL] Spark TypedAggregateExpression uses g...

2018-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21276 **[Test build #90451 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90451/testReport)** for PR 21276 at commit

[GitHub] spark pull request #21276: [SPARK-24216][SQL] Spark TypedAggregateExpression...

2018-05-10 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21276#discussion_r187278875 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -2715,6 +2715,66 @@ private[spark] object Utils extends Logging {

[GitHub] spark issue #21290: [SPARK-24241][Submit]Do not fail fast when dynamic resou...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21290 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21290: [SPARK-24241][Submit]Do not fail fast when dynamic resou...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21290 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3100/

[GitHub] spark issue #21291: [SPARK-24242][SQL] RangeExec should have correct outputO...

2018-05-10 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/21291 cc @cloud-fan @kiszk --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21054: [SPARK-23907][SQL] Add regr_* functions

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21054 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90443/ Test PASSed. ---

[GitHub] spark issue #21054: [SPARK-23907][SQL] Add regr_* functions

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21054 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #21287: [SPARK-1849][Core]Add encoding customization supp...

2018-05-10 Thread cqzlxl
Github user cqzlxl commented on a diff in the pull request: https://github.com/apache/spark/pull/21287#discussion_r187274648 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -816,14 +816,25 @@ class SparkContext(config: SparkConf) extends Logging {

[GitHub] spark pull request #21290: [SPARK-24241][Submit]Do not fail fast when dynami...

2018-05-10 Thread yaooqinn
GitHub user yaooqinn opened a pull request: https://github.com/apache/spark/pull/21290 [SPARK-24241][Submit]Do not fail fast when dynamic resource allocation enabled with 0 executor ## What changes were proposed in this pull request? ``` ~/spark-2.3.0-bin-hadoop2.7$

[GitHub] spark pull request #21282: [SPARK-23934][SQL] Adding map_from_entries functi...

2018-05-10 Thread adrian-wang
Github user adrian-wang commented on a diff in the pull request: https://github.com/apache/spark/pull/21282#discussion_r187291692 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -118,6 +120,229 @@ case class

[GitHub] spark pull request #21028: [SPARK-23922][SQL] Add arrays_overlap function

2018-05-10 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/21028#discussion_r187294411 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -529,6 +564,272 @@ case class

[GitHub] spark issue #21291: [SPARK-24242][SQL] RangeExec should have correct outputO...

2018-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21291 **[Test build #90455 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90455/testReport)** for PR 21291 at commit

[GitHub] spark issue #21054: [SPARK-23907][SQL] Add regr_* functions

2018-05-10 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/21054 Thanks! merging to master. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #21276: [SPARK-24216][SQL] Spark TypedAggregateExpression...

2018-05-10 Thread fangshil
Github user fangshil commented on a diff in the pull request: https://github.com/apache/spark/pull/21276#discussion_r187271712 --- Diff: core/src/test/scala/org/apache/spark/util/UtilsSuite.scala --- @@ -1168,6 +1168,32 @@ class UtilsSuite extends SparkFunSuite with

[GitHub] spark pull request #21267: [SPARK-21945][YARN][PYTHON] Make --py-files work ...

2018-05-10 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/21267#discussion_r187274825 --- Diff: python/pyspark/context.py --- @@ -211,9 +211,23 @@ def _do_init(self, master, appName, sparkHome, pyFiles, environment, batchSize,

[GitHub] spark issue #21276: [SPARK-24216][SQL] Spark TypedAggregateExpression uses g...

2018-05-10 Thread fangshil
Github user fangshil commented on the issue: https://github.com/apache/spark/pull/21276 >> Do we have other places in Spark calling getSimpleName which also need this change? there are a few other places that may have similar issue. will update together ---

[GitHub] spark issue #16677: [SPARK-19355][SQL] Use map output statistics to improve ...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16677 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3101/

[GitHub] spark issue #16677: [SPARK-19355][SQL] Use map output statistics to improve ...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16677 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #21276: [SPARK-24216][SQL] Spark TypedAggregateExpression...

2018-05-10 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21276#discussion_r187279829 --- Diff: core/src/test/scala/org/apache/spark/util/UtilsSuite.scala --- @@ -1168,6 +1168,35 @@ class UtilsSuite extends SparkFunSuite with

[GitHub] spark issue #21280: [SPARK-19181][Core] Fixing flaky "SparkListenerSuite.loc...

2018-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21280 **[Test build #90453 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90453/testReport)** for PR 21280 at commit

[GitHub] spark issue #21288: [SPARK-24206][SQL] Improve FilterPushdownBenchmark bench...

2018-05-10 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/21288 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #21155: [SPARK-23927][SQL] Add "sequence" expression

2018-05-10 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/21155#discussion_r187289346 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -1468,3 +1472,388 @@ case class

[GitHub] spark issue #21054: [SPARK-23907][SQL] Add regr_* functions

2018-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21054 **[Test build #90443 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90443/testReport)** for PR 21054 at commit

[GitHub] spark issue #21289: [SPARK-24240] Add a config to control whether InMemoryFi...

2018-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21289 **[Test build #90447 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90447/testReport)** for PR 21289 at commit

[GitHub] spark issue #21276: [SPARK-24216][SQL] Spark TypedAggregateExpression uses g...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21276 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90445/ Test PASSed. ---

[GitHub] spark issue #21155: [SPARK-23927][SQL] Add "sequence" expression

2018-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21155 **[Test build #90456 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90456/testReport)** for PR 21155 at commit

[GitHub] spark issue #21292: [SPARK-24068][BACKPORT-2.3] Propagating DataFrameReader'...

2018-05-10 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/21292 add to whitelist --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21292: [SPARK-24068][BACKPORT-2.3] Propagating DataFrameReader'...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21292 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21182: [SPARK-24068] Propagating DataFrameReader's options to T...

2018-05-10 Thread MaxGekk
Github user MaxGekk commented on the issue: https://github.com/apache/spark/pull/21182 Here is the backport to 2.3: https://github.com/apache/spark/pull/21292 --- - To unsubscribe, e-mail:

[GitHub] spark issue #21280: [SPARK-19181][Core] Fixing flaky "SparkListenerSuite.loc...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21280 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90453/ Test PASSed. ---

[GitHub] spark issue #21280: [SPARK-19181][Core] Fixing flaky "SparkListenerSuite.loc...

2018-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21280 **[Test build #90453 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90453/testReport)** for PR 21280 at commit

[GitHub] spark pull request #21054: [SPARK-23907][SQL] Add regr_* functions

2018-05-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/21054 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #21276: [SPARK-24216][SQL] Spark TypedAggregateExpression uses g...

2018-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21276 **[Test build #90445 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90445/testReport)** for PR 21276 at commit

[GitHub] spark issue #21276: [SPARK-24216][SQL] Spark TypedAggregateExpression uses g...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21276 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21276: [SPARK-24216][SQL] Spark TypedAggregateExpression uses g...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21276 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90446/ Test PASSed. ---

[GitHub] spark issue #16677: [SPARK-19355][SQL] Use map output statistics to improve ...

2018-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16677 **[Test build #90452 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90452/testReport)** for PR 16677 at commit

[GitHub] spark pull request #21292: [SPARK-24068][BACKPORT-2.3] Propagating DataFrame...

2018-05-10 Thread MaxGekk
GitHub user MaxGekk opened a pull request: https://github.com/apache/spark/pull/21292 [SPARK-24068][BACKPORT-2.3] Propagating DataFrameReader's options to Text datasource on schema inferring ## What changes were proposed in this pull request? While reading CSV or JSON

[GitHub] spark issue #21276: [SPARK-24216][SQL] Spark TypedAggregateExpression uses g...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21276 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90451/ Test PASSed. ---

[GitHub] spark issue #21276: [SPARK-24216][SQL] Spark TypedAggregateExpression uses g...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21276 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21290: [SPARK-24241][Submit]Do not fail fast when dynamic resou...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21290 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21289: [SPARK-24240] Add a config to control whether InMemoryFi...

2018-05-10 Thread adrian-ionescu
Github user adrian-ionescu commented on the issue: https://github.com/apache/spark/pull/21289 I just took a quick look... Do I understand correctly that your flag basically controls whether the refresh is eager (`true`, current behavior) vs lazy (`false`)? If so, let's rename the

[GitHub] spark issue #21108: [SPARK-24027][SQL] Support MapType with StringType for k...

2018-05-10 Thread MaxGekk
Github user MaxGekk commented on the issue: https://github.com/apache/spark/pull/21108 @marmbrus May I ask you to look at the PR. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21291: [SPARK-24242][SQL] RangeExec should have correct outputO...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21291 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21291: [SPARK-24242][SQL] RangeExec should have correct outputO...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21291 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90455/ Test PASSed. ---

[GitHub] spark pull request #21155: [SPARK-23927][SQL] Add "sequence" expression

2018-05-10 Thread wajda
Github user wajda commented on a diff in the pull request: https://github.com/apache/spark/pull/21155#discussion_r187309647 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -1468,3 +1472,388 @@ case class

[GitHub] spark issue #21292: [SPARK-24068][BACKPORT-2.3] Propagating DataFrameReader'...

2018-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21292 **[Test build #90458 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90458/testReport)** for PR 21292 at commit

[GitHub] spark issue #21288: [SPARK-24206][SQL] Improve FilterPushdownBenchmark bench...

2018-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21288 **[Test build #90454 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90454/testReport)** for PR 21288 at commit

[GitHub] spark issue #21280: [SPARK-19181][Core] Fixing flaky "SparkListenerSuite.loc...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21280 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21290: [SPARK-24241][Submit]Do not fail fast when dynamic resou...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21290 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90450/ Test FAILed. ---

[GitHub] spark issue #21289: [SPARK-24240] Add a config to control whether InMemoryFi...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21289 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90447/ Test PASSed. ---

[GitHub] spark issue #21289: [SPARK-24240] Add a config to control whether InMemoryFi...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21289 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21276: [SPARK-24216][SQL] Spark TypedAggregateExpression uses g...

2018-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21276 **[Test build #90449 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90449/testReport)** for PR 21276 at commit

[GitHub] spark issue #21276: [SPARK-24216][SQL] Spark TypedAggregateExpression uses g...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21276 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90449/ Test PASSed. ---

[GitHub] spark issue #21276: [SPARK-24216][SQL] Spark TypedAggregateExpression uses g...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21276 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21276: [SPARK-24216][SQL] Spark TypedAggregateExpression uses g...

2018-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21276 **[Test build #90446 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90446/testReport)** for PR 21276 at commit

[GitHub] spark issue #21276: [SPARK-24216][SQL] Spark TypedAggregateExpression uses g...

2018-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21276 **[Test build #90451 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90451/testReport)** for PR 21276 at commit

[GitHub] spark issue #21276: [SPARK-24216][SQL] Spark TypedAggregateExpression uses g...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21276 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21247: [SPARK-24190] Separating JSONOptions for read

2018-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21247 **[Test build #90457 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90457/testReport)** for PR 21247 at commit

[GitHub] spark issue #16677: [SPARK-19355][SQL] Use map output statistics to improve ...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16677 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90452/ Test FAILed. ---

[GitHub] spark issue #16677: [SPARK-19355][SQL] Use map output statistics to improve ...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16677 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21288: [SPARK-24206][SQL] Improve FilterPushdownBenchmark bench...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21288 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21288: [SPARK-24206][SQL] Improve FilterPushdownBenchmark bench...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21288 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90454/ Test PASSed. ---

[GitHub] spark issue #21282: [SPARK-23934][SQL] Adding map_from_entries function

2018-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21282 **[Test build #90459 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90459/testReport)** for PR 21282 at commit

[GitHub] spark issue #21290: [SPARK-24241][Submit]Do not fail fast when dynamic resou...

2018-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21290 **[Test build #90450 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90450/testReport)** for PR 21290 at commit

[GitHub] spark issue #21291: [SPARK-24242][SQL] RangeExec should have correct outputO...

2018-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21291 **[Test build #90455 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90455/testReport)** for PR 21291 at commit

[GitHub] spark issue #21054: [SPARK-23907][SQL] Add regr_* functions

2018-05-10 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/21054 Jenkins, retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21054: [SPARK-23907][SQL] Add regr_* functions

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21054 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3097/

[GitHub] spark issue #21054: [SPARK-23907][SQL] Add regr_* functions

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21054 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21279: [SPARK-24219][k8s] Improve the docker building script to...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21279 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21279: [SPARK-24219][k8s] Improve the docker building script to...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21279 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90435/ Test PASSed. ---

[GitHub] spark issue #21054: [SPARK-23907][SQL] Add regr_* functions

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21054 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3098/

[GitHub] spark issue #21276: [SPARK-24216][SQL] Spark TypedAggregateExpression uses g...

2018-05-10 Thread fangshil
Github user fangshil commented on the issue: https://github.com/apache/spark/pull/21276 updating --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21054: [SPARK-23907][SQL] Add regr_* functions

2018-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21054 **[Test build #90443 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90443/testReport)** for PR 21054 at commit

[GitHub] spark issue #21273: [SPARK-17916][SQL] Fix empty string being parsed as null...

2018-05-10 Thread MaxGekk
Github user MaxGekk commented on the issue: https://github.com/apache/spark/pull/21273 @HyukjinKwon @maropu Please, have a look at the PR. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark pull request #21267: [SPARK-21945][YARN][PYTHON] Make --py-files work ...

2018-05-10 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/21267#discussion_r187264822 --- Diff: python/pyspark/context.py --- @@ -211,9 +211,23 @@ def _do_init(self, master, appName, sparkHome, pyFiles, environment, batchSize,

[GitHub] spark issue #21289: [SPARK-24240] Add a config to control whether InMemoryFi...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21289 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3099/

[GitHub] spark issue #21289: [SPARK-24240] Add a config to control whether InMemoryFi...

2018-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21289 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21247: [SPARK-24190] Separating JSONOptions for read

2018-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21247 **[Test build #90448 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90448/testReport)** for PR 21247 at commit

[GitHub] spark issue #21054: [SPARK-23907][SQL] Add regr_* functions

2018-05-10 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/21054 LGTM, but I'd retrigger the build because it's been some time since the last build. --- - To unsubscribe, e-mail:

  1   2   3   4   5   >