[GitHub] spark pull request #20797: [SPARK-23583][SQL] Invoke should support interpre...

2018-04-03 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/20797#discussion_r178756215 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -263,11 +295,21 @@ case class Invoke(

[GitHub] spark pull request #20858: [SPARK-23736][SQL] Extending the concat function ...

2018-04-03 Thread mn-mikke
Github user mn-mikke commented on a diff in the pull request: https://github.com/apache/spark/pull/20858#discussion_r178759909 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala --- @@ -3046,6 +3036,16 @@ object functions { ArrayContains(column.expr,

[GitHub] spark issue #20821: [SPARK-23678][GraphX] a more efficient partition strateg...

2018-04-03 Thread sujithjay
Github user sujithjay commented on the issue: https://github.com/apache/spark/pull/20821 Hi @weiwee , I have a few questions about this contribution: 1. What are the use cases for which this partitioning strategy is more suitable, compared to the existing strategies? 2. You

[GitHub] spark issue #20966: [SPARK-23854] Update Guava to 16.0.1

2018-04-03 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/20966 @Fokko upgrading guava has been notoriously hard to do, it is used in a lot Spark's dependencies and the guava developers aggressively remove deprecated APIs; updating can easily break stuff

[GitHub] spark issue #20966: [SPARK-23854] Update Guava to 16.0.1

2018-04-03 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/20966 Agree, this is the problem. If there is no actual improvement or fix in the upgrade here, no value in doing this. --- - To

[GitHub] spark issue #20960: [MINOR][CORE] Show block manager id when remove RDD/Broa...

2018-04-03 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20960 cc @viirya too before merging it. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20797: [SPARK-23583][SQL] Invoke should support interpre...

2018-04-03 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/20797#discussion_r178761933 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -263,11 +295,21 @@ case class Invoke(

[GitHub] spark issue #20811: [SPARK-23668][K8S] Add config option for passing through...

2018-04-03 Thread andrusha
Github user andrusha commented on the issue: https://github.com/apache/spark/pull/20811 @foxish fixed --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20811: [SPARK-23668][K8S] Add config option for passing through...

2018-04-03 Thread andrusha
Github user andrusha commented on the issue: https://github.com/apache/spark/pull/20811 Jenkins, test this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #20858: [SPARK-23736][SQL] Extending the concat function ...

2018-04-03 Thread mn-mikke
Github user mn-mikke commented on a diff in the pull request: https://github.com/apache/spark/pull/20858#discussion_r178759108 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -287,3 +289,152 @@ case class

[GitHub] spark pull request #20858: [SPARK-23736][SQL] Extending the concat function ...

2018-04-03 Thread mn-mikke
Github user mn-mikke commented on a diff in the pull request: https://github.com/apache/spark/pull/20858#discussion_r178753211 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Expression.scala --- @@ -699,3 +699,88 @@ abstract class

[GitHub] spark pull request #20797: [SPARK-23583][SQL] Invoke should support interpre...

2018-04-03 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/20797#discussion_r178753061 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -263,11 +295,21 @@ case class Invoke(

[GitHub] spark issue #19675: [SPARK-14540][BUILD] Support Scala 2.12 closures and Jav...

2018-04-03 Thread retronym
Github user retronym commented on the issue: https://github.com/apache/spark/pull/19675 I'm happy to help, but I would appreciate if someone could pose the question you have about the lambda encoding / `SerializedLambda` in a standalone fashion. In the meantime, here are

[GitHub] spark pull request #20964: [SPARK-22883] ML test for StructuredStreaming: sp...

2018-04-03 Thread WeichenXu123
Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/20964#discussion_r178784391 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/NGramSuite.scala --- @@ -84,7 +84,7 @@ class NGramSuite extends MLTest with

[GitHub] spark pull request #20611: [SPARK-23425][SQL]Support wildcard in HDFS path f...

2018-04-03 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/20611#discussion_r178801061 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -385,7 +385,9 @@ case class LoadDataCommand(

[GitHub] spark issue #20945: [SPARK-23790][Mesos] fix metastore connection issue

2018-04-03 Thread skonto
Github user skonto commented on the issue: https://github.com/apache/spark/pull/20945 @vanzin gentle ping. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #20797: [SPARK-23583][SQL] Invoke should support interpre...

2018-04-03 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/20797#discussion_r178761075 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -263,11 +295,21 @@ case class Invoke(

[GitHub] spark pull request #20797: [SPARK-23583][SQL] Invoke should support interpre...

2018-04-03 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/20797#discussion_r178780712 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -263,11 +295,21 @@ case class Invoke(

[GitHub] spark pull request #20964: [SPARK-22883] ML test for StructuredStreaming: sp...

2018-04-03 Thread WeichenXu123
Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/20964#discussion_r178784053 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/MinMaxScalerSuite.scala --- @@ -48,8 +46,8 @@ class MinMaxScalerSuite extends SparkFunSuite

[GitHub] spark pull request #20964: [SPARK-22883] ML test for StructuredStreaming: sp...

2018-04-03 Thread WeichenXu123
Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/20964#discussion_r178778285 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/ImputerSuite.scala --- @@ -76,6 +75,28 @@ class ImputerSuite extends SparkFunSuite with

[GitHub] spark pull request #20964: [SPARK-22883] ML test for StructuredStreaming: sp...

2018-04-03 Thread WeichenXu123
Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/20964#discussion_r178780101 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/MaxAbsScalerSuite.scala --- @@ -45,9 +44,9 @@ class MaxAbsScalerSuite extends SparkFunSuite

[GitHub] spark pull request #20964: [SPARK-22883] ML test for StructuredStreaming: sp...

2018-04-03 Thread WeichenXu123
Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/20964#discussion_r178783980 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/MinHashLSHSuite.scala --- @@ -167,4 +166,20 @@ class MinHashLSHSuite extends SparkFunSuite

[GitHub] spark issue #19675: [SPARK-14540][BUILD] Support Scala 2.12 closures and Jav...

2018-04-03 Thread retronym
Github user retronym commented on the issue: https://github.com/apache/spark/pull/19675 Another, semi-nuclear option is to use an unsupported option of `LambdaMetafactory` to dump generated classfiles to disk. ``` ⚡ mkdir /tmp/dump

[GitHub] spark issue #20945: [SPARK-23790][Mesos] fix metastore connection issue

2018-04-03 Thread skonto
Github user skonto commented on the issue: https://github.com/apache/spark/pull/20945 @susanxhuynh the cache represents the ticket for the superuser since he needs to create a DT as nobody to impersonate nobody. The superuser has the right to impersonate. The ticket cache replaces

[GitHub] spark issue #20057: [SPARK-22880][SQL] Add cascadeTruncate option to JDBC da...

2018-04-03 Thread Fokko
Github user Fokko commented on the issue: https://github.com/apache/spark/pull/20057 Gentle ping @gatorsmile @dongjoon-hyun 👍 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19222: [SPARK-10399][CORE][SQL] Introduce multiple MemoryBlocks...

2018-04-03 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/19222 @cloud-fan I compared the performance of TPC-DS using modified maropu's script between this PR and master. I collected average performance of 20 trials of each query. Here is

[GitHub] spark pull request #20611: [SPARK-23425][SQL]Support wildcard in HDFS path f...

2018-04-03 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/20611#discussion_r178736198 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -385,7 +385,9 @@ case class LoadDataCommand( val

[GitHub] spark issue #20938: [SPARK-23821][SQL] Collection function: flatten

2018-04-03 Thread mn-mikke
Github user mn-mikke commented on the issue: https://github.com/apache/spark/pull/20938 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #17979: [SPARK-19320][MESOS][WIP]allow specifying a hard limit o...

2018-04-03 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17979 @yanji84 you are the author, do you see the option to reopen this PR in github.com? if not, feel free to open a new PR and @ me there ---

[GitHub] spark issue #20928: Fix small typo in configuration doc

2018-04-03 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20928 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #20944: [SPARK-23831][SQL] Add org.apache.derby to Isolat...

2018-04-03 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/20944#discussion_r178720885 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/IsolatedClientLoader.scala --- @@ -188,6 +188,9 @@ private[hive] class

[GitHub] spark pull request #20881: Add a note about jobs running in FIFO order in th...

2018-04-03 Thread sujithjay
Github user sujithjay commented on a diff in the pull request: https://github.com/apache/spark/pull/20881#discussion_r178729284 --- Diff: docs/job-scheduling.md --- @@ -215,6 +215,9 @@ pool), but inside each pool, jobs run in FIFO order. For example, if you create means that

[GitHub] spark pull request #20945: [SPARK-23790][Mesos] fix metastore connection iss...

2018-04-03 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/20945#discussion_r178820771 --- Diff: resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala --- @@ -506,6 +506,10 @@

[GitHub] spark issue #19675: [SPARK-14540][BUILD] Support Scala 2.12 closures and Jav...

2018-04-03 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/19675 @retronym thanks for joining this thread -- good to see you here. In short, as you probably know, Spark needs to serialize lambdas to execute them remotely. Sometimes, the lambda

[GitHub] spark issue #20771: [SPARK-23587][SQL] Add interpreted execution for MapObje...

2018-04-03 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/20771 ping @hvanhovell Do you have any more comments? Thanks. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark pull request #20945: [SPARK-23790][Mesos] fix metastore connection iss...

2018-04-03 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/20945#discussion_r178859087 --- Diff: core/src/main/scala/org/apache/spark/rdd/HadoopRDD.scala --- @@ -197,6 +197,7 @@ class HadoopRDD[K, V]( val jobConf = getJobConf()

[GitHub] spark issue #20966: [SPARK-23854] Update Guava to 16.0.1

2018-04-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20966 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20967: [SPARK-23857][Mesos] remove keytab check in mesos cluste...

2018-04-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20967 **[Test build #88839 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88839/testReport)** for PR 20967 at commit

[GitHub] spark issue #20933: [SPARK-23817][SQL]Migrate ORC file format read path to d...

2018-04-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20933 **[Test build #88843 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88843/testReport)** for PR 20933 at commit

[GitHub] spark issue #20955: [SPARK-23838][WEBUI] Running SQL query is displayed as "...

2018-04-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20955 **[Test build #88841 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88841/testReport)** for PR 20955 at commit

[GitHub] spark issue #20928: Fix small typo in configuration doc

2018-04-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20928 **[Test build #88844 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88844/testReport)** for PR 20928 at commit

[GitHub] spark issue #20923: [SPARK-23807][BUILD][WIP] Add Hadoop 3 profile with rele...

2018-04-03 Thread steveloughran
Github user steveloughran commented on the issue: https://github.com/apache/spark/pull/20923 bq. I think we could separate cloud related stuffs to another PR, and fix only build related stuff in this PR OK ---

[GitHub] spark pull request #20960: [MINOR][CORE] Show block manager id when remove R...

2018-04-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20960 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #20965: [SPARK-21870][SQL] Split aggregation code into sm...

2018-04-03 Thread mgaido91
Github user mgaido91 commented on a diff in the pull request: https://github.com/apache/spark/pull/20965#discussion_r178841287 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -685,6 +685,17 @@ object SQLConf { .intConf

[GitHub] spark issue #20923: [SPARK-23807][BUILD][WIP] Add Hadoop 3 profile with rele...

2018-04-03 Thread steveloughran
Github user steveloughran commented on the issue: https://github.com/apache/spark/pull/20923 @jerryshao the latest revision only has the POM changes, and that also excludes the build profile option to compile the hadoop-3 source trees It also switches the hadoop 3.1 version

[GitHub] spark pull request #20945: [SPARK-23790][Mesos] fix metastore connection iss...

2018-04-03 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/20945#discussion_r178844155 --- Diff: resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala --- @@ -506,6 +506,10 @@

[GitHub] spark issue #20560: [SPARK-23375][SQL] Eliminate unneeded Sort in Optimizer

2018-04-03 Thread mgaido91
Github user mgaido91 commented on the issue: https://github.com/apache/spark/pull/20560 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20701: [SPARK-23528][ML] Add numIter to ClusteringSummary

2018-04-03 Thread mgaido91
Github user mgaido91 commented on the issue: https://github.com/apache/spark/pull/20701 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20939: [SPARK-23823][SQL] ResolveReferences should preserve tre...

2018-04-03 Thread JiahuiJiang
Github user JiahuiJiang commented on the issue: https://github.com/apache/spark/pull/20939 @gatorsmile Is #20961 crazy to do? It makes sure all the origins are kept correctly after analyzing, so future refactor won't cause similar issue. But not sure whether that behavior should be

[GitHub] spark issue #20966: [SPARK-23854] Update Guava to 16.0.1

2018-04-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20966 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20886: [SPARK-19724][SQL]create a managed table with an existed...

2018-04-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20886 **[Test build #88846 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88846/testReport)** for PR 20886 at commit

[GitHub] spark issue #20886: [SPARK-19724][SQL]create a managed table with an existed...

2018-04-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20886 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20886: [SPARK-19724][SQL]create a managed table with an existed...

2018-04-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20886 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88846/ Test FAILed. ---

[GitHub] spark issue #20959: [SPARK-23846][SQL] The samplingRatio option for CSV data...

2018-04-03 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20959 For usability, the workaround I suggested above has more flexibility. For example, we can make different operation (e.g, filter) on schema inference path. They are only few lines.

[GitHub] spark issue #20959: [SPARK-23846][SQL] The samplingRatio option for CSV data...

2018-04-03 Thread MaxGekk
Github user MaxGekk commented on the issue: https://github.com/apache/spark/pull/20959 @rxin I made an experiment on json files but numbers for csv are almost the same. For example, inferring schema for 50GB json: ``` scala> spark.read.option("samplingRatio",

[GitHub] spark issue #20960: [MINOR][CORE] Show block manager id when remove RDD/Broa...

2018-04-03 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20960 Merged to master and branch-2.3. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark pull request #20965: [SPARK-21870][SQL] Split aggregation code into sm...

2018-04-03 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/20965#discussion_r178845452 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -685,6 +685,17 @@ object SQLConf { .intConf

[GitHub] spark issue #20965: [SPARK-21870][SQL] Split aggregation code into small fun...

2018-04-03 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/20965 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20965: [SPARK-21870][SQL] Split aggregation code into small fun...

2018-04-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20965 **[Test build #88840 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88840/testReport)** for PR 20965 at commit

[GitHub] spark issue #20560: [SPARK-23375][SQL] Eliminate unneeded Sort in Optimizer

2018-04-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20560 **[Test build #88849 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88849/testReport)** for PR 20560 at commit

[GitHub] spark issue #20965: [SPARK-21870][SQL] Split aggregation code into small fun...

2018-04-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20965 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1915/

[GitHub] spark issue #20886: [SPARK-19724][SQL]create a managed table with an existed...

2018-04-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20886 **[Test build #88846 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88846/testReport)** for PR 20886 at commit

[GitHub] spark issue #20965: [SPARK-21870][SQL] Split aggregation code into small fun...

2018-04-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20965 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20701: [SPARK-23528][ML] Add numIter to ClusteringSummary

2018-04-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20701 **[Test build #88848 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88848/testReport)** for PR 20701 at commit

[GitHub] spark issue #20938: [SPARK-23821][SQL] Collection function: flatten

2018-04-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20938 **[Test build #88842 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88842/testReport)** for PR 20938 at commit

[GitHub] spark issue #20923: [SPARK-23807][BUILD][WIP] Add Hadoop 3 profile with rele...

2018-04-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20923 **[Test build #88845 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88845/testReport)** for PR 20923 at commit

[GitHub] spark issue #20797: [SPARK-23583][SQL] Invoke should support interpreted exe...

2018-04-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20797 **[Test build #88847 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88847/testReport)** for PR 20797 at commit

[GitHub] spark issue #20886: [SPARK-19724][SQL]create a managed table with an existed...

2018-04-03 Thread gengliangwang
Github user gengliangwang commented on the issue: https://github.com/apache/spark/pull/20886 retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #20945: [SPARK-23790][Mesos] fix metastore connection iss...

2018-04-03 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/20945#discussion_r178859057 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala --- @@ -123,7 +123,9 @@ class SparkHadoopUtil extends Logging { */

[GitHub] spark issue #20967: [SPARK-23857][Mesos] remove keytab check in mesos cluste...

2018-04-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20967 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20881: Add a note about jobs running in FIFO order in th...

2018-04-03 Thread Alexis-D
Github user Alexis-D commented on a diff in the pull request: https://github.com/apache/spark/pull/20881#discussion_r178817534 --- Diff: docs/job-scheduling.md --- @@ -215,6 +215,9 @@ pool), but inside each pool, jobs run in FIFO order. For example, if you create means that

[GitHub] spark issue #20260: [SPARK-23039][SQL] Finish TODO work in alter table set l...

2018-04-03 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/20260 @xubo245 please close this if the other PR supersedes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark pull request #20967: [SPARK-23857][Mesos] remove keytab check in mesos...

2018-04-03 Thread skonto
GitHub user skonto opened a pull request: https://github.com/apache/spark/pull/20967 [SPARK-23857][Mesos] remove keytab check in mesos cluster mode at first submit time ## What changes were proposed in this pull request? - Removes the check for the keytab when we are running in

[GitHub] spark issue #20967: [SPARK-23857][Mesos] remove keytab check in mesos cluste...

2018-04-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20967 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1914/

[GitHub] spark issue #20249: [SPARK-23057][SPARK-19235][SQL] SET LOCATION should chan...

2018-04-03 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/20249 @gatorsmile @xubo245 what is the status of this? Can we also get a better description on this? What exactly is the bug, what does the user see? Does set location work at all? ---

[GitHub] spark issue #20955: [SPARK-23838][WEBUI] Running SQL query is displayed as "...

2018-04-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20955 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1916/

[GitHub] spark issue #20955: [SPARK-23838][WEBUI] Running SQL query is displayed as "...

2018-04-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20955 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20933: [SPARK-23817][SQL]Migrate ORC file format read path to d...

2018-04-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20933 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20933: [SPARK-23817][SQL]Migrate ORC file format read path to d...

2018-04-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20933 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1917/

[GitHub] spark pull request #20881: Add a note about jobs running in FIFO order in th...

2018-04-03 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/spark/pull/20881#discussion_r178886364 --- Diff: docs/job-scheduling.md --- @@ -215,6 +215,9 @@ pool), but inside each pool, jobs run in FIFO order. For example, if you create means

[GitHub] spark pull request #20923: [SPARK-23807][BUILD][WIP] Add Hadoop 3 profile wi...

2018-04-03 Thread steveloughran
Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/20923#discussion_r178823511 --- Diff: pom.xml --- @@ -2671,6 +2671,15 @@ + + hadoop-3 + +3.1.0-SNAPSHOT ---

[GitHub] spark issue #20913: [SPARK-23799] FilterEstimation.evaluateInSet produces de...

2018-04-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20913 **[Test build #88850 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88850/testReport)** for PR 20913 at commit

[GitHub] spark issue #20967: [SPARK-23857][Mesos] remove keytab check in mesos cluste...

2018-04-03 Thread skonto
Github user skonto commented on the issue: https://github.com/apache/spark/pull/20967 @susanxhuynh pls review. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #20964: [SPARK-22883] ML test for StructuredStreaming: sp...

2018-04-03 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/20964#discussion_r178893936 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/NGramSuite.scala --- @@ -84,7 +84,7 @@ class NGramSuite extends MLTest with

[GitHub] spark issue #20964: [SPARK-22883] ML test for StructuredStreaming: spark.ml....

2018-04-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20964 **[Test build #88851 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88851/testReport)** for PR 20964 at commit

[GitHub] spark issue #20923: [SPARK-23807][BUILD][WIP] Add Hadoop 3 profile with rele...

2018-04-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20923 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20923: [SPARK-23807][BUILD][WIP] Add Hadoop 3 profile with rele...

2018-04-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20923 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1918/

[GitHub] spark issue #20811: [SPARK-23668][K8S] Add config option for passing through...

2018-04-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20811 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/1888/ ---

[GitHub] spark pull request #20964: [SPARK-22883] ML test for StructuredStreaming: sp...

2018-04-03 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/20964#discussion_r178894229 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/MinMaxScalerSuite.scala --- @@ -48,8 +46,8 @@ class MinMaxScalerSuite extends SparkFunSuite

[GitHub] spark pull request #20964: [SPARK-22883] ML test for StructuredStreaming: sp...

2018-04-03 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/20964#discussion_r178896682 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/MinHashLSHSuite.scala --- @@ -167,4 +166,20 @@ class MinHashLSHSuite extends SparkFunSuite

[GitHub] spark pull request #20964: [SPARK-22883] ML test for StructuredStreaming: sp...

2018-04-03 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/20964#discussion_r178896432 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/ImputerSuite.scala --- @@ -76,6 +75,28 @@ class ImputerSuite extends SparkFunSuite with

[GitHub] spark issue #20886: [SPARK-19724][SQL]create a managed table with an existed...

2018-04-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20886 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20886: [SPARK-19724][SQL]create a managed table with an existed...

2018-04-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20886 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1919/

[GitHub] spark issue #20797: [SPARK-23583][SQL] Invoke should support interpreted exe...

2018-04-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20797 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1921/

[GitHub] spark issue #20797: [SPARK-23583][SQL] Invoke should support interpreted exe...

2018-04-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20797 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20811: [SPARK-23668][K8S] Add config option for passing through...

2018-04-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20811 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/1888/ ---

[GitHub] spark issue #20560: [SPARK-23375][SQL] Eliminate unneeded Sort in Optimizer

2018-04-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20560 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20560: [SPARK-23375][SQL] Eliminate unneeded Sort in Optimizer

2018-04-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20560 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1923/

[GitHub] spark issue #20701: [SPARK-23528][ML] Add numIter to ClusteringSummary

2018-04-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20701 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1922/

[GitHub] spark issue #20913: [SPARK-23799] FilterEstimation.evaluateInSet produces de...

2018-04-03 Thread mshtelma
Github user mshtelma commented on the issue: https://github.com/apache/spark/pull/20913 I have added the unit case for this particular situation --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

  1   2   3   4   5   >