[GitHub] spark pull request: [SPARK-8867][SQL][WIP] Support list / describe...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7259#issuecomment-122772276 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9178][SQL] Add an empty string constant...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7509#issuecomment-122772218 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8867][SQL][WIP] Support list / describe...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7259#issuecomment-122772268 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-4598][WebUI]Task table pagination for t...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7399#issuecomment-122776540 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8756][SQL] Keep cached information and ...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7154#issuecomment-122776612 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8756][SQL] Keep cached information and ...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7154#issuecomment-122776552 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9023] [SQL] Efficiency improvements for...

2015-07-20 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/7456#issuecomment-122776235 Looks pretty good. I'm going to merge it. Please submit a followup pr to address some of the comments on documentation and choice of buffer size. --- If your project is

[GitHub] spark pull request: [SPARK-9187][WebUI] Timeline view may show neg...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7526#issuecomment-122776566 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9187][WebUI] Timeline view may show neg...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7526#issuecomment-122776531 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9023] [SQL] Efficiency improvements for...

2015-07-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7456 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-8756][SQL] Keep cached information and ...

2015-07-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7154#issuecomment-122776765 [Test build #37812 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/37812/consoleFull) for PR 7154 at commit

[GitHub] spark pull request: [SPARK-4598][WebUI]Task table pagination for t...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7399#issuecomment-122776608 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Avoid assigning tasks to lost executor(s)

2015-07-20 Thread GraceH
GitHub user GraceH opened a pull request: https://github.com/apache/spark/pull/7528 Avoid assigning tasks to lost executor(s) Now, when some executors are killed by dynamic-allocation, it leads to some mis-assignment onto lost executors sometimes. Such kind of mis-assignment

[GitHub] spark pull request: [SPARK-8230][SQL] Add array/map size method

2015-07-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7462#issuecomment-122782256 [Test build #37801 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/37801/console) for PR 7462 at commit

[GitHub] spark pull request: [SPARK-4131][SQL] support writing data into th...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4380#issuecomment-122782405 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8230][SQL] Add array/map size method

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7462#issuecomment-122782276 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-4598][WebUI]Task table pagination for t...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7399#issuecomment-122783241 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-4598][WebUI]Task table pagination for t...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7399#issuecomment-122783251 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-4598][WebUI]Task table pagination for t...

2015-07-20 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/7399#issuecomment-122783130 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-8230][SQL] Add array/map size method

2015-07-20 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/7462#issuecomment-122784721 Please resolve the merge conflict if you can. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-8230][SQL] Add array/map size method

2015-07-20 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/7462#discussion_r34972154 --- Diff: python/pyspark/sql/functions.py --- @@ -188,6 +188,10 @@ def _(): This is equivalent to the PERCENT_RANK function in SQL., }

[GitHub] spark pull request: [SPARK-8968] [SQL] external sort by the partit...

2015-07-20 Thread scwf
Github user scwf commented on the pull request: https://github.com/apache/spark/pull/7336#issuecomment-122784742 @rxin, yes we found this issue when do dynamic partitioning in our case, so here i do local sort data on the partition columns to reduce the gc overhead. --- If your

[GitHub] spark pull request: [SPARK-9091][STREAMING]Add the CompressionCode...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7442#issuecomment-122785355 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9116] [SQL] [PYSPARK] support Python UD...

2015-07-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7453#issuecomment-122785576 [Test build #37817 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/37817/console) for PR 7453 at commit

[GitHub] spark pull request: [SPARK-9091][STREAMING]Add the CompressionCode...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7442#issuecomment-122785341 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9091][STREAMING]Add the CompressionCode...

2015-07-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7442#issuecomment-122785499 [Test build #37818 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/37818/consoleFull) for PR 7442 at commit

[GitHub] spark pull request: [SPARK-9155][SQL] codegen StringSpace

2015-07-20 Thread tarekauel
Github user tarekauel commented on a diff in the pull request: https://github.com/apache/spark/pull/7531#discussion_r34972744 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringOperations.scala --- @@ -556,6 +556,16 @@ case class

[GitHub] spark pull request: SPARK-9059 Update Direct Kafka Word count exam...

2015-07-20 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/7467#issuecomment-122786735 I believe this PR/JIRA should be closed as a duplicate --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-9101] [PySpark] Add missing NullType

2015-07-20 Thread sixers
Github user sixers commented on the pull request: https://github.com/apache/spark/pull/7499#issuecomment-122788836 @JoshRosen I see, thanks for suggestion, I added this test. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-9187][WebUI] Timeline view may show neg...

2015-07-20 Thread carsonwang
Github user carsonwang commented on the pull request: https://github.com/apache/spark/pull/7526#issuecomment-122791974 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-8264][SQL]add substring_index function

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7533#issuecomment-122805824 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [WIP][SPARK-4751] Dynamic allocation in standa...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7532#issuecomment-122805842 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SQL] Minor document fix in HadoopFsRelationPr...

2015-07-20 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/7524#discussion_r34969879 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/sources/interfaces.scala --- @@ -111,7 +111,7 @@ trait SchemaRelationProvider { * * The

[GitHub] spark pull request: [SQL][DOC] Minor document fix in HadoopFsRelat...

2015-07-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7524#issuecomment-122773205 [Test build #37806 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/37806/consoleFull) for PR 7524 at commit

[GitHub] spark pull request: [SPARK-9081][SQL][WIP] fillna/dropna should al...

2015-07-20 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/7523#discussion_r34969987 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/nullFunctions.scala --- @@ -198,14 +203,39 @@ case class AtLeastNNonNulls(n:

[GitHub] spark pull request: [SPARK-9066][SQL] Improve cartesian performanc...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7417#issuecomment-122773289 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8935][SQL] Implement code generation fo...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7365#issuecomment-122773507 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9186][SQL] make deterministic describin...

2015-07-20 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/7525 [SPARK-9186][SQL] make deterministic describing the tree rather than the expression You can merge this pull request into a Git repository by running: $ git pull

[GitHub] spark pull request: [SQL][DOC] Minor document fix in HadoopFsRelat...

2015-07-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7524 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-9186][SQL] make deterministic describin...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7525#issuecomment-122773813 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9186][SQL] make deterministic describin...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7525#issuecomment-122773807 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9023] [SQL] Efficiency improvements for...

2015-07-20 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/7456#discussion_r34970391 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/UnsafeRowSerializer.scala --- @@ -0,0 +1,142 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-9177][SQL] Reuse of calendar object in ...

2015-07-20 Thread tarekauel
Github user tarekauel commented on the pull request: https://github.com/apache/spark/pull/7516#issuecomment-122774605 Sure. I am going to solve some of them. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9023] [SQL] Efficiency improvements for...

2015-07-20 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/7456#discussion_r34970544 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/UnsafeRowSerializer.scala --- @@ -0,0 +1,142 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-9026] Refactor SimpleFutureAction.onCom...

2015-07-20 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/7385#discussion_r34971118 --- Diff: core/src/main/scala/org/apache/spark/scheduler/JobWaiter.scala --- @@ -50,28 +72,23 @@ private[spark] class JobWaiter[T]( }

[GitHub] spark pull request: [SPARK-9153][SQL] codegen StirngLPad/StringRPa...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7527#issuecomment-122781817 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-4131][SQL] support writing data into th...

2015-07-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4380#issuecomment-122782563 [Test build #37815 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/37815/consoleFull) for PR 4380 at commit

[GitHub] spark pull request: Avoid assigning tasks to lost executor(s)

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7528#issuecomment-122782409 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Avoid assigning tasks to lost executor(s)

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7528#issuecomment-122782396 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-4598][WebUI]Task table pagination for t...

2015-07-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7399#issuecomment-122783459 [Test build #37816 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/37816/consoleFull) for PR 7399 at commit

[GitHub] spark pull request: [SPARK-8813][SQL] Support combine text/parquet...

2015-07-20 Thread watermen
Github user watermen commented on the pull request: https://github.com/apache/spark/pull/7210#issuecomment-122786160 @liancheng I see `coalesce` will take locality and load balance(the number of partitions in each group) into

[GitHub] spark pull request: [SPARK-5423][Core]Register a TaskCompletionLis...

2015-07-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7529#issuecomment-122786198 [Test build #37820 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/37820/consoleFull) for PR 7529 at commit

[GitHub] spark pull request: [SPARK-9155][SQL] codegen StringSpace

2015-07-20 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/7531#discussion_r34972652 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringOperations.scala --- @@ -556,6 +556,16 @@ case class StringSpace(child:

[GitHub] spark pull request: [SPARK-9066][SQL] Improve cartesian performanc...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7417#issuecomment-122788178 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9066][SQL] Improve cartesian performanc...

2015-07-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7417#issuecomment-122788052 [Test build #37807 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/37807/console) for PR 7417 at commit

[GitHub] spark pull request: [SPARK-9177][SQL] Reuse of calendar object in ...

2015-07-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7516#issuecomment-122794063 [Test build #1116 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1116/console) for PR 7516 at commit

[GitHub] spark pull request: [SPARK-9091][STREAMING]Add the CompressionCode...

2015-07-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7442#issuecomment-122800414 [Test build #37818 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/37818/console) for PR 7442 at commit

[GitHub] spark pull request: [SPARK-9155][SQL] codegen StringSpace

2015-07-20 Thread tarekauel
Github user tarekauel commented on the pull request: https://github.com/apache/spark/pull/7531#issuecomment-122800467 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8756][SQL] Keep cached information and ...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7154#issuecomment-122800067 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8756][SQL] Keep cached information and ...

2015-07-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7154#issuecomment-122799420 [Test build #37812 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/37812/console) for PR 7154 at commit

[GitHub] spark pull request: [SPARK-9081][SQL][WIP] fillna/dropna should al...

2015-07-20 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/7523#issuecomment-122772598 While you are at this, can you add some unit test for the AtLeastNNonNulls expression to NullFunctionsSuite? --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-9066][SQL] Improve cartesian performanc...

2015-07-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7417#issuecomment-122773389 [Test build #37807 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/37807/consoleFull) for PR 7417 at commit

[GitHub] spark pull request: [SPARK-9066][SQL] Improve cartesian performanc...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7417#issuecomment-122773299 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9177][SQL] Reuse of calendar object in ...

2015-07-20 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/7516#issuecomment-122774362 I triggered it finally. Meantime, if you have time, do you want to pick up some other issues here? https://issues.apache.org/jira/browse/SPARK-8829 --- If your

[GitHub] spark pull request: [SPARK-9177][SQL] Reuse of calendar object in ...

2015-07-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7516#issuecomment-122774336 [Test build #1116 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1116/consoleFull) for PR 7516 at commit

[GitHub] spark pull request: [SPARK-9067][SQL] Close reader in NewHadoopRDD...

2015-07-20 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/7424#discussion_r34970834 --- Diff: core/src/main/scala/org/apache/spark/rdd/NewHadoopRDD.scala --- @@ -141,6 +141,11 @@ class NewHadoopRDD[K, V]( override def hasNext: Boolean

[GitHub] spark pull request: [SPARK-9091][STREAMING]Add the CompressionCode...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7442#issuecomment-122778570 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9091][STREAMING]Add the CompressionCode...

2015-07-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7442#issuecomment-122778962 [Test build #37813 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/37813/consoleFull) for PR 7442 at commit

[GitHub] spark pull request: [SPARK-9067][SQL] Close reader in NewHadoopRDD...

2015-07-20 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/7424#issuecomment-122778668 cc @zsxwing for review --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-9091][STREAMING]Add the CompressionCode...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7442#issuecomment-122778516 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9067][SQL] Close reader in NewHadoopRDD...

2015-07-20 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/7424#discussion_r34973826 --- Diff: core/src/main/scala/org/apache/spark/rdd/NewHadoopRDD.scala --- @@ -159,7 +164,10 @@ class NewHadoopRDD[K, V]( private def close() {

[GitHub] spark pull request: [SPARK-9091][STREAMING]Add the CompressionCode...

2015-07-20 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/7442#discussion_r34973871 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/DStream.scala --- @@ -906,12 +908,16 @@ abstract class DStream[T: ClassTag] ( /**

[GitHub] spark pull request: [SPARK-9175] [MLlib] BLAS.gemm fails to update...

2015-07-20 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/7503#issuecomment-122804300 @brkyvz is this OK with you? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9081][SQL][WIP] fillna/dropna should al...

2015-07-20 Thread yjshen
Github user yjshen commented on a diff in the pull request: https://github.com/apache/spark/pull/7523#discussion_r34969931 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/nullFunctions.scala --- @@ -198,14 +203,39 @@ case class AtLeastNNonNulls(n:

[GitHub] spark pull request: [SPARK-9177][SQL] Reuse of calendar object in ...

2015-07-20 Thread tarekauel
Github user tarekauel commented on the pull request: https://github.com/apache/spark/pull/7516#issuecomment-122773919 @rxin Jenkins still doesn't like me --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8867][SQL][WIP] Support list / describe...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7259#issuecomment-122776730 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8867][SQL][WIP] Support list / describe...

2015-07-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7259#issuecomment-122776686 [Test build #37805 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/37805/console) for PR 7259 at commit

[GitHub] spark pull request: [SPARK-4366] [SQL] [WIP] Aggregation Improveme...

2015-07-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7458#issuecomment-122777013 [Test build #37804 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/37804/console) for PR 7458 at commit

[GitHub] spark pull request: [SPARK-4366] [SQL] [WIP] Aggregation Improveme...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7458#issuecomment-122777314 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9153][SQL] codegen StirngLPad/StringRPa...

2015-07-20 Thread tarekauel
GitHub user tarekauel opened a pull request: https://github.com/apache/spark/pull/7527 [SPARK-9153][SQL] codegen StirngLPad/StringRPad Jira: https://issues.apache.org/jira/browse/SPARK-9153 You can merge this pull request into a Git repository by running: $ git pull

[GitHub] spark pull request: [SPARK-9116] [SQL] [PYSPARK] support Python UD...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7453#issuecomment-122784786 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9116] [SQL] [PYSPARK] support Python UD...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7453#issuecomment-122784796 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8230][SQL] Add array/map size method

2015-07-20 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/7462#discussion_r34972139 --- Diff: python/pyspark/sql/functions.py --- @@ -196,6 +200,8 @@ def _(): globals()[_name] = since(1.4)(_create_binary_mathfunction(_name, _doc))

[GitHub] spark pull request: [SPARK-8230][SQL] Add array/map size method

2015-07-20 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/7462#discussion_r34972186 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -0,0 +1,43 @@ +/* + * Licensed to the

[GitHub] spark pull request: [SPARK-9187][WebUI] Timeline view may show neg...

2015-07-20 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/7526#issuecomment-122784957 CC @kayousterhout --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-9155][SQL] codegen StringSpace

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7531#issuecomment-122786056 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-5423][Core]Register a TaskCompletionLis...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7529#issuecomment-122786084 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SQL] Remove space from DataFrame Scala/Java A...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7530#issuecomment-122786059 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9155][SQL] codegen StringSpace

2015-07-20 Thread tarekauel
GitHub user tarekauel opened a pull request: https://github.com/apache/spark/pull/7531 [SPARK-9155][SQL] codegen StringSpace Jira https://issues.apache.org/jira/browse/SPARK-9155 You can merge this pull request into a Git repository by running: $ git pull

[GitHub] spark pull request: [SQL] Remove space from DataFrame Scala/Java A...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7530#issuecomment-122786072 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-5423][Core]Register a TaskCompletionLis...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7529#issuecomment-122786064 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SQL] SPARK-6981: Factor out SparkPlanner and ...

2015-07-20 Thread evacchi
Github user evacchi commented on the pull request: https://github.com/apache/spark/pull/6356#issuecomment-122785825 ok, will check today --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-9091][STREAMING]Add the CompressionCode...

2015-07-20 Thread SaintBacchus
Github user SaintBacchus commented on a diff in the pull request: https://github.com/apache/spark/pull/7442#discussion_r34973017 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/DStream.scala --- @@ -906,12 +908,16 @@ abstract class DStream[T: ClassTag] (

[GitHub] spark pull request: [SPARK-9187][WebUI] Timeline view may show neg...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7526#issuecomment-122795497 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9091][STREAMING]Add the CompressionCode...

2015-07-20 Thread SaintBacchus
Github user SaintBacchus closed the pull request at: https://github.com/apache/spark/pull/7442 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark pull request: [SPARK-9091][STREAMING]Add the CompressionCode...

2015-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7442#issuecomment-122800806 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9081][SQL][WIP] fillna/dropna should al...

2015-07-20 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/7523#issuecomment-122772382 Jenkins, ok to test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-9178][SQL] Add an empty string constant...

2015-07-20 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/7509#issuecomment-122772372 There is a failure ``` [error] Test org.apache.spark.unsafe.types.UTF8StringSuite.concatTest failed: java.lang.NullPointerException: null [error] at

[GitHub] spark pull request: [SPARK-8867][SQL][WIP] Support list / describe...

2015-07-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7259#issuecomment-122772380 [Test build #37805 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/37805/consoleFull) for PR 7259 at commit

[GitHub] spark pull request: [SPARK-8935][SQL] Implement code generation fo...

2015-07-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7365#issuecomment-122773454 [Test build #37800 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/37800/console) for PR 7365 at commit

  1   2   3   4   5   6   7   8   9   10   >