[GitHub] spark pull request: [SPARK-11553] [SQL] Primitive Row accessors sh...

2015-11-16 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/9642#issuecomment-157147813 The original behavior of these classes was to throw if you tried to retrieve a null primitive value and I think thats a lot less confusing. Unfortunately it seems that

[GitHub] spark pull request: [SPARK-11480][CORE][WEBUI] Wrong callsite is d...

2015-11-16 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/9437#issuecomment-157147732 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-11718][Yarn][Core]Fix explicitly killed...

2015-11-16 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9684#issuecomment-157147767 Merging to master / 1.6. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have thi

[GitHub] spark pull request: [SPARK-9065][Streaming][PySpark] Add MessageHa...

2015-11-16 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/9742 [SPARK-9065][Streaming][PySpark] Add MessageHandler for Kafka Python API Fixed the merge conflicts in #7410 Closes #7410 You can merge this pull request into a Git repository by running:

[GitHub] spark pull request: [SPARK-11544][SQL] sqlContext doesn't use Path...

2015-11-16 Thread dilipbiswal
Github user dilipbiswal commented on a diff in the pull request: https://github.com/apache/spark/pull/9652#discussion_r44971819 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonSuite.scala --- @@ -1393,4 +1401,58 @@ class JsonSuite extends Quer

[GitHub] spark pull request: Prevent the call to StreamingContext#stop() in...

2015-11-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9741#issuecomment-157147189 **[Test build #46003 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46003/consoleFull)** for PR 9741 at commit [`8f583b9`](https://gith

[GitHub] spark pull request: [SPARK-11031][SPARKR] Method str() on a DataFr...

2015-11-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9613#issuecomment-157145793 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9065][Streaming][PySpark] Add MessageHa...

2015-11-16 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/7410#issuecomment-157145854 @jerryshao sorry for so much delays on this PR. We needed to fix issues like #9669 before merging python streaming features. Hence the delay. Would you mind if we take over

[GitHub] spark pull request: [SPARK-11031][SPARKR] Method str() on a DataFr...

2015-11-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9613#issuecomment-157145795 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-11031][SPARKR] Method str() on a DataFr...

2015-11-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9613#issuecomment-157145644 **[Test build #46002 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46002/consoleFull)** for PR 9613 at commit [`05bb4aa`](https://git

[GitHub] spark pull request: [SPARK-6328] [Python] Python API for Streaming...

2015-11-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9186 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-11731][STREAMING] Enable batching on Dr...

2015-11-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9695 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-6328] [Python] Python API for Streaming...

2015-11-16 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/9186#issuecomment-157142357 Thanks @djalova and @zsxwing for your efforts. Merging this to master and 1.6 --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: [SPARK-11731][STREAMING] Enable batching on Dr...

2015-11-16 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/9695#issuecomment-157141926 LGTM. Merging this to master and 1.6 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[GitHub] spark pull request: Prevent the call to StreamingContext#stop() in...

2015-11-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9741#issuecomment-157141615 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: Prevent the call to StreamingContext#stop() in...

2015-11-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9741#issuecomment-157141612 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: Prevent the call to StreamingContext#stop() in...

2015-11-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9741#issuecomment-157141605 **[Test build #46001 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46001/consoleFull)** for PR 9741 at commit [`bc40285`](https://git

[GitHub] spark pull request: Prevent the call to StreamingContext#stop() in...

2015-11-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9741#issuecomment-157140927 **[Test build #46001 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46001/consoleFull)** for PR 9741 at commit [`bc40285`](https://gith

[GitHub] spark pull request: [SPARK-11720] [SQL][ML] Return Double.NaN inst...

2015-11-16 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/9705#issuecomment-157140840 LGTM. cc @yhuai for another pass. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11031][SPARKR] Method str() on a DataFr...

2015-11-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9613#issuecomment-157140688 **[Test build #46002 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46002/consoleFull)** for PR 9613 at commit [`05bb4aa`](https://gith

[GitHub] spark pull request: [SPARK-11195][CORE] Use correct classloader fo...

2015-11-16 Thread choochootrain
Github user choochootrain commented on a diff in the pull request: https://github.com/apache/spark/pull/9367#discussion_r44967864 --- Diff: core/src/main/scala/org/apache/spark/TestUtils.scala --- @@ -78,15 +79,15 @@ private[spark] object TestUtils { } /** -

[GitHub] spark pull request: [SPARK-11523][SQL] Throw AnalysisException for...

2015-11-16 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/9496#issuecomment-157138979 @cloud-fan Would you mind to have a look at this one? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. I

[GitHub] spark pull request: [SPARK-11583] [Core]MapStatus Using RoaringBit...

2015-11-16 Thread gssiyankai
Github user gssiyankai commented on the pull request: https://github.com/apache/spark/pull/9661#issuecomment-157138785 @davies, I've worked on the issue SPARK-11016. The fix is available in this PR: https://github.com/yaooqinn/spark/pull/1 --- If your project is set up for it,

[GitHub] spark pull request: [SPARK-11195][CORE] Use correct classloader fo...

2015-11-16 Thread choochootrain
Github user choochootrain commented on a diff in the pull request: https://github.com/apache/spark/pull/9367#discussion_r44967313 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskResultGetterSuite.scala --- @@ -119,5 +124,47 @@ class TaskResultGetterSuite extends SparkF

[GitHub] spark pull request: [SPARK-11044][SQL] Parquet writer version fixe...

2015-11-16 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/9060#issuecomment-157138358 Merging to branch-1.6. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: Prevent the call to StreamingContext#stop() in...

2015-11-16 Thread tedyu
Github user tedyu commented on the pull request: https://github.com/apache/spark/pull/9741#issuecomment-157138122 @tdas @zsxwing Please take a look --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project doe

[GitHub] spark pull request: [SPARK-11572] Process outstanding requests aft...

2015-11-16 Thread tedyu
Github user tedyu closed the pull request at: https://github.com/apache/spark/pull/9723 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: Prevent the call to StreamingContext#stop() in...

2015-11-16 Thread tedyu
GitHub user tedyu opened a pull request: https://github.com/apache/spark/pull/9741 Prevent the call to StreamingContext#stop() in the listener bus's thread See discussion toward the tail of https://github.com/apache/spark/pull/9723 You can merge this pull request into a Git reposit

[GitHub] spark pull request: [SPARK-11583] [Core]MapStatus Using RoaringBit...

2015-11-16 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9661#issuecomment-157136868 SGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark pull request: [SPARK-11089] [SQL] Adds option for disabling ...

2015-11-16 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9740#discussion_r44966303 --- Diff: sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/HiveThriftServer2Suites.scala --- @@ -635,6 +683,7 @@ abstract class Hiv

[GitHub] spark pull request: [SPARK-11195][CORE] Use correct classloader fo...

2015-11-16 Thread choochootrain
Github user choochootrain commented on a diff in the pull request: https://github.com/apache/spark/pull/9367#discussion_r44965129 --- Diff: core/src/main/scala/org/apache/spark/TestUtils.scala --- @@ -130,7 +131,7 @@ private[spark] object TestUtils { val fileName = classNam

[GitHub] spark pull request: [SPARK-11195][CORE] Use correct classloader fo...

2015-11-16 Thread choochootrain
Github user choochootrain commented on a diff in the pull request: https://github.com/apache/spark/pull/9367#discussion_r44965069 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskResultGetterSuite.scala --- @@ -17,8 +17,13 @@ package org.apache.spark.schedule

[GitHub] spark pull request: [SPARK-11089] [SQL] Adds option for disabling ...

2015-11-16 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/9740#issuecomment-157134508 Yeah, I'll add it to the programming guide. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: [SPARK-11089] [SQL] Adds option for disabling ...

2015-11-16 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/9740#discussion_r44964862 --- Diff: sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/HiveThriftServer2Suites.scala --- @@ -635,6 +683,7 @@ abstract class

[GitHub] spark pull request: [SPARK-11195][CORE] Use correct classloader fo...

2015-11-16 Thread choochootrain
Github user choochootrain commented on a diff in the pull request: https://github.com/apache/spark/pull/9367#discussion_r44964392 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskResultGetterSuite.scala --- @@ -119,5 +124,47 @@ class TaskResultGetterSuite extends SparkF

[GitHub] spark pull request: [SPARK-11195][CORE] Use correct classloader fo...

2015-11-16 Thread choochootrain
Github user choochootrain commented on a diff in the pull request: https://github.com/apache/spark/pull/9367#discussion_r44964408 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskResultGetterSuite.scala --- @@ -119,5 +124,47 @@ class TaskResultGetterSuite extends SparkF

[GitHub] spark pull request: [Spark-11522][SQL] input_file_name() returns "...

2015-11-16 Thread xwu0226
Github user xwu0226 commented on the pull request: https://github.com/apache/spark/pull/9542#issuecomment-157131325 @yhuai Many thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark pull request: [SPARK-11535][ML] handling empty string in Str...

2015-11-16 Thread pravingadakh
Github user pravingadakh commented on the pull request: https://github.com/apache/spark/pull/9522#issuecomment-157131275 @jkbradley Any updates on this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-11447][SQL] change NullType to StringTy...

2015-11-16 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/9720#discussion_r44963028 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/HiveTypeCoercion.scala --- @@ -280,6 +280,12 @@ object HiveTypeCoercion {

[GitHub] spark pull request: SPARK-7729:Executor which has been killed shou...

2015-11-16 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/6263#issuecomment-157128907 @archit279thakur yeah don't worry about that test failure ... when you push updates & bring up to date w/ master the tests will re-run in any case --- If your project is

[GitHub] spark pull request: [SPARK-10181][SQL] Do kerberos login for crede...

2015-11-16 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/9272#issuecomment-157128630 Also merged to branch-1.5. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: SPARK-7729:Executor which has been killed shou...

2015-11-16 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6263#discussion_r44961686 --- Diff: core/src/main/scala/org/apache/spark/storage/StorageStatusListener.scala --- @@ -87,6 +113,8 @@ class StorageStatusListener extends SparkListener {

[GitHub] spark pull request: [SPARK-11089] [SQL] Adds option for disabling ...

2015-11-16 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/9740#issuecomment-157128229 @liancheng This option is only for backward compatibility purpose, could we document it somewhere? We should also mention this change (isolated sessions) in release note.

[GitHub] spark pull request: [SPARK-11089] [SQL] Adds option for disabling ...

2015-11-16 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/9740#issuecomment-157127825 @liancheng I like the this approach more, all global configurations should be placed in SparkConf (could be override in current session) --- If your project is set up fo

[GitHub] spark pull request: SPARK-7729:Executor which has been killed shou...

2015-11-16 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6263#discussion_r44961121 --- Diff: core/src/main/scala/org/apache/spark/storage/StorageStatusListener.scala --- @@ -28,15 +35,34 @@ import org.apache.spark.scheduler._ * *

[GitHub] spark pull request: SPARK-7729:Executor which has been killed shou...

2015-11-16 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6263#discussion_r44960862 --- Diff: core/src/main/scala/org/apache/spark/ui/exec/ExecutorsPage.scala --- @@ -25,6 +25,7 @@ import scala.xml.Node import org.apache.spark.status.api.

[GitHub] spark pull request: [SPARK-11089] [SQL] Adds option for disabling ...

2015-11-16 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9740#discussion_r44960873 --- Diff: sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/HiveThriftServer2Suites.scala --- @@ -635,6 +683,7 @@ abstract class Hiv

[GitHub] spark pull request: [SPARK-11583] [Core]MapStatus Using RoaringBit...

2015-11-16 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/9661#issuecomment-157125514 @yaooqinn This PR looks good to me overall. Since your patch basically revert #9243, I'd like to revert that first, then rebase this pr, to make the history more clear. W

[GitHub] spark pull request: [SPARK-7799][Streaming]Add "streaming-akka" pr...

2015-11-16 Thread zsxwing
Github user zsxwing closed the pull request at: https://github.com/apache/spark/pull/6841 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-7799][Streaming]Add "streaming-akka" pr...

2015-11-16 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/6841#issuecomment-157124033 I'm closing this one. We can reopen it if we want to do it in 1.7. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: [SPARK-11089] [SQL] Adds option for disabling ...

2015-11-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9740#issuecomment-157122865 **[Test build #46000 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46000/consoleFull)** for PR 9740 at commit [`eeeb194`](https://gith

[GitHub] spark pull request: [SPARK-11572] Process outstanding requests aft...

2015-11-16 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/9723#issuecomment-157122774 > Sounds like we should prevent the call to StreamingContext#stop() in the listener bus's thread. > How about setting a ThreadLocal Boolean to indicate to StreamingCo

[GitHub] spark pull request: [SPARK-11089] [SQL] Adds option for disabling ...

2015-11-16 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/9740#issuecomment-157121925 Another approach for this problem is to have "global" options. For example, `SET -g key=value` sets `key` to `value` for all sessions. This adds a new concept and requ

[GitHub] spark pull request: [SPARK-11583] [Core]MapStatus Using RoaringBit...

2015-11-16 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9661#discussion_r44958484 --- Diff: core/src/main/scala/org/apache/spark/scheduler/MapStatus.scala --- @@ -173,18 +172,15 @@ private[spark] object HighlyCompressedMapStatus { va

[GitHub] spark pull request: [SPARK-11583] [Core]MapStatus Using RoaringBit...

2015-11-16 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9661#discussion_r44958298 --- Diff: core/src/main/scala/org/apache/spark/serializer/KryoSerializer.scala --- @@ -21,24 +21,24 @@ import java.io.{EOFException, IOException, InputStream,

[GitHub] spark pull request: [SPARK-11089] [SQL] Adds option for disabling ...

2015-11-16 Thread liancheng
GitHub user liancheng opened a pull request: https://github.com/apache/spark/pull/9740 [SPARK-11089] [SQL] Adds option for disabling multi-session in Thrift server This PR adds a new option `spark.sql.hive.thriftServer.singleSession` for disabling multi-session support in the Thrift

[GitHub] spark pull request: [SPARK-11744][Launcher] Fix print version thro...

2015-11-16 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9721#issuecomment-157116639 LGTM (although you could probably have a single flag for both). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: SPARK-11716 - UDFRegistration just drops the i...

2015-11-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9739#issuecomment-157116741 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-11617] [network] Fix leak in TransportF...

2015-11-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9619#issuecomment-157116469 **[Test build #45999 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45999/consoleFull)** for PR 9619 at commit [`180456c`](https://gith

[GitHub] spark pull request: SPARK-11716 - UDFRegistration just drops the i...

2015-11-16 Thread jbonofre
GitHub user jbonofre opened a pull request: https://github.com/apache/spark/pull/9739 SPARK-11716 - UDFRegistration just drops the input type when re-creat… …ing the UserDefinedFunction You can merge this pull request into a Git repository by running: $ git pull https://git

[GitHub] spark pull request: [SPARK-11617] [network] Fix leak in TransportF...

2015-11-16 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9619#issuecomment-157111920 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request: [SPARK-11044][SQL] Parquet writer version fixe...

2015-11-16 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/9060#issuecomment-157108064 Sure --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-11692][SQL] Support for Parquet logical...

2015-11-16 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/9658#issuecomment-157106033 We've added support for reading these types as strings, but we can't round trip data without losing the annotation which might be kind of confusing for users. Perhaps

[GitHub] spark pull request: [SPARK-11755] [R] SparkR should export "predic...

2015-11-16 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/9732#discussion_r44952987 --- Diff: R/pkg/R/generics.R --- @@ -1054,6 +1054,10 @@ setGeneric("year", function(x) { standardGeneric("year") }) #' @export setGeneric("glm")

[GitHub] spark pull request: SPARK-11760 - Fix getSeconds() to use the time...

2015-11-16 Thread jbonofre
Github user jbonofre closed the pull request at: https://github.com/apache/spark/pull/9738 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[GitHub] spark pull request: SPARK-11760 - Fix getSeconds() to use the time...

2015-11-16 Thread jbonofre
Github user jbonofre commented on the pull request: https://github.com/apache/spark/pull/9738#issuecomment-157102150 A fix has already been applied. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-11760 - Fix getSeconds() to use the time...

2015-11-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9738#issuecomment-157100489 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-11530] [MLLIB] Return eigenvalues with ...

2015-11-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9736#issuecomment-157099967 **[Test build #45998 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45998/consoleFull)** for PR 9736 at commit [`253235a`](https://gith

[GitHub] spark pull request: [Spark-11522][SQL] input_file_name() returns "...

2015-11-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9542 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-11743][SQL] Add UserDefinedType support...

2015-11-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9712 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-11752][SQL] fix timezone problem for Da...

2015-11-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9728 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: SPARK-11760 - Fix getSeconds() to use the time...

2015-11-16 Thread jbonofre
GitHub user jbonofre opened a pull request: https://github.com/apache/spark/pull/9738 SPARK-11760 - Fix getSeconds() to use the timezone You can merge this pull request into a Git repository by running: $ git pull https://github.com/jbonofre/spark SPARK-11760 Alternatively yo

[GitHub] spark pull request: [SPARK-11743][SQL] Add UserDefinedType support...

2015-11-16 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/9712#issuecomment-157098726 LGTM, merging this into master and 1.6 branch, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-11752][SQL] fix timezone problem for Da...

2015-11-16 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/9728#issuecomment-157097729 Merged into master, 1.6 and 1.5 branch --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project doe

[GitHub] spark pull request: [SPARK-11743][SQL] Add UserDefinedType support...

2015-11-16 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9712#discussion_r44949708 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/encoders/RowEncoderSuite.scala --- @@ -68,7 +117,36 @@ class RowEncoderSuite extends Spark

[GitHub] spark pull request: [SPARK-10852][PySpark][SQL] Override built-in ...

2015-11-16 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/8934#issuecomment-157095257 @viirya This PR only help a two corner cases, and they are not blocker (could be easily workaround), I'd like to not fix these (avoid the complexity). If we merge this on

[GitHub] spark pull request: [SPARK-11544][SQL] sqlContext doesn't use Path...

2015-11-16 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/9652#discussion_r44945464 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonSuite.scala --- @@ -1393,4 +1401,58 @@ class JsonSuite extends QueryT

[GitHub] spark pull request: [SPARK-11191] [SQL] [FOLLOW-UP] Cleans up unne...

2015-11-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9737#issuecomment-157084858 **[Test build #45997 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45997/consoleFull)** for PR 9737 at commit [`1cb40df`](https://git

[GitHub] spark pull request: [SPARK-11191] [SQL] [FOLLOW-UP] Cleans up unne...

2015-11-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9737#issuecomment-157085080 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11191] [SQL] [FOLLOW-UP] Cleans up unne...

2015-11-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9737#issuecomment-157085084 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-11544][SQL] sqlContext doesn't use Path...

2015-11-16 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/9652#discussion_r44942818 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonSuite.scala --- @@ -1393,4 +1401,58 @@ class JsonSuite extends QueryT

[GitHub] spark pull request: [SPARK-11544][SQL] sqlContext doesn't use Path...

2015-11-16 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/9652#discussion_r44942723 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonSuite.scala --- @@ -1393,4 +1401,58 @@ class JsonSuite extends QueryT

[GitHub] spark pull request: [Spark-11522][SQL] input_file_name() returns "...

2015-11-16 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/9542#issuecomment-157083196 @xwu0226 https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45977/consoleFull is good. I will merge it to master and branch 1.6. --- If your project is s

[GitHub] spark pull request: [SPARK-11544][SQL] sqlContext doesn't use Path...

2015-11-16 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/9652#discussion_r44942380 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/sources/interfaces.scala --- @@ -814,8 +821,18 @@ private[sql] object HadoopFsRelation extends Loggin

[GitHub] spark pull request: [SPARK-11652] [CORE] Remote code execution wit...

2015-11-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9731#issuecomment-157079364 **[Test build #2064 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2064/consoleFull)** for PR 9731 at commit [`0828753`](https://gi

[GitHub] spark pull request: [SPARK-11544][SQL] sqlContext doesn't use Path...

2015-11-16 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/9652#discussion_r44942050 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/sources/interfaces.scala --- @@ -440,9 +441,15 @@ abstract class HadoopFsRelation private[sql](maybe

[GitHub] spark pull request: [Spark-11522][SQL] input_file_name() returns "...

2015-11-16 Thread xwu0226
Github user xwu0226 commented on the pull request: https://github.com/apache/spark/pull/9542#issuecomment-157075099 @yhuai The last test build passed. Do you know what might cause the previous errors? After resolving the conflicts, my own diff for this PR is still the same place, that

[GitHub] spark pull request: [SPARK-11743][SQL] Add UserDefinedType support...

2015-11-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9712#issuecomment-157062181 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11743][SQL] Add UserDefinedType support...

2015-11-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9712#issuecomment-157062183 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-11743][SQL] Add UserDefinedType support...

2015-11-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9712#issuecomment-157061992 **[Test build #45994 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45994/consoleFull)** for PR 9712 at commit [`a5fdbce`](https://git

[GitHub] spark pull request: [SPARK-11551][DOC][Example]Replace example cod...

2015-11-16 Thread yinxusen
Github user yinxusen commented on the pull request: https://github.com/apache/spark/pull/9735#issuecomment-157041394 Hi @somideshmukh, thanks for working on this. You can use the PR https://github.com/apache/spark/pull/9713 as an example. What we need to do is replacing all raw code s

[GitHub] spark pull request: [SPARK-11057] [SQL] Add correlation and covari...

2015-11-16 Thread NarineK
Github user NarineK commented on a diff in the pull request: https://github.com/apache/spark/pull/9366#discussion_r44926444 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/stat/StatFunctions.scala --- @@ -33,6 +34,31 @@ private[sql] object StatFunctions extends Lo

[GitHub] spark pull request: [SPARK-11551][DOC][Example]Replace example cod...

2015-11-16 Thread yinxusen
Github user yinxusen commented on a diff in the pull request: https://github.com/apache/spark/pull/9735#discussion_r44926012 --- Diff: docs/ml-features.md --- @@ -53,7 +53,24 @@ Refer to the [HashingTF Java docs](api/java/org/apache/spark/ml/feature/HashingT Refer to the [Hash

[GitHub] spark pull request: [SPARK-11191] [SQL] [FOLLOW-UP] Cleans up unne...

2015-11-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9737#issuecomment-157037682 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-11530] [MLLIB] Return eigenvalues with ...

2015-11-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9736#issuecomment-157037907 **[Test build #2065 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2065/consoleFull)** for PR 9736 at commit [`e0b26c4`](https://gi

[GitHub] spark pull request: [SPARK-11551][DOC][Example]Replace example cod...

2015-11-16 Thread yinxusen
Github user yinxusen commented on a diff in the pull request: https://github.com/apache/spark/pull/9735#discussion_r44925725 --- Diff: docs/ml-features.md --- @@ -37,7 +37,7 @@ In the following code segment, we start with a set of sentences. We split each Refer to the [Hashin

[GitHub] spark pull request: [SPARK-11191] [SQL] [FOLLOW-UP] Cleans up unne...

2015-11-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9737#issuecomment-157037680 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11191] [SQL] [FOLLOW-UP] Cleans up unne...

2015-11-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9737#issuecomment-157037193 **[Test build #45997 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45997/consoleFull)** for PR 9737 at commit [`1cb40df`](https://gith

[GitHub] spark pull request: [SPARK-11692][SQL] Support for Parquet logical...

2015-11-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9658 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-11692][SQL] Support for Parquet logical...

2015-11-16 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/9658#issuecomment-157034946 Thanks! Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

<    1   2   3   4   5   6   7   >