[GitHub] spark issue #11336: [SPARK-9325][SPARK-R] collect() head() and show() for Co...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11336 **[Test build #66911 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66911/consoleFull)** for PR 11336 at commit [`445407c`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14690 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14690 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66906/ Test FAILed. ---

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14690 **[Test build #66906 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66906/consoleFull)** for PR 14690 at commit [`3a072bd`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #15307: [SPARK-17731][SQL][STREAMING] Metrics for structu...

2016-10-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15307 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15416: [SPARK-17849] [SQL] Fix NPE problem when using grouping ...

2016-10-13 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15416 @yangw1234 can you fix the scala styles? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enab

[GitHub] spark issue #15460: [SPARK-17903][SQL] MetastoreRelation should talk to exte...

2016-10-13 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/15460 LGTM if tests pass :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #15397: [SPARK-17834][SQL]Fetch the earliest offsets manu...

2016-10-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15397 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15460: [SPARK-17903][SQL] MetastoreRelation should talk to exte...

2016-10-13 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15460 A bunch of mysterious failures ... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark issue #15469: [SPARK-17900][SQL] Graduate a list of Spark SQL APIs to ...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15469 **[Test build #66910 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66910/consoleFull)** for PR 15469 at commit [`f712dd4`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #15460: [SPARK-17903][SQL] MetastoreRelation should talk to exte...

2016-10-13 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/15460 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #15397: [SPARK-17834][SQL]Fetch the earliest offsets manually in...

2016-10-13 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15397 Thanks! Merging to master and 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #15469: Graduate a list of Spark SQL APIs to stable

2016-10-13 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/15469 Graduate a list of Spark SQL APIs to stable ## What changes were proposed in this pull request? This patch graduates a list of Spark SQL APIs and mark them stable. The following are marked

[GitHub] spark issue #15307: [SPARK-17731][SQL][STREAMING] Metrics for structured str...

2016-10-13 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/15307 @marmbrus @brkyvz @zsxwing @koeninger Thank you very much for your feedback. I am going to merge this to master. I will open a different PR to merge this to branch 2.0 --- If your project is set up

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/14690 > Ok. I'm looking into the org.apache.spark.sql.hive.ParquetSourceSuite failure. I think that was caused by the p => pQ change --- If your project is set up for it, you can reply to this ema

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/14690 > Btw, I noticed that this suite was failing in jenkins only. > > [info] - partitioned pruned table reports only selected files *** FAILED *** (610 milliseconds) > > That's pretty wei

[GitHub] spark pull request #14690: [SPARK-16980][SQL] Load only catalog table partit...

2016-10-13 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/14690#discussion_r83302513 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala --- @@ -230,13 +230,21 @@ case class FileSourceScanExec( va

[GitHub] spark issue #15460: [SPARK-17903][SQL] MetastoreRelation should talk to exte...

2016-10-13 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15460 cc @ericl --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[GitHub] spark issue #13713: [SPARK-15994] [MESOS] Allow enabling Mesos fetch cache i...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13713 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66909/ Test PASSed. ---

[GitHub] spark issue #13713: [SPARK-15994] [MESOS] Allow enabling Mesos fetch cache i...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13713 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13713: [SPARK-15994] [MESOS] Allow enabling Mesos fetch cache i...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13713 **[Test build #66909 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66909/consoleFull)** for PR 13713 at commit [`7195c6e`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15397: [SPARK-17834][SQL]Fetch the earliest offsets manually in...

2016-10-13 Thread koeninger
Github user koeninger commented on the issue: https://github.com/apache/spark/pull/15397 LGTM, thanks for talking it through --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabl

[GitHub] spark pull request #15044: [SQL][SPARK-17490] Optimize SerializeFromObject()...

2016-10-13 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/15044#discussion_r83300104 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/CatalystTypeConvertersSuite.scala --- @@ -61,4 +63,39 @@ class CatalystTypeConverters

[GitHub] spark issue #15397: [SPARK-17834][SQL]Fetch the earliest offsets manually in...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15397 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15397: [SPARK-17834][SQL]Fetch the earliest offsets manually in...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15397 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66908/ Test PASSed. ---

[GitHub] spark issue #15397: [SPARK-17834][SQL]Fetch the earliest offsets manually in...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15397 **[Test build #66908 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66908/consoleFull)** for PR 15397 at commit [`7986f18`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14690 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66903/ Test FAILed. ---

[GitHub] spark issue #13713: [SPARK-15994] [MESOS] Allow enabling Mesos fetch cache i...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13713 **[Test build #66909 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66909/consoleFull)** for PR 13713 at commit [`7195c6e`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14690 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14690 **[Test build #66903 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66903/consoleFull)** for PR 14690 at commit [`d48ff10`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #13713: [SPARK-15994] [MESOS] Allow enabling Mesos fetch ...

2016-10-13 Thread drcrallen
Github user drcrallen commented on a diff in the pull request: https://github.com/apache/spark/pull/13713#discussion_r83297642 --- Diff: mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala --- @@ -369,9 +369,11 @@ trait MesosSchedulerUtils exten

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14690 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14690 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66899/ Test FAILed. ---

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14690 **[Test build #66899 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66899/consoleFull)** for PR 14690 at commit [`adeddbf`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15307: [SPARK-17731][SQL][STREAMING] Metrics for structured str...

2016-10-13 Thread marmbrus
Github user marmbrus commented on the issue: https://github.com/apache/spark/pull/15307 This LGTM as a first cut. Thanks for working on it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14690 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66898/ Test FAILed. ---

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14690 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14690 **[Test build #66898 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66898/consoleFull)** for PR 14690 at commit [`afb3340`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15327: [SPARK-16575] [spark core] partition calculation mismatc...

2016-10-13 Thread fidato13
Github user fidato13 commented on the issue: https://github.com/apache/spark/pull/15327 @rxin, The support for openCostInBytes, similar to SQL has now been added for the affected binaryFiles case. Can I please seek for your review and valuable suggestion for taking this forward and me

[GitHub] spark issue #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14547 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66907/ Test FAILed. ---

[GitHub] spark issue #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14547 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14547 **[Test build #66907 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66907/consoleFull)** for PR 14547 at commit [`b7d66df`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15397: [SPARK-17834][SQL]Fetch the earliest offsets manually in...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15397 **[Test build #66908 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66908/consoleFull)** for PR 15397 at commit [`7986f18`](https://github.com/apache/spark/commit/7

[GitHub] spark pull request #11105: [SPARK-12469][CORE] Data Property accumulators fo...

2016-10-13 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/11105#discussion_r83287789 --- Diff: core/src/main/scala/org/apache/spark/util/JsonProtocol.scala --- @@ -722,6 +722,7 @@ private[spark] object JsonProtocol { val value = Utils.

[GitHub] spark pull request #11105: [SPARK-12469][CORE] Data Property accumulators fo...

2016-10-13 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/11105#discussion_r83273608 --- Diff: core/src/main/scala/org/apache/spark/util/AccumulatorV2.scala --- @@ -42,18 +60,43 @@ private[spark] case class AccumulatorMetadata( * `OUT` sh

[GitHub] spark pull request #11105: [SPARK-12469][CORE] Data Property accumulators fo...

2016-10-13 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/11105#discussion_r83290175 --- Diff: core/src/main/scala/org/apache/spark/rdd/ShuffledRDD.scala --- @@ -104,10 +105,26 @@ class ShuffledRDD[K: ClassTag, V: ClassTag, C: ClassTag](

[GitHub] spark issue #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14547 **[Test build #66907 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66907/consoleFull)** for PR 14547 at commit [`b7d66df`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14690 **[Test build #66906 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66906/consoleFull)** for PR 14690 at commit [`3a072bd`](https://github.com/apache/spark/commit/3

[GitHub] spark pull request #11105: [SPARK-12469][CORE] Data Property accumulators fo...

2016-10-13 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/11105#discussion_r83280578 --- Diff: core/src/main/scala/org/apache/spark/util/AccumulatorV2.scala --- @@ -136,15 +179,76 @@ abstract class AccumulatorV2[IN, OUT] extends Serializable {

[GitHub] spark pull request #11105: [SPARK-12469][CORE] Data Property accumulators fo...

2016-10-13 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/11105#discussion_r83271510 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -1314,27 +1347,54 @@ class SparkContext(config: SparkConf) extends Logging with Execu

[GitHub] spark pull request #11105: [SPARK-12469][CORE] Data Property accumulators fo...

2016-10-13 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/11105#discussion_r83287564 --- Diff: core/src/main/scala/org/apache/spark/util/AccumulatorV2.scala --- @@ -136,15 +179,76 @@ abstract class AccumulatorV2[IN, OUT] extends Serializable {

[GitHub] spark pull request #11105: [SPARK-12469][CORE] Data Property accumulators fo...

2016-10-13 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/11105#discussion_r83284254 --- Diff: core/src/main/scala/org/apache/spark/util/AccumulatorV2.scala --- @@ -136,15 +179,76 @@ abstract class AccumulatorV2[IN, OUT] extends Serializable {

[GitHub] spark pull request #11105: [SPARK-12469][CORE] Data Property accumulators fo...

2016-10-13 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/11105#discussion_r83271825 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -1343,7 +1403,25 @@ class SparkContext(config: SparkConf) extends Logging with Execut

[GitHub] spark pull request #11105: [SPARK-12469][CORE] Data Property accumulators fo...

2016-10-13 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/11105#discussion_r83287419 --- Diff: core/src/main/scala/org/apache/spark/util/AccumulatorV2.scala --- @@ -42,18 +60,43 @@ private[spark] case class AccumulatorMetadata( * `OUT` sh

[GitHub] spark pull request #11105: [SPARK-12469][CORE] Data Property accumulators fo...

2016-10-13 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/11105#discussion_r83271147 --- Diff: core/src/main/scala/org/apache/spark/Accumulable.scala --- @@ -56,15 +61,26 @@ class Accumulable[R, T] private ( @transient private val init

[GitHub] spark pull request #11105: [SPARK-12469][CORE] Data Property accumulators fo...

2016-10-13 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/11105#discussion_r83291225 --- Diff: core/src/main/scala/org/apache/spark/TaskContextImpl.scala --- @@ -126,4 +126,14 @@ private[spark] class TaskContextImpl( taskMetrics.regist

[GitHub] spark pull request #11105: [SPARK-12469][CORE] Data Property accumulators fo...

2016-10-13 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/11105#discussion_r83272894 --- Diff: core/src/main/scala/org/apache/spark/rdd/MapPartitionsRDD.scala --- @@ -34,8 +35,29 @@ private[spark] class MapPartitionsRDD[U: ClassTag, T: ClassT

[GitHub] spark pull request #11105: [SPARK-12469][CORE] Data Property accumulators fo...

2016-10-13 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/11105#discussion_r83279340 --- Diff: core/src/main/scala/org/apache/spark/util/AccumulatorV2.scala --- @@ -136,15 +179,76 @@ abstract class AccumulatorV2[IN, OUT] extends Serializable {

[GitHub] spark pull request #15335: [SPARK-17769][Core][Scheduler]Some FetchFailure r...

2016-10-13 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/spark/pull/15335#discussion_r83289400 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -1255,27 +1255,46 @@ class DAGScheduler( s"longer r

[GitHub] spark pull request #15397: [SPARK-17834][SQL]Fetch the earliest offsets manu...

2016-10-13 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15397#discussion_r83289086 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -270,7 +281,7 @@ private[kafka010] case class Kafk

[GitHub] spark pull request #15397: [SPARK-17834][SQL]Fetch the earliest offsets manu...

2016-10-13 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15397#discussion_r83289072 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -256,8 +269,6 @@ private[kafka010] case class Kafk

[GitHub] spark issue #11336: [SPARK-9325][SPARK-R] collect() head() and show() for Co...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11336 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #11336: [SPARK-9325][SPARK-R] collect() head() and show() for Co...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11336 **[Test build #66905 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66905/consoleFull)** for PR 11336 at commit [`0691c32`](https://github.com/apache/spark/commit/

[GitHub] spark issue #11336: [SPARK-9325][SPARK-R] collect() head() and show() for Co...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11336 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66905/ Test FAILed. ---

[GitHub] spark issue #11336: [SPARK-9325][SPARK-R] collect() head() and show() for Co...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11336 **[Test build #66905 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66905/consoleFull)** for PR 11336 at commit [`0691c32`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #14963: [SPARK-16992][PYSPARK] Virtualenv for Pylint and pep8 in...

2016-10-13 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/14963 @Stibbons however the problem is the virtualenv that gets created when a user is in a conda enviroment is partially broken. --- If your project is set up for it, you can reply to this email and hav

[GitHub] spark pull request #15446: [SPARK-17882][SparkR] Fix swallowed exception in ...

2016-10-13 Thread jrshust
Github user jrshust closed the pull request at: https://github.com/apache/spark/pull/15446 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[GitHub] spark issue #15446: [SPARK-17882][SparkR] Fix swallowed exception in RBacken...

2016-10-13 Thread jrshust
Github user jrshust commented on the issue: https://github.com/apache/spark/pull/15446 yep. Closing since the fix is a duplicate of #15375. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/14690 MiMa is supposed to detect binary incompatible changes. Looking at the console output though, it seems like MiMa just crashed. Running `./dev/mima` locally worked though, so maybe it was some

[GitHub] spark issue #15468: [SPARK-17915][SQL] Prepare a new ColumnVector implementa...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15468 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66904/ Test FAILed. ---

[GitHub] spark issue #15468: [SPARK-17915][SQL] Prepare a new ColumnVector implementa...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15468 **[Test build #66904 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66904/consoleFull)** for PR 15468 at commit [`870c644`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15468: [SPARK-17915][SQL] Prepare a new ColumnVector implementa...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15468 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15397: [SPARK-17834][SQL]Fetch the earliest offsets manually in...

2016-10-13 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15397 > My main point is that whoever implements SPARK-17812 is going to have to deal with the issue shown in SPARK-17782, which means much of this patch is going to need to be changed anyway. @k

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/14690 > This patch fails MiMa tests. I've never seen this before. What does this mean? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as we

[GitHub] spark pull request #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-10-13 Thread vlad17
Github user vlad17 commented on a diff in the pull request: https://github.com/apache/spark/pull/14547#discussion_r83285393 --- Diff: python/pyspark/ml/regression.py --- @@ -1003,20 +1003,20 @@ class GBTRegressor(JavaEstimator, HasFeaturesCol, HasLabelCol, HasPredictionCol,

[GitHub] spark issue #15468: [SPARK-17915][SQL] Prepare a new ColumnVector implementa...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15468 **[Test build #66904 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66904/consoleFull)** for PR 15468 at commit [`870c644`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #15468: [SPARK-17915][SQL] Prepare a new ColumnVector implementa...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15468 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15468: [SPARK-17915][SQL] Prepare a new ColumnVector implementa...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15468 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66902/ Test FAILed. ---

[GitHub] spark issue #15468: [SPARK-17915][SQL] Prepare a new ColumnVector implementa...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15468 **[Test build #66902 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66902/consoleFull)** for PR 15468 at commit [`9a57147`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #15009: [SPARK-17443][SPARK-11035] Stop Spark Application...

2016-10-13 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/15009#discussion_r83277627 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -710,7 +724,12 @@ object SparkSubmit { printWarning("Subclasses of sc

[GitHub] spark pull request #15009: [SPARK-17443][SPARK-11035] Stop Spark Application...

2016-10-13 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/15009#discussion_r83280861 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -1189,6 +1217,10 @@ private[spark] class Client( private object Client exte

[GitHub] spark pull request #15009: [SPARK-17443][SPARK-11035] Stop Spark Application...

2016-10-13 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/15009#discussion_r83281329 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -1197,12 +1229,22 @@ private object Client extends Logging { // Set an

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14690 **[Test build #66903 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66903/consoleFull)** for PR 14690 at commit [`d48ff10`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #15468: [SPARK-17915][SQL] Prepare a new ColumnVector implementa...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15468 **[Test build #66902 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66902/consoleFull)** for PR 15468 at commit [`9a57147`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14690 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66900/ Test FAILed. ---

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14690 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14690 **[Test build #66900 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66900/consoleFull)** for PR 14690 at commit [`bf6f46f`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #15464: [SPARK-17827][SQL]maxColLength type should be Int...

2016-10-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15464 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15464: [SPARK-17827][SQL]maxColLength type should be Int for St...

2016-10-13 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15464 Merging to master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and w

[GitHub] spark issue #15467: [SPARK-17912][SQL] Refactor code generation to get data ...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15467 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66897/ Test PASSed. ---

[GitHub] spark pull request #14788: [SPARK-17174][SQL] Add the support for TimestampT...

2016-10-13 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14788#discussion_r83280122 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -916,21 +931,26 @@ case class ToDate(chi

[GitHub] spark issue #15467: [SPARK-17912][SQL] Refactor code generation to get data ...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15467 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15467: [SPARK-17912][SQL] Refactor code generation to get data ...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15467 **[Test build #66897 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66897/consoleFull)** for PR 15467 at commit [`5d78d01`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15468: [SPARK-17915][SQL] Prepare a new ColumnVector implementa...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15468 **[Test build #66901 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66901/consoleFull)** for PR 15468 at commit [`8b38531`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15468: [SPARK-17915][SQL] Prepare a new ColumnVector implementa...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15468 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15468: [SPARK-17915][SQL] Prepare a new ColumnVector implementa...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15468 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66901/ Test FAILed. ---

[GitHub] spark issue #15468: [SPARK-17915][SQL] Prepare a new ColumnVector implementa...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15468 **[Test build #66901 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66901/consoleFull)** for PR 15468 at commit [`8b38531`](https://github.com/apache/spark/commit/8

[GitHub] spark pull request #15457: [SPARK-17830][SQL] Annotate remaining SQL APIs wi...

2016-10-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15457 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-10-13 Thread vlad17
Github user vlad17 commented on a diff in the pull request: https://github.com/apache/spark/pull/14547#discussion_r83278154 --- Diff: mllib/src/test/scala/org/apache/spark/ml/util/GBTSuiteHelper.scala --- @@ -0,0 +1,271 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-10-13 Thread vlad17
Github user vlad17 commented on a diff in the pull request: https://github.com/apache/spark/pull/14547#discussion_r83278169 --- Diff: mllib/src/test/scala/org/apache/spark/ml/util/GBTSuiteHelper.scala --- @@ -0,0 +1,271 @@ +/* + * Licensed to the Apache Software Foundation

<    1   2   3   4   5   6   >