[GitHub] spark pull request: [SPARK-11691][SQL] Support setting hadoop comp...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11324#issuecomment-188661197 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11691][SQL] Support setting hadoop comp...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11324#issuecomment-188660473 **[Test build #51935 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51935/consoleFull)** for PR 11324 at commit

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-24 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/11136#discussion_r54059562 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/GeneralizedLinearRegression.scala --- @@ -0,0 +1,565 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-24 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/11136#discussion_r54059544 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/GeneralizedLinearRegression.scala --- @@ -0,0 +1,565 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-24 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/11136#discussion_r54059585 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/GeneralizedLinearRegression.scala --- @@ -0,0 +1,565 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-24 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/11136#discussion_r54059572 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/GeneralizedLinearRegression.scala --- @@ -0,0 +1,565 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-24 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/11136#discussion_r54059552 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/GeneralizedLinearRegression.scala --- @@ -0,0 +1,565 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-24 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/11136#discussion_r54059534 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/GeneralizedLinearRegression.scala --- @@ -0,0 +1,565 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-24 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/11136#discussion_r54059489 --- Diff: mllib/src/test/scala/org/apache/spark/ml/regression/GeneralizedLinearRegressionSuite.scala --- @@ -0,0 +1,499 @@ +/* + * Licensed to the

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-24 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/11136#discussion_r54059524 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/WeightedLeastSquares.scala --- @@ -156,6 +156,8 @@ private[ml] class WeightedLeastSquares(

[GitHub] spark pull request: [SPARK-7106][MLlib][PySpark] Support model sav...

2016-02-24 Thread vectorijk
Github user vectorijk commented on the pull request: https://github.com/apache/spark/pull/11321#issuecomment-188658913 @mengxr, Thanks for replying! Definitely, I will post a rough draft proposal on JIRA later. On Wed, Feb 24, 2016 at 11:31 PM, Xiangrui Meng

[GitHub] spark pull request: [SPARK-12864][YARN] initialize executorIdCount...

2016-02-24 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/10794#discussion_r54059178 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala --- @@ -78,6 +78,9 @@ class

[GitHub] spark pull request: [Minor][SPARK-13482][Configuration]Make consis...

2016-02-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11360 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-12864][YARN] initialize executorIdCount...

2016-02-24 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/10794#discussion_r54058886 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala --- @@ -81,8 +82,20 @@ private[yarn] class YarnAllocator( new

[GitHub] spark pull request: [Minor][SPARK-13482][Configuration]Make consis...

2016-02-24 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11360#issuecomment-188658196 Thanks - going to merge this in master and branch-1.6. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-12864][YARN] initialize executorIdCount...

2016-02-24 Thread zhonghaihua
Github user zhonghaihua commented on a diff in the pull request: https://github.com/apache/spark/pull/10794#discussion_r54058736 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala --- @@ -81,8 +82,20 @@ private[yarn] class YarnAllocator( new

[GitHub] spark pull request: [SPARK-12864][YARN] initialize executorIdCount...

2016-02-24 Thread zhonghaihua
Github user zhonghaihua commented on a diff in the pull request: https://github.com/apache/spark/pull/10794#discussion_r54058368 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala --- @@ -78,6 +78,9 @@ class

[GitHub] spark pull request: [SPARK-12613] [SQL] Outer Join Elimination by ...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10566#issuecomment-188656355 **[Test build #51943 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51943/consoleFull)** for PR 10566 at commit

[GitHub] spark pull request: [SPARK-13069][STREAMING]. Adds synchronous sto...

2016-02-24 Thread lin-zhao
Github user lin-zhao commented on a diff in the pull request: https://github.com/apache/spark/pull/11176#discussion_r54057678 --- Diff: external/akka/src/main/scala/org/apache/spark/streaming/akka/ActorReceiver.scala --- @@ -162,6 +177,18 @@ abstract class JavaActorReceiver

[GitHub] spark pull request: [SPARK-12864][YARN] initialize executorIdCount...

2016-02-24 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/10794#discussion_r54057627 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala --- @@ -81,8 +82,20 @@ private[yarn] class YarnAllocator( new

[GitHub] spark pull request: [SPARK-7106][MLlib][PySpark] Support model sav...

2016-02-24 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/11321#issuecomment-188651306 LGTM. Merged into master. Thanks! For GSoC, I created https://issues.apache.org/jira/browse/SPARK-13489 to collect some project ideas. Let's move our discussion

[GitHub] spark pull request: [SPARK-12864][YARN] initialize executorIdCount...

2016-02-24 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/10794#discussion_r54057531 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala --- @@ -78,6 +78,9 @@ class

[GitHub] spark pull request: [SPARK-7106][MLlib][PySpark] Support model sav...

2016-02-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11321 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-13479] [SQL] [PYTHON] Added Python API ...

2016-02-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11356 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-13479] [SQL] [PYTHON] Added Python API ...

2016-02-24 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/11356#issuecomment-188647418 Merged into master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-13454] [SQL] Allow users to drop a tabl...

2016-02-24 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/11349#discussion_r54056540 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveMetastoreCatalogSuite.scala --- @@ -47,6 +47,17 @@ class HiveMetastoreCatalogSuite

[GitHub] spark pull request: [SPARK-13233][SQL][WIP] Python Dataset (basic ...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11347#issuecomment-188647094 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13233][SQL][WIP] Python Dataset (basic ...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11347#issuecomment-188647091 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13233][SQL][WIP] Python Dataset (basic ...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11347#issuecomment-188646971 **[Test build #51926 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51926/consoleFull)** for PR 11347 at commit

[GitHub] spark pull request: [SPARK-13454] [SQL] Allow users to drop a tabl...

2016-02-24 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/11349#discussion_r54055804 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveQl.scala --- @@ -542,7 +542,14 @@

[GitHub] spark pull request: [SPARK-13233][SQL][WIP] Python Dataset (basic ...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11347#issuecomment-188640712 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13233][SQL][WIP] Python Dataset (basic ...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11347#issuecomment-188640714 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13233][SQL][WIP] Python Dataset (basic ...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11347#issuecomment-188640208 **[Test build #51925 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51925/consoleFull)** for PR 11347 at commit

[GitHub] spark pull request: [SPARK-8813][SQL]Combine splits by size

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9097#issuecomment-188638097 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8813][SQL]Combine splits by size

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9097#issuecomment-188638099 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-8813][SQL]Combine splits by size

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9097#issuecomment-188637662 **[Test build #51929 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51929/consoleFull)** for PR 9097 at commit

[GitHub] spark pull request: [SPARK-12820][SQL]Resolve db.table.column

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10753#issuecomment-188634972 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-12820][SQL]Resolve db.table.column

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10753#issuecomment-188634976 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12820][SQL]Resolve db.table.column

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10753#issuecomment-188634859 **[Test build #51930 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51930/consoleFull)** for PR 10753 at commit

[GitHub] spark pull request: [SPARK-13487][SQL] User-facing RuntimeConfig i...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11364#issuecomment-188634685 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13487][SQL] User-facing RuntimeConfig i...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11364#issuecomment-188634677 **[Test build #51939 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51939/consoleFull)** for PR 11364 at commit

[GitHub] spark pull request: [SPARK-13487][SQL] User-facing RuntimeConfig i...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11364#issuecomment-188634683 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13486][SQL] Move SQLConf into an intern...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11363#issuecomment-188634681 **[Test build #51942 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51942/consoleFull)** for PR 11363 at commit

[GitHub] spark pull request: [SPARK-13361][SQL] Add benchmark codes for Enc...

2016-02-24 Thread maropu
Github user maropu commented on the pull request: https://github.com/apache/spark/pull/11236#issuecomment-188634551 @nongli @rxin ping --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-13486][SQL] Move SQLConf into an intern...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11363#issuecomment-188634349 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13487][SQL] User-facing RuntimeConfig i...

2016-02-24 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11364#issuecomment-188634330 Note that Jenkins will fail, until we merge #11363 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13487][SQL] User-facing RuntimeConfig i...

2016-02-24 Thread rxin
Github user rxin closed the pull request at: https://github.com/apache/spark/pull/11364 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-13486][SQL] Move SQLConf into an intern...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11363#issuecomment-188634322 **[Test build #51937 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51937/consoleFull)** for PR 11363 at commit

[GitHub] spark pull request: [SPARK-13486][SQL] Move SQLConf into an intern...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11363#issuecomment-188634351 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13376] [SPARK-13476] [SQL] improve colu...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11354#issuecomment-188633958 **[Test build #51940 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51940/consoleFull)** for PR 11354 at commit

[GitHub] spark pull request: [SPARK-11691][SQL] Support setting hadoop comp...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11324#issuecomment-188633964 **[Test build #51941 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51941/consoleFull)** for PR 11324 at commit

[GitHub] spark pull request: [SPARK-13487][SQL] User-facing RuntimeConfig i...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11364#issuecomment-188633957 **[Test build #51939 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51939/consoleFull)** for PR 11364 at commit

[GitHub] spark pull request: [SPARK-13487][SQL] User-facing RuntimeConfig i...

2016-02-24 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11364#issuecomment-188633707 cc @marmbrus --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-13486][SQL] Move SQLConf into an intern...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11363#issuecomment-188633649 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13487][SQL] User-facing RuntimeConfig i...

2016-02-24 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/11364 [SPARK-13487][SQL] User-facing RuntimeConfig interface ## What changes were proposed in this pull request? This patch creates the public API for runtime configuration and an implementation for

[GitHub] spark pull request: [SPARK-13486][SQL] Move SQLConf into an intern...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11363#issuecomment-188633638 **[Test build #51936 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51936/consoleFull)** for PR 11363 at commit

[GitHub] spark pull request: [SPARK-13486][SQL] Move SQLConf into an intern...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11363#issuecomment-188633652 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11691][SQL] Support setting hadoop comp...

2016-02-24 Thread maropu
Github user maropu commented on the pull request: https://github.com/apache/spark/pull/11324#issuecomment-188633506 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-13479] [SQL] [PYTHON] Added Python API ...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11356#issuecomment-188633385 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13479] [SQL] [PYTHON] Added Python API ...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11356#issuecomment-188633381 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13479] [SQL] [PYTHON] Added Python API ...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11356#issuecomment-188633059 **[Test build #51933 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51933/consoleFull)** for PR 11356 at commit

[GitHub] spark pull request: [SPARK-12864][YARN] initialize executorIdCount...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10794#issuecomment-188633095 **[Test build #51938 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51938/consoleFull)** for PR 10794 at commit

[GitHub] spark pull request: [SPARK-13486][SQL] Move SQLConf into an intern...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11363#issuecomment-188632407 **[Test build #51937 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51937/consoleFull)** for PR 11363 at commit

[GitHub] spark pull request: [SPARK-13486][SQL] Move SQLConf into an intern...

2016-02-24 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11363#issuecomment-188632012 cc @cloud-fan for review --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-13486][SQL] Move SQLConf into an intern...

2016-02-24 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/11363#discussion_r54052828 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/test/TestSQLContext.scala --- @@ -39,7 +39,7 @@ private[sql] class TestSQLContext(sc: SparkContext)

[GitHub] spark pull request: [SPARK-13486][SQL] Move SQLConf into an intern...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11363#issuecomment-188631746 **[Test build #51936 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51936/consoleFull)** for PR 11363 at commit

[GitHub] spark pull request: [SPARK-13486][SQL] Move SQLConf into an intern...

2016-02-24 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/11363 [SPARK-13486][SQL] Move SQLConf into an internal package ## What changes were proposed in this pull request? This patch moves SQLConf into org.apache.spark.sql.internal package to make it very

[GitHub] spark pull request: [SPARK-13479] [SQL] [PYTHON] Added Python API ...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11356#issuecomment-188631576 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13479] [SQL] [PYTHON] Added Python API ...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11356#issuecomment-188631579 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13479] [SQL] [PYTHON] Added Python API ...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11356#issuecomment-188631382 **[Test build #51932 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51932/consoleFull)** for PR 11356 at commit

[GitHub] spark pull request: [SPARK-13321][SQL] Support nested UNION in par...

2016-02-24 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11361#issuecomment-188629681 Can you take a look why would 2 queries take 13 mins? ``` EXPLAIN SELECT count(1) FROM ( SELECT key, value FROM src UNION ALL SELECT key, value

[GitHub] spark pull request: [SPARK-11691][SQL] Support setting hadoop comp...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11324#issuecomment-188627486 **[Test build #51934 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51934/consoleFull)** for PR 11324 at commit

[GitHub] spark pull request: [SPARK-11691][SQL] Support setting hadoop comp...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11324#issuecomment-188627492 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11691][SQL] Support setting hadoop comp...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11324#issuecomment-188627490 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11691][SQL] Support setting hadoop comp...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11324#issuecomment-188627467 **[Test build #51935 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51935/consoleFull)** for PR 11324 at commit

[GitHub] spark pull request: [SPARK-13321][SQL] Support nested UNION in par...

2016-02-24 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/11361#issuecomment-188627434 @rxin Looks like HiveCompatibilitySuite.union16 doesn't hang from this. But it actually takes long time to finish that test (`[info] - union16 (13 minutes, 21

[GitHub] spark pull request: [SPARK-13321][SQL] Support nested UNION in par...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11361#issuecomment-188626798 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13321][SQL] Support nested UNION in par...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11361#issuecomment-188626796 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11691][SQL] Support setting hadoop comp...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11324#issuecomment-188626411 **[Test build #51934 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51934/consoleFull)** for PR 11324 at commit

[GitHub] spark pull request: [SPARK-13321][SQL] Support nested UNION in par...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11361#issuecomment-188626175 **[Test build #51928 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51928/consoleFull)** for PR 11361 at commit

[GitHub] spark pull request: [Minor][SPARK-13482][Configuration]Make consis...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11360#issuecomment-188625878 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [Minor][SPARK-13482][Configuration]Make consis...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11360#issuecomment-188625881 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [Minor][SPARK-13482][Configuration]Make consis...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11360#issuecomment-188624899 **[Test build #51927 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51927/consoleFull)** for PR 11360 at commit

[GitHub] spark pull request: [SPARK-13471] [SQL]: WiP update hive version t...

2016-02-24 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/11346#issuecomment-188622694 @steveloughran do we also needs an update for master branch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: [SPARK-13478] [yarn] Use real user when fetchi...

2016-02-24 Thread harishreedharan
Github user harishreedharan commented on the pull request: https://github.com/apache/spark/pull/11358#issuecomment-188621725 This looks like it might affect HDFS tokens as well and error that looks like this might come up during the initial token renewal: ``` WARN

[GitHub] spark pull request: [SPARK-6735][YARN] Add window based executor f...

2016-02-24 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/10241#discussion_r54049969 --- Diff: docs/running-on-yarn.md --- @@ -318,6 +318,14 @@ If you need a reference to the proper location to put log files in the YARN so t

[GitHub] spark pull request: [SPARK-13478] [yarn] Use real user when fetchi...

2016-02-24 Thread harishreedharan
Github user harishreedharan commented on the pull request: https://github.com/apache/spark/pull/11358#issuecomment-188615270 So I have not tested using the keytab-based login with proxy user stuff at all. We get delegation tokens even there - does this issue affect that as well?

[GitHub] spark pull request: [SPARK-13123][SQL] Implement whole state codeg...

2016-02-24 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11359#issuecomment-188613970 @sameeragarwal you should update the pr description to actually include what this patch does (in addition to that it was built on an earlier pr). For code gen

[GitHub] spark pull request: [SPARK-13320] [SQL] Support Star in CreateStru...

2016-02-24 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/11208#discussion_r54048383 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -369,28 +370,83 @@ class Analyzer( }

[GitHub] spark pull request: [SPARK-13479] [SQL] [PYTHON] Added Python API ...

2016-02-24 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/11356#issuecomment-188613807 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-13479] [SQL] [PYTHON] Added Python API ...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11356#issuecomment-18865 **[Test build #51933 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51933/consoleFull)** for PR 11356 at commit

[GitHub] spark pull request: [SPARK-13292][ML][PYTHON] QuantileDiscretizer ...

2016-02-24 Thread yu-iskw
Github user yu-iskw commented on the pull request: https://github.com/apache/spark/pull/11362#issuecomment-188610588 @mengxr can you review it when you have time? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-13479] [SQL] [PYTHON] Added Python API ...

2016-02-24 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/11356#discussion_r54047942 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameStatFunctions.scala --- @@ -71,6 +71,41 @@ final class DataFrameStatFunctions

[GitHub] spark pull request: [SPARK-13292][ML][PYTHON] QuantileDiscretizer ...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11362#issuecomment-188609863 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13292][ML][PYTHON] QuantileDiscretizer ...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11362#issuecomment-188609862 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13292][ML][PYTHON] QuantileDiscretizer ...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11362#issuecomment-188609806 **[Test build #51931 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51931/consoleFull)** for PR 11362 at commit

[GitHub] spark pull request: [SPARK-13479] [SQL] [PYTHON] Added Python API ...

2016-02-24 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/11356#discussion_r54047585 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameStatFunctions.scala --- @@ -71,6 +71,41 @@ final class DataFrameStatFunctions

[GitHub] spark pull request: [SPARK-13376] [SPARK-13476] [SQL] improve colu...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11354#issuecomment-188608671 **[Test build #2583 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2583/consoleFull)** for PR 11354 at commit

[GitHub] spark pull request: [SPARK-13479] [SQL] [PYTHON] Added Python API ...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11356#issuecomment-188608553 **[Test build #51932 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51932/consoleFull)** for PR 11356 at commit

[GitHub] spark pull request: [SPARK-13479] [SQL] [PYTHON] Added Python API ...

2016-02-24 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/11356#discussion_r54047396 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameStatFunctions.scala --- @@ -71,6 +71,41 @@ final class DataFrameStatFunctions

  1   2   3   4   5   6   >