[GitHub] spark pull request: [SPARK-8688][YARN]Bug fix: disable the cache f...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7069#issuecomment-116251762 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8688][YARN]Bug fix: disable the cache f...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7069#issuecomment-116251692 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8688][YARN]Bug fix: disable the cache f...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7069#issuecomment-116251880 [Test build #35935 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35935/consoleFull) for PR 7069 at commit

[GitHub] spark pull request: [SPARK-7944][SPARK-8013] Remove most of the Sp...

2015-06-28 Thread dragos
Github user dragos commented on a diff in the pull request: https://github.com/apache/spark/pull/6903#discussion_r33421311 --- Diff: repl/scala-2.11/src/main/scala/org/apache/spark/repl/SparkILoop.scala --- @@ -1,88 +1,64 @@ -/* NSC -- new Scala compiler - * Copyright

[GitHub] spark pull request: [SPARK-7944][SPARK-8013] Remove most of the Sp...

2015-06-28 Thread dragos
Github user dragos commented on a diff in the pull request: https://github.com/apache/spark/pull/6903#discussion_r33421316 --- Diff: pom.xml --- @@ -1227,6 +1222,7 @@ encodingUTF-8/encoding maxmem1024m/maxmem forktrue/fork +

[GitHub] spark pull request: [SPARK-8688][YARN]Bug fix: disable the cache f...

2015-06-28 Thread SaintBacchus
Github user SaintBacchus commented on a diff in the pull request: https://github.com/apache/spark/pull/7069#discussion_r33421898 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala --- @@ -334,6 +334,16 @@ class SparkHadoopUtil extends Logging { *

[GitHub] spark pull request: [SPARK-8688][YARN]Bug fix: disable the cache f...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7069#issuecomment-116272214 [Test build #35937 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35937/consoleFull) for PR 7069 at commit

[GitHub] spark pull request: [SPARK-7944][SPARK-8013] Remove most of the Sp...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6903#issuecomment-116272283 [Test build #35936 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35936/consoleFull) for PR 6903 at commit

[GitHub] spark pull request: [WIP] Binary processing sort for Spark SQL

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6444#issuecomment-116240820 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [WIP] Binary processing sort for Spark SQL

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6444#issuecomment-116240665 [Test build #35926 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35926/console) for PR 6444 at commit

[GitHub] spark pull request: [SPARK-8664] [ML] Add PCA transformer

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7065#issuecomment-116241394 [Test build #35929 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35929/console) for PR 7065 at commit

[GitHub] spark pull request: [SPARK-8688][YARN]Bug fix: disable the cache f...

2015-06-28 Thread SaintBacchus
GitHub user SaintBacchus opened a pull request: https://github.com/apache/spark/pull/7069 [SPARK-8688][YARN]Bug fix: disable the cache fs to gain the HDFS connection. If `fs.hdfs.impl.disable.cache` was `false`(default), `FileSystem` will use the cached `DFSClient` which use old

[GitHub] spark pull request: [SPARK-8689][SQL] Add get* methods with fieldN...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7067#issuecomment-116253498 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8653][SPARK-8245][SQL] Add DataTypeCons...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7034#issuecomment-116253536 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8689][SQL] Add get* methods with fieldN...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7067#issuecomment-116253494 [Test build #35932 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35932/console) for PR 7067 at commit

[GitHub] spark pull request: [SPARK-8653][SPARK-8245][SQL] Add DataTypeCons...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7034#issuecomment-116253531 [Test build #35933 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35933/console) for PR 7034 at commit

[GitHub] spark pull request: [SPARK-8679][SQL] remove dummy java class Base...

2015-06-28 Thread cloud-fan
Github user cloud-fan closed the pull request at: https://github.com/apache/spark/pull/7059 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-6910] [SQL] Support for pushing predica...

2015-06-28 Thread piaozhexiu
Github user piaozhexiu commented on the pull request: https://github.com/apache/spark/pull/6921#issuecomment-116243679 @marmbrus I got all the unit tests passing now. Can you please review my patch? This is no longer WIP. I incorporated all your suggestions. A couple of

[GitHub] spark pull request: [SPARK-8690][SQL] Add a setting to disable Spa...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7070#issuecomment-116253471 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7944][SPARK-8013] Remove most of the Sp...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6903#issuecomment-116258000 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8688][YARN]Bug fix: disable the cache f...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7069#issuecomment-116262691 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8679][SQL] remove dummy java class Base...

2015-06-28 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/7059#issuecomment-116268772 closing in favor of https://github.com/apache/spark/pull/7003 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: [SPARK-7944][SPARK-8013] Remove most of the Sp...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6903#issuecomment-116271284 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8688][YARN]Bug fix: disable the cache f...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7069#issuecomment-116271285 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8610] [SQL] Separate Row and InternalRo...

2015-06-28 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/7003#issuecomment-116271563 LGTM. For data source API, I understand we need an efficient `buildScan` that return `RDD[InternalRow]` as `RDD[Row]`. But I'm still feel we should make

[GitHub] spark pull request: [SPARK-8688][YARN]Bug fix: disable the cache f...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7069#issuecomment-116271238 [Test build #35935 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35935/console) for PR 7069 at commit

[GitHub] spark pull request: [SPARK-8688][YARN]Bug fix: disable the cache f...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7069#issuecomment-116271265 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8650][SQL] Use the user-specified app n...

2015-06-28 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/7030#discussion_r33419288 --- Diff: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkSQLEnv.scala --- @@ -38,9 +38,11 @@ private[hive] object

[GitHub] spark pull request: [SPARK-8650][SQL] Use the user-specified app n...

2015-06-28 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/7030#issuecomment-116205783 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-8610] [SQL] Separate Row and InternalRo...

2015-06-28 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7003#issuecomment-116206108 (That test failure is my fault; already hotfixed) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-8610] [SQL] Separate Row and InternalRo...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7003#issuecomment-116206133 [Test build #969 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/969/consoleFull) for PR 7003 at commit

[GitHub] spark pull request: [SPARK-8610] [SQL] Separate Row and InternalRo...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7003#issuecomment-116206173 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8610] [SQL] Separate Row and InternalRo...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7003#issuecomment-116206176 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-5161] [WIP] Parallelize Python test exe...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7031#issuecomment-116206123 [Test build #35918 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35918/consoleFull) for PR 7031 at commit

[GitHub] spark pull request: [SPARK-5161] [WIP] Parallelize Python test exe...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7031#issuecomment-116207504 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-5161] [WIP] Parallelize Python test exe...

2015-06-28 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7031#issuecomment-116206924 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-5161] [WIP] Parallelize Python test exe...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7031#issuecomment-116207547 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6910] [SQL] [WIP] Support for pushing p...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6921#issuecomment-116207971 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6910] [SQL] [WIP] Support for pushing p...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6921#issuecomment-116207973 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-5161] [WIP] Parallelize Python test exe...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7031#issuecomment-116208416 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-5161] [WIP] Parallelize Python test exe...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7031#issuecomment-116208411 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [WIP] Binary processing sort for Spark SQL

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6444#issuecomment-116208417 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [WIP] Binary processing sort for Spark SQL

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6444#issuecomment-116208443 [Test build #35926 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35926/consoleFull) for PR 6444 at commit

[GitHub] spark pull request: [WIP] Binary processing sort for Spark SQL

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6444#issuecomment-116208412 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-5161] [WIP] Parallelize Python test exe...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7031#issuecomment-116208419 [Test build #35925 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35925/consoleFull) for PR 7031 at commit

[GitHub] spark pull request: [SPARK-5161] [WIP] Parallelize Python test exe...

2015-06-28 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7031#issuecomment-116208897 Looks like that didn't help: ``` Build step 'Publish JUnit test result report' changed build result to UNSTABLE Finished: UNSTABLE ``` --- If

[GitHub] spark pull request: [SPARK-8214][SQL]Add function hex

2015-06-28 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/6976#discussion_r33420090 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala --- @@ -1047,6 +1047,22 @@ object functions { def floor(columnName: String):

[GitHub] spark pull request: [SPARK-5161] [WIP] Parallelize Python test exe...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7031#issuecomment-116218969 [Test build #35927 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35927/console) for PR 7031 at commit

[GitHub] spark pull request: [SPARK-5161] [WIP] Parallelize Python test exe...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7031#issuecomment-116219009 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-5962] [MLlib] Python support for Power ...

2015-06-28 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/6992#discussion_r33420166 --- Diff: python/pyspark/mllib/clustering.py --- @@ -466,7 +557,8 @@ def predictOnValues(self, dstream): def _test(): import doctest

[GitHub] spark pull request: [SPARK-8579] [SQL] support arbitrary object in...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6959#issuecomment-116223882 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8686][SQL] DataFrame should support `wh...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7063#issuecomment-116223325 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8664] [ML] Add PCA transformer

2015-06-28 Thread yanboliang
GitHub user yanboliang opened a pull request: https://github.com/apache/spark/pull/7065 [SPARK-8664] [ML] Add PCA transformer Add PCA transformer for ML pipeline You can merge this pull request into a Git repository by running: $ git pull https://github.com/yanboliang/spark

[GitHub] spark pull request: [SPARK-8664] [ML] Add PCA transformer

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7065#issuecomment-116224957 [Test build #35929 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35929/consoleFull) for PR 7065 at commit

[GitHub] spark pull request: [SPARK-5155] [PySpark] [Streaming] Mqtt stream...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4229#issuecomment-116224970 [Test build #35930 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35930/console) for PR 4229 at commit

[GitHub] spark pull request: [SPARK-5155] [PySpark] [Streaming] Mqtt stream...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4229#issuecomment-116224973 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8610] [SQL] Separate Row and InternalRo...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7003#issuecomment-116224980 [Test build #970 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/970/console) for PR 7003 at commit

[GitHub] spark pull request: [SPARK-8579] [SQL] support arbitrary object in...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6959#issuecomment-116224993 [Test build #35922 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35922/console) for PR 6959 at commit

[GitHub] spark pull request: [SPARK-8687][YARN]Fix bug: Executor can't fetc...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7066#issuecomment-116226786 [Test build #35931 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35931/consoleFull) for PR 7066 at commit

[GitHub] spark pull request: [SPARK-8596][EC2] Added port for Rstudio

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7068#issuecomment-116228309 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8653][SPARK-8245][SQL] Add DataTypeCons...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7034#issuecomment-116228316 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8653][SPARK-8245][SQL] Add DataTypeCons...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7034#issuecomment-116228336 [Test build #35933 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35933/consoleFull) for PR 7034 at commit

[GitHub] spark pull request: [SPARK-8653][SPARK-8245][SQL] Add DataTypeCons...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7034#issuecomment-116228313 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-4176][WIP] Support decimal types with p...

2015-06-28 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/6796#discussion_r33420570 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/parquet/CatalystSchemaConverter.scala --- @@ -383,20 +386,14 @@ private[parquet] class

[GitHub] spark pull request: [SPARK-4176][WIP] Support decimal types with p...

2015-06-28 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/6796#discussion_r33420649 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/parquet/CatalystSchemaConverter.scala --- @@ -404,9 +401,10 @@ private[parquet] class

[GitHub] spark pull request: [SPARK-4176][WIP] Support decimal types with p...

2015-06-28 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/6796#discussion_r33420652 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/parquet/CatalystSchemaConverter.scala --- @@ -562,4 +560,5 @@ private[parquet] object

[GitHub] spark pull request: [SPARK-4176][WIP] Support decimal types with p...

2015-06-28 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/6796#discussion_r33420661 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTableSupport.scala --- @@ -212,10 +212,7 @@ private[parquet] class RowWriteSupport

[GitHub] spark pull request: [SPARK-4176][WIP] Support decimal types with p...

2015-06-28 Thread rtreffer
Github user rtreffer commented on a diff in the pull request: https://github.com/apache/spark/pull/6796#discussion_r33420742 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/parquet/CatalystSchemaConverter.scala --- @@ -383,20 +386,14 @@ private[parquet] class

[GitHub] spark pull request: [SPARK-8686][SQL] DataFrame should support `wh...

2015-06-28 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/7063#issuecomment-116205754 This failure was due to a bug in dev/run-test.py and it's been already resolved. Jenkins, retest this please. --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-8610] [SQL] Separate Row and InternalRo...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7003#issuecomment-116206071 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6910] [SQL] [WIP] Support for pushing p...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6921#issuecomment-116206067 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8579] [SQL] support arbitrary object in...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6959#issuecomment-116206063 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8683] [BUILD] Depend on mockito-core in...

2015-06-28 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7061#issuecomment-116206053 Alright, I'm going to merge this now. I'll backport to branch-1.4 later if it turns out to be necessary for backporting regression tests. --- If your project is set

[GitHub] spark pull request: [SPARK-5161] [WIP] Parallelize Python test exe...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7031#issuecomment-116206065 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-5161] [WIP] Parallelize Python test exe...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7031#issuecomment-116206054 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8610] [SQL] Separate Row and InternalRo...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7003#issuecomment-116206068 [Test build #35916 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35916/console) for PR 7003 at commit

[GitHub] spark pull request: [SPARK-8579] [SQL] support arbitrary object in...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6959#issuecomment-116206084 [Test build #35919 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35919/consoleFull) for PR 6959 at commit

[GitHub] spark pull request: [SPARK-8610] [SQL] Separate Row and InternalRo...

2015-06-28 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7003#issuecomment-116206104 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8683] [BUILD] Depend on mockito-core in...

2015-06-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7061 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-8579] [SQL] support arbitrary object in...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6959#issuecomment-116206668 [Test build #35922 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35922/consoleFull) for PR 6959 at commit

[GitHub] spark pull request: [SPARK-8579] [SQL] support arbitrary object in...

2015-06-28 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/6959#discussion_r33419372 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeRow.java --- @@ -48,7 +38,15 @@ * primitive types, such as long,

[GitHub] spark pull request: [SPARK-8579] [SQL] support arbitrary object in...

2015-06-28 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/6959#discussion_r33419369 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeRow.java --- @@ -171,8 +122,64 @@ private void setNotNullAt(int i) {

[GitHub] spark pull request: [SPARK-5161] [WIP] Parallelize Python test exe...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7031#issuecomment-116207939 [Test build #35923 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35923/consoleFull) for PR 7031 at commit

[GitHub] spark pull request: [SPARK-5161] [WIP] Parallelize Python test exe...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7031#issuecomment-116208281 [Test build #35923 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35923/console) for PR 7031 at commit

[GitHub] spark pull request: [SPARK-8437] [DOCS] Using directory path witho...

2015-06-28 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/7036#issuecomment-116208664 The JIRA says local, HDFS, S3. Yes you can repro easily with something like `sc.binaryFiles(/Users/srowen/Library/Caches/Metadata/Safari/History/).count()` vs adding a

[GitHub] spark pull request: [SPARK-5562][MLlib] LDA should handle empty do...

2015-06-28 Thread aloknsingh
Github user aloknsingh commented on a diff in the pull request: https://github.com/apache/spark/pull/7064#discussion_r33419658 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/clustering/LDASuite.scala --- @@ -232,12 +238,20 @@ private[clustering] object LDASuite { }

[GitHub] spark pull request: [SPARK-5562][MLlib] LDA should handle empty do...

2015-06-28 Thread aloknsingh
Github user aloknsingh commented on a diff in the pull request: https://github.com/apache/spark/pull/7064#discussion_r33419654 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/LDAOptimizer.scala --- @@ -119,6 +119,18 @@ final class EMLDAOptimizer extends

[GitHub] spark pull request: [SPARK-5161] [WIP] Parallelize Python test exe...

2015-06-28 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7031#issuecomment-116213031 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8214][SQL]Add function hex

2015-06-28 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/6976#discussion_r33420012 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/math.scala --- @@ -287,6 +286,88 @@ case class Pow(left: Expression, right:

[GitHub] spark pull request: [SPARK-8214][SQL]Add function hex

2015-06-28 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/6976#discussion_r3342 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/math.scala --- @@ -287,6 +286,88 @@ case class Pow(left: Expression, right:

[GitHub] spark pull request: [SPARK-8214][SQL]Add function hex

2015-06-28 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/6976#discussion_r33420126 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/math.scala --- @@ -287,6 +286,88 @@ case class Pow(left: Expression,

[GitHub] spark pull request: [SPARK-8649] [BUILD] Mapr repository is not de...

2015-06-28 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/7054#issuecomment-116220075 Sure, we can fix this up. In general with the hadoop-provided builds we expect people to use those from now on. Also, this definitely worked for me locally, so I

[GitHub] spark pull request: [SPARK-8214][SQL]Add function hex

2015-06-28 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/6976#discussion_r33420117 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/math.scala --- @@ -287,6 +286,88 @@ case class Pow(left: Expression, right:

[GitHub] spark pull request: [SPARK-8214][SQL]Add function hex

2015-06-28 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/6976#discussion_r33420109 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/math.scala --- @@ -287,6 +286,88 @@ case class Pow(left: Expression, right:

[GitHub] spark pull request: [MLlib] [SPARK-7667] MLlib Python API consiste...

2015-06-28 Thread yanboliang
Github user yanboliang commented on the pull request: https://github.com/apache/spark/pull/6856#issuecomment-116222651 @jkbradley --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-8686][SQL] DataFrame should support `wh...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7063#issuecomment-116223233 [Test build #35917 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35917/console) for PR 7063 at commit

[GitHub] spark pull request: [SPARK-8579] [SQL] support arbitrary object in...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6959#issuecomment-116224994 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-4176][WIP] Support decimal types with p...

2015-06-28 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/6796#discussion_r33420609 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/parquet/CatalystSchemaConverter.scala --- @@ -169,11 +169,12 @@ private[parquet] class

[GitHub] spark pull request: [SPARK-4176][WIP] Support decimal types with p...

2015-06-28 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/6796#discussion_r33420628 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/parquet/CatalystSchemaConverter.scala --- @@ -373,8 +374,10 @@ private[parquet] class

[GitHub] spark pull request: [SPARK-8610] [SQL] Separate Row and InternalRo...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7003#issuecomment-116229585 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

  1   2   3   4   >