[GitHub] spark pull request: [SPARK-8477][sql][pyspark] Add in operator to ...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6908#issuecomment-113626980 [Test build #35314 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35314/consoleFull) for PR 6908 at commit

[GitHub] spark pull request: [SPARK-7045] [MLlib] Avoid intermediate repres...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5748#issuecomment-113629316 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7045] [MLlib] Avoid intermediate repres...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5748#issuecomment-113629287 [Test build #35309 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35309/console) for PR 5748 at commit

[GitHub] spark pull request: [HotFIX] Fix scala style in DFSReadWriteTest t...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6907#issuecomment-113632888 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8420][SQL] Fix comparision of timestamp...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6888#issuecomment-113634569 [Test build #35320 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35320/consoleFull) for PR 6888 at commit

[GitHub] spark pull request: [SPARK-8432] [SQL] fix hashCode() and equals()...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6876#issuecomment-113637840 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8432] [SQL] fix hashCode() and equals()...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6876#issuecomment-113637801 [Test build #35307 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35307/console) for PR 6876 at commit

[GitHub] spark pull request: [SPARK-8432] [SQL] fix hashCode() and equals()...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6876#issuecomment-113643422 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8432] [SQL] fix hashCode() and equals()...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6876#issuecomment-113643472 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8127] KafkaRDD optimi...

2015-06-19 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/6632#discussion_r32872490 --- Diff: external/kafka/src/test/scala/org/apache/spark/streaming/kafka/KafkaRDDSuite.scala --- @@ -68,6 +68,21 @@ class KafkaRDDSuite extends

[GitHub] spark pull request: [SPARK-8498] Add regression test for SPARK-847...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6909#issuecomment-113654119 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8498] [SQL] Add regression test for SPA...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6909#issuecomment-113656046 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8127] KafkaRDD optimi...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6632#issuecomment-113656013 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8127] KafkaRDD optimi...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6632#issuecomment-113656030 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8376][Docs]Add common lang3 to the Spar...

2015-06-19 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/6829#issuecomment-113656100 I see. So the Kafka is present only through the flume-kafka-source http://mvnrepository.com/artifact/org.apache.flume.flume-ng-sources/flume-kafka-source/1.6.0

[GitHub] spark pull request: [SPARK-8420][SQL] Fix comparision of timestamp...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6888#issuecomment-113661246 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8420][SQL] Fix comparision of timestamp...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6888#issuecomment-113661226 [Test build #35319 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35319/console) for PR 6888 at commit

[GitHub] spark pull request: [SPARK-5482][PySpark] Allow individual test su...

2015-06-19 Thread potix2
Github user potix2 commented on the pull request: https://github.com/apache/spark/pull/4269#issuecomment-113661417 Sorry to confuse you, I agree with you. As a first step, we should rewrite run-tests in Python, then append new features. I took a look at #6866, I think it has

[GitHub] spark pull request: [SPARK-8307] [SQL] improve timestamp from parq...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6759#issuecomment-113673700 [Test build #941 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/941/consoleFull) for PR 6759 at commit

[GitHub] spark pull request: [SPARK-8420][SQL] Fix comparision of timestamp...

2015-06-19 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/6888#issuecomment-113675079 Thanks! I am merging it to master and branch 1.4. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-4644 blockjoin

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6883#issuecomment-113629566 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8468][ML] Take the negative of some met...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6905#issuecomment-113629487 [Test build #35311 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35311/console) for PR 6905 at commit

[GitHub] spark pull request: [SPARK-8468][ML] Take the negative of some met...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6905#issuecomment-113629511 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8420][SQL] Fix comparision of timestamp...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6888#issuecomment-113632909 [Test build #35319 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35319/consoleFull) for PR 6888 at commit

[GitHub] spark pull request: [SPARK-8307] [SQL] improve timestamp from parq...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6759#issuecomment-113642553 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8307] [SQL] improve timestamp from parq...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6759#issuecomment-113642670 [Test build #35321 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35321/consoleFull) for PR 6759 at commit

[GitHub] spark pull request: [SPARK-8307] [SQL] improve timestamp from parq...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6759#issuecomment-113642575 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8093] [SQL] Remove empty structs inferr...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6799#issuecomment-113645291 [Test build #940 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/940/consoleFull) for PR 6799 at commit

[GitHub] spark pull request: [SPARK-8359][SQL] Fix incorrect decimal precis...

2015-06-19 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/6814#discussion_r32869361 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/types/decimal/DecimalSuite.scala --- @@ -162,4 +162,9 @@ class DecimalSuite extends SparkFunSuite

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8127] KafkaRDD optimi...

2015-06-19 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/6632#discussion_r32869380 --- Diff: external/kafka/src/test/scala/org/apache/spark/streaming/kafka/KafkaRDDSuite.scala --- @@ -68,6 +68,21 @@ class KafkaRDDSuite extends SparkFunSuite

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8127] KafkaRDD optimi...

2015-06-19 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/6632#discussion_r32869403 --- Diff: external/kafka/src/test/scala/org/apache/spark/streaming/kafka/KafkaRDDSuite.scala --- @@ -68,6 +68,21 @@ class KafkaRDDSuite extends SparkFunSuite

[GitHub] spark pull request: [SPARK-8307] [SQL] improve timestamp from parq...

2015-06-19 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/6759#discussion_r32871422 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTableSupport.scala --- @@ -360,7 +367,7 @@ private[parquet] class

[GitHub] spark pull request: [SPARK-8307] [SQL] improve timestamp from parq...

2015-06-19 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/6759#discussion_r32871383 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTableSupport.scala --- @@ -313,10 +314,16 @@ private[parquet] class RowWriteSupport

[GitHub] spark pull request: [SPARKR][SPARK-8452] expose jobGroup API in Sp...

2015-06-19 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/6889#issuecomment-113650123 LGTM, waiting for tests. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8477][sql][pyspark] Add in operator to ...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6908#issuecomment-113651550 [Test build #35314 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35314/console) for PR 6908 at commit

[GitHub] spark pull request: [SPARKR][SPARK-8452] expose jobGroup API in Sp...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6889#issuecomment-113656892 [Test build #35316 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35316/console) for PR 6889 at commit

[GitHub] spark pull request: SPARK-8398 hadoop input/output format advanced...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6848#issuecomment-113657049 [Test build #35330 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35330/consoleFull) for PR 6848 at commit

[GitHub] spark pull request: [SPARKR][SPARK-8452] expose jobGroup API in Sp...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6889#issuecomment-113656998 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8127] KafkaRDD optimi...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6632#issuecomment-113657139 [Test build #35331 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35331/consoleFull) for PR 6632 at commit

[GitHub] spark pull request: [SPARK-8483][Streaming] Remove commons-lang3 d...

2015-06-19 Thread harishreedharan
GitHub user harishreedharan opened a pull request: https://github.com/apache/spark/pull/6910 [SPARK-8483][Streaming] Remove commons-lang3 dependency from Flume Si… …nk. Also bump Flume version to 1.6.0 You can merge this pull request into a Git repository by running: $ git

[GitHub] spark pull request: [SPARKR][SPARK-8452] expose jobGroup API in Sp...

2015-06-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6889 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-8483][Streaming] Remove commons-lang3 d...

2015-06-19 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/6910#discussion_r32876062 --- Diff: external/flume-sink/src/main/scala/org/apache/spark/streaming/flume/sink/SparkAvroCallbackHandler.scala --- @@ -53,7 +53,7 @@ private[flume]

[GitHub] spark pull request: [SPARK-8498] [SQL] Add regression test for SPA...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6909#issuecomment-113674331 [Test build #35328 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35328/console) for PR 6909 at commit

[GitHub] spark pull request: [SPARK-8498] [SQL] Add regression test for SPA...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6909#issuecomment-113674309 [Test build #35327 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35327/console) for PR 6909 at commit

[GitHub] spark pull request: [SPARK-8498] [SQL] Add regression test for SPA...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6909#issuecomment-113674327 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6749] [SQL] Make metastore client robus...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6912#issuecomment-113677840 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6749] [SQL] Make metastore client robus...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6912#issuecomment-113677726 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8127] KafkaRDD optimi...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6632#issuecomment-113676707 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8420][SQL] Fix comparision of timestamp...

2015-06-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6888 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-8477][sql][pyspark] Add in operator to ...

2015-06-19 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/6908#discussion_r32864207 --- Diff: python/pyspark/sql/column.py --- @@ -326,6 +326,27 @@ def between(self, lowerBound, upperBound): return (self =

[GitHub] spark pull request: [SPARK-4176] Support decimal types with precis...

2015-06-19 Thread rtreffer
Github user rtreffer commented on the pull request: https://github.com/apache/spark/pull/6796#issuecomment-113629961 I've pushed the hive generated parquet file and I'll call it a day. I think I'll have to relax the validation of column types for DECIMAL. --- If your project

[GitHub] spark pull request: [SPARK-8420][SQL] Fix comparision of timestamp...

2015-06-19 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/6888#issuecomment-113632149 @yhuai updated to avoid changing equality behavior. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-8420][SQL] Fix comparision of timestamp...

2015-06-19 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/6888#issuecomment-113635239 lgtm --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-8368] [SPARK-8058] [SQL] HiveContext ma...

2015-06-19 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/6895#issuecomment-113638271 Closing it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-8368] [SPARK-8058] [SQL] HiveContext ma...

2015-06-19 Thread yhuai
Github user yhuai closed the pull request at: https://github.com/apache/spark/pull/6895 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-5836] [DOCS] [STREAMING] Clarify what m...

2015-06-19 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/6901#discussion_r32867731 --- Diff: docs/programming-guide.md --- @@ -1144,9 +1144,11 @@ generate these on the reduce side. When data does not fit in memory Spark will s to disk,

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8127] KafkaRDD optimi...

2015-06-19 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/6632#issuecomment-113645504 Just a couple of more comments on the tests. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-5037][STREAMING] dynamically loaded DSt...

2015-06-19 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/3858#issuecomment-113648094 That gives me some context. We are adding more stuff to the python API for parity with Scala and Java. We have added full Kafka Python API, Flume is being added, and

[GitHub] spark pull request: [SPARK-8498] Add regression test for SPARK-847...

2015-06-19 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/6909#issuecomment-113652053 @marmbrus @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-8307] [SQL] improve timestamp from parq...

2015-06-19 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/6759#discussion_r32872239 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/DateTimeUtilsSuite.scala --- @@ -21,19 +21,31 @@ import java.sql.Timestamp

[GitHub] spark pull request: [SPARK-8376][Docs]Add common lang3 to the Spar...

2015-06-19 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/6829#issuecomment-113652186 I dont see a dependency on Kafka in Flume 1.4.0 http://mvnrepository.com/artifact/org.apache.flume/flume-ng-sdk/1.4.0 What am i missing? On Fri, Jun

[GitHub] spark pull request: [SPARK-8498] Add regression test for SPARK-847...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6909#issuecomment-113652204 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8127] KafkaRDD optimi...

2015-06-19 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/6632#discussion_r32872739 --- Diff: external/kafka/src/test/scala/org/apache/spark/streaming/kafka/KafkaRDDSuite.scala --- @@ -68,6 +68,21 @@ class KafkaRDDSuite extends SparkFunSuite

[GitHub] spark pull request: [SPARK-8307] [SQL] improve timestamp from parq...

2015-06-19 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/6759#discussion_r32872749 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/DateTimeUtilsSuite.scala --- @@ -21,19 +21,31 @@ import java.sql.Timestamp

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8127] KafkaRDD optimi...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6632#issuecomment-113656191 [Test build #35329 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35329/consoleFull) for PR 6632 at commit

[GitHub] spark pull request: [SPARK-8080][STREAMING] Receiver.store with It...

2015-06-19 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/6707#issuecomment-113656399 Thank you very much for this patch. This was a very important one, especially the tests. On Thu, Jun 18, 2015 at 8:02 PM, asfgit notificati...@github.com wrote:

[GitHub] spark pull request: [SPARK-8483][Streaming] Remove commons-lang3 d...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6910#issuecomment-113663947 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8498] [SQL] Add regression test for SPA...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6909#issuecomment-113669127 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8498] [SQL] Add regression test for SPA...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6909#issuecomment-113669074 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7165] [SQL] use sort merge join for out...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5717#issuecomment-113670190 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7165] [SQL] use sort merge join for out...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5717#issuecomment-113670244 [Test build #35337 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35337/consoleFull) for PR 5717 at commit

[GitHub] spark pull request: [SPARK-7165] [SQL] use sort merge join for out...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5717#issuecomment-113670198 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8492] [SQL] support binaryType in Unsaf...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6911#issuecomment-113675867 [Test build #35339 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35339/consoleFull) for PR 6911 at commit

[GitHub] spark pull request: [SPARK-6749] [SQL] Make metastore client robus...

2015-06-19 Thread ericl
Github user ericl commented on the pull request: https://github.com/apache/spark/pull/6912#issuecomment-113676454 @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8127] KafkaRDD optimi...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6632#issuecomment-113676455 [Test build #35329 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35329/console) for PR 6632 at commit

[GitHub] spark pull request: [SPARK-6749] [SQL] Make metastore client robus...

2015-06-19 Thread ericl
GitHub user ericl opened a pull request: https://github.com/apache/spark/pull/6912 [SPARK-6749] [SQL] Make metastore client robust to underlying socket connection loss This works around a bug in the underlying RetryingMetaStoreClient (HIVE-10384) by refreshing the metastore client

[GitHub] spark pull request: SPARK-4644 blockjoin

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6883#issuecomment-113630110 [Test build #35315 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35315/consoleFull) for PR 6883 at commit

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8390] fix docs relate...

2015-06-19 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/6863#issuecomment-113630096 So the JIRA was about updating the examples actually. Its great that you have updated the docs AND the tests, but it would ideal if the examples DirectKafkaWordCount and

[GitHub] spark pull request: [SPARK-8481] [MLlib] GaussianMixtureModel pred...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6906#issuecomment-113632802 [Test build #35318 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35318/consoleFull) for PR 6906 at commit

[GitHub] spark pull request: [HotFIX] Fix scala style in DFSReadWriteTest t...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6907#issuecomment-113632842 [Test build #35304 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35304/console) for PR 6907 at commit

[GitHub] spark pull request: [SPARK-8186] [SPARK-8187] [SQL] datetime funct...

2015-06-19 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/6782#discussion_r32867754 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeFunctions.scala --- @@ -0,0 +1,176 @@ +/* + * Licensed to

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8127] KafkaRDD optimi...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6632#issuecomment-113644879 [Test build #35310 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35310/console) for PR 6632 at commit

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8127] KafkaRDD optimi...

2015-06-19 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/6632#discussion_r32869331 --- Diff: external/kafka/src/test/scala/org/apache/spark/streaming/kafka/KafkaRDDSuite.scala --- @@ -68,6 +68,21 @@ class KafkaRDDSuite extends SparkFunSuite

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8127] KafkaRDD optimi...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6632#issuecomment-113644969 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8359][SQL] Fix incorrect decimal precis...

2015-06-19 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/6814#discussion_r32869329 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/types/Decimal.scala --- @@ -286,6 +288,9 @@ object Decimal { /** Maximum number of decimal

[GitHub] spark pull request: [SPARK-8307] [SQL] improve timestamp from parq...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6759#issuecomment-113647862 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8307] [SQL] improve timestamp from parq...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6759#issuecomment-113647849 [Test build #35321 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35321/console) for PR 6759 at commit

[GitHub] spark pull request: [SPARK-8265] [MLlib] [PySpark] Add LinearDataG...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6715#issuecomment-113648863 [Test build #35312 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35312/console) for PR 6715 at commit

[GitHub] spark pull request: [SPARK-8265] [MLlib] [PySpark] Add LinearDataG...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6715#issuecomment-113648895 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: Expose regionName setting in Kinesis receiver ...

2015-06-19 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/5375#issuecomment-113648887 This is not needed any more as Spark 1.4.0 has fixed this issue. Mind closing this PR? --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-8376][Docs]Add common lang3 to the Spar...

2015-06-19 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/6829#issuecomment-113653289 That looks like just the API module. I suspect it comes via the actual implementation such as in

[GitHub] spark pull request: [SPARK-8307] [SQL] improve timestamp from parq...

2015-06-19 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/6759#discussion_r32872412 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTableSupport.scala --- @@ -313,10 +314,16 @@ private[parquet] class RowWriteSupport

[GitHub] spark pull request: spark-7300 remove temporary directories after ...

2015-06-19 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/5834#discussion_r32873174 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/InsertIntoHiveTable.scala --- @@ -251,6 +251,11 @@ case class InsertIntoHiveTable(

[GitHub] spark pull request: [SPARK-8376][Docs]Add common lang3 to the Spar...

2015-06-19 Thread harishreedharan
Github user harishreedharan commented on the pull request: https://github.com/apache/spark/pull/6829#issuecomment-113659788 Yes, all of the libs in the flume-ng/lib directory gets added to the classpath, so scala would get added to the classpath, but get loaded only as required

[GitHub] spark pull request: [SPARK-8307] [SQL] improve timestamp from parq...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6759#issuecomment-113659586 [Test build #35332 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35332/consoleFull) for PR 6759 at commit

[GitHub] spark pull request: [SPARK-8420][SQL] Fix comparision of timestamp...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6888#issuecomment-113661550 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8420][SQL] Fix comparision of timestamp...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6888#issuecomment-113661524 [Test build #35320 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35320/console) for PR 6888 at commit

[GitHub] spark pull request: [SPARK-8498] [SQL] Add regression test for SPA...

2015-06-19 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/6909#issuecomment-113668048 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-8432] [SQL] fix hashCode() and equals()...

2015-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6876#issuecomment-113670534 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8432] [SQL] fix hashCode() and equals()...

2015-06-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6876#issuecomment-113670505 [Test build #35322 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35322/console) for PR 6876 at commit

  1   2   3   4   5   6   7   8   9   10   >