[GitHub] spark pull request: [SPARK-5210] Support group event log when app ...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9246#issuecomment-150524119 **[Test build #44216 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44216/consoleFull)** for PR 9246 at commit

[GitHub] spark pull request: [SPARK-11279] [PYSPARK] Add DataFrame#toDF in ...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9248#issuecomment-150648435 **[Test build #1947 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1947/consoleFull)** for PR 9248 at commit

[GitHub] spark pull request: [SPARK-10984] [WIP] Simplify *MemoryManager cl...

2015-10-23 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9127#discussion_r42895096 --- Diff: core/src/main/scala/org/apache/spark/util/collection/ExternalAppendOnlyMap.scala --- @@ -49,18 +48,25 @@ import

[GitHub] spark pull request: [SPARK-8029][core][wip] first successful shuff...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9214#issuecomment-150650371 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8029][core][wip] first successful shuff...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9214#issuecomment-150650374 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: SPARK-11286 Make Outbox stopped exception sing...

2015-10-23 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/9254#discussion_r42895844 --- Diff: core/src/main/scala/org/apache/spark/rpc/netty/Outbox.scala --- @@ -215,7 +216,7 @@ private[netty] class Outbox(nettyEnv: NettyRpcEnv, val address:

[GitHub] spark pull request: [SPARK-10641][WIP][SQL] Add Skewness and Kurto...

2015-10-23 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/9003#discussion_r42897843 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/functions.scala --- @@ -930,3 +930,330 @@ object

[GitHub] spark pull request: [SPARK-10641][WIP][SQL] Add Skewness and Kurto...

2015-10-23 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/9003#discussion_r42897835 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/functions.scala --- @@ -930,3 +930,327 @@ object

[GitHub] spark pull request: SPARK-11265 hive tokens

2015-10-23 Thread steveloughran
Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/9232#discussion_r42897746 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -1337,55 +1337,8 @@ object Client extends Logging { conf:

[GitHub] spark pull request: [SPARK-11125] [SQL] Uninformative exception wh...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9134#issuecomment-150654820 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10641][WIP][SQL] Add Skewness and Kurto...

2015-10-23 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/9003#discussion_r42897850 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/functions.scala --- @@ -930,3 +930,330 @@ object

[GitHub] spark pull request: [SPARK-10984] [WIP] Simplify *MemoryManager cl...

2015-10-23 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9127#discussion_r42898522 --- Diff: core/src/main/scala/org/apache/spark/memory/MemoryManager.scala --- @@ -155,4 +274,44 @@ private[spark] abstract class MemoryManager extends

[GitHub] spark pull request: SPARK-11265 hive tokens

2015-10-23 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/9232#discussion_r42898469 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -1337,55 +1337,8 @@ object Client extends Logging { conf:

[GitHub] spark pull request: SPARK-11286 Make Outbox stopped exception sing...

2015-10-23 Thread tedyu
Github user tedyu commented on a diff in the pull request: https://github.com/apache/spark/pull/9254#discussion_r42898550 --- Diff: core/src/main/scala/org/apache/spark/rpc/netty/Outbox.scala --- @@ -215,7 +216,7 @@ private[netty] class Outbox(nettyEnv: NettyRpcEnv, val address:

[GitHub] spark pull request: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Tr...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9207#issuecomment-150659033 **[Test build #44241 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44241/consoleFull)** for PR 9207 at commit

[GitHub] spark pull request: [SPARK-10847] [SQL] [PySpark] Pyspark - DataFr...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8969#issuecomment-150659611 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10847] [SQL] [PySpark] Pyspark - DataFr...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8969#issuecomment-150659658 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11271][SPARK-11016][Core] Use Spark Bit...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9243#issuecomment-150662204 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10641][WIP][SQL] Add Skewness and Kurto...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9003#issuecomment-150662310 **[Test build #44234 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44234/consoleFull)** for PR 9003 at commit

[GitHub] spark pull request: [SPARK-10847] [SQL] [PySpark] Pyspark - DataFr...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8969#issuecomment-150662280 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10847] [SQL] [PySpark] Pyspark - DataFr...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8969#issuecomment-150662279 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8992] [SQL] Add pivot to dataframe api

2015-10-23 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/7841#issuecomment-150663288 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-10641][WIP][SQL] Add Skewness and Kurto...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9003#issuecomment-150662563 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11287] Fixed class name to properly sta...

2015-10-23 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9255#discussion_r42894744 --- Diff: core/src/main/scala/org/apache/spark/deploy/client/TestClient.scala --- @@ -49,7 +49,8 @@ private[spark] object TestClient { val conf =

[GitHub] spark pull request: SPARK-11286 Make Outbox stopped exception sing...

2015-10-23 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9254#issuecomment-150647468 Ted - why is this change necessary? These only happen in error cases so I'm not sure how useful it is to optimize then. On top of that, this seems to change the stacktrace

[GitHub] spark pull request: [SPARK-11274][SQL] Text data source support fo...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9240#issuecomment-150647556 **[Test build #44240 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44240/consoleFull)** for PR 9240 at commit

[GitHub] spark pull request: [SPARK-11274][SQL] Text data source support fo...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9240#issuecomment-150647273 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-11286 Make Outbox stopped exception sing...

2015-10-23 Thread tedyu
Github user tedyu closed the pull request at: https://github.com/apache/spark/pull/9254 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-8029][core][wip] first successful shuff...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9214#issuecomment-150650304 **[Test build #44229 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44229/consoleFull)** for PR 9214 at commit

[GitHub] spark pull request: SPARK-11286 Make Outbox stopped exception sing...

2015-10-23 Thread tedyu
Github user tedyu commented on a diff in the pull request: https://github.com/apache/spark/pull/9254#discussion_r42896202 --- Diff: core/src/main/scala/org/apache/spark/rpc/netty/Outbox.scala --- @@ -215,7 +216,7 @@ private[netty] class Outbox(nettyEnv: NettyRpcEnv, val address:

[GitHub] spark pull request: SPARK-11286 Make Outbox stopped exception sing...

2015-10-23 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/9254#discussion_r42896850 --- Diff: core/src/main/scala/org/apache/spark/rpc/netty/Outbox.scala --- @@ -215,7 +216,7 @@ private[netty] class Outbox(nettyEnv: NettyRpcEnv, val address:

[GitHub] spark pull request: [SPARK-10342] [SQL] [WIP] Cooperative memory m...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9241#issuecomment-150653550 **[Test build #44242 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44242/consoleFull)** for PR 9241 at commit

[GitHub] spark pull request: [SPARK-11271][SPARK-11016][Core] Use Spark Bit...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9243#issuecomment-150653468 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11125] [SQL] Uninformative exception wh...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9134#issuecomment-150654821 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10984] [WIP] Simplify *MemoryManager cl...

2015-10-23 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9127#discussion_r42898208 --- Diff: core/src/main/scala/org/apache/spark/memory/MemoryManager.scala --- @@ -102,9 +113,88 @@ private[spark] abstract class MemoryManager extends

[GitHub] spark pull request: [SPARK-10984] [WIP] Simplify *MemoryManager cl...

2015-10-23 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9127#discussion_r42898147 --- Diff: core/src/main/scala/org/apache/spark/memory/MemoryManager.scala --- @@ -102,9 +113,88 @@ private[spark] abstract class MemoryManager extends

[GitHub] spark pull request: [SPARK-10847] [SQL] [PySpark] Pyspark - DataFr...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8969#issuecomment-150656437 [Test build #44243 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44243/consoleFull) for PR 8969 at commit

[GitHub] spark pull request: SPARK-11286 Make Outbox stopped exception sing...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9254#issuecomment-150658341 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-1537: pure service API and test service

2015-10-23 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9182#issuecomment-150658207 > There's duplication between the two schedulers, ..., because the common superclass, YarnSchedulerBackend is in spark-core I'd just move that class to the yarn

[GitHub] spark pull request: SPARK-11286 Make Outbox stopped exception sing...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9254#issuecomment-150658344 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: SPARK-11258 Converting a Spark DataFrame into ...

2015-10-23 Thread Gerrrr
Github user Ge commented on the pull request: https://github.com/apache/spark/pull/9222#issuecomment-150659258 The problem might be related to GC as a current implementation of `dfToCols` allocates memory for the map result and the array while @FRosner implementation only

[GitHub] spark pull request: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Tr...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9207#issuecomment-150659207 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Tr...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9207#issuecomment-150659205 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10847] [SQL] [PySpark] Pyspark - DataFr...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8969#issuecomment-150660369 **[Test build #44246 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44246/consoleFull)** for PR 8969 at commit

[GitHub] spark pull request: [SPARK-10266][Documentation, ML] Fixed @Since ...

2015-10-23 Thread ehsanmok
Github user ehsanmok commented on the pull request: https://github.com/apache/spark/pull/8729#issuecomment-150661652 After dev/lint-scala should I include the `build/sbt-launch-0.13.7.jar.part` as well? --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: SPARK-11265 hive tokens

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9232#issuecomment-150662642 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11271][SPARK-11016][Core] Use Spark Bit...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9243#issuecomment-150662823 **[Test build #44247 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44247/consoleFull)** for PR 9243 at commit

[GitHub] spark pull request: [SPARK-6328] [Python] Python API for Streaming...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9186#issuecomment-150663329 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6328] [Python] Python API for Streaming...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9186#issuecomment-150663302 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11274][SQL] Text data source support fo...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9240#issuecomment-150515594 **[Test build #44215 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44215/consoleFull)** for PR 9240 at commit

[GitHub] spark pull request: [SPARK-11274][SQL] Text data source support fo...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9240#issuecomment-150516390 **[Test build #44215 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44215/consoleFull)** for PR 9240 at commit

[GitHub] spark pull request: [SPARK-11274][SQL] Text data source support fo...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9240#issuecomment-150516399 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11274][SQL] Text data source support fo...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9240#issuecomment-150516397 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-5210] Support group event log when app ...

2015-10-23 Thread XuTingjun
GitHub user XuTingjun opened a pull request: https://github.com/apache/spark/pull/9246 [SPARK-5210] Support group event log when app is long-running For long-running Spark applications (e.g. running for days / weeks), the Spark event log may grow to be very large. I think

[GitHub] spark pull request: [SPARK-10342] [SQL] [WIP] Cooperative memory m...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9241#issuecomment-150520132 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5210] Support group event log when app ...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9246#issuecomment-150520248 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10342] [SQL] [WIP] Cooperative memory m...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9241#issuecomment-150519962 **[Test build #44210 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44210/consoleFull)** for PR 9241 at commit

[GitHub] spark pull request: [SPARK-10342] [SQL] [WIP] Cooperative memory m...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9241#issuecomment-150520127 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-5210] Support group event log when app ...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9246#issuecomment-150520179 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10947] [SQL] With schema inference from...

2015-10-23 Thread stephend-realitymine
Github user stephend-realitymine commented on the pull request: https://github.com/apache/spark/pull/9245#issuecomment-150523833 Going to close this pull request and recreate from rebased master. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-10947] [SQL] With schema inference from...

2015-10-23 Thread stephend-realitymine
Github user stephend-realitymine closed the pull request at: https://github.com/apache/spark/pull/9245 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request: SPARK-11286 Make Outbox stopped exception sing...

2015-10-23 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9254#issuecomment-150647838 Yeah, please don't do this. Broken stack traces are terrible. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: Fix typos

2015-10-23 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9250#issuecomment-150647882 +1 If you are doing a lot of these, it'd be great to batch them. Don't be mistaken - the effort is hugely appreciated! --- If your project is set up for it, you

[GitHub] spark pull request: [SPARK-11171][SPARK-11237][SPARK-11241][ML][WI...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9207#issuecomment-150647979 **[Test build #44241 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44241/consoleFull)** for PR 9207 at commit

[GitHub] spark pull request: [SPARK-10984] [WIP] Simplify *MemoryManager cl...

2015-10-23 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9127#discussion_r42894944 --- Diff: core/src/main/scala/org/apache/spark/util/collection/ExternalAppendOnlyMap.scala --- @@ -49,18 +48,25 @@ import

[GitHub] spark pull request: [SPARK-11271][SPARK-11016][Core] Use Spark Bit...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9243#issuecomment-150653416 **[Test build #44225 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44225/consoleFull)** for PR 9243 at commit

[GitHub] spark pull request: [SPARK-11271][SPARK-11016][Core] Use Spark Bit...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9243#issuecomment-150653471 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11125] [SQL] Uninformative exception wh...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9134#issuecomment-150654718 **[Test build #44232 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44232/consoleFull)** for PR 9134 at commit

[GitHub] spark pull request: [SPARK-8029][core][wip] first successful shuff...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9214#issuecomment-150654384 **[Test build #44231 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44231/consoleFull)** for PR 9214 at commit

[GitHub] spark pull request: [SPARK-8029][core][wip] first successful shuff...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9214#issuecomment-150654523 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: SPARK-11265 hive tokens

2015-10-23 Thread steveloughran
Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/9232#discussion_r42897540 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -322,8 +322,10 @@ private[spark] class Client( // multiple

[GitHub] spark pull request: [SPARK-8029][core][wip] first successful shuff...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9214#issuecomment-150654521 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-11265 hive tokens

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9232#issuecomment-150655438 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-11265 hive tokens

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9232#issuecomment-150655380 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10984] [WIP] Simplify *MemoryManager cl...

2015-10-23 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9127#discussion_r42897971 --- Diff: core/src/main/scala/org/apache/spark/memory/MemoryManager.scala --- @@ -42,8 +60,10 @@ private[spark] abstract class MemoryManager extends

[GitHub] spark pull request: [SPARK-10984] [WIP] Simplify *MemoryManager cl...

2015-10-23 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9127#discussion_r42898067 --- Diff: core/src/main/scala/org/apache/spark/memory/MemoryManager.scala --- @@ -115,6 +205,35 @@ private[spark] abstract class MemoryManager extends

[GitHub] spark pull request: [SPARK-11279] [PYSPARK] Add DataFrame#toDF in ...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9248#issuecomment-150656265 **[Test build #1947 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1947/consoleFull)** for PR 9248 at commit

[GitHub] spark pull request: [SPARK-10622] [core] [yarn] Differentiate dead...

2015-10-23 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/8887#issuecomment-150657909 So, any remaining feedback? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9319][SPARKR] Add support for setting c...

2015-10-23 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/9218#discussion_r42899259 --- Diff: R/pkg/R/DataFrame.R --- @@ -276,6 +276,57 @@ setMethod("names<-", } }) +#' @rdname columns +#'

[GitHub] spark pull request: [SPARK-8992] [SQL] Add pivot to dataframe api

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7841#issuecomment-150664411 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8992] [SQL] Add pivot to dataframe api

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7841#issuecomment-150664375 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10984] [WIP] Simplify *MemoryManager cl...

2015-10-23 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9127#discussion_r42902440 --- Diff: core/src/main/java/org/apache/spark/memory/TaskMemoryManager.java --- @@ -277,10 +311,20 @@ public long cleanUpAllAllocatedMemory() {

[GitHub] spark pull request: [SPARK-8992] [SQL] Add pivot to dataframe api

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7841#issuecomment-150665042 **[Test build #44249 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44249/consoleFull)** for PR 7841 at commit

[GitHub] spark pull request: [SPARK-6328] [Python] Python API for Streaming...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9186#issuecomment-150665420 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-6328] [Python] Python API for Streaming...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9186#issuecomment-150665416 **[Test build #44248 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44248/consoleFull)** for PR 9186 at commit

[GitHub] spark pull request: [SPARK-10984] [WIP] Simplify *MemoryManager cl...

2015-10-23 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9127#discussion_r42902567 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/ShuffleExternalSorter.java --- @@ -316,9 +313,13 @@ private long freeMemory() { long

[GitHub] spark pull request: [SPARK-11287] Fixed class name to properly sta...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9255#issuecomment-150665518 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6328] [Python] Python API for Streaming...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9186#issuecomment-150665299 **[Test build #44248 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44248/consoleFull)** for PR 9186 at commit

[GitHub] spark pull request: [SPARK-6328] [Python] Python API for Streaming...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9186#issuecomment-150665419 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11287] Fixed class name to properly sta...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9255#issuecomment-150665545 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11273][SQL] Move ArrayData/MapData/Data...

2015-10-23 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/9239#issuecomment-150524806 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-11277] [SQL] sort_array throws exceptio...

2015-10-23 Thread jliwork
GitHub user jliwork opened a pull request: https://github.com/apache/spark/pull/9247 [SPARK-11277] [SQL] sort_array throws exception scala.MatchError I'm new to spark. I was trying out the sort_array function then hit this exception. I looked into the spark source code. I found the

[GitHub] spark pull request: [SPARK-11279] [PYSPARK] Add DataFrame#toDF in ...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9248#issuecomment-150528090 **[Test build #44217 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44217/consoleFull)** for PR 9248 at commit

[GitHub] spark pull request: [SPARK-11271][Core] Use Spark BitSet instead o...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9243#issuecomment-150558748 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10947] [SQL] With schema inference from...

2015-10-23 Thread stephend-realitymine
GitHub user stephend-realitymine opened a pull request: https://github.com/apache/spark/pull/9249 [SPARK-10947] [SQL] With schema inference from JSON into a Dataframe, add option to infer all primitive object types as strings Currently, when a schema is inferred from a JSON file

[GitHub] spark pull request: [SPARK-11271][Core] Use Spark BitSet instead o...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9243#issuecomment-150558750 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11271][Core] Use Spark BitSet instead o...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9243#issuecomment-150558712 **[Test build #44213 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44213/consoleFull)** for PR 9243 at commit

[GitHub] spark pull request: [SPARK-10562][SQL] support mixed case partitio...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9251#issuecomment-150587942 **[Test build #44226 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44226/consoleFull)** for PR 9251 at commit

[GitHub] spark pull request: Stevel/patches/spark 11265 hive tokens

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9232#issuecomment-150589550 **[Test build #44223 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44223/consoleFull)** for PR 9232 at commit

[GitHub] spark pull request: [SPARK-5569] [STREAMING] fix ObjectInputStream...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8955#issuecomment-150605267 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

  1   2   3   4   5   6   7   8   >