[GitHub] spark pull request: [SPARK-10983] Unified memory manager

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9084#issuecomment-147611987 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10412][SQL] report memory usage for tun...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8931#issuecomment-147614038 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10412][SQL] report memory usage for tun...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8931#issuecomment-147613951 [Test build #43612 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43612/console) for PR 8931 at commit

[GitHub] spark pull request: [SPARK-10412][SQL] report memory usage for tun...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8931#issuecomment-147614040 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11076][SQL]Add decimal support for floo...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9086#issuecomment-147579391 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10983] Unified memory manager

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9084#issuecomment-147588424 [Test build #43602 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43602/console) for PR 9084 at commit

[GitHub] spark pull request: [SPARK-10983] Unified memory manager

2015-10-12 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9084#discussion_r41825192 --- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala --- @@ -509,6 +512,11 @@ class SparkConf(loadDefaults: Boolean) extends Cloneable with

[GitHub] spark pull request: [SPARK-10983] Unified memory manager

2015-10-12 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9084#discussion_r41825937 --- Diff: core/src/main/scala/org/apache/spark/memory/UnifiedMemoryManager.scala --- @@ -0,0 +1,138 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-11077] [SQL] Join elimination in Cataly...

2015-10-12 Thread ankurdave
GitHub user ankurdave opened a pull request: https://github.com/apache/spark/pull/9089 [SPARK-11077] [SQL] Join elimination in Catalyst Join elimination is a query optimization where certain joins can be eliminated when followed by projections that only keep columns from one side

[GitHub] spark pull request: [SPARK-10983] Unified memory manager

2015-10-12 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9084#discussion_r41826327 --- Diff: core/src/main/scala/org/apache/spark/memory/UnifiedMemoryManager.scala --- @@ -0,0 +1,138 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-11009] [SQL] fix wrong result of Window...

2015-10-12 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9050#discussion_r41826342 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveSparkSubmitSuite.scala --- @@ -320,3 +331,36 @@ object SPARK_9757 extends QueryTest {

[GitHub] spark pull request: [SPARK-10983] Unified memory manager

2015-10-12 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9084#discussion_r41826285 --- Diff: core/src/main/scala/org/apache/spark/memory/UnifiedMemoryManager.scala --- @@ -0,0 +1,138 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-11076][SQL]Add decimal support for floo...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9086#issuecomment-147599906 [Test build #43610 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43610/console) for PR 9086 at commit

[GitHub] spark pull request: [SPARK-11077] [SQL] Join elimination in Cataly...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9089#issuecomment-147601433 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10617] [SQL] Fixed AddMonths leap year ...

2015-10-12 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9004#issuecomment-147601671 (Do you mind closing this PR too?) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: SPARK-10876 - Display total uptime for complet...

2015-10-12 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/9059#discussion_r41826841 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/AllJobsPage.scala --- @@ -289,13 +290,13 @@ private[ui] class AllJobsPage(parent: JobsTab) extends

[GitHub] spark pull request: [SPARK-11077] [SQL] Join elimination in Cataly...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9089#issuecomment-147601491 [Test build #43620 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43620/consoleFull) for PR 9089 at commit

[GitHub] spark pull request: [SPARK-10921] [YARN] Completely remove the use...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8976#issuecomment-147602759 [Test build #1886 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1886/consoleFull) for PR 8976 at commit

[GitHub] spark pull request: [SPARK-11009] [SQL] fix wrong result of Window...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9050#issuecomment-147602563 [Test build #43621 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43621/consoleFull) for PR 9050 at commit

[GitHub] spark pull request: [SPARK-10739][Yarn] Add application attempt wi...

2015-10-12 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/8857#issuecomment-147602659 Thanks @vanzin for your review. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-10983] Unified memory manager

2015-10-12 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9084#discussion_r41828008 --- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala --- @@ -509,6 +512,11 @@ class SparkConf(loadDefaults: Boolean) extends Cloneable with

[GitHub] spark pull request: [SPARK-10829][SQL]Filter combine partition key...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8916#issuecomment-147604550 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10829][SQL]Filter combine partition key...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8916#issuecomment-147604554 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-9776]Another instance of Derby may have...

2015-10-12 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/8947#issuecomment-147606847 Do you mind closing this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11017] [SQL] Support ImperativeAggregat...

2015-10-12 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/9038#issuecomment-147609673 To elaborate on the test failures: All tests pass as of 8695e3f, when the Tungsten code path is not used for imperative distinct aggregates. As of

[GitHub] spark pull request: [SPARK-11076][SQL]Add decimal support for floo...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9086#issuecomment-147579622 [Test build #43610 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43610/consoleFull) for PR 9086 at commit

[GitHub] spark pull request: [SPARK-10412][SQL] report memory usage for tun...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8931#issuecomment-147587017 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10412][SQL] report memory usage for tun...

2015-10-12 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/8931#issuecomment-147586197 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-10983] Unified memory manager

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9084#issuecomment-147588554 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10983] Unified memory manager

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9084#issuecomment-147588551 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8386] [SQL]add write.mode for insertInt...

2015-10-12 Thread huaxingao
Github user huaxingao commented on the pull request: https://github.com/apache/spark/pull/9042#issuecomment-147592598 Has the test result come back yet? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10104][SQL] Consolidate different forms...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8453#issuecomment-147592350 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10104][SQL] Consolidate different forms...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8453#issuecomment-147592385 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8386] [SQL]add write.mode for insertInt...

2015-10-12 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9042#issuecomment-147597485 Nope... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-10983] Unified memory manager

2015-10-12 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9084#discussion_r41825365 --- Diff: core/src/main/scala/org/apache/spark/memory/MemoryManager.scala --- @@ -72,46 +92,62 @@ private[spark] abstract class MemoryManager { def

[GitHub] spark pull request: [SPARK-10959] [PYSPARK] StreamingLogisticRegre...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9087#issuecomment-147597310 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10983] Unified memory manager

2015-10-12 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9084#discussion_r41825331 --- Diff: core/src/main/scala/org/apache/spark/memory/MemoryManager.scala --- @@ -72,46 +92,62 @@ private[spark] abstract class MemoryManager { def

[GitHub] spark pull request: [SPARK-10990] [SPARK-11018] [SQL] improve unro...

2015-10-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9016 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-10959] [PYSPARK] StreamingLogisticRegre...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9087#issuecomment-147597328 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10959] [PYSPARK] StreamingLogisticRegre...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9087#issuecomment-147598087 [Test build #43614 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43614/consoleFull) for PR 9087 at commit

[GitHub] spark pull request: [SPARK-10959] [PYSPARK] StreamingLogisticRegre...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9087#issuecomment-147598106 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10959] [PYSPARK] StreamingLogisticRegre...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9087#issuecomment-147598104 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-147598394 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-147598395 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10983] Unified memory manager

2015-10-12 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9084#discussion_r41826153 --- Diff: core/src/main/scala/org/apache/spark/memory/UnifiedMemoryManager.scala --- @@ -0,0 +1,138 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-10983] Unified memory manager

2015-10-12 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9084#discussion_r41826520 --- Diff: core/src/main/scala/org/apache/spark/storage/MemoryStore.scala --- @@ -365,16 +372,13 @@ private[spark] class MemoryStore(blockManager:

[GitHub] spark pull request: [PYTHON] [MINOR] List modules in PySpark tests...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9088#issuecomment-147600271 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11077] [SQL] Join elimination in Cataly...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9089#issuecomment-147600249 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [PYTHON] [MINOR] List modules in PySpark tests...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9088#issuecomment-147600272 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11077] [SQL] Join elimination in Cataly...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9089#issuecomment-147600353 [Test build #43619 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43619/consoleFull) for PR 9089 at commit

[GitHub] spark pull request: [SPARK-11009] [SQL] fix wrong result of Window...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9050#issuecomment-147601820 [Test build #43618 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43618/console) for PR 9050 at commit

[GitHub] spark pull request: [SPARK-11009] [SQL] fix wrong result of Window...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9050#issuecomment-147601877 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11009] [SQL] fix wrong result of Window...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9050#issuecomment-147601840 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: Comment Syntax checkup

2015-10-12 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9080#issuecomment-147601831 Do you mind closing this PR? yes, the text was correct before. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-11009] [SQL] fix wrong result of Window...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9050#issuecomment-147601839 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10983] Unified memory manager

2015-10-12 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9084#discussion_r41827174 --- Diff: core/src/main/scala/org/apache/spark/memory/UnifiedMemoryManager.scala --- @@ -0,0 +1,138 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-11009] [SQL] fix wrong result of Window...

2015-10-12 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9050#discussion_r41828330 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveSparkSubmitSuite.scala --- @@ -320,3 +331,36 @@ object SPARK_9757 extends QueryTest {

<    2   3   4   5   6   7