[GitHub] spark pull request #16108: [SPARK-18670][SS]Limit the number of StreamingQue...

2016-12-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16108#discussion_r90562475 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQueryListenerSuite.scala --- @@ -191,6 +192,50 @@ class StreamingQueryListenerSuite

[GitHub] spark issue #16094: [SPARK-18541][Python]Add metadata parameter to pyspark.s...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16094 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16094: [SPARK-18541][Python]Add metadata parameter to pyspark.s...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16094 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69517/ Test FAILed. ---

[GitHub] spark issue #16094: [SPARK-18541][Python]Add metadata parameter to pyspark.s...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16094 **[Test build #69517 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69517/consoleFull)** for PR 16094 at commit

[GitHub] spark issue #16111: [SPARK-18538] [SQL] [Backport-2.1] Fix Concurrent Table ...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16111 **[Test build #69518 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69518/consoleFull)** for PR 16111 at commit

[GitHub] spark issue #16104: [SPARK-18675][SQL] CTAS for hive serde table should work...

2016-12-01 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16104 Will review this PR tonight. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16111: [SPARK-18538] [SQL] [Backport-2.1] Fix Concurrent...

2016-12-01 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/16111 [SPARK-18538] [SQL] [Backport-2.1] Fix Concurrent Table Fetching Using DataFrameReader JDBC APIs ### What changes were proposed in this pull request? This PR is to backport

[GitHub] spark issue #15863: [SPARK-18419][SQL] `JDBCRelation.insert` should not remo...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15863 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69498/ Test PASSed. ---

[GitHub] spark issue #15863: [SPARK-18419][SQL] `JDBCRelation.insert` should not remo...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15863 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16107: SPARK-18677: Fix parsing ['key'] in JSON path expression...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16107 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69502/ Test PASSed. ---

[GitHub] spark issue #15863: [SPARK-18419][SQL] `JDBCRelation.insert` should not remo...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15863 **[Test build #69498 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69498/consoleFull)** for PR 15863 at commit

[GitHub] spark issue #16107: SPARK-18677: Fix parsing ['key'] in JSON path expression...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16107 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16107: SPARK-18677: Fix parsing ['key'] in JSON path expression...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16107 **[Test build #69502 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69502/consoleFull)** for PR 16107 at commit

[GitHub] spark issue #15998: [SPARK-18572][SQL] Add a method `listPartitionNames` to ...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15998 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15998: [SPARK-18572][SQL] Add a method `listPartitionNames` to ...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15998 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69501/ Test PASSed. ---

[GitHub] spark issue #15998: [SPARK-18572][SQL] Add a method `listPartitionNames` to ...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15998 **[Test build #69501 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69501/consoleFull)** for PR 15998 at commit

[GitHub] spark issue #15821: [SPARK-13534][WIP][PySpark] Using Apache Arrow to increa...

2016-12-01 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/15821 Hi @wesm and @icexelloss , that sounds good on our end. @yinxusen has been working on validating some basic conversion so far, but everything is still very preliminary so it would be great to

[GitHub] spark pull request #13147: [SPARK-6320][SQL] Move planLater method into Gene...

2016-12-01 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/13147#discussion_r90560927 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/planning/QueryPlanner.scala --- @@ -27,6 +27,14 @@ import

[GitHub] spark issue #16094: [SPARK-18541][Python]Add metadata parameter to pyspark.s...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16094 **[Test build #69517 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69517/consoleFull)** for PR 16094 at commit

[GitHub] spark issue #16092: [SPARK-18662] Move resource managers to separate directo...

2016-12-01 Thread foxish
Github user foxish commented on the issue: https://github.com/apache/spark/pull/16092 The test failure appears to be an unrelated flake. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16094: [SPARK-18541][Python]Add metadata parameter to pyspark.s...

2016-12-01 Thread marmbrus
Github user marmbrus commented on the issue: https://github.com/apache/spark/pull/16094 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #16092: [SPARK-18662] Move resource managers to separate directo...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16092 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69499/ Test FAILed. ---

[GitHub] spark issue #16092: [SPARK-18662] Move resource managers to separate directo...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16092 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16092: [SPARK-18662] Move resource managers to separate directo...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16092 **[Test build #69499 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69499/consoleFull)** for PR 16092 at commit

[GitHub] spark issue #16061: [SPARK-18278] [Scheduler] Support native submission of s...

2016-12-01 Thread erikerlandson
Github user erikerlandson commented on the issue: https://github.com/apache/spark/pull/16061 At the risk of redundant announcements, I am going to present this spark-on-kube topic at the [Kubernetes SIG-Apps](https://github.com/kubernetes/community/tree/master/sig-apps) next Monday

[GitHub] spark issue #16080: [SPARK-18647][SQL] do not put provider in table properti...

2016-12-01 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16080 The [`alterTable`](https://github.com/cloud-fan/spark/blob/5ee6489cdd1c22a1071c4fb6c7e4c4af126c9d50/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala#L533) API in

[GitHub] spark issue #16061: [SPARK-18278] [Scheduler] Support native submission of s...

2016-12-01 Thread erikerlandson
Github user erikerlandson commented on the issue: https://github.com/apache/spark/pull/16061 Since we have at least four people with interest in working on the code, I have a workflow proposal, which is that we all submit candidate updates to #16061 in the form of PRs against

[GitHub] spark issue #16046: [SPARK-18582][SQL] Whitelist LogicalPlan operators allow...

2016-12-01 Thread nsyca
Github user nsyca commented on the issue: https://github.com/apache/spark/pull/16046 Thank you. I was reading the test log just to see if my code might cause the failure. It does not look like it does. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #16046: [SPARK-18582][SQL] Whitelist LogicalPlan operators allow...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16046 **[Test build #69515 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69515/consoleFull)** for PR 16046 at commit

[GitHub] spark issue #16043: [SPARK-18601][SQL] Simplify Create/Get complex expressio...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16043 **[Test build #69516 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69516/consoleFull)** for PR 16043 at commit

[GitHub] spark issue #16046: [SPARK-18582][SQL] Whitelist LogicalPlan operators allow...

2016-12-01 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/16046 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16084: [SPARK-18654][SQL] Remove unreachable patterns in makeRo...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16084 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16084: [SPARK-18654][SQL] Remove unreachable patterns in makeRo...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16084 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69496/ Test PASSed. ---

[GitHub] spark issue #16046: [SPARK-18582][SQL] Whitelist LogicalPlan operators allow...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16046 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16046: [SPARK-18582][SQL] Whitelist LogicalPlan operators allow...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16046 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69500/ Test FAILed. ---

[GitHub] spark issue #16084: [SPARK-18654][SQL] Remove unreachable patterns in makeRo...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16084 **[Test build #69496 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69496/consoleFull)** for PR 16084 at commit

[GitHub] spark issue #16046: [SPARK-18582][SQL] Whitelist LogicalPlan operators allow...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16046 **[Test build #69500 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69500/consoleFull)** for PR 16046 at commit

[GitHub] spark issue #16110: [SPARK-18674][SQL][Follow-Up] improve the error message ...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16110 **[Test build #69513 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69513/consoleFull)** for PR 16110 at commit

[GitHub] spark issue #16090: [SPARK-18661] [SQL] Creating a partitioned datasource ta...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16090 **[Test build #69514 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69514/consoleFull)** for PR 16090 at commit

[GitHub] spark pull request #16090: [SPARK-18661] [SQL] Creating a partitioned dataso...

2016-12-01 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/16090#discussion_r90555068 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala --- @@ -565,7 +571,8 @@ class DDLSuite extends QueryTest with

[GitHub] spark pull request #16090: [SPARK-18661] [SQL] Creating a partitioned dataso...

2016-12-01 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/16090#discussion_r90554917 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/createDataSourceTables.scala --- @@ -58,13 +58,20 @@ case class

[GitHub] spark issue #16110: [SPARK-18674][SQL][Follow-Up] improve the error message ...

2016-12-01 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16110 cc @cloud-fan @hvanhovell --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16110: [SPARK-18674][SQL][Follow-Up] improve the error m...

2016-12-01 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/16110 [SPARK-18674][SQL][Follow-Up] improve the error message of using join ### What changes were proposed in this pull request? Added a test case for using joins with nested fields. ###

[GitHub] spark issue #16108: [SPARK-18670][SS]Limit the number of StreamingQueryListe...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16108 **[Test build #69512 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69512/consoleFull)** for PR 16108 at commit

[GitHub] spark issue #16106: [SPARK-17213][SQL] Disable Parquet filter push-down for ...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16106 **[Test build #69511 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69511/consoleFull)** for PR 16106 at commit

[GitHub] spark issue #16104: [SPARK-18675][SQL] CTAS for hive serde table should work...

2016-12-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16104 Last time, ``` [info] - set hive.metastore.warehouse.dir *** FAILED *** (5 minutes, 0 seconds) ``` At this time, ``` [info] - SPARK-18360: default table path of tables

[GitHub] spark issue #16104: [SPARK-18675][SQL] CTAS for hive serde table should work...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16104 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16104: [SPARK-18675][SQL] CTAS for hive serde table should work...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16104 **[Test build #69503 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69503/consoleFull)** for PR 16104 at commit

[GitHub] spark issue #16043: [SPARK-18601][SQL] Simplify Create/Get complex expressio...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16043 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69510/ Test FAILed. ---

[GitHub] spark issue #16043: [SPARK-18601][SQL] Simplify Create/Get complex expressio...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16043 **[Test build #69510 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69510/consoleFull)** for PR 16043 at commit

[GitHub] spark issue #16043: [SPARK-18601][SQL] Simplify Create/Get complex expressio...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16043 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16043: [SPARK-18601][SQL] Simplify Create/Get complex expressio...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16043 **[Test build #69510 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69510/consoleFull)** for PR 16043 at commit

[GitHub] spark issue #16106: [SPARK-17213][SQL] Disable Parquet filter push-down for ...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16106 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16106: [SPARK-17213][SQL] Disable Parquet filter push-down for ...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16106 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69497/ Test FAILed. ---

[GitHub] spark issue #16106: [SPARK-17213][SQL] Disable Parquet filter push-down for ...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16106 **[Test build #69497 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69497/consoleFull)** for PR 16106 at commit

[GitHub] spark issue #16092: [SPARK-18662] Move resource managers to separate directo...

2016-12-01 Thread foxish
Github user foxish commented on the issue: https://github.com/apache/spark/pull/16092 @JoshRosen Thanks for reviewing. Updated. PTAL. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #16105: [SPARK-18617][Tests]Fix flaky test: StreamingCont...

2016-12-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16105 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16105: [SPARK-18617][Tests]Fix flaky test: StreamingContextSuit...

2016-12-01 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16105 Thanks. Merging to master, 2.1 and 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15863: [SPARK-18419][SQL] `JDBCRelation.insert` should not remo...

2016-12-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15863 The only failure seems to be irrelevant. ``` Had test failures in pyspark.streaming.tests with pypy; see logs. ``` --- If your project is set up for it, you can reply to this

[GitHub] spark issue #15863: [SPARK-18419][SQL] `JDBCRelation.insert` should not remo...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15863 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69493/ Test FAILed. ---

[GitHub] spark issue #15863: [SPARK-18419][SQL] `JDBCRelation.insert` should not remo...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15863 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15863: [SPARK-18419][SQL] `JDBCRelation.insert` should not remo...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15863 **[Test build #69493 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69493/consoleFull)** for PR 15863 at commit

[GitHub] spark pull request #15237: [SPARK-17663] [CORE] SchedulableBuilder should ha...

2016-12-01 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/15237#discussion_r90543844 --- Diff: core/src/test/scala/org/apache/spark/scheduler/PoolSuite.scala --- @@ -20,15 +20,21 @@ package org.apache.spark.scheduler import

[GitHub] spark pull request #15237: [SPARK-17663] [CORE] SchedulableBuilder should ha...

2016-12-01 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/15237#discussion_r90548446 --- Diff: core/src/main/scala/org/apache/spark/scheduler/SchedulableBuilder.scala --- @@ -102,38 +105,55 @@ private[spark] class FairSchedulableBuilder(val

[GitHub] spark pull request #15237: [SPARK-17663] [CORE] SchedulableBuilder should ha...

2016-12-01 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/15237#discussion_r90548133 --- Diff: core/src/main/scala/org/apache/spark/scheduler/SchedulableBuilder.scala --- @@ -102,38 +105,55 @@ private[spark] class FairSchedulableBuilder(val

[GitHub] spark pull request #15237: [SPARK-17663] [CORE] SchedulableBuilder should ha...

2016-12-01 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/15237#discussion_r90544307 --- Diff: core/src/test/scala/org/apache/spark/scheduler/PoolSuite.scala --- @@ -20,15 +20,21 @@ package org.apache.spark.scheduler import

[GitHub] spark pull request #15237: [SPARK-17663] [CORE] SchedulableBuilder should ha...

2016-12-01 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/15237#discussion_r90547665 --- Diff: core/src/main/scala/org/apache/spark/scheduler/SchedulableBuilder.scala --- @@ -102,38 +105,55 @@ private[spark] class FairSchedulableBuilder(val

[GitHub] spark pull request #15237: [SPARK-17663] [CORE] SchedulableBuilder should ha...

2016-12-01 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/15237#discussion_r90548835 --- Diff: core/src/test/scala/org/apache/spark/scheduler/PoolSuite.scala --- @@ -178,4 +177,36 @@ class PoolSuite extends SparkFunSuite with

[GitHub] spark pull request #15237: [SPARK-17663] [CORE] SchedulableBuilder should ha...

2016-12-01 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/15237#discussion_r90543989 --- Diff: core/src/test/scala/org/apache/spark/scheduler/PoolSuite.scala --- @@ -74,30 +79,24 @@ class PoolSuite extends SparkFunSuite with LocalSparkContext

[GitHub] spark pull request #16108: [SPARK-18670][SS]Limit the number of StreamingQue...

2016-12-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16108#discussion_r90548402 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQueryListenerSuite.scala --- @@ -191,6 +192,48 @@ class StreamingQueryListenerSuite

[GitHub] spark pull request #16108: [SPARK-18670][SS]Limit the number of StreamingQue...

2016-12-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16108#discussion_r90548243 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQueryListenerSuite.scala --- @@ -191,6 +192,48 @@ class StreamingQueryListenerSuite

[GitHub] spark pull request #16108: [SPARK-18670][SS]Limit the number of StreamingQue...

2016-12-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16108#discussion_r90547917 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala --- @@ -218,7 +223,15 @@ class StreamExecution(

[GitHub] spark pull request #16108: [SPARK-18670][SS]Limit the number of StreamingQue...

2016-12-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16108#discussion_r90547116 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -603,6 +603,13 @@ object SQLConf {

[GitHub] spark issue #16043: [SPARK-18601][SQL] Simplify Create/Get complex expressio...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16043 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69509/ Test FAILed. ---

[GitHub] spark issue #16043: [SPARK-18601][SQL] Simplify Create/Get complex expressio...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16043 **[Test build #69509 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69509/consoleFull)** for PR 16043 at commit

[GitHub] spark issue #15863: [SPARK-18419][SQL] `JDBCRelation.insert` should not remo...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15863 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69494/ Test PASSed. ---

[GitHub] spark pull request #16108: [SPARK-18670][SS]Limit the number of StreamingQue...

2016-12-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16108#discussion_r90547085 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -603,6 +603,13 @@ object SQLConf {

[GitHub] spark issue #16043: [SPARK-18601][SQL] Simplify Create/Get complex expressio...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16043 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15863: [SPARK-18419][SQL] `JDBCRelation.insert` should not remo...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15863 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15863: [SPARK-18419][SQL] `JDBCRelation.insert` should not remo...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15863 **[Test build #69494 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69494/consoleFull)** for PR 15863 at commit

[GitHub] spark issue #16043: [SPARK-18601][SQL] Simplify Create/Get complex expressio...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16043 **[Test build #69509 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69509/consoleFull)** for PR 16043 at commit

[GitHub] spark issue #16105: [SPARK-18617][Tests]Fix flaky test: StreamingContextSuit...

2016-12-01 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16105 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #16109: [SPARK-18588][Tests]Fix flaky test: KafkaSourceStressFor...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16109 **[Test build #69508 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69508/consoleFull)** for PR 16109 at commit

[GitHub] spark issue #16109: [SPARK-18588][Tests]Fix flaky test: KafkaSourceStressFor...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16109 **[Test build #3452 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3452/consoleFull)** for PR 16109 at commit

[GitHub] spark issue #16109: [SPARK-18588][Tests]Fix flaky test: KafkaSourceStressFor...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16109 **[Test build #3451 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3451/consoleFull)** for PR 16109 at commit

[GitHub] spark issue #16109: [SPARK-18588][Tests]Fix flaky test: KafkaSourceStressFor...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16109 **[Test build #3453 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3453/consoleFull)** for PR 16109 at commit

[GitHub] spark issue #16109: [SPARK-18588][Tests]Fix flaky test: KafkaSourceStressFor...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16109 **[Test build #3450 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3450/consoleFull)** for PR 16109 at commit

[GitHub] spark pull request #16048: [DO_NOT_MERGE]Test kafka deletion

2016-12-01 Thread zsxwing
Github user zsxwing closed the pull request at: https://github.com/apache/spark/pull/16048 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #16109: [SPARK-18588][Tests]Fix flaky test: KafkaSourceSt...

2016-12-01 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16109#discussion_r90545011 --- Diff: external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaTestUtils.scala --- @@ -331,7 +351,7 @@ class KafkaTestUtils extends

[GitHub] spark pull request #16109: [SPARK-18588][Tests]Fix flaky test: KafkaSourceSt...

2016-12-01 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16109#discussion_r90544901 --- Diff: external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaTestUtils.scala --- @@ -286,36 +286,56 @@ class KafkaTestUtils extends

[GitHub] spark pull request #16109: [SPARK-18588][Tests]Fix flaky test: KafkaSourceSt...

2016-12-01 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16109#discussion_r90544756 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -102,7 +102,7 @@ private[kafka010] case class

[GitHub] spark pull request #16109: [SPARK-18588][Tests]Fix flaky test: KafkaSourceSt...

2016-12-01 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/16109 [SPARK-18588][Tests]Fix flaky test: KafkaSourceStressForDontFailOnDataLossSuite ## What changes were proposed in this pull request? Fixed the following failures: ```

[GitHub] spark issue #15219: [SPARK-14098][SQL] Generate Java code to build CachedCol...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15219 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15219: [SPARK-14098][SQL] Generate Java code to build CachedCol...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15219 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69492/ Test PASSed. ---

[GitHub] spark issue #15795: [SPARK-18081] Add user guide for Locality Sensitive Hash...

2016-12-01 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/15795 +1 for consolidating the examples. The boilerplate of creating a dataset and setting algorithm parameters takes up most of the example. I would create 1 example per algorithm which does

[GitHub] spark issue #16043: [SPARK-18601][SQL] Simplify Create/Get complex expressio...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16043 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16043: [SPARK-18601][SQL] Simplify Create/Get complex expressio...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16043 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69507/ Test FAILed. ---

[GitHub] spark issue #16043: [SPARK-18601][SQL] Simplify Create/Get complex expressio...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16043 **[Test build #69507 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69507/consoleFull)** for PR 16043 at commit

[GitHub] spark issue #15219: [SPARK-14098][SQL] Generate Java code to build CachedCol...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15219 **[Test build #69492 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69492/consoleFull)** for PR 15219 at commit

[GitHub] spark pull request #16100: [SPARK-18674][SQL] improve the error message of u...

2016-12-01 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16100#discussion_r90543899 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/joinTypes.scala --- @@ -100,7 +100,7 @@ case class NaturalJoin(tpe: JoinType)

<    1   2   3   4   5   6   7   >