[GitHub] spark issue #16183: [SPARK-18671][SS][test-maven] Follow up PR to fix test f...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16183 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16183: [SPARK-18671][SS][test-maven] Follow up PR to fix test f...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16183 **[Test build #69764 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69764/consoleFull)** for PR 16183 at commit

[GitHub] spark issue #16180: [DOCS][MINOR] Clarify Where AccumulatorV2s are Displayed

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16180 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69770/ Test PASSed. ---

[GitHub] spark issue #16180: [DOCS][MINOR] Clarify Where AccumulatorV2s are Displayed

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16180 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16180: [DOCS][MINOR] Clarify Where AccumulatorV2s are Displayed

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16180 **[Test build #69770 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69770/consoleFull)** for PR 16180 at commit

[GitHub] spark issue #16183: [SPARK-18671][SS][test-maven] Follow up PR to fix test f...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16183 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16183: [SPARK-18671][SS][test-maven] Follow up PR to fix test f...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16183 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69763/ Test PASSed. ---

[GitHub] spark issue #16183: [SPARK-18671][SS][test-maven] Follow up PR to fix test f...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16183 **[Test build #69763 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69763/consoleFull)** for PR 16183 at commit

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK][WIP] Classification and regre...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16171 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69768/ Test FAILed. ---

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK][WIP] Classification and regre...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16171 **[Test build #69768 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69768/consoleFull)** for PR 16171 at commit

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK][WIP] Classification and regre...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16171 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16182: [SPARK-18754][SS] Rename recentProgresses to recentProgr...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16182 **[Test build #69771 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69771/consoleFull)** for PR 16182 at commit

[GitHub] spark issue #16109: [SPARK-18588][Tests]Fix flaky test: KafkaSourceStressFor...

2016-12-06 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/16109 overall LGTM, just a few nits that would be good to fix. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #16182: [SPARK-18754][SS] Rename recentProgresses to recentProgr...

2016-12-06 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/16182 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #16180: [DOCS][MINOR] Clarify Where AccumulatorV2s are Displayed

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16180 **[Test build #69770 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69770/consoleFull)** for PR 16180 at commit

[GitHub] spark issue #16186: [SPARK-18758][SS] StreamingQueryListener events from a S...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16186 **[Test build #69769 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69769/consoleFull)** for PR 16186 at commit

[GitHub] spark pull request #16186: [SPARK-18758][SS] StreamingQueryListener events f...

2016-12-06 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16186#discussion_r91222579 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/memory.scala --- @@ -70,11 +70,11 @@ case class MemoryStream[A : Encoder](id: Int,

[GitHub] spark pull request #16186: [SPARK-18758][SS] StreamingQueryListener events f...

2016-12-06 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16186#discussion_r91222596 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamTest.scala --- @@ -319,7 +319,6 @@ trait StreamTest extends QueryTest with

[GitHub] spark pull request #16186: [SPARK-18758][SS] StreamingQueryListener events f...

2016-12-06 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16186#discussion_r91222589 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamTest.scala --- @@ -231,8 +231,8 @@ trait StreamTest extends QueryTest with

[GitHub] spark pull request #16186: [SPARK-18758][SS] StreamingQueryListener events f...

2016-12-06 Thread tdas
GitHub user tdas opened a pull request: https://github.com/apache/spark/pull/16186 [SPARK-18758][SS] StreamingQueryListener events from a StreamingQuery should be sent only to the listeners in the same session as the query ## What changes were proposed in this pull request?

[GitHub] spark issue #16182: [SPARK-18754][SS] Rename recentProgresses to recentProgr...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16182 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69761/ Test FAILed. ---

[GitHub] spark issue #16182: [SPARK-18754][SS] Rename recentProgresses to recentProgr...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16182 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16165: [SPARK-8617] [WEBUI] HistoryServer: Include in-pr...

2016-12-06 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/16165#discussion_r91222047 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala --- @@ -546,7 +546,7 @@ private[history] class FsHistoryProvider(conf:

[GitHub] spark issue #16182: [SPARK-18754][SS] Rename recentProgresses to recentProgr...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16182 **[Test build #69761 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69761/consoleFull)** for PR 16182 at commit

[GitHub] spark issue #16115: [SPARK-18667][PySpark][SQL] Change the way to group row ...

2016-12-06 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16115 cc @cloud-fan @hvanhovell too --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16165: [SPARK-8617] [WEBUI] HistoryServer: Include in-pr...

2016-12-06 Thread seyfe
Github user seyfe commented on a diff in the pull request: https://github.com/apache/spark/pull/16165#discussion_r91221947 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala --- @@ -546,7 +546,7 @@ private[history] class FsHistoryProvider(conf:

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK][WIP] Classification and regre...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16171 **[Test build #69768 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69768/consoleFull)** for PR 16171 at commit

[GitHub] spark pull request #16165: [SPARK-8617] [WEBUI] HistoryServer: Include in-pr...

2016-12-06 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/16165#discussion_r91221480 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala --- @@ -546,7 +546,7 @@ private[history] class FsHistoryProvider(conf:

[GitHub] spark issue #16183: [SPARK-18671][SS][test-maven] Follow up PR to fix test f...

2016-12-06 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16183 LGTM pending tests --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #16114: [SPARK-18620][Streaming][Kinesis] Flatten input rates in...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16114 **[Test build #69765 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69765/consoleFull)** for PR 16114 at commit

[GitHub] spark issue #16114: [SPARK-18620][Streaming][Kinesis] Flatten input rates in...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16114 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69765/ Test PASSed. ---

[GitHub] spark issue #16114: [SPARK-18620][Streaming][Kinesis] Flatten input rates in...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16114 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16135: [SPARK-18700][SQL] Add ReadWriteLock for each table's re...

2016-12-06 Thread xuanyuanking
Github user xuanyuanking commented on the issue: https://github.com/apache/spark/pull/16135 @rxin @liancheng --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16179: [SPARK-18752][hive] "isSrcLocal" value should be set fro...

2016-12-06 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/16179 Hmm, those tests passed locally... let me rebase. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16177: [SPARK-17760][SQL] AnalysisException with dataframe pivo...

2016-12-06 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16177 cc @cloud-fan / @hvanhovell --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16139: [SPARK-18705][ML][DOC] Update user guide to reflect one ...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16139 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16139: [SPARK-18705][ML][DOC] Update user guide to reflect one ...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16139 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69766/ Test PASSed. ---

[GitHub] spark issue #16139: [SPARK-18705][ML][DOC] Update user guide to reflect one ...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16139 **[Test build #69766 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69766/consoleFull)** for PR 16139 at commit

[GitHub] spark pull request #16175: [SPARK-17460][SQL]check if statistics.sizeInBytes...

2016-12-06 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16175#discussion_r91219886 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala --- @@ -1110,6 +1110,14 @@ class DatasetSuite extends QueryTest with

[GitHub] spark pull request #16185: Update Spark documentation to provide information...

2016-12-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16185 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16185: Update Spark documentation to provide information on how...

2016-12-06 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16185 Thanks - merging in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16185: Update Spark documentation to provide information on how...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16185 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #16185: Update Spark documentation to provide information...

2016-12-06 Thread c-sahuja
GitHub user c-sahuja opened a pull request: https://github.com/apache/spark/pull/16185 Update Spark documentation to provide information on how to create External Table ## What changes were proposed in this pull request? Although, currently, the saveAsTable does not provide an

[GitHub] spark issue #16184: [SPARK-18753][SQL] Keep pushed-down null literal as a fi...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16184 **[Test build #69767 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69767/consoleFull)** for PR 16184 at commit

[GitHub] spark issue #16184: [SPARK-18753][SQL] Keep pushed-down null literal as a fi...

2016-12-06 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16184 cc @liancheng and @zsxwing. Could you take a look and see if it makes sense please? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request #16184: [SPARK-18753][SQL] Keep pushed-down null literal ...

2016-12-06 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/16184 [SPARK-18753][SQL] Keep pushed-down null literal as a filter in Spark-side post-filter for FileFormat datasources ## What changes were proposed in this pull request? Currently,

[GitHub] spark issue #16139: [SPARK-18705][ML][DOC] Update user guide to reflect one ...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16139 **[Test build #69766 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69766/consoleFull)** for PR 16139 at commit

[GitHub] spark pull request #16139: [SPARK-18705][ML][DOC] Update user guide to refle...

2016-12-06 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/16139#discussion_r91218016 --- Diff: docs/ml-advanced.md --- @@ -59,17 +59,22 @@ Given $n$ weighted observations $(w_i, a_i, b_i)$: The number of features for each

[GitHub] spark pull request #16165: [SPARK-8617] [WEBUI] HistoryServer: Include in-pr...

2016-12-06 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/16165#discussion_r91218008 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala --- @@ -546,7 +546,7 @@ private[history] class FsHistoryProvider(conf:

[GitHub] spark pull request #16139: [SPARK-18705][ML][DOC] Update user guide to refle...

2016-12-06 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/16139#discussion_r91217902 --- Diff: docs/ml-advanced.md --- @@ -59,17 +59,22 @@ Given $n$ weighted observations $(w_i, a_i, b_i)$: The number of features for each

[GitHub] spark issue #16000: [SPARK-18537][Web UI]Add a REST api to spark streaming

2016-12-06 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/16000 I disagree. It's completely possible to mount the streaming API on top of the existing spark-core API. You just need to add the necessary hooks so that the API code can ask the streaming module for

[GitHub] spark pull request #16139: [SPARK-18705][ML][DOC] Update user guide to refle...

2016-12-06 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/16139#discussion_r91217895 --- Diff: docs/ml-advanced.md --- @@ -59,17 +59,22 @@ Given $n$ weighted observations $(w_i, a_i, b_i)$: The number of features for each

[GitHub] spark issue #16092: [SPARK-18662] Move resource managers to separate directo...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16092 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16092: [SPARK-18662] Move resource managers to separate directo...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16092 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69756/ Test FAILed. ---

[GitHub] spark issue #16092: [SPARK-18662] Move resource managers to separate directo...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16092 **[Test build #69756 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69756/consoleFull)** for PR 16092 at commit

[GitHub] spark issue #16000: [SPARK-18537][Web UI]Add a REST api to spark streaming

2016-12-06 Thread ChorPangChan
Github user ChorPangChan commented on the issue: https://github.com/apache/spark/pull/16000 @vanzin I undertstand the story now, but im afraid i cant help to accomplish that story. as my first comment state, this implementation is base on the current REST

[GitHub] spark issue #16114: [SPARK-18620][Streaming][Kinesis] Flatten input rates in...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16114 **[Test build #69765 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69765/consoleFull)** for PR 16114 at commit

[GitHub] spark issue #15819: [SPARK-18372][SQL][Branch-1.6].Staging directory fail to...

2016-12-06 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15819 @lichenglin Another PR https://github.com/apache/spark/pull/16134 is trying to delete the staging directory and the temporary data files (which is pretty big in your case) after each insert.

[GitHub] spark issue #16122: [SPARK-18681][SQL] Fix filtering to compatible with part...

2016-12-06 Thread wangyum
Github user wangyum commented on the issue: https://github.com/apache/spark/pull/16122 @mallman OK, thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #16109: [SPARK-18588][Tests]Fix flaky test: KafkaSourceStressFor...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16109 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69752/ Test PASSed. ---

[GitHub] spark issue #16109: [SPARK-18588][Tests]Fix flaky test: KafkaSourceStressFor...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16109 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16109: [SPARK-18588][Tests]Fix flaky test: KafkaSourceStressFor...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16109 **[Test build #69752 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69752/consoleFull)** for PR 16109 at commit

[GitHub] spark issue #16179: [SPARK-18752][hive] "isSrcLocal" value should be set fro...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16179 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16179: [SPARK-18752][hive] "isSrcLocal" value should be set fro...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16179 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69757/ Test FAILed. ---

[GitHub] spark issue #16179: [SPARK-18752][hive] "isSrcLocal" value should be set fro...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16179 **[Test build #69757 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69757/consoleFull)** for PR 16179 at commit

[GitHub] spark issue #15722: [SPARK-18208] [Shuffle] Executor OOM due to a growing Lo...

2016-12-06 Thread jiexiong
Github user jiexiong commented on the issue: https://github.com/apache/spark/pull/15722 @hvanhovell, thanks for your suggestion. I will change the PR description as suggested. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #16114: [SPARK-18620][Streaming][Kinesis] Flatten input rates in...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16114 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69762/ Test FAILed. ---

[GitHub] spark issue #16114: [SPARK-18620][Streaming][Kinesis] Flatten input rates in...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16114 **[Test build #69762 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69762/consoleFull)** for PR 16114 at commit

[GitHub] spark issue #16114: [SPARK-18620][Streaming][Kinesis] Flatten input rates in...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16114 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16178: [SPARK-18751][Core]Fix deadlock when SparkContext.stop i...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16178 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69751/ Test PASSed. ---

[GitHub] spark issue #16178: [SPARK-18751][Core]Fix deadlock when SparkContext.stop i...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16178 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16183: [SPARK-18671][SS][test-maven] Follow up PR to fix test f...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16183 **[Test build #69764 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69764/consoleFull)** for PR 16183 at commit

[GitHub] spark issue #16173: [SPARK-18742][CORE]readd spark.broadcast.factory conf to...

2016-12-06 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16173 It existed to support several _internal_ implementations, of which there is only one now. I don't know that it was ever intended for external implementations. --- If your project is set up for it,

[GitHub] spark issue #16178: [SPARK-18751][Core]Fix deadlock when SparkContext.stop i...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16178 **[Test build #69751 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69751/consoleFull)** for PR 16178 at commit

[GitHub] spark issue #15819: [SPARK-18372][SQL][Branch-1.6].Staging directory fail to...

2016-12-06 Thread lichenglin
Github user lichenglin commented on the issue: https://github.com/apache/spark/pull/15819 In fact,I'm using zeppelin to run sql. When I restart spark interpreter , the folders are deleted. Thank you a lot --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #16183: [SPARK-18671][SS][test-maven] Follow up PR to fix test f...

2016-12-06 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/16183 jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16183: [SPARK-18671][SS][TEST] Follow up PR to fix test for Mav...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16183 **[Test build #69763 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69763/consoleFull)** for PR 16183 at commit

[GitHub] spark issue #16182: [SPARK-18754][SS] Rename recentProgresses to recentProgr...

2016-12-06 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/16182 LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #16183: [SPARK-18671][SS][TEST] Follow up PR to fix test ...

2016-12-06 Thread tdas
GitHub user tdas opened a pull request: https://github.com/apache/spark/pull/16183 [SPARK-18671][SS][TEST] Follow up PR to fix test for Maven ## What changes were proposed in this pull request? Maven compilation seem to not allow resource is sql/test to be easily referred

[GitHub] spark issue #16182: [SPARK-18754][SS] Rename recentProgresses to recentProgr...

2016-12-06 Thread marmbrus
Github user marmbrus commented on the issue: https://github.com/apache/spark/pull/16182 /cc @tdas --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #16173: [SPARK-18742][CORE]readd spark.broadcast.factory conf to...

2016-12-06 Thread windpiger
Github user windpiger commented on the issue: https://github.com/apache/spark/pull/16173 since the trait BroadcastFactory is design for multiple implements, is't reasonable to provide a way to change the implement of BroadcastFactory? or only TorrentBroadcastFactory is enough ---

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK] Models in pyspark.classificat...

2016-12-06 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/16171 @srowen No, I think this maybe the third of five PR. Distinct from the first two PRs which only deal with the overlook, the PR modify the hierarchy of classification `Model`s in the python

[GitHub] spark pull request #16114: [SPARK-18620][Streaming][Kinesis] Flatten input r...

2016-12-06 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/16114#discussion_r91210953 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisRecordProcessor.scala --- @@ -68,9 +69,16 @@ private[kinesis] class

[GitHub] spark pull request #16109: [SPARK-18588][Tests]Fix flaky test: KafkaSourceSt...

2016-12-06 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16109#discussion_r91210829 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -102,7 +102,7 @@ private[kafka010] case class

[GitHub] spark issue #16180: [DOCS][MINOR] Clarify Where AccumulatorV2s are Displayed

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16180 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69760/ Test PASSed. ---

[GitHub] spark pull request #16109: [SPARK-18588][Tests]Fix flaky test: KafkaSourceSt...

2016-12-06 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16109#discussion_r91210695 --- Diff: external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaSourceSuite.scala --- @@ -811,6 +812,12 @@ class

[GitHub] spark issue #16180: [DOCS][MINOR] Clarify Where AccumulatorV2s are Displayed

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16180 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16180: [DOCS][MINOR] Clarify Where AccumulatorV2s are Displayed

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16180 **[Test build #69760 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69760/consoleFull)** for PR 16180 at commit

[GitHub] spark issue #16178: [SPARK-18751][Core]Fix deadlock when SparkContext.stop i...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16178 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69750/ Test PASSed. ---

[GitHub] spark issue #16182: [SPARK-18754][SS] Rename recentProgresses to recentProgr...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16182 **[Test build #69761 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69761/consoleFull)** for PR 16182 at commit

[GitHub] spark issue #16114: [SPARK-18620][Streaming][Kinesis] Flatten input rates in...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16114 **[Test build #69762 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69762/consoleFull)** for PR 16114 at commit

[GitHub] spark pull request #16109: [SPARK-18588][Tests]Fix flaky test: KafkaSourceSt...

2016-12-06 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16109#discussion_r91210556 --- Diff: external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaTestUtils.scala --- @@ -286,36 +286,56 @@ class KafkaTestUtils extends

[GitHub] spark issue #16178: [SPARK-18751][Core]Fix deadlock when SparkContext.stop i...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16178 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16178: [SPARK-18751][Core]Fix deadlock when SparkContext.stop i...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16178 **[Test build #69750 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69750/consoleFull)** for PR 16178 at commit

[GitHub] spark issue #16180: [DOCS][MINOR] Clarify Where AccumulatorV2s are Displayed

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16180 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69759/ Test PASSed. ---

[GitHub] spark issue #16180: [DOCS][MINOR] Clarify Where AccumulatorV2s are Displayed

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16180 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16180: [DOCS][MINOR] Clarify Where AccumulatorV2s are Displayed

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16180 **[Test build #69759 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69759/consoleFull)** for PR 16180 at commit

[GitHub] spark pull request #16182: [SPARK-18754][SS] Rename recentProgresses to rece...

2016-12-06 Thread marmbrus
GitHub user marmbrus opened a pull request: https://github.com/apache/spark/pull/16182 [SPARK-18754][SS] Rename recentProgresses to recentProgress Based on an informal survey, users find this option easier to understand / remember. You can merge this pull request into a Git

[GitHub] spark issue #16159: [SPARK-18697][BUILD] Upgrade sbt plugins

2016-12-06 Thread weiqingy
Github user weiqingy commented on the issue: https://github.com/apache/spark/pull/16159 Thanks, @srowen @zsxwing . My bad. I am looking into it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #15819: [SPARK-18372][SQL][Branch-1.6].Staging directory fail to...

2016-12-06 Thread merlintang
Github user merlintang commented on the issue: https://github.com/apache/spark/pull/15819 do you exit the spark shell ? I have tested on this, and this staging file would be removed after we exit the spark shell under spark 2.0.x. meanwhile, the staging file are used for

<    1   2   3   4   5   6   >