[GitHub] spark issue #16453: [SPARK-19054][ML] Eliminate extra pass in NB

2017-01-04 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16453 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #16455: [MINOR][DOCS] Remove consecutive duplicated words/typo i...

2017-01-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16455 **[Test build #3519 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3519/testReport)** for PR 16455 at commit

[GitHub] spark pull request #16461: [SPARK-19060][SQL] remove the supportsPartial fla...

2017-01-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16461 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16451: [SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ident...

2017-01-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16451 **[Test build #70871 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70871/testReport)** for PR 16451 at commit

[GitHub] spark pull request #16451: [SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix al...

2017-01-04 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16451#discussion_r94569924 --- Diff: external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaTestUtils.scala --- @@ -138,10 +139,15 @@ class KafkaTestUtils

[GitHub] spark issue #16461: [SPARK-19060][SQL] remove the supportsPartial flag in Ag...

2017-01-04 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/16461 LGTM. Merging to master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14284: [SPARK-16633] [SPARK-16642] [SPARK-16721] [SQL] Fixes th...

2017-01-04 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14284 @chengat1314 this has never been supported, and is a new feature. There was some discussion on the JIRA a while back: https://issues.apache.org/jira/browse/SPARK-17423. Lets move the discussion

[GitHub] spark issue #16451: [SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ident...

2017-01-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16451 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16451: [SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ident...

2017-01-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16451 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70866/ Test PASSed. ---

[GitHub] spark issue #16451: [SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ident...

2017-01-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16451 **[Test build #70866 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70866/testReport)** for PR 16451 at commit

[GitHub] spark issue #16451: [SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ident...

2017-01-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16451 **[Test build #70870 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70870/testReport)** for PR 16451 at commit

[GitHub] spark issue #16451: [SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ident...

2017-01-04 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16451 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16451: [SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ident...

2017-01-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16451 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16451: [SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ident...

2017-01-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16451 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70869/ Test FAILed. ---

[GitHub] spark issue #16451: [SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ident...

2017-01-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16451 **[Test build #70869 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70869/testReport)** for PR 16451 at commit

[GitHub] spark issue #16451: [SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ident...

2017-01-04 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16451 Now, there are 30ish tests failed on Windows which I could identify via AppVeyor tests [here](https://gist.github.com/HyukjinKwon/88a0b37cd027934bc14f3aa9f812be31) which I am currently working

[GitHub] spark issue #16451: [SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ident...

2017-01-04 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16451 Hi @srowen, do you mind if I ask to check whether the changes look reasonable? (I will double check if the tests are really passed after the tests above are finished.) --- If your project is

[GitHub] spark pull request #16451: [WIP][SPARK-18922][SQL][CORE][STREAMING][TESTS] F...

2017-01-04 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16451#discussion_r94563476 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -222,25 +223,34 @@ case class LoadDataCommand( val

[GitHub] spark pull request #16451: [WIP][SPARK-18922][SQL][CORE][STREAMING][TESTS] F...

2017-01-04 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16451#discussion_r94564162 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveSparkSubmitSuite.scala --- @@ -339,10 +339,15 @@ class HiveSparkSubmitSuite

[GitHub] spark pull request #16451: [WIP][SPARK-18922][SQL][CORE][STREAMING][TESTS] F...

2017-01-04 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16451#discussion_r94562756 --- Diff: external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaTestUtils.scala --- @@ -374,8 +380,15 @@ class KafkaTestUtils

[GitHub] spark pull request #16451: [WIP][SPARK-18922][SQL][CORE][STREAMING][TESTS] F...

2017-01-04 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16451#discussion_r94563417 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -222,25 +223,34 @@ case class LoadDataCommand( val

[GitHub] spark pull request #16451: [WIP][SPARK-18922][SQL][CORE][STREAMING][TESTS] F...

2017-01-04 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16451#discussion_r94562260 --- Diff: external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaTestUtils.scala --- @@ -138,10 +139,15 @@ class KafkaTestUtils

[GitHub] spark pull request #16451: [WIP][SPARK-18922][SQL][CORE][STREAMING][TESTS] F...

2017-01-04 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16451#discussion_r94564561 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/receiver/ReceiverSupervisorImpl.scala --- @@ -175,6 +175,12 @@ private[streaming] class

[GitHub] spark pull request #16451: [WIP][SPARK-18922][SQL][CORE][STREAMING][TESTS] F...

2017-01-04 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16451#discussion_r94562979 --- Diff: external/kafka-0-10/src/test/scala/org/apache/spark/streaming/kafka010/DirectKafkaStreamSuite.scala --- @@ -372,7 +367,7 @@ class

[GitHub] spark pull request #16451: [WIP][SPARK-18922][SQL][CORE][STREAMING][TESTS] F...

2017-01-04 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16451#discussion_r94561930 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -1485,17 +1485,18 @@ private[spark] object Utils extends Logging { /**

[GitHub] spark pull request #16451: [WIP][SPARK-18922][SQL][CORE][STREAMING][TESTS] F...

2017-01-04 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16451#discussion_r94562021 --- Diff: core/src/test/scala/org/apache/spark/util/UtilsSuite.scala --- @@ -482,7 +482,7 @@ class UtilsSuite extends SparkFunSuite with

[GitHub] spark issue #16470: [SPARK-19033][Core] Add admin acls for history server

2017-01-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16470 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16470: [SPARK-19033][Core] Add admin acls for history server

2017-01-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16470 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70865/ Test PASSed. ---

[GitHub] spark issue #16470: [SPARK-19033][Core] Add admin acls for history server

2017-01-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16470 **[Test build #70865 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70865/testReport)** for PR 16470 at commit

[GitHub] spark issue #16451: [WIP][SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ...

2017-01-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16451 **[Test build #70869 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70869/testReport)** for PR 16451 at commit

[GitHub] spark issue #16451: [WIP][SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ...

2017-01-04 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16451 Build started: [TESTS] `org.apache.spark.sql.hive.PartitionedTablePerfStatsSuite`

[GitHub] spark issue #16466: [SPARK-19070] Clean-up dataset actions

2017-01-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16466 **[Test build #70868 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70868/testReport)** for PR 16466 at commit

[GitHub] spark pull request #16459: [SPARK-19073] LauncherState should be only set to...

2017-01-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16459 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16451: [WIP][SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ...

2017-01-04 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16451 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16451: [WIP][SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ...

2017-01-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16451 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16451: [WIP][SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ...

2017-01-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16451 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70864/ Test FAILed. ---

[GitHub] spark issue #16451: [WIP][SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ...

2017-01-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16451 **[Test build #70864 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70864/testReport)** for PR 16451 at commit

[GitHub] spark issue #16451: [WIP][SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ...

2017-01-04 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16451 Now, there are 30ish tests failed on Windows which I could identify via AppVeyor tests [here](https://gist.github.com/HyukjinKwon/88a0b37cd027934bc14f3aa9f812be31) which I am currently working

[GitHub] spark issue #15240: [SPARK-17556] [CORE] [SQL] Executor side broadcast for b...

2017-01-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15240 **[Test build #70867 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70867/testReport)** for PR 15240 at commit

[GitHub] spark issue #16451: [WIP][SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ...

2017-01-04 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16451 Build started: [TESTS] `org.apache.spark.streaming.kafka010.DirectKafkaStreamSuite`

[GitHub] spark issue #16451: [WIP][SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ...

2017-01-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16451 **[Test build #70866 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70866/testReport)** for PR 16451 at commit

[GitHub] spark issue #16376: [SPARK-18967][SCHEDULER] compute locality levels even if...

2017-01-04 Thread lirui-intel
Github user lirui-intel commented on the issue: https://github.com/apache/spark/pull/16376 @kayousterhout I see. Thanks for the explanations :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #16432: [SPARK-19021][YARN] Generailize HDFSCredentialProvider t...

2017-01-04 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/16432 Thanks @tgravescs for your comments. Yes actually it should be Hadoop compatible file systems, or in other words should be Hadoop `FileSystem` API supported FS. I tested with kerberized HDFS and

[GitHub] spark issue #16470: [SPARK-19033][Core] Add admin acls for history server

2017-01-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16470 **[Test build #70865 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70865/testReport)** for PR 16470 at commit

[GitHub] spark pull request #16470: [SPARK-19033][Core] Add admin acls for history se...

2017-01-04 Thread jerryshao
GitHub user jerryshao opened a pull request: https://github.com/apache/spark/pull/16470 [SPARK-19033][Core] Add admin acls for history server ## What changes were proposed in this pull request? Current HistoryServer's ACLs is derived from application event-log, which means

[GitHub] spark pull request #16460: [SPARK-19058][SQL] fix partition related behavior...

2017-01-04 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/16460#discussion_r94542321 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/InsertIntoHadoopFsRelationCommand.scala --- @@ -74,12 +69,29 @@ case class

[GitHub] spark issue #16451: [WIP][SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ...

2017-01-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16451 **[Test build #70864 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70864/testReport)** for PR 16451 at commit

[GitHub] spark issue #16464: [SPARK-19066][SparkR]:SparkR LDA doesn't set optimizer c...

2017-01-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16464 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16417: [SPARK-19014][SQL] support complex aggregate buffer in H...

2017-01-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16417 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70862/ Test FAILed. ---

[GitHub] spark issue #15178: [SPARK-17556][SQL] Executor side broadcast for broadcast...

2017-01-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15178 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70861/ Test FAILed. ---

[GitHub] spark issue #15178: [SPARK-17556][SQL] Executor side broadcast for broadcast...

2017-01-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15178 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16417: [SPARK-19014][SQL] support complex aggregate buffer in H...

2017-01-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16417 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16464: [SPARK-19066][SparkR]:SparkR LDA doesn't set optimizer c...

2017-01-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16464 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70863/ Test FAILed. ---

<    1   2   3   4   5