[GitHub] spark issue #16699: [SPARK-18710][ML] Add offset in GLM

2017-01-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16699 **[Test build #72067 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72067/testReport)** for PR 16699 at commit

[GitHub] spark issue #16700: [SPARK-19359][SQL]clear useless path after rename a part...

2017-01-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16700 **[Test build #72066 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72066/testReport)** for PR 16700 at commit

[GitHub] spark pull request #16344: [SPARK-18929][ML] Add Tweedie distribution in GLM

2017-01-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16344 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16344: [SPARK-18929][ML] Add Tweedie distribution in GLM

2017-01-26 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/16344 Merged into master. If there are comments from others, we can address them in follow-up work. Thanks. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #16706: [SPARK-19365][Core]Optimize RequestMessage serialization

2017-01-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16706 **[Test build #72065 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72065/testReport)** for PR 16706 at commit

[GitHub] spark issue #16716: [SPARK-19378][SS] Ensure continuity of stateOperator and...

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16716 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16716: [SPARK-19378][SS] Ensure continuity of stateOperator and...

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16716 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72064/ Test PASSed. ---

[GitHub] spark issue #16716: [SPARK-19378][SS] Ensure continuity of stateOperator and...

2017-01-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16716 **[Test build #72064 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72064/testReport)** for PR 16716 at commit

[GitHub] spark pull request #16696: [SPARK-19350] [SQL] Cardinality estimation of Lim...

2017-01-26 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16696#discussion_r98146358 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicLogicalOperators.scala --- @@ -727,37 +728,18 @@ case class

[GitHub] spark pull request #16668: [SPARK-18788][SPARKR] Add API for getNumPartition...

2017-01-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16668 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #16566: [SPARK-18821][SparkR]: Bisecting k-means wrapper ...

2017-01-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16566 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16566: [SPARK-18821][SparkR]: Bisecting k-means wrapper in Spar...

2017-01-26 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16566 merged to master. Let's follow up with programming guide, example and vignettes - would you be able to pick these up too @wangmiao1981 ? --- If your project is set up for it, you can reply to

[GitHub] spark issue #16689: [SPARK-19342][SPARKR] bug fixed in collect method for co...

2017-01-26 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16689 Just to make sure you see this: https://github.com/apache/spark/pull/16689#issuecomment-275063425 --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request #15730: [SPARK-18218][ML][MLLib] Reduce shuffled data siz...

2017-01-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15730 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15730: [SPARK-18218][ML][MLLib] Reduce shuffled data size of Bl...

2017-01-26 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/15730 Merging to master! Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16716: [SPARK-19378][SS] Ensure continuity of stateOperator and...

2017-01-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16716 **[Test build #72064 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72064/testReport)** for PR 16716 at commit

[GitHub] spark pull request #16716: [SPARK-19378][SS] Ensure continuity of stateOpera...

2017-01-26 Thread brkyvz
Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/16716#discussion_r98141759 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQueryStatusAndProgressSuite.scala --- @@ -171,6 +174,47 @@ class

[GitHub] spark pull request #16694: [SPARK-19336][ML][Pyspark]: LinearSVC Python API

2017-01-26 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/16694#discussion_r98141073 --- Diff: python/pyspark/ml/classification.py --- @@ -60,6 +61,137 @@ def numClasses(self): @inherit_doc +class

[GitHub] spark pull request #16694: [SPARK-19336][ML][Pyspark]: LinearSVC Python API

2017-01-26 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/16694#discussion_r98141077 --- Diff: python/pyspark/ml/classification.py --- @@ -60,6 +61,137 @@ def numClasses(self): @inherit_doc +class

[GitHub] spark pull request #16694: [SPARK-19336][ML][Pyspark]: LinearSVC Python API

2017-01-26 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/16694#discussion_r98141071 --- Diff: python/pyspark/ml/classification.py --- @@ -60,6 +61,137 @@ def numClasses(self): @inherit_doc +class

[GitHub] spark pull request #16694: [SPARK-19336][ML][Pyspark]: LinearSVC Python API

2017-01-26 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/16694#discussion_r98141079 --- Diff: python/pyspark/ml/classification.py --- @@ -60,6 +61,137 @@ def numClasses(self): @inherit_doc +class

[GitHub] spark pull request #16694: [SPARK-19336][ML][Pyspark]: LinearSVC Python API

2017-01-26 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/16694#discussion_r98141074 --- Diff: python/pyspark/ml/classification.py --- @@ -60,6 +61,137 @@ def numClasses(self): @inherit_doc +class

[GitHub] spark pull request #16694: [SPARK-19336][ML][Pyspark]: LinearSVC Python API

2017-01-26 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/16694#discussion_r98141066 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LinearSVC.scala --- @@ -63,7 +63,7 @@ class LinearSVC @Since("2.2.0") ( def

[GitHub] spark issue #16690: [SPARK-19347] ReceiverSupervisorImpl can add block to Re...

2017-01-26 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/16690 @vanzin @zsxwing ping for review~ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16716: [SPARK-19378][SS] Ensure continuity of stateOpera...

2017-01-26 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16716#discussion_r98140040 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQueryStatusAndProgressSuite.scala --- @@ -171,6 +174,47 @@ class

[GitHub] spark issue #16717: [SPARK-19220][UI] Make redirection to HTTPS apply to all...

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16717 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72060/ Test PASSed. ---

[GitHub] spark issue #16717: [SPARK-19220][UI] Make redirection to HTTPS apply to all...

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16717 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16717: [SPARK-19220][UI] Make redirection to HTTPS apply to all...

2017-01-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16717 **[Test build #72060 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72060/consoleFull)** for PR 16717 at commit

[GitHub] spark issue #16716: [SPARK-19378][SS] Ensure continuity of stateOperator and...

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16716 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72059/ Test PASSed. ---

[GitHub] spark issue #16716: [SPARK-19378][SS] Ensure continuity of stateOperator and...

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16716 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16700: [SPARK-19359][SQL]clear useless path after rename a part...

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16700 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72062/ Test PASSed. ---

[GitHub] spark issue #16700: [SPARK-19359][SQL]clear useless path after rename a part...

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16700 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16716: [SPARK-19378][SS] Ensure continuity of stateOperator and...

2017-01-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16716 **[Test build #72059 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72059/testReport)** for PR 16716 at commit

[GitHub] spark issue #15730: [SPARK-18218][ML][MLLib] Reduce shuffled data size of Bl...

2017-01-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15730 **[Test build #72063 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72063/testReport)** for PR 15730 at commit

[GitHub] spark issue #15730: [SPARK-18218][ML][MLLib] Reduce shuffled data size of Bl...

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15730 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15730: [SPARK-18218][ML][MLLib] Reduce shuffled data size of Bl...

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15730 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72063/ Test PASSed. ---

[GitHub] spark issue #16700: [SPARK-19359][SQL]clear useless path after rename a part...

2017-01-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16700 **[Test build #72062 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72062/testReport)** for PR 16700 at commit

[GitHub] spark issue #16716: [SPARK-19378][SS] Ensure continuity of stateOperator and...

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16716 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72061/ Test FAILed. ---

[GitHub] spark issue #16716: [SPARK-19378][SS] Ensure continuity of stateOperator and...

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16716 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16716: [SPARK-19378][SS] Ensure continuity of stateOperator and...

2017-01-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16716 **[Test build #72061 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72061/testReport)** for PR 16716 at commit

[GitHub] spark issue #16714: [SPARK-16333][Core] Enable EventLoggingListener to log l...

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16714 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16714: [SPARK-16333][Core] Enable EventLoggingListener to log l...

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16714 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72058/ Test PASSed. ---

[GitHub] spark issue #16714: [SPARK-16333][Core] Enable EventLoggingListener to log l...

2017-01-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16714 **[Test build #72058 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72058/testReport)** for PR 16714 at commit

[GitHub] spark issue #16690: [SPARK-19347] ReceiverSupervisorImpl can add block to Re...

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16690 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16690: [SPARK-19347] ReceiverSupervisorImpl can add block to Re...

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16690 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72057/ Test PASSed. ---

[GitHub] spark issue #16690: [SPARK-19347] ReceiverSupervisorImpl can add block to Re...

2017-01-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16690 **[Test build #72057 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72057/testReport)** for PR 16690 at commit

[GitHub] spark issue #13808: [SPARK-14480][SQL] Remove meaningless StringIteratorRead...

2017-01-26 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/13808 FWIW, I remember I had a hard time to figure out https://issues.apache.org/jira/browse/SPARK-14103 where the issue itself was about quote but it ended up reading whole partition as a value.

[GitHub] spark issue #13808: [SPARK-14480][SQL] Remove meaningless StringIteratorRead...

2017-01-26 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/13808 @davies, removed `StringIteratorReader` concatenates the lines in each iterator into reader in each partition IIRC. New line in the column was not supported correctly up to my

[GitHub] spark issue #16415: [SPARK-19063][ML]Speedup and optimize the GradientBooste...

2017-01-26 Thread zdh2292390
Github user zdh2292390 commented on the issue: https://github.com/apache/spark/pull/16415 @jkbradley @srowen Have you checked the latest commit?Is there any problem? Feeling long time no news --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #15730: [SPARK-18218][ML][MLLib] Reduce shuffled data size of Bl...

2017-01-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15730 **[Test build #72063 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72063/testReport)** for PR 15730 at commit

[GitHub] spark issue #15730: [SPARK-18218][ML][MLLib] Reduce shuffled data size of Bl...

2017-01-26 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/15730 @brkyvz Also thanks for your careful code review! ^_^ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #16700: [SPARK-19359][SQL]clear useless path after rename a part...

2017-01-26 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16700 LGTM except three comments. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16700: [SPARK-19359][SQL]clear useless path after rename...

2017-01-26 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16700#discussion_r98134323 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -839,6 +839,25 @@ private[spark] class

[GitHub] spark pull request #16700: [SPARK-19359][SQL]clear useless path after rename...

2017-01-26 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16700#discussion_r98134168 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -899,6 +918,22 @@ private[spark] class

[GitHub] spark issue #14725: [SPARK-17161] [PYSPARK][ML] Add PySpark-ML JavaWrapper c...

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14725 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72056/ Test PASSed. ---

[GitHub] spark issue #14725: [SPARK-17161] [PYSPARK][ML] Add PySpark-ML JavaWrapper c...

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14725 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14725: [SPARK-17161] [PYSPARK][ML] Add PySpark-ML JavaWrapper c...

2017-01-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14725 **[Test build #72056 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72056/testReport)** for PR 14725 at commit

[GitHub] spark pull request #16700: [SPARK-19359][SQL]clear useless path after rename...

2017-01-26 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16700#discussion_r98133500 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -899,6 +918,22 @@ private[spark] class

[GitHub] spark issue #13808: [SPARK-14480][SQL] Remove meaningless StringIteratorRead...

2017-01-26 Thread davies
Github user davies commented on the issue: https://github.com/apache/spark/pull/13808 @HyukjinKwon @rxin This patch have a regression: A column that have escaped newline can't be correctly parsed anymore. Should we revert this patch or figure a way to fix that? --- If your project

[GitHub] spark issue #16650: [SPARK-16554][CORE] Automatically Kill Executors and Nod...

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16650 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72053/ Test PASSed. ---

[GitHub] spark issue #16650: [SPARK-16554][CORE] Automatically Kill Executors and Nod...

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16650 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16650: [SPARK-16554][CORE] Automatically Kill Executors and Nod...

2017-01-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16650 **[Test build #72053 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72053/testReport)** for PR 16650 at commit

[GitHub] spark issue #16625: [SPARK-17874][core] Add SSL port configuration.

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16625 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72054/ Test PASSed. ---

[GitHub] spark issue #16625: [SPARK-17874][core] Add SSL port configuration.

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16625 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16625: [SPARK-17874][core] Add SSL port configuration.

2017-01-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16625 **[Test build #72054 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72054/testReport)** for PR 16625 at commit

[GitHub] spark pull request #16700: [SPARK-19359][SQL]clear useless path after rename...

2017-01-26 Thread windpiger
Github user windpiger commented on a diff in the pull request: https://github.com/apache/spark/pull/16700#discussion_r98131097 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -899,6 +918,21 @@ private[spark] class

[GitHub] spark issue #16716: [SPARK-19378][SS] Ensure continuity of stateOperator and...

2017-01-26 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/16716 @tdas Addressed --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #16700: [SPARK-19359][SQL]clear useless path after rename...

2017-01-26 Thread windpiger
Github user windpiger commented on a diff in the pull request: https://github.com/apache/spark/pull/16700#discussion_r98130978 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -839,6 +839,25 @@ private[spark] class

[GitHub] spark issue #16716: [SPARK-19378][SS] Ensure continuity of stateOperator and...

2017-01-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16716 **[Test build #72061 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72061/testReport)** for PR 16716 at commit

[GitHub] spark issue #14725: [SPARK-17161] [PYSPARK][ML] Add PySpark-ML JavaWrapper c...

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14725 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72051/ Test PASSed. ---

[GitHub] spark issue #14725: [SPARK-17161] [PYSPARK][ML] Add PySpark-ML JavaWrapper c...

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14725 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14725: [SPARK-17161] [PYSPARK][ML] Add PySpark-ML JavaWrapper c...

2017-01-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14725 **[Test build #72051 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72051/testReport)** for PR 14725 at commit

[GitHub] spark issue #16717: [SPARK-19220][UI] Make redirection to HTTPS apply to all...

2017-01-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16717 **[Test build #72060 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72060/consoleFull)** for PR 16717 at commit

[GitHub] spark pull request #16717: [SPARK-19220][UI] Make redirection to HTTPS apply...

2017-01-26 Thread vanzin
GitHub user vanzin opened a pull request: https://github.com/apache/spark/pull/16717 [SPARK-19220][UI] Make redirection to HTTPS apply to all URIs. (branch-2.0) The redirect handler was installed only for the root of the server; any other context ended up being served directly

[GitHub] spark issue #16534: [SPARK-19161][PYTHON][SQL] Improving UDF Docstrings

2017-01-26 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/16534 @rxin I am not aware of any straightforward way of separating these two, but I focused on the docstrings anyway. The rationale is simple - I want to be able to: - Create packages

[GitHub] spark pull request #16716: [SPARK-19378][SS] Ensure continuity of stateOpera...

2017-01-26 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16716#discussion_r98127618 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/ProgressReporter.scala --- @@ -180,15 +180,59 @@ trait ProgressReporter extends

[GitHub] spark pull request #16716: [SPARK-19378][SS] Ensure continuity of stateOpera...

2017-01-26 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16716#discussion_r98127344 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQueryStatusAndProgressSuite.scala --- @@ -171,6 +174,42 @@ class

[GitHub] spark pull request #16716: [SPARK-19378][SS] Ensure continuity of stateOpera...

2017-01-26 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16716#discussion_r98127274 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/ProgressReporter.scala --- @@ -180,15 +180,59 @@ trait ProgressReporter extends

[GitHub] spark pull request #16716: [SPARK-19378][SS] Ensure continuity of stateOpera...

2017-01-26 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16716#discussion_r98127228 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/ProgressReporter.scala --- @@ -180,15 +180,59 @@ trait ProgressReporter extends

[GitHub] spark pull request #16716: [SPARK-19378][SS] Ensure continuity of stateOpera...

2017-01-26 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16716#discussion_r98127156 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQueryStatusAndProgressSuite.scala --- @@ -171,6 +174,42 @@ class

[GitHub] spark issue #16697: [SPARK-19358][CORE] LiveListenerBus shall log the event ...

2017-01-26 Thread mridulm
Github user mridulm commented on the issue: https://github.com/apache/spark/pull/16697 This PR will log only the first event which got dropped. The first event which got droped need not necessarily have a correlation to the actual event(s) flooding the queue. The PR

[GitHub] spark issue #16711: [SPARK-19220][UI] Make redirection to HTTPS apply to all...

2017-01-26 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/16711 Didn't merge to 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #16711: [SPARK-19220][UI] Make redirection to HTTPS apply...

2017-01-26 Thread vanzin
Github user vanzin closed the pull request at: https://github.com/apache/spark/pull/16711 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16711: [SPARK-19220][UI] Make redirection to HTTPS apply to all...

2017-01-26 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/16711 Merging to 2.1 (and 2.0 if no conflicts). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16650: [SPARK-16554][CORE] Automatically Kill Executors ...

2017-01-26 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/16650#discussion_r98126533 --- Diff: core/src/main/scala/org/apache/spark/ExecutorAllocationClient.scala --- @@ -54,11 +54,28 @@ private[spark] trait ExecutorAllocationClient {

[GitHub] spark pull request #16650: [SPARK-16554][CORE] Automatically Kill Executors ...

2017-01-26 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/16650#discussion_r98125826 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -139,6 +139,11 @@ package object config {

[GitHub] spark pull request #16650: [SPARK-16554][CORE] Automatically Kill Executors ...

2017-01-26 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/16650#discussion_r98126123 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala --- @@ -148,6 +153,14 @@ class

[GitHub] spark issue #16716: [SPARK-19378][SS] Ensure continuity of stateOperator and...

2017-01-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16716 **[Test build #72059 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72059/testReport)** for PR 16716 at commit

[GitHub] spark pull request #16716: [SPARK-19378][SS] Ensure continuity of stateOpera...

2017-01-26 Thread brkyvz
GitHub user brkyvz opened a pull request: https://github.com/apache/spark/pull/16716 [SPARK-19378][SS] Ensure continuity of stateOperator and eventTime metrics even if there is no new data in trigger ## What changes were proposed in this pull request? In

[GitHub] spark issue #16620: [SPARK-19263] DAGScheduler should avoid sending conflict...

2017-01-26 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/16620 @squito Could you please take another look at this ? : ) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #16711: [SPARK-19220][UI] Make redirection to HTTPS apply to all...

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16711 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16714: [SPARK-16333][Core] Enable EventLoggingListener to log l...

2017-01-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16714 **[Test build #72058 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72058/testReport)** for PR 16714 at commit

[GitHub] spark issue #16711: [SPARK-19220][UI] Make redirection to HTTPS apply to all...

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16711 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72049/ Test PASSed. ---

[GitHub] spark issue #16711: [SPARK-19220][UI] Make redirection to HTTPS apply to all...

2017-01-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16711 **[Test build #72049 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72049/testReport)** for PR 16711 at commit

[GitHub] spark issue #16714: [SPARK-16333][Core] Enable EventLoggingListener to log l...

2017-01-26 Thread jisookim0513
Github user jisookim0513 commented on the issue: https://github.com/apache/spark/pull/16714 Not sure why the second test build failed at PySpark unit tests. I only changed the comments. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #16690: [SPARK-19347] ReceiverSupervisorImpl can add block to Re...

2017-01-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16690 **[Test build #72057 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72057/testReport)** for PR 16690 at commit

[GitHub] spark issue #16706: [SPARK-19365][Core]Optimize RequestMessage serialization

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16706 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16706: [SPARK-19365][Core]Optimize RequestMessage serialization

2017-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16706 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72047/ Test PASSed. ---

[GitHub] spark pull request #16706: [SPARK-19365][Core]Optimize RequestMessage serial...

2017-01-26 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/16706#discussion_r98121685 --- Diff: core/src/main/scala/org/apache/spark/rpc/netty/NettyRpcEnv.scala --- @@ -501,34 +498,99 @@ private[netty] class NettyRpcEndpointRef(

[GitHub] spark pull request #16706: [SPARK-19365][Core]Optimize RequestMessage serial...

2017-01-26 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/16706#discussion_r98121192 --- Diff: core/src/main/scala/org/apache/spark/rpc/netty/NettyRpcEnv.scala --- @@ -501,34 +498,99 @@ private[netty] class NettyRpcEndpointRef(

  1   2   3   4   5   >