GitHub user IngoSchuster opened a pull request:
https://github.com/apache/spark/pull/18437
[SPARK-21176] [Web UI] Limit number of selector threads for admin ui proxy
servlets to 8
## What changes were proposed in this pull request?
Please see also https://issues.apache.org/jira
Github user IngoSchuster commented on a diff in the pull request:
https://github.com/apache/spark/pull/18437#discussion_r124552646
--- Diff: core/src/main/scala/org/apache/spark/ui/JettyUtils.scala ---
@@ -208,6 +210,13 @@ private[spark] object JettyUtils extends Logging
Github user IngoSchuster commented on a diff in the pull request:
https://github.com/apache/spark/pull/18437#discussion_r124771993
--- Diff: core/src/main/scala/org/apache/spark/ui/JettyUtils.scala ---
@@ -208,6 +210,13 @@ private[spark] object JettyUtils extends Logging
Github user IngoSchuster commented on the issue:
https://github.com/apache/spark/pull/18437
Thank you all for your support!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user IngoSchuster commented on the issue:
https://github.com/apache/spark/pull/18499
Can we pull that also into 2.1.1? The original code in JettyUtils to limit
the number of selector threads is actually wrong.
Instead of
` val numSelectors = math.max(1, math.min(8
Github user IngoSchuster commented on a diff in the pull request:
https://github.com/apache/spark/pull/18499#discussion_r125498872
--- Diff: core/src/main/scala/org/apache/spark/ui/JettyUtils.scala ---
@@ -194,30 +194,26 @@ private[spark] object JettyUtils extends Logging
Github user IngoSchuster commented on the issue:
https://github.com/apache/spark/pull/18499
You are right, a short moment of confusion - already deleted my comment...
;-)
Please disregard it
Regards,
Ingo Schuster
Tel: +49-(0)7031-16-5156
Github user IngoSchuster commented on a diff in the pull request:
https://github.com/apache/spark/pull/18499#discussion_r125665745
--- Diff: core/src/main/scala/org/apache/spark/ui/JettyUtils.scala ---
@@ -194,30 +194,26 @@ private[spark] object JettyUtils extends Logging
Github user IngoSchuster commented on the issue:
https://github.com/apache/spark/pull/18499
Yes I believe it still makes sense to limit the number of selector threads.
Jetty's default is tuned for a real web server and by default it creates
(number of cpus / 2) selector th
