[GitHub] spark issue #17608: [SPARK-20293][WEB UI][History]In the page of 'jobs' or '...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17608 It sounds a different issue with this. If it is a question, maybe, it might be better to ask a question to mailing list first before opening a JIRA. If it is really an issue, it might be better to report it with description, snaptops and steps to reproduce like I did above https://github.com/apache/spark/pull/17608#issuecomment-294059200 and https://github.com/apache/spark/pull/17608#issuecomment-293771070 It seems a warning not an error BTW. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17608: [SPARK-20293][WEB UI][History]In the page of 'jobs' or '...
Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/17608 @HyukjinKwon **I just replaced the spark-core_2.11-2.2.0-SNAPSHOT.jar Successfully start history server, but I click the Go button, now is error, the error log is as follows:**. 17/04/14 13:21:33 WARN ServletHandler: /history/app-20170411132432-0004/1/jobs/ scala.MatchError: java.lang.NoSuchMethodError: org.apache.spark.scheduler.TaskInfo.accumulables()Lscala/collection/mutable/ListBuffer; (of class java.lang.NoSuchMethodError) at org.apache.spark.deploy.history.HistoryServer.org$apache$spark$deploy$history$HistoryServer$$loadAppUi(HistoryServer.scala:230) at org.apache.spark.deploy.history.HistoryServer$$anon$1.doGet(HistoryServer.scala:86) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.spark_project.jetty.servlet.ServletHolder.handle(ServletHolder.java:812) at org.spark_project.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:587) at org.spark_project.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) at org.spark_project.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) at org.spark_project.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) at org.spark_project.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.spark_project.jetty.servlets.gzip.GzipHandler.handle(GzipHandler.java:479) at org.spark_project.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215) at org.spark_project.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.spark_project.jetty.server.Server.handle(Server.java:499) at org.spark_project.jetty.server.HttpChannel.handle(HttpChannel.java:311) at org.spark_project.jetty.server.HttpConnection.onFillable(HttpConnection.java:257) at org.spark_project.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544) at org.spark_project.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.spark_project.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17608: [SPARK-20293][WEB UI][History]In the page of 'jobs' or '...
Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/17608 @HyukjinKwon Thank you again, and now windows machines can compile apache master. No my java version is 1.8. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17608: [SPARK-20293][WEB UI][History]In the page of 'jobs' or '...
Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/17608 @ajbozarth @HyukjinKwon OK.thanks. I will close this PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17608: [SPARK-20293][WEB UI][History]In the page of 'jobs' or '...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17608 @guoxiaolongzte I assume your Java version is 7. I think we dropped the support of Java 7 (https://issues.apache.org/jira/browse/SPARK-19493). We are able to build this on Windows but there are additional settings needed (e.g., memory for maven). (FYI, I was able to build Spark on Windows 7 with 32 bits before and we are building it Windows server 2012 64 bits via AppVeyor up to my knowledge.) @ajbozarth, thank you for your time and effort. I at least confirm that this issue is not reproducible in the current master. @guoxiaolongzte Let's close this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17608: [SPARK-20293][WEB UI][History]In the page of 'jobs' or '...
Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/17608 After seeing @HyukjinKwon inspector I tracked down the issue and found #16953 that fixed this in master and 2.1 already. It was such a tiny pr I forgot all about it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17608: [SPARK-20293][WEB UI][History]In the page of 'jobs' or '...
Github user guoxiaolongzte commented on the issue:
https://github.com/apache/spark/pull/17608
@HyukjinKwon
**Now build the apache master is error.**
[INFO] Compiling 73 Java sources to
/home/spark_build/spark-2.1.0/common/network-common/target/scala-2.11/classes...
[ERROR]
/home/spark_build/spark-2.1.0/common/network-common/src/main/java/org/apache/spark/network/client/TransportClient.java:144:
é误: éæ³ç表达å¼å¼å§
[ERROR] channel.writeAndFlush(new
ChunkFetchRequest(streamChunkId)).addListener(future -> {
[ERROR]
^
[ERROR]
/home/spark_build/spark-2.1.0/common/network-common/src/main/java/org/apache/spark/network/client/TransportClient.java:144:
é误: éæ³ç表达å¼å¼å§
[ERROR] channel.writeAndFlush(new
ChunkFetchRequest(streamChunkId)).addListener(future -> {
[ERROR]
^
[ERROR]
/home/spark_build/spark-2.1.0/common/network-common/src/main/java/org/apache/spark/network/client/TransportClient.java:144:
é误: éè¦';'
[ERROR] channel.writeAndFlush(new
ChunkFetchRequest(streamChunkId)).addListener(future -> {
[ERROR]
^
[ERROR]
/home/spark_build/spark-2.1.0/common/network-common/src/main/java/org/apache/spark/network/client/TransportClient.java:145:
é误: ä¸æ¯è¯å¥
[ERROR] if (future.isSuccess()) {
[ERROR] ^
[ERROR]
/home/spark_build/spark-2.1.0/common/network-common/src/main/java/org/apache/spark/network/client/TransportClient.java:145:
é误: éè¦';'
[ERROR] if (future.isSuccess()) {
[ERROR] ^
[ERROR]
/home/spark_build/spark-2.1.0/common/network-common/src/main/java/org/apache/spark/network/client/TransportClient.java:151:
é误: æ 'if', ä½æ¯æ²¡æ 'else'
[ERROR] } else {
[ERROR] ^
[ERROR]
/home/spark_build/spark-2.1.0/common/network-common/src/main/java/org/apache/spark/network/client/TransportClient.java:163:
é误: éæ³çç±»åå¼å§
[ERROR] });
[ERROR] ^
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17608: [SPARK-20293][WEB UI][History]In the page of 'jobs' or '...
Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/17608 I am trying hard to test it in apache master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17608: [SPARK-20293][WEB UI][History]In the page of 'jobs' or '...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17608 @ajbozarth, I am terribly sorry. I just realised that my classpath was pointing out Spark 2.1.0 (I was testing regressions.). At that time it was as below: ### Spark 2.1.0 **Before GO button**  **After GO button**  **Go button inspection**  I just clean/package again and then retested this. I can't reproduce this as below in the current master ### Current Master **Before GO button**  **After GO button**  **Go button inspection**  I can't reproduce this now. I think we should close this. I apologise again ... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17608: [SPARK-20293][WEB UI][History]In the page of 'jobs' or '...
Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/17608 So I'm still not able to recreate this, I'm unsure how the Go button is creating the url you have, the issue here is for some reason `#completed` is being inserted in the middle of the url where it's not supposed to be and the extra `#` is being encoded and causing you issues. I'm not sure this is a good fix, but we should figure out why your history server is adding the extra `#completed` to the middle of your url and not mine and fix that. In order to help me figure out why our results are difference could you do an inspect on the Go button on your stage page and attach a screenshot? This is what mine looks like:  --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17608: [SPARK-20293][WEB UI][History]In the page of 'jobs' or '...
Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/17608 @ajbozarth @HyukjinKwon I have added the PR description again. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17608: [SPARK-20293][WEB UI][History]In the page of 'jobs' or '...
Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/17608 Thanks for the followup @guoxiaolongzte and @HyukjinKwon I'll take another look at work tomorrow. Also for clarification, the reason I'm being extra detailed about this is because I want to make sure this fix isn't just a band-aid solution. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17608: [SPARK-20293][WEB UI][History]In the page of 'jobs' or '...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17608 > maybe you can show a more concrete example of the URL as generated by the UI, and exactly what it is interpreted as, and the error page. This isn't very clear now. +1. @guoxiaolongzte do you mind if I ask to fill up the PR description with them? I think UI changes require before/after snapshots. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17608: [SPARK-20293][WEB UI][History]In the page of 'jobs' or '...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17608 After replacing `%23` to `#`, it seems showing the contents correctly as below:   --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17608: [SPARK-20293][WEB UI][History]In the page of 'jobs' or '...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17608 I can reproduce this bug by the following steps provided in the JIRA - https://issues.apache.org/jira/secure/attachment/12862828/jobs.png and https://issues.apache.org/jira/secure/attachment/12862829/stages.png **Chrome**   **Safari**   --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17608: [SPARK-20293][WEB UI][History]In the page of 'jobs' or '...
Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/17608 Browser is Chrome. Spark version is 2.1.0. Must be History Server Web ui. My Url: http://10.43.183.120:18082/history/app-20170411132432-0004/jobs/?completedJob.prevPageSize=100=Job+Id=true%23completed=1=100#completed Excuse me,Are you testing at the History Server Web Ui? Today,I try to recreate the latest Apache master code to test the bug. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17608: [SPARK-20293][WEB UI][History]In the page of 'jobs' or '...
Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/17608 I attempted to recreate this with the latest code on Safari, Firefox and Chrome and everything worked fine for me. What browser/environment are you using that you see this issue? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17608: [SPARK-20293][WEB UI][History]In the page of 'jobs' or '...
Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/17608 I just downloaded the latest spark master code to compile and install , test the problem, there are still bugs, the page is wrong. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17608: [SPARK-20293][WEB UI][History]In the page of 'jobs' or '...
Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/17608 So how do I deal with this PR?@ajbozarth --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17608: [SPARK-20293][WEB UI][History]In the page of 'jobs' or '...
Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/17608 On a quick git blame this is my code that seems to be broken. I'll take a more detailed look when I can in the next couple days. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17608: [SPARK-20293][WEB UI][History]In the page of 'jobs' or '...
Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/17608 After taking another look I was mixing this bug up with another when I asked that --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17608: [SPARK-20293][WEB UI][History]In the page of 'jobs' or '...
Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/17608 @ajbozarth I am using the latest spark version. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17608: [SPARK-20293][WEB UI][History]In the page of 'jobs' or '...
Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/17608 @guoxiaolongzte This seems familiar, are you using the latest version of Knox with your Spark UI? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17608: [SPARK-20293][WEB UI][History]In the page of 'jobs' or '...
Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/17608 Is this, the only way to encode, will not let the browser to escape our special characters.The page will not be error. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17608: [SPARK-20293][WEB UI][History]In the page of 'jobs' or '...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17608 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17608: [SPARK-20293][WEB UI][History]In the page of 'jobs' or '...
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17608 I don't quite understand, in that you say that the problem was URL-encoding the URL, but the solution here is to URL-encode it again. Is that right? maybe you can show a more concrete example of the URL as generated by the UI, and exactly what it is interpreted as, and the error page. This isn't very clear now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
