[ https://issues.apache.org/jira/browse/SPARK-32467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368005#comment-17368005 ]
dzcxzl commented on SPARK-32467: -------------------------------- YARN-3239. WebAppProxy does not support a final tracking url which has query fragments and params. If the Yarn cluster does not use the YARN-3239 patch, the running spark job still encounters the NPE problem when accessing the task page. Does spark need to do URL decode twice to avoid NPE? > Avoid encoding URL twice on https redirect > ------------------------------------------ > > Key: SPARK-32467 > URL: https://issues.apache.org/jira/browse/SPARK-32467 > Project: Spark > Issue Type: Bug > Components: Web UI > Affects Versions: 3.0.1, 3.1.0 > Reporter: Gengliang Wang > Assignee: Gengliang Wang > Priority: Major > > Currently, on https redirect, the original URL is encoded as an HTTPS URL. > However, the original URL could be encoded already, so that the return result > of method > UriInfo.getQueryParameters will contain encoded keys and values. For example, > a parameter > order[0][dir] will become order%255B0%255D%255Bcolumn%255D after encoded > twice, and the decoded > key in the result of UriInfo.getQueryParameters will be > order%5B0%5D%5Bcolumn%5D. > To fix the problem, we try decoding the query parameters before encoding it. > This is to make sure we encode the URL exactly once. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org