[
https://issues.apache.org/jira/browse/SPARK-32467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368005#comment-17368005
]
dzcxzl edited comment on SPARK-32467 at 7/6/21, 1:16 PM:
---------------------------------------------------------
YARN-3239. WebAppProxy does not support a final tracking url which has query
fragments and params.
If the Yarn cluster does not use the YARN-3217 YARN-3239 patch, the running
spark job still encounters the NPE problem when accessing the task page.
Does spark need to do URL decode twice to avoid NPE?
was (Author: dzcxzl):
YARN-3239. WebAppProxy does not support a final tracking url which has query
fragments and params.
If the Yarn cluster does not use the YARN-3239 patch, the running spark job
still encounters the NPE problem when accessing the task page.
Does spark need to do URL decode twice to avoid NPE?
> Avoid encoding URL twice on https redirect
> ------------------------------------------
>
> Key: SPARK-32467
> URL: https://issues.apache.org/jira/browse/SPARK-32467
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 3.0.1, 3.1.0
> Reporter: Gengliang Wang
> Assignee: Gengliang Wang
> Priority: Major
>
> Currently, on https redirect, the original URL is encoded as an HTTPS URL.
> However, the original URL could be encoded already, so that the return result
> of method
> UriInfo.getQueryParameters will contain encoded keys and values. For example,
> a parameter
> order[0][dir] will become order%255B0%255D%255Bcolumn%255D after encoded
> twice, and the decoded
> key in the result of UriInfo.getQueryParameters will be
> order%5B0%5D%5Bcolumn%5D.
> To fix the problem, we try decoding the query parameters before encoding it.
> This is to make sure we encode the URL exactly once.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
