[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2022-05-11 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17534889#comment-17534889 ] Gabor Somogyi commented on SPARK-25355: --- I've had a deeper look and HADOOP_TOKEN_FILE_LOCATION is

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2022-05-06 Thread Shrikant (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17532757#comment-17532757 ] Shrikant commented on SPARK-25355: -- [~gaborgsomogyi] I am working on fixing this issue using similar

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2022-05-05 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17532191#comment-17532191 ] Gabor Somogyi commented on SPARK-25355: --- [~unamesk15] I think the only option for now is to obtain

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2022-05-05 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17532135#comment-17532135 ] Gabor Somogyi commented on SPARK-25355: --- After some playground work, code digging and your

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2022-05-04 Thread Shrikant (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17532063#comment-17532063 ] Shrikant commented on SPARK-25355: -- The reason for no delegation token found is that the proxy user UGI

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2022-05-04 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17531777#comment-17531777 ] Gabor Somogyi commented on SPARK-25355: --- Hmmm, seems like I've already debugged such thing and

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2022-05-04 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17531743#comment-17531743 ] Gabor Somogyi commented on SPARK-25355: --- Now I see where the driver blows up and why no Spark logs

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2022-05-04 Thread Shrikant (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17531696#comment-17531696 ] Shrikant commented on SPARK-25355: -- Haven't removed anything from log4j.properties. Only Changed log

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2022-05-04 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17531646#comment-17531646 ] Gabor Somogyi commented on SPARK-25355: --- > (IllegalArgumentException: Empty cookie header string)

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2022-05-04 Thread Shrikant (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17531628#comment-17531628 ] Shrikant commented on SPARK-25355: -- We have to use the --proxy-user arg.So need to get Option 1

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2022-05-04 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17531523#comment-17531523 ] Gabor Somogyi commented on SPARK-25355: --- After the attached logs now I see more.

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2022-05-03 Thread Shrikant (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17531480#comment-17531480 ] Shrikant commented on SPARK-25355: -- [~gaborgsomogyi] I have attached the full driver log in Jira. There

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2022-05-02 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17530812#comment-17530812 ] Gabor Somogyi commented on SPARK-25355: --- > Thanks for looking further. Your assumption that 3

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2022-05-02 Thread Shrikant (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17530709#comment-17530709 ] Shrikant commented on SPARK-25355: -- Thanks for looking further. Your assumption that 3 tokens loaded

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2022-05-02 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17530692#comment-17530692 ] Gabor Somogyi commented on SPARK-25355: --- I've had a further look and found the following:

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2022-05-02 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17530678#comment-17530678 ] Gabor Somogyi commented on SPARK-25355: --- Guys, when I take a look at the logs and hear what you

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2022-05-02 Thread Shrikant (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17530665#comment-17530665 ] Shrikant commented on SPARK-25355: -- The issue is the AccessControlException which we are getting when

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2022-05-02 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17530650#comment-17530650 ] Gabor Somogyi commented on SPARK-25355: --- If the issue still persists then please provide the

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2022-05-02 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17530649#comment-17530649 ] Gabor Somogyi commented on SPARK-25355: --- Then there are 2 issues on your side guys. In the

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2022-05-01 Thread Shrikant (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17530602#comment-17530602 ] Shrikant commented on SPARK-25355: -- [~gaborgsomogyi] ConnectionRefusedExcpetion is not there, only

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2022-04-30 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17530370#comment-17530370 ] Gabor Somogyi commented on SPARK-25355: --- Please make sure that namenode host:port is available

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2022-04-30 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17530369#comment-17530369 ] Gabor Somogyi commented on SPARK-25355: --- I've answered this question in the community but I would

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2022-04-29 Thread pralabhkumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17530083#comment-17530083 ] pralabhkumar commented on SPARK-25355: -- [~hyukjin.kwon]  Can u please us  or redirect us to someone 

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2022-04-29 Thread Shrikant (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17530046#comment-17530046 ] Shrikant commented on SPARK-25355: -- [~pedro.rossi] [~dongjoon]  When we use the proxy-user parameter,

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2022-04-25 Thread jagadeesh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17527648#comment-17527648 ] jagadeesh commented on SPARK-25355: --- [~pedro.rossi]  , we are running into problem with this feature

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2020-01-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027801#comment-17027801 ] Dongjoon Hyun commented on SPARK-25355: --- [~pedro.rossi]. 2.4.x is maintained, but Apache Spark

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2020-01-31 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027672#comment-17027672 ] Pedro Gonçalves Rossi Rodrigues commented on SPARK-25355: - This problem also

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2020-01-31 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027665#comment-17027665 ] Pedro Gonçalves Rossi Rodrigues commented on SPARK-25355: - [~vanzin] I made a

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2019-02-14 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16768108#comment-16768108 ] Stavros Kontopoulos commented on SPARK-25355: - My understanding was that it was not

[jira] [Commented] (SPARK-25355) Support --proxy-user for Spark on K8s

2019-02-13 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16767724#comment-16767724 ] Marcelo Vanzin commented on SPARK-25355: Doesn't that work already? I don't see any checks that