Github user skonto commented on the issue:
https://github.com/apache/spark/pull/20945
@vanzin correct.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20945
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3339/
Tes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20945
Build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/20945
I actually can't close this, only you can.
If the DC/OS libraries are open source and something people can pull in by
changing `mesos.version` or some other build-time parameter, you could
p
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/20945
@vanzin here is the fix that works for DC/OS:
https://github.com/mesosphere/spark/pull/26
Unfortunately I cannot bring it back here.
---
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/20945
@susanxhuynh Unfortunately I cannot unify the APIs even for DC/OS, 1.10.x
is different from 1.11.x
(https://docs.mesosphere.com/services/spark/2.3.0-2.2.1-2/security/) and code
is dependent on this
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/20945
@susanxhuynh @vanzin
It seems to me that if SPARK-20982 is fixed then from what I see all secret
stores I searched provide an http API:
https://github.com/kubernetes/kubernetes/blob/09f321c8
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/20945
@vanzin Sure we will try to comply the thing is pure mesos does not have an
api for secrets only DC/OS has one and we cannot bring that api in the Spark
project, otherwise I would just implement opti
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/20945
SPARK-20982 doesn't look particularly hard to fix.
I don't understand the differences between plain Mesos and DC/OS so a lot
of the things you're saying are over my head. I'm just concerned w
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/20945
@susanxhuynh the doAs call from hadoop libs on the proxy user in
SparkSubmit is using java.security.AccessController.doPrivileged at the java
security level, what if I use a security manager policy
Github user susanxhuynh commented on the issue:
https://github.com/apache/spark/pull/20945
(1) seems the most secure. How do we handle keytabs today in cluster mode
in pure Mesos? Is it the same situation -- the keytab gets sent over a HTTP
connection to the Dispatcher?
(3) Y
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/20945
@vanzin @susanxhuynh
> - require the launcher to have a kerberos login, and send DTs to the
application. a.k.a. what Spark-on-YARN does.
> - in the code that launches the driver on the M
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/20945
@susanxhuynh the cache represents the ticket for the superuser since he
needs to create a DT as nobody to impersonate nobody. The superuser has the
right to impersonate. The ticket cache replaces the
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/20945
@vanzin gentle ping.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user susanxhuynh commented on the issue:
https://github.com/apache/spark/pull/20945
@skonto Basic question: in your example above, which user does the
"krb5cc_65534" ticket cache belong to? The superuser or the proxy-user
("nobody")?
---
-
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20945
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20945
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88794/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20945
**[Test build #88794 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88794/testReport)**
for PR 20945 at commit
[`1060405`](https://github.com/apache/spark/commit/1
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20945
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20945
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1888/
Tes
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20945
**[Test build #88794 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88794/testReport)**
for PR 20945 at commit
[`1060405`](https://github.com/apache/spark/commit/10
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/20945
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h..
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/20945
Failed unit test:
org.apache.spark.launcher.LauncherServerSuite.testAppHandleDisconnect
Will re-test this is not from this patch.
---
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20945
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20945
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88788/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20945
**[Test build #88788 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88788/testReport)**
for PR 20945 at commit
[`1060405`](https://github.com/apache/spark/commit/1
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/20945
@vanzin I think its on the right path now.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20945
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1885/
Tes
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20945
**[Test build #88788 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88788/testReport)**
for PR 20945 at commit
[`1060405`](https://github.com/apache/spark/commit/10
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20945
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20945
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20945
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88776/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20945
**[Test build #88776 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88776/testReport)**
for PR 20945 at commit
[`76330eb`](https://github.com/apache/spark/commit/7
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/20945
I attach the log file of the last run with the updated PR.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.or
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20945
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1879/
Tes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20945
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20945
**[Test build #88776 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88776/testReport)**
for PR 20945 at commit
[`76330eb`](https://github.com/apache/spark/commit/76
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/20945
@vanzin ok let's see if I understand correctly, so Spark Job's main is run
via a proxy user if it exists, and then we use the real user for
HiveDelegationTokenProvider just because the hive needs the
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/20945
I don't think this is right. You do not want to start the session as the
real user. That's why you're using a proxy user in the first place - to
identify as someone else to external services.
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20945
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20945
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88752/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20945
**[Test build #88752 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88752/testReport)**
for PR 20945 at commit
[`5f7851c`](https://github.com/apache/spark/commit/5
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20945
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20945
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1863/
Tes
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20945
**[Test build #88752 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88752/testReport)**
for PR 20945 at commit
[`5f7851c`](https://github.com/apache/spark/commit/5f
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20945
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20945
**[Test build #88751 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88751/testReport)**
for PR 20945 at commit
[`5aa7231`](https://github.com/apache/spark/commit/5
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20945
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88751/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20945
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1862/
Tes
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20945
**[Test build #88751 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88751/testReport)**
for PR 20945 at commit
[`5aa7231`](https://github.com/apache/spark/commit/5a
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20945
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/20945
@vanzin @susanxhuynh pls review, this probably needs backport to 2.3 also
not sure if is ok with yarn.
---
-
To unsubscribe, e-ma
52 matches
Mail list logo
