[jira] [Commented] (YARN-6466) Provide shaded framework jar for containers

2017-08-11 Thread Haibo Chen (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-6466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124273#comment-16124273
 ] 

Haibo Chen commented on YARN-6466:
--

Thanks [~sjlee0] for the pointer! I will take a look at it in more details and 
may come back with questions here to start the discussion again.

> Provide shaded framework jar for containers
> ---
>
> Key: YARN-6466
> URL: https://issues.apache.org/jira/browse/YARN-6466
> Project: Hadoop YARN
>  Issue Type: New Feature
>  Components: build, yarn
>Affects Versions: 3.0.0-alpha1
>Reporter: Sean Busbey
>Assignee: Haibo Chen
>
> We should build on the existing shading work to provide a jar with all of the 
> bits needed within a YARN application's container to talk to the resource 
> manager and node manager.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Commented] (YARN-6466) Provide shaded framework jar for containers

2017-08-11 Thread Sangjin Lee (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-6466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124097#comment-16124097
 ] 

Sangjin Lee commented on YARN-6466:
---

[~haibochen], I see you reassigned this to yourself. Let's resurrect the 
discussion on this one as it's been sitting idle for a while. Please have a 
look at the ongoing effort at HADOOP-13398 too. Thanks!

> Provide shaded framework jar for containers
> ---
>
> Key: YARN-6466
> URL: https://issues.apache.org/jira/browse/YARN-6466
> Project: Hadoop YARN
>  Issue Type: New Feature
>  Components: build, yarn
>Affects Versions: 3.0.0-alpha1
>Reporter: Sean Busbey
>Assignee: Haibo Chen
>
> We should build on the existing shading work to provide a jar with all of the 
> bits needed within a YARN application's container to talk to the resource 
> manager and node manager.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Commented] (YARN-6466) Provide shaded framework jar for containers

2017-04-18 Thread Sangjin Lee (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-6466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15973649#comment-15973649
 ] 

Sangjin Lee commented on YARN-6466:
---

I think the separate discussion that's happening on HADOOP-11656 is informative.

I would very much like to keep the isolating classloader feature at least for 
the container runtime. I have the main part of the work in the reviewable state 
on HADOOP-13398. Also, please note that the isolating classloader feature is an 
existing feature that works and many folks use. We're basically adding the 
stricter behavior for 3.0. I think it would be a loss if we abandon that. Let's 
discuss this.

bq. We probably don't need much of a footprint within the container in the 
first place.

I'm not quite sure if I understand this. Could you kindly elaborate?

> Provide shaded framework jar for containers
> ---
>
> Key: YARN-6466
> URL: https://issues.apache.org/jira/browse/YARN-6466
> Project: Hadoop YARN
>  Issue Type: New Feature
>  Components: build, yarn
>Affects Versions: 3.0.0-alpha1
>Reporter: Sean Busbey
>
> We should build on the existing shading work to provide a jar with all of the 
> bits needed within a YARN application's container to talk to the resource 
> manager and node manager.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Commented] (YARN-6466) Provide shaded framework jar for containers

2017-04-11 Thread Andrew Wang (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-6466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965019#comment-15965019
 ] 

Andrew Wang commented on YARN-6466:
---

Are we planning to get this in for 3.0.0-alpha3 in approximately 1 month?

> Provide shaded framework jar for containers
> ---
>
> Key: YARN-6466
> URL: https://issues.apache.org/jira/browse/YARN-6466
> Project: Hadoop YARN
>  Issue Type: New Feature
>  Components: build, yarn
>Affects Versions: 3.0.0-alpha1
>Reporter: Sean Busbey
>
> We should build on the existing shading work to provide a jar with all of the 
> bits needed within a YARN application's container to talk to the resource 
> manager and node manager.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Commented] (YARN-6466) Provide shaded framework jar for containers

2017-04-11 Thread Sean Busbey (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-6466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964732#comment-15964732
 ] 

Sean Busbey commented on YARN-6466:
---

Yeah, my thinking is that we probably don't need much of a footprint within the 
container in the first place and just relocating the third party libs might be 
simpler.

> Provide shaded framework jar for containers
> ---
>
> Key: YARN-6466
> URL: https://issues.apache.org/jira/browse/YARN-6466
> Project: Hadoop YARN
>  Issue Type: New Feature
>  Components: build, yarn
>Reporter: Sean Busbey
>
> We should build on the existing shading work to provide a jar with all of the 
> bits needed within a YARN application's container to talk to the resource 
> manager and node manager.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Commented] (YARN-6466) Provide shaded framework jar for containers

2017-04-11 Thread Sangjin Lee (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-6466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964646#comment-15964646
 ] 

Sangjin Lee commented on YARN-6466:
---

Hi [~busbey], thanks for raising this. How would this compare with the ongoing 
work at HADOOP-13070? Is your thinking that shading should be the/a mechanism 
for isolation for containers instead of the classloader isolation?

Note that the classloader isolation already exists and folks have been using it 
to accomplish isolation. I think we may need to sort out what our story on this 
is for 3.0 going forward.

> Provide shaded framework jar for containers
> ---
>
> Key: YARN-6466
> URL: https://issues.apache.org/jira/browse/YARN-6466
> Project: Hadoop YARN
>  Issue Type: New Feature
>  Components: build, yarn
>Reporter: Sean Busbey
>
> We should build on the existing shading work to provide a jar with all of the 
> bits needed within a YARN application's container to talk to the resource 
> manager and node manager.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Commented] (YARN-6466) Provide shaded framework jar for containers

2017-04-11 Thread Sean Busbey (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-6466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964490#comment-15964490
 ] 

Sean Busbey commented on YARN-6466:
---

reading through the DistributedShell example application, it looks like this 
should also plan to work with the timeline service apis.

> Provide shaded framework jar for containers
> ---
>
> Key: YARN-6466
> URL: https://issues.apache.org/jira/browse/YARN-6466
> Project: Hadoop YARN
>  Issue Type: New Feature
>  Components: build, yarn
>Reporter: Sean Busbey
>
> We should build on the existing shading work to provide a jar with all of the 
> bits needed within a YARN application's container to talk to the resource 
> manager and node manager.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org