[
https://issues.apache.org/jira/browse/YARN-218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom White resolved YARN-218.
Resolution: Duplicate
Fixed in YARN-614.
> Distiguish between "failed" and "killed" app attempts
> --
[
https://issues.apache.org/jira/browse/YARN-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13849016#comment-13849016
]
Tom White commented on YARN-1029:
-
> RM HA uses ZK itself for shared storage, so it already
[
https://issues.apache.org/jira/browse/YARN-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13847432#comment-13847432
]
Tom White commented on YARN-1028:
-
Thanks for addressing the feedback I gave. +1 for the la
[
https://issues.apache.org/jira/browse/YARN-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13846395#comment-13846395
]
Tom White commented on YARN-1028:
-
Thanks for the explanation of how failover works, Karthi
[
https://issues.apache.org/jira/browse/YARN-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13845491#comment-13845491
]
Tom White commented on YARN-1029:
-
Implementing ActiveStandbyElector sounds like a good app
[
https://issues.apache.org/jira/browse/YARN-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13845471#comment-13845471
]
Tom White commented on YARN-1028:
-
It looks like the behaviour in this patch differs from t
[
https://issues.apache.org/jira/browse/YARN-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13761732#comment-13761732
]
Tom White commented on YARN-1144:
-
+1
> Unmanaged AMs registering a tracki
[
https://issues.apache.org/jira/browse/YARN-884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13706826#comment-13706826
]
Tom White commented on YARN-884:
The approach seems reasonable to me. +1 for the patch.
[
https://issues.apache.org/jira/browse/YARN-789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13683466#comment-13683466
]
Tom White commented on YARN-789:
This looks good to me, +1. The increment setting only appli
[
https://issues.apache.org/jira/browse/YARN-803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13683454#comment-13683454
]
Tom White commented on YARN-803:
Looks good to me. Is there a reason FairScheduler#validateC
[
https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13677937#comment-13677937
]
Tom White commented on YARN-689:
+1 to Hitesh and Bikas' points about minimum (and increment
[
https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13676843#comment-13676843
]
Tom White commented on YARN-689:
> The multiplier seems to be one approach to do this, thoug
[
https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13676096#comment-13676096
]
Tom White commented on YARN-689:
> the change in the yarn-default.xml from 32 to 4 is becaus
[
https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675988#comment-13675988
]
Tom White commented on YARN-689:
I had a look at the latest patch. Why is
yarn.scheduler.m
[
https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13673582#comment-13673582
]
Tom White commented on YARN-689:
It seems that there's a concern about impacting CS with thi
[
https://issues.apache.org/jira/browse/YARN-595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640612#comment-13640612
]
Tom White commented on YARN-595:
+1
> Refactor fair scheduler to use common
[
https://issues.apache.org/jira/browse/YARN-142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13573516#comment-13573516
]
Tom White commented on YARN-142:
> I think it'd be useful to have the APIs throw IOException
[
https://issues.apache.org/jira/browse/YARN-371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13572374#comment-13572374
]
Tom White commented on YARN-371:
Glad this turned into a good debate :)
On the task-centric
[
https://issues.apache.org/jira/browse/YARN-371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13570109#comment-13570109
]
Tom White commented on YARN-371:
Looks like there's a misunderstanding here - Sandy talks ab
[
https://issues.apache.org/jira/browse/YARN-319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13559583#comment-13559583
]
Tom White commented on YARN-319:
> When waiting for the final application status to be faile
[
https://issues.apache.org/jira/browse/YARN-333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13559548#comment-13559548
]
Tom White commented on YARN-333:
This is not a problem in MR is it, since the queue is alway
[
https://issues.apache.org/jira/browse/YARN-319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13553942#comment-13553942
]
Tom White commented on YARN-319:
Is it possible to write a unit test for this?
[
https://issues.apache.org/jira/browse/YARN-302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13553948#comment-13553948
]
Tom White commented on YARN-302:
+1
> Fair scheduler assignmultiple should
[
https://issues.apache.org/jira/browse/YARN-307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13542993#comment-13542993
]
Tom White commented on YARN-307:
Lohit, if you set yarn.nodemanager.delete.debug-delay-sec t
[
https://issues.apache.org/jira/browse/YARN-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13542060#comment-13542060
]
Tom White commented on YARN-286:
The patch is needed by MAPREDUCE-1700 for class isolation i
[
https://issues.apache.org/jira/browse/YARN-192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13538112#comment-13538112
]
Tom White commented on YARN-192:
If I run the new test without the fix it passes. Sandy, can
[
https://issues.apache.org/jira/browse/YARN-286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom White updated YARN-286:
---
Attachment: YARN-286.patch
> Add a YARN ApplicationClassLoader
> -
>
>
Tom White created YARN-286:
--
Summary: Add a YARN ApplicationClassLoader
Key: YARN-286
URL: https://issues.apache.org/jira/browse/YARN-286
Project: Hadoop YARN
Issue Type: New Feature
Compo
[
https://issues.apache.org/jira/browse/YARN-103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536990#comment-13536990
]
Tom White commented on YARN-103:
Some feedback on the current patch:
* Why not use the exist
[
https://issues.apache.org/jira/browse/YARN-103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536929#comment-13536929
]
Tom White commented on YARN-103:
> The interface shouldn't really be implemented by anyone o
[
https://issues.apache.org/jira/browse/YARN-103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535045#comment-13535045
]
Tom White commented on YARN-103:
> +1, this is really helpful if we can get the APIs right.
[
https://issues.apache.org/jira/browse/YARN-252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535034#comment-13535034
]
Tom White commented on YARN-252:
Bikas - it's a toy YARN app written in Java that runs the A
[
https://issues.apache.org/jira/browse/YARN-272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13534981#comment-13534981
]
Tom White commented on YARN-272:
It would be better to add the toString() methods since then
[
https://issues.apache.org/jira/browse/YARN-230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13534044#comment-13534044
]
Tom White commented on YARN-230:
Arun, yes it looks good to me, +1. We can address any chang
[
https://issues.apache.org/jira/browse/YARN-252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom White updated YARN-252:
---
Attachment: YARN-252.patch
Another patch with some comments about ACLs.
> Would you please register your ideas
Tom White created YARN-273:
--
Summary: Add an unmanaged AM client for in-process AMs
Key: YARN-273
URL: https://issues.apache.org/jira/browse/YARN-273
Project: Hadoop YARN
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/YARN-255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13532414#comment-13532414
]
Tom White commented on YARN-255:
Per discussion on YARN-252, the ACL methods might be better
[
https://issues.apache.org/jira/browse/YARN-230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13532371#comment-13532371
]
Tom White commented on YARN-230:
OK, in which case please make the default state store the f
[
https://issues.apache.org/jira/browse/YARN-230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13531147#comment-13531147
]
Tom White commented on YARN-230:
Thanks for addressing my feedback Bikas. The NullRMStateSto
[
https://issues.apache.org/jira/browse/YARN-252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom White updated YARN-252:
---
Summary: Unmanaged AMs should not have to set the AM's
ContainerLaunchContext (was: Unmanaged AMs should not h
[
https://issues.apache.org/jira/browse/YARN-252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13531104#comment-13531104
]
Tom White commented on YARN-252:
> I think it would be good to add the assert in the other p
[
https://issues.apache.org/jira/browse/YARN-253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom White updated YARN-253:
---
Attachment: YARN-253.patch
New patch which removes code from TestContainerManagerSecurity.
> C
[
https://issues.apache.org/jira/browse/YARN-253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13530009#comment-13530009
]
Tom White commented on YARN-253:
Thanks Vinod. Looking at LCE, it seems to handle this case
[
https://issues.apache.org/jira/browse/YARN-252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom White updated YARN-252:
---
Attachment: YARN-252.patch
Bikas, thanks for taking a look. I was thinking that since there is no AM
container
[
https://issues.apache.org/jira/browse/YARN-253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13508685#comment-13508685
]
Tom White commented on YARN-253:
I see that you removed the change in MAPREDUCE-4427 because
[
https://issues.apache.org/jira/browse/YARN-253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom White updated YARN-253:
---
Attachment: YARN-253.patch
This fixes the problem by creating parent directories if they don't already
exist.
[
https://issues.apache.org/jira/browse/YARN-253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom White updated YARN-253:
---
Attachment: YARN-253-test.patch
This change to the DS unit test exposes the problem by changing the mini YARN
Tom White created YARN-253:
--
Summary: Container launch may fail if no files were localized
Key: YARN-253
URL: https://issues.apache.org/jira/browse/YARN-253
Project: Hadoop YARN
Issue Type: Bug
[
https://issues.apache.org/jira/browse/YARN-252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13507442#comment-13507442
]
Tom White commented on YARN-252:
Testing is covered by the existing TestUnmanagedAMLauncher.
[
https://issues.apache.org/jira/browse/YARN-252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom White updated YARN-252:
---
Attachment: YARN-252.patch
Simple fix.
> Unmanaged AMs should not have to set the ContainerLau
Tom White created YARN-252:
--
Summary: Unmanaged AMs should not have to set the
ContainerLaunchContext
Key: YARN-252
URL: https://issues.apache.org/jira/browse/YARN-252
Project: Hadoop YARN
Issue Ty
[
https://issues.apache.org/jira/browse/YARN-251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom White updated YARN-251:
---
Attachment: YARN-251.patch
With this fix applications that don't set a tracking URI won't get a confusing
warn
[
https://issues.apache.org/jira/browse/YARN-251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13507403#comment-13507403
]
Tom White commented on YARN-251:
Running TestRM produces the following warning (although the
Tom White created YARN-251:
--
Summary: Proxy URI generation fails for blank tracking URIs
Key: YARN-251
URL: https://issues.apache.org/jira/browse/YARN-251
Project: Hadoop YARN
Issue Type: Bug
[
https://issues.apache.org/jira/browse/YARN-72?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13507290#comment-13507290
]
Tom White commented on YARN-72:
---
+1
> NM should handle cleaning up containers
[
https://issues.apache.org/jira/browse/YARN-72?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom White updated YARN-72:
--
Summary: NM should handle cleaning up containers when it shuts down (was:
NM should handle cleaning up containers
[
https://issues.apache.org/jira/browse/YARN-170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13507289#comment-13507289
]
Tom White commented on YARN-170:
+1
Vinod, do you have any more comments before we commit t
[
https://issues.apache.org/jira/browse/YARN-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506574#comment-13506574
]
Tom White commented on YARN-248:
I thought about it more, and delegation tokens from the job
[
https://issues.apache.org/jira/browse/YARN-187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506408#comment-13506408
]
Tom White commented on YARN-187:
Sandy, thanks for adding the javadoc. It would be good to u
[
https://issues.apache.org/jira/browse/YARN-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13505726#comment-13505726
]
Tom White commented on YARN-248:
I can think of a couple of options: i) persist RMDelegation
Tom White created YARN-248:
--
Summary: Restore RMDelegationTokenSecretManager state on restart
Key: YARN-248
URL: https://issues.apache.org/jira/browse/YARN-248
Project: Hadoop YARN
Issue Type: Sub-t
[
https://issues.apache.org/jira/browse/YARN-230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13505427#comment-13505427
]
Tom White commented on YARN-230:
bq. But it could make sense to remove application attempts
[
https://issues.apache.org/jira/browse/YARN-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13505417#comment-13505417
]
Tom White commented on YARN-231:
I was assuming that the store was HA since it would be back
[
https://issues.apache.org/jira/browse/YARN-187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13505402#comment-13505402
]
Tom White commented on YARN-187:
License headers are missing on the new files. (BTW I filed
[
https://issues.apache.org/jira/browse/YARN-72?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13505398#comment-13505398
]
Tom White commented on YARN-72:
---
I don't think it needs to be configurable, since it's a best e
[
https://issues.apache.org/jira/browse/YARN-170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13505384#comment-13505384
]
Tom White commented on YARN-170:
This looks like an overall improvement. A few minor comment
[
https://issues.apache.org/jira/browse/YARN-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13504772#comment-13504772
]
Tom White commented on YARN-231:
bq. Errors could either be because of store error or loss o
[
https://issues.apache.org/jira/browse/YARN-230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13504765#comment-13504765
]
Tom White commented on YARN-230:
{quote}
The store and remove methods have been made mirrors
[
https://issues.apache.org/jira/browse/YARN-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13503229#comment-13503229
]
Tom White commented on YARN-231:
Some initial feedback on FileSystemRMStateStore (I haven't
[
https://issues.apache.org/jira/browse/YARN-230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13503228#comment-13503228
]
Tom White commented on YARN-230:
Overall, this looks great. General feedback:
* Can we make
[
https://issues.apache.org/jira/browse/YARN-229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13503178#comment-13503178
]
Tom White commented on YARN-229:
Can you make org.apache.hadoop.yarn.server.resourcemanager.
[
https://issues.apache.org/jira/browse/YARN-128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13500434#comment-13500434
]
Tom White commented on YARN-128:
I had a quick look at the new patches and FileSystemRMState
[
https://issues.apache.org/jira/browse/YARN-72?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13500195#comment-13500195
]
Tom White commented on YARN-72:
---
Sandy, this looks like a good start, hooking in the code for c
[
https://issues.apache.org/jira/browse/YARN-128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13498883#comment-13498883
]
Tom White commented on YARN-128:
You are right about there being no race - I missed the comm
Tom White created YARN-218:
--
Summary: Distiguish between "failed" and "killed" app attempts
Key: YARN-218
URL: https://issues.apache.org/jira/browse/YARN-218
Project: Hadoop YARN
Issue Type: New Fea
[
https://issues.apache.org/jira/browse/YARN-128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13498825#comment-13498825
]
Tom White commented on YARN-128:
Bikas, this looks good so far. Thanks for working on it. A
[
https://issues.apache.org/jira/browse/YARN-129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13492416#comment-13492416
]
Tom White commented on YARN-129:
The test failure is unrelated - see MAPREDUCE-4774.
bq. To
[
https://issues.apache.org/jira/browse/YARN-169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13492378#comment-13492378
]
Tom White commented on YARN-169:
+1 pending Jenkins.
> Update log4j.appende
[
https://issues.apache.org/jira/browse/YARN-164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13492373#comment-13492373
]
Tom White commented on YARN-164:
+1. I've just triggered Jenkins for this patch. The lack of
[
https://issues.apache.org/jira/browse/YARN-183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13492348#comment-13492348
]
Tom White commented on YARN-183:
+1 looks good to me. The patch doesn't apply any longer - c
[
https://issues.apache.org/jira/browse/YARN-129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom White updated YARN-129:
---
Attachment: YARN-129.patch
Thanks for taking a look, Vinod. I've updated the patch so it applies cleanly
to tr
[
https://issues.apache.org/jira/browse/YARN-145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13474035#comment-13474035
]
Tom White commented on YARN-145:
+1 I ran a single node cluster and monitored the fair sched
[
https://issues.apache.org/jira/browse/YARN-146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom White reassigned YARN-146:
--
Assignee: Sandy Ryza
> Add unit tests for computing fair share in the fair scheduler
> --
[
https://issues.apache.org/jira/browse/YARN-146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13473329#comment-13473329
]
Tom White commented on YARN-146:
Looks good to me. Nit: please change the test to use JUnit
[
https://issues.apache.org/jira/browse/YARN-129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom White updated YARN-129:
---
Attachment: YARN-129.patch
Patch to fix findbugs warnings.
> Simplify classpath construction f
[
https://issues.apache.org/jira/browse/YARN-129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom White updated YARN-129:
---
Attachment: YARN-129.patch
Here's a patch that implements this idea.
> Simplify classpath cons
Tom White created YARN-129:
--
Summary: Simplify classpath construction for mini YARN tests
Key: YARN-129
URL: https://issues.apache.org/jira/browse/YARN-129
Project: Hadoop YARN
Issue Type: Improveme
[
https://issues.apache.org/jira/browse/YARN-105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454763#comment-13454763
]
Tom White commented on YARN-105:
Isn't this being fixed in MAPREDUCE-4421? I think the idea
Tom White created YARN-81:
-
Summary: Make sure YARN declares correct set of dependencies
Key: YARN-81
URL: https://issues.apache.org/jira/browse/YARN-81
Project: Hadoop YARN
Issue Type: Improvement
89 matches
Mail list logo