[jira] [Commented] (MAPREDUCE-6302) deadlock in a job between map and reduce cores allocation

[ https://issues.apache.org/jira/browse/MAPREDUCE-6302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565608#comment-14565608 ] Craig Welch commented on MAPREDUCE-6302: [~kasha] this looks good to me

[jira] [Commented] (MAPREDUCE-6251) JobClient needs additional retries at a higher level to address not-immediately-consistent dfs corner cases

[ https://issues.apache.org/jira/browse/MAPREDUCE-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540287#comment-14540287 ] Craig Welch commented on MAPREDUCE-6251: None of the checkstyle warnings

[jira] [Updated] (MAPREDUCE-6251) JobClient needs additional retries at a higher level to address not-immediately-consistent dfs corner cases

[ https://issues.apache.org/jira/browse/MAPREDUCE-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated MAPREDUCE-6251: --- Status: Patch Available (was: Open) JobClient needs additional retries at a higher

[jira] [Updated] (MAPREDUCE-6251) JobClient needs additional retries at a higher level to address not-immediately-consistent dfs corner cases

[ https://issues.apache.org/jira/browse/MAPREDUCE-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated MAPREDUCE-6251: --- Attachment: MAPREDUCE-6251.8.patch Reattach as I don't see it getting built. JobClient

[jira] [Updated] (MAPREDUCE-6251) JobClient needs additional retries at a higher level to address not-immediately-consistent dfs corner cases

[ https://issues.apache.org/jira/browse/MAPREDUCE-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated MAPREDUCE-6251: --- Attachment: MAPREDUCE-6251.8.patch ...add line failed to stage for last patch.

[jira] [Commented] (MAPREDUCE-6251) JobClient needs additional retries at a higher level to address not-immediately-consistent dfs corner cases

[ https://issues.apache.org/jira/browse/MAPREDUCE-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14533513#comment-14533513 ] Craig Welch commented on MAPREDUCE-6251: Uploaded patch to fix mistake in

[jira] [Updated] (MAPREDUCE-6251) JobClient needs additional retries at a higher level to address not-immediately-consistent dfs corner cases

[ https://issues.apache.org/jira/browse/MAPREDUCE-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated MAPREDUCE-6251: --- Attachment: MAPREDUCE-6251.6.patch With mapred-default.xml entries JobClient needs

[jira] [Updated] (MAPREDUCE-6251) JobClient needs additional retries at a higher level to address not-immediately-consistent dfs corner cases

[ https://issues.apache.org/jira/browse/MAPREDUCE-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated MAPREDUCE-6251: --- Status: Patch Available (was: Open) JobClient needs additional retries at a higher

[jira] [Updated] (MAPREDUCE-6251) JobClient needs additional retries at a higher level to address not-immediately-consistent dfs corner cases

[ https://issues.apache.org/jira/browse/MAPREDUCE-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated MAPREDUCE-6251: --- Attachment: MAPREDUCE-6251.4.patch Updated with recommended move to MRJobConfig

[jira] [Updated] (MAPREDUCE-6251) JobClient needs additional retries at a higher level to address not-immediately-consistent dfs corner cases

[ https://issues.apache.org/jira/browse/MAPREDUCE-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated MAPREDUCE-6251: --- Attachment: MAPREDUCE-6251.3.patch JobClient needs additional retries at a higher level

[jira] [Commented] (MAPREDUCE-6251) JobClient needs additional retries at a higher level to address not-immediately-consistent dfs corner cases

[ https://issues.apache.org/jira/browse/MAPREDUCE-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514319#comment-14514319 ] Craig Welch commented on MAPREDUCE-6251: bq. It is not just getJob(). Clients

[jira] [Commented] (MAPREDUCE-6251) JobClient needs additional retries at a higher level to address not-immediately-consistent dfs corner cases

[ https://issues.apache.org/jira/browse/MAPREDUCE-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514368#comment-14514368 ] Craig Welch commented on MAPREDUCE-6251: TestMRJobs passing fine on my box,

[jira] [Commented] (MAPREDUCE-6251) JobClient needs additional retries at a higher level to address not-immediately-consistent dfs corner cases

[ https://issues.apache.org/jira/browse/MAPREDUCE-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14515842#comment-14515842 ] Craig Welch commented on MAPREDUCE-6251: bq. We should definitely rename the

[jira] [Updated] (MAPREDUCE-6252) JobHistoryServer should not fail when encountering a missing directory

[ https://issues.apache.org/jira/browse/MAPREDUCE-6252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated MAPREDUCE-6252: --- Status: Patch Available (was: Open) JobHistoryServer should not fail when encountering

[jira] [Updated] (MAPREDUCE-6252) JobHistoryServer should not fail when encountering a missing directory

[ https://issues.apache.org/jira/browse/MAPREDUCE-6252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated MAPREDUCE-6252: --- Attachment: MAPREDUCE-6252.1.patch added test JobHistoryServer should not fail when

[jira] [Updated] (MAPREDUCE-6251) JobClient needs additional retries at a higher level to address not-immediately-consistent dfs corner cases

[ https://issues.apache.org/jira/browse/MAPREDUCE-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated MAPREDUCE-6251: --- Attachment: MAPREDUCE-6251.2.patch Checkstyle not meaningful, see [HADOOP-11869].

[jira] [Updated] (MAPREDUCE-6251) JobClient needs additional retries at a higher level to address not-immediately-consistent dfs corner cases

[ https://issues.apache.org/jira/browse/MAPREDUCE-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated MAPREDUCE-6251: --- Attachment: MAPREDUCE-6251.1.patch added unit test JobClient needs additional retries

[jira] [Commented] (MAPREDUCE-6252) JobHistoryServer should not fail when encountering a missing directory

[ https://issues.apache.org/jira/browse/MAPREDUCE-6252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318638#comment-14318638 ] Craig Welch commented on MAPREDUCE-6252: Not at all, will do.

[jira] [Commented] (MAPREDUCE-3973) [Umbrella JIRA] JobHistoryServer performance improvements in YARN+MR

[ https://issues.apache.org/jira/browse/MAPREDUCE-3973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14314972#comment-14314972 ] Craig Welch commented on MAPREDUCE-3973: [~revans2], for what it's worth I

[jira] [Commented] (MAPREDUCE-3973) [Umbrella JIRA] JobHistoryServer performance improvements in YARN+MR

[ https://issues.apache.org/jira/browse/MAPREDUCE-3973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14314976#comment-14314976 ] Craig Welch commented on MAPREDUCE-3973: [~revans2] I would add that I think

[jira] [Commented] (MAPREDUCE-3966) Add separate cache for CompletedJobs with tasks loaded and without tasks loaded in JobHIstoryServer

[ https://issues.apache.org/jira/browse/MAPREDUCE-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14314987#comment-14314987 ] Craig Welch commented on MAPREDUCE-3966: Hmm, I actually thing we would be

[jira] [Commented] (MAPREDUCE-5547) Job history should not be flushed to JHS until AM gets unregistered

[ https://issues.apache.org/jira/browse/MAPREDUCE-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14314937#comment-14314937 ] Craig Welch commented on MAPREDUCE-5547: So, I think it will be very

[jira] [Created] (MAPREDUCE-6251) JobClient needs additional retries at a higher level to address not-immediately-consistent dfs corner cases

Craig Welch created MAPREDUCE-6251: -- Summary: JobClient needs additional retries at a higher level to address not-immediately-consistent dfs corner cases Key: MAPREDUCE-6251 URL:

[jira] [Updated] (MAPREDUCE-6251) JobClient needs additional retries at a higher level to address not-immediately-consistent dfs corner cases

[ https://issues.apache.org/jira/browse/MAPREDUCE-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated MAPREDUCE-6251: --- Attachment: MAPREDUCE-6251.0.patch Attached is a patch which locates the retry where it

[jira] [Updated] (MAPREDUCE-6251) JobClient needs additional retries at a higher level to address not-immediately-consistent dfs corner cases

[ https://issues.apache.org/jira/browse/MAPREDUCE-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated MAPREDUCE-6251: --- Component/s: mrv2 JobClient needs additional retries at a higher level to address

[jira] [Updated] (MAPREDUCE-6252) JobHistoryServer should not fail when encountering a missing directory

[ https://issues.apache.org/jira/browse/MAPREDUCE-6252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated MAPREDUCE-6252: --- Status: Patch Available (was: Open) JobHistoryServer should not fail when encountering

[jira] [Assigned] (MAPREDUCE-6252) JobHistoryServer should not fail when encountering a missing directory

[ https://issues.apache.org/jira/browse/MAPREDUCE-6252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch reassigned MAPREDUCE-6252: -- Assignee: Craig Welch JobHistoryServer should not fail when encountering a

[jira] [Updated] (MAPREDUCE-6252) JobHistoryServer should not fail when encountering a missing directory

[ https://issues.apache.org/jira/browse/MAPREDUCE-6252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated MAPREDUCE-6252: --- Affects Version/s: 2.6.0 JobHistoryServer should not fail when encountering a missing

[jira] [Updated] (MAPREDUCE-6251) JobClient needs additional retries at a higher level to address not-immediately-consistent dfs corner cases

[ https://issues.apache.org/jira/browse/MAPREDUCE-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated MAPREDUCE-6251: --- Affects Version/s: (was: 2.2.0) 2.6.0 JobClient needs

[jira] [Updated] (MAPREDUCE-6252) JobHistoryServer should not fail when encountering a missing directory

[ https://issues.apache.org/jira/browse/MAPREDUCE-6252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated MAPREDUCE-6252: --- Attachment: MAPREDUCE-6252.0.patch JobHistoryServer should not fail when encountering a

[jira] [Updated] (MAPREDUCE-6252) JobHistoryServer should not fail when encountering a missing directory

[ https://issues.apache.org/jira/browse/MAPREDUCE-6252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated MAPREDUCE-6252: --- Component/s: jobhistoryserver JobHistoryServer should not fail when encountering a

[jira] [Updated] (MAPREDUCE-6251) JobClient needs additional retries at a higher level to address not-immediately-consistent dfs corner cases

[ https://issues.apache.org/jira/browse/MAPREDUCE-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated MAPREDUCE-6251: --- Status: Patch Available (was: Open) JobClient needs additional retries at a higher

[jira] [Created] (MAPREDUCE-6252) JobHistoryServer should not fail when encountering a missing directory

Craig Welch created MAPREDUCE-6252: -- Summary: JobHistoryServer should not fail when encountering a missing directory Key: MAPREDUCE-6252 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6252

[jira] [Updated] (MAPREDUCE-6252) JobHistoryServer should not fail when encountering a missing directory

[ https://issues.apache.org/jira/browse/MAPREDUCE-6252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated MAPREDUCE-6252: --- Description: The JobHistoryServer maintains a cache of job serial number parts to dfs