[jira] [Commented] (MAPREDUCE-6654) Possible NPE in JobHistoryEventHandler#handleEvent

[ https://issues.apache.org/jira/browse/MAPREDUCE-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16595970#comment-16595970 ] Junping Du commented on MAPREDUCE-6654: --- [~sunilg], I don't have bandwidth in short term for

[jira] [Updated] (MAPREDUCE-6654) Possible NPE in JobHistoryEventHandler#handleEvent

[ https://issues.apache.org/jira/browse/MAPREDUCE-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6654: -- Target Version/s: (was: 3.2.0) > Possible NPE in JobHistoryEventHandler#handleEvent >

[jira] [Commented] (MAPREDUCE-7012) 3.0 deployment cannot work with old version MR tar ball which break rolling upgrade

[ https://issues.apache.org/jira/browse/MAPREDUCE-7012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261476#comment-16261476 ] Junping Du commented on MAPREDUCE-7012: --- CC [~andrew.wang], [~vinodkv], [~jlowe]. > 3.0

[jira] [Created] (MAPREDUCE-7012) 3.0 deployment cannot work with old version MR tar ball which break rolling upgrade

Junping Du created MAPREDUCE-7012: - Summary: 3.0 deployment cannot work with old version MR tar ball which break rolling upgrade Key: MAPREDUCE-7012 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7012

[jira] [Updated] (MAPREDUCE-5889) Deprecate FileInputFormat.setInputPaths(Job, String) and FileInputFormat.addInputPaths(Job, String)

[ https://issues.apache.org/jira/browse/MAPREDUCE-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5889: -- Target Version/s: 2.8.3 (was: 2.8.1) > Deprecate FileInputFormat.setInputPaths(Job,

[jira] [Updated] (MAPREDUCE-5392) "mapred job -history all" command throws IndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/MAPREDUCE-5392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5392: -- Target Version/s: 2.8.3 (was: 2.8.1) > "mapred job -history all" command throws

[jira] [Updated] (MAPREDUCE-6498) ClientServiceDelegate should not retry upon AccessControlException

[ https://issues.apache.org/jira/browse/MAPREDUCE-6498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6498: -- Target Version/s: 2.8.3 (was: 2.8.1) > ClientServiceDelegate should not retry upon

[jira] [Updated] (MAPREDUCE-6491) Environment variable handling assumes values should be appended

[ https://issues.apache.org/jira/browse/MAPREDUCE-6491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6491: -- Target Version/s: 2.8.3 (was: 2.8.1) > Environment variable handling assumes values should

[jira] [Updated] (MAPREDUCE-6864) Hadoop streaming creates 2 mappers when the input has only one block

[ https://issues.apache.org/jira/browse/MAPREDUCE-6864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6864: -- Target Version/s: 2.8.3 (was: 2.8.1) > Hadoop streaming creates 2 mappers when the input

[jira] [Updated] (MAPREDUCE-6096) SummarizedJob class NPEs with some jhist files

[ https://issues.apache.org/jira/browse/MAPREDUCE-6096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6096: -- Target Version/s: 2.8.3 (was: 2.8.1) > SummarizedJob class NPEs with some jhist files >

[jira] [Updated] (MAPREDUCE-6117) Hadoop ignores yarn.nodemanager.hostname for RPC listeners

[ https://issues.apache.org/jira/browse/MAPREDUCE-6117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6117: -- Target Version/s: 2.8.3 (was: 2.8.1) > Hadoop ignores yarn.nodemanager.hostname for RPC

[jira] [Updated] (MAPREDUCE-6101) on job submission, if input or output directories are encrypted, shuffle data should be encrypted at rest

[ https://issues.apache.org/jira/browse/MAPREDUCE-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6101: -- Target Version/s: 2.8.3 (was: 2.8.1) > on job submission, if input or output directories

[jira] [Commented] (MAPREDUCE-6941) The default setting doesn't work for MapReduce job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154675#comment-16154675 ] Junping Du commented on MAPREDUCE-6941: --- Sorry missing comments on this JIRA. I think Ray's

[jira] [Commented] (MAPREDUCE-6931) Remove TestDFSIO "Total Throughput" calculation

[ https://issues.apache.org/jira/browse/MAPREDUCE-6931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16151042#comment-16151042 ] Junping Du commented on MAPREDUCE-6931: --- This JIRA is marked as trivial, but we are in 2.8.2 RC

[jira] [Commented] (MAPREDUCE-6937) Backport MAPREDUCE-6870 to branch-2 while preserving compatibility

[ https://issues.apache.org/jira/browse/MAPREDUCE-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149746#comment-16149746 ] Junping Du commented on MAPREDUCE-6937: --- Sounds like we forget to commit to branch-2.8.2. Just

[jira] [Commented] (MAPREDUCE-6931) Remove TestDFSIO "Total Throughput" calculation

[ https://issues.apache.org/jira/browse/MAPREDUCE-6931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149704#comment-16149704 ] Junping Du commented on MAPREDUCE-6931: --- 2.8.2 is in RC stage. Move to 2.8.3 given this only

[jira] [Updated] (MAPREDUCE-6931) Remove TestDFSIO "Total Throughput" calculation

[ https://issues.apache.org/jira/browse/MAPREDUCE-6931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6931: -- Fix Version/s: (was: 2.8.2) 2.8.3 > Remove TestDFSIO "Total

[jira] [Created] (MAPREDUCE-6941) The default setting doesn't work for MapReduce job

Junping Du created MAPREDUCE-6941: - Summary: The default setting doesn't work for MapReduce job Key: MAPREDUCE-6941 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6941 Project: Hadoop Map/Reduce

[jira] [Updated] (MAPREDUCE-6925) CLONE - Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild

[ https://issues.apache.org/jira/browse/MAPREDUCE-6925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6925: -- Fix Version/s: (was: 3.0.0-alpha1) (was: 2.9.0) > CLONE - Make

[jira] [Updated] (MAPREDUCE-6925) CLONE - Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild

[ https://issues.apache.org/jira/browse/MAPREDUCE-6925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6925: -- Target Version/s: 2.9.0, 3.0.0-beta1 (was: 2.7.0) > CLONE - Make Counter limits consistent

[jira] [Updated] (MAPREDUCE-6925) CLONE - Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild

[ https://issues.apache.org/jira/browse/MAPREDUCE-6925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6925: -- Hadoop Flags: (was: Reviewed) > CLONE - Make Counter limits consistent across JobClient,

[jira] [Commented] (MAPREDUCE-5875) Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild

[ https://issues.apache.org/jira/browse/MAPREDUCE-5875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108080#comment-16108080 ] Junping Du commented on MAPREDUCE-5875: --- bq. At a minimum, -beta1 will need to include a note

[jira] [Comment Edited] (MAPREDUCE-5875) Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild

[ https://issues.apache.org/jira/browse/MAPREDUCE-5875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108052#comment-16108052 ] Junping Du edited comment on MAPREDUCE-5875 at 7/31/17 10:05 PM: - Drop

[jira] [Commented] (MAPREDUCE-5875) Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild

[ https://issues.apache.org/jira/browse/MAPREDUCE-5875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108052#comment-16108052 ] Junping Du commented on MAPREDUCE-5875: --- Drop 2.9.0 as the patch get reverted from branch-2.

[jira] [Updated] (MAPREDUCE-5875) Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild

[ https://issues.apache.org/jira/browse/MAPREDUCE-5875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5875: -- Fix Version/s: (was: 2.9.0) > Make Counter limits consistent across JobClient,

[jira] [Created] (MAPREDUCE-6925) CLONE - Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild

Junping Du created MAPREDUCE-6925: - Summary: CLONE - Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild Key: MAPREDUCE-6925 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6925

[jira] [Updated] (MAPREDUCE-6199) AbstractCounters are not reset completely on deserialization

[ https://issues.apache.org/jira/browse/MAPREDUCE-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6199: -- Fix Version/s: (was: 3.0.0-alpha1) (was: 2.8.0) >

[jira] [Reopened] (MAPREDUCE-6199) AbstractCounters are not reset completely on deserialization

[ https://issues.apache.org/jira/browse/MAPREDUCE-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reopened MAPREDUCE-6199: --- > AbstractCounters are not reset completely on deserialization >

[jira] [Resolved] (MAPREDUCE-6199) AbstractCounters are not reset completely on deserialization

[ https://issues.apache.org/jira/browse/MAPREDUCE-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved MAPREDUCE-6199. --- Resolution: Won't Fix > AbstractCounters are not reset completely on deserialization >

[jira] [Commented] (MAPREDUCE-6199) AbstractCounters are not reset completely on deserialization

[ https://issues.apache.org/jira/browse/MAPREDUCE-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16107992#comment-16107992 ] Junping Du commented on MAPREDUCE-6199: --- MAPREDUCE-5875 is revert, so patch here is not needed.

[jira] [Updated] (MAPREDUCE-6286) A typo in HistoryViewer makes some code useless, which causes counter limits are not reset correctly.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6286: -- Fix Version/s: (was: 3.0.0-alpha1) (was: 2.9.0) > A typo in

[jira] [Resolved] (MAPREDUCE-6286) A typo in HistoryViewer makes some code useless, which causes counter limits are not reset correctly.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved MAPREDUCE-6286. --- Resolution: Won't Fix MAPREDUCE-5875 is revert, so patch here is not needed. reopen and

[jira] [Reopened] (MAPREDUCE-6286) A typo in HistoryViewer makes some code useless, which causes counter limits are not reset correctly.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reopened MAPREDUCE-6286: --- > A typo in HistoryViewer makes some code useless, which causes counter limits > are not

[jira] [Commented] (MAPREDUCE-5875) Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild

[ https://issues.apache.org/jira/browse/MAPREDUCE-5875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16107986#comment-16107986 ] Junping Du commented on MAPREDUCE-5875: --- As discussed in MAPREDUCE-6288, I have revert this

[jira] [Assigned] (MAPREDUCE-5875) Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild

[ https://issues.apache.org/jira/browse/MAPREDUCE-5875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned MAPREDUCE-5875: - Assignee: Gera Shegalov (was: Junping Du) > Make Counter limits consistent across

[jira] [Assigned] (MAPREDUCE-5875) Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild

[ https://issues.apache.org/jira/browse/MAPREDUCE-5875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned MAPREDUCE-5875: - Assignee: Junping Du (was: Gera Shegalov) > Make Counter limits consistent across

[jira] [Resolved] (MAPREDUCE-6288) mapred job -status fails with AccessControlException

[ https://issues.apache.org/jira/browse/MAPREDUCE-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved MAPREDUCE-6288. --- Resolution: Done I have revert MAPREDUCE-6286, MAPREDUCE-6199 and MAPREDUCE-5875 from

[jira] [Commented] (MAPREDUCE-6288) mapred job -status fails with AccessControlException

[ https://issues.apache.org/jira/browse/MAPREDUCE-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104470#comment-16104470 ] Junping Du commented on MAPREDUCE-6288: --- Yep. We keep reverting it from 2.7.x release and 2.8 so

[jira] [Commented] (MAPREDUCE-6288) mapred job -status fails with AccessControlException

[ https://issues.apache.org/jira/browse/MAPREDUCE-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104162#comment-16104162 ] Junping Du commented on MAPREDUCE-6288: --- Thus, I would suggest we reopen MAPREDUCE-5875 for a

[jira] [Commented] (MAPREDUCE-6288) mapred job -status fails with AccessControlException

[ https://issues.apache.org/jira/browse/MAPREDUCE-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104157#comment-16104157 ] Junping Du commented on MAPREDUCE-6288: --- [~rkanter], I think all people here agree that

[jira] [Commented] (MAPREDUCE-6288) mapred job -status fails with AccessControlException

[ https://issues.apache.org/jira/browse/MAPREDUCE-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103827#comment-16103827 ] Junping Du commented on MAPREDUCE-6288: --- This has pending for a while. Sounds like no one object

[jira] [Created] (MAPREDUCE-6915) On branch-2 ResourceManager failed to start

Junping Du created MAPREDUCE-6915: - Summary: On branch-2 ResourceManager failed to start Key: MAPREDUCE-6915 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6915 Project: Hadoop Map/Reduce

[jira] [Commented] (MAPREDUCE-6288) mapred job -status fails with AccessControlException

[ https://issues.apache.org/jira/browse/MAPREDUCE-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090497#comment-16090497 ] Junping Du commented on MAPREDUCE-6288: --- bq. If nobody steps up to address this then the

[jira] [Updated] (MAPREDUCE-5621) mr-jobhistory-daemon.sh doesn't have to execute mkdir and chown all the time

[ https://issues.apache.org/jira/browse/MAPREDUCE-5621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5621: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.2 Status:

[jira] [Updated] (MAPREDUCE-5621) mr-jobhistory-daemon.sh doesn't have to execute mkdir and chown all the time

[ https://issues.apache.org/jira/browse/MAPREDUCE-5621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5621: -- Attachment: MAPREDUCE-5621-branch-2.02.patch Fix the warning issue in 02 patch. >

[jira] [Updated] (MAPREDUCE-5621) mr-jobhistory-daemon.sh doesn't have to execute mkdir and chown all the time

[ https://issues.apache.org/jira/browse/MAPREDUCE-5621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5621: -- Affects Version/s: (was: 3.0.0-alpha1) Status: Patch Available (was:

[jira] [Updated] (MAPREDUCE-5621) mr-jobhistory-daemon.sh doesn't have to execute mkdir and chown all the time

[ https://issues.apache.org/jira/browse/MAPREDUCE-5621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5621: -- Attachment: MAPREDUCE-5621-branch-2.patch Rename the patch for branch-2. The latest patch

[jira] [Reopened] (MAPREDUCE-5621) mr-jobhistory-daemon.sh doesn't have to execute mkdir and chown all the time

[ https://issues.apache.org/jira/browse/MAPREDUCE-5621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reopened MAPREDUCE-5621: --- Reopen this ticket as the issue still exists on branch-2. > mr-jobhistory-daemon.sh doesn't

[jira] [Updated] (MAPREDUCE-5621) mr-jobhistory-daemon.sh doesn't have to execute mkdir and chown all the time

[ https://issues.apache.org/jira/browse/MAPREDUCE-5621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5621: -- Affects Version/s: 2.8.0 > mr-jobhistory-daemon.sh doesn't have to execute mkdir and chown

[jira] [Updated] (MAPREDUCE-5621) mr-jobhistory-daemon.sh doesn't have to execute mkdir and chown all the time

[ https://issues.apache.org/jira/browse/MAPREDUCE-5621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5621: -- Target Version/s: 2.9 > mr-jobhistory-daemon.sh doesn't have to execute mkdir and chown all

[jira] [Updated] (MAPREDUCE-6246) DBOutputFormat.java appending extra semicolon to query which is incompatible with DB2

[ https://issues.apache.org/jira/browse/MAPREDUCE-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6246: -- Fix Version/s: 3.0.0-beta1 > DBOutputFormat.java appending extra semicolon to query which

[jira] [Updated] (MAPREDUCE-6246) DBOutputFormat.java appending extra semicolon to query which is incompatible with DB2

[ https://issues.apache.org/jira/browse/MAPREDUCE-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6246: -- Resolution: Fixed Assignee: Gergely Novák (was: ramtin) Hadoop Flags:

[jira] [Updated] (MAPREDUCE-6246) DBOutputFormat.java appending extra semicolon to query which is incompatible with DB2

[ https://issues.apache.org/jira/browse/MAPREDUCE-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6246: -- Labels: (was: BB2015-05-RFC) Status: Patch Available (was: Open) Thanks

[jira] [Updated] (MAPREDUCE-6246) DBOutputFormat.java appending extra semicolon to query which is incompatible with DB2

[ https://issues.apache.org/jira/browse/MAPREDUCE-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6246: -- Status: Open (was: Patch Available) > DBOutputFormat.java appending extra semicolon to

[jira] [Commented] (MAPREDUCE-6246) DBOutputFormat.java appending extra semicolon to query which is incompatible with DB2

[ https://issues.apache.org/jira/browse/MAPREDUCE-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067268#comment-16067268 ] Junping Du commented on MAPREDUCE-6246: --- Looks like the patch doesn't apply to trunk any more.

[jira] [Commented] (MAPREDUCE-6246) DBOutputFormat.java appending extra semicolon to query which is incompatible with DB2

[ https://issues.apache.org/jira/browse/MAPREDUCE-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067141#comment-16067141 ] Junping Du commented on MAPREDUCE-6246: --- Thanks [~ramtinb] for the patch contribution. Latest

[jira] [Commented] (MAPREDUCE-6897) Add Unit Test to make sure Job end notification get sent even appMaster stop get YarnRuntimeException

[ https://issues.apache.org/jira/browse/MAPREDUCE-6897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16052416#comment-16052416 ] Junping Du commented on MAPREDUCE-6897: --- Thanks [~GergelyNovak] for contributing the patch and

[jira] [Updated] (MAPREDUCE-6895) Job end notification not send due to YarnRuntimeException

[ https://issues.apache.org/jira/browse/MAPREDUCE-6895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6895: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha4

[jira] [Commented] (MAPREDUCE-6895) Job end notification not send due to YarnRuntimeException

[ https://issues.apache.org/jira/browse/MAPREDUCE-6895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048705#comment-16048705 ] Junping Du commented on MAPREDUCE-6895: --- Just filed MAPREDUCE-6897 and commit the latest patch

[jira] [Created] (MAPREDUCE-6897) Add Unit Test to make sure Job end notification get sent even appMaster stop get YarnRuntimeException

Junping Du created MAPREDUCE-6897: - Summary: Add Unit Test to make sure Job end notification get sent even appMaster stop get YarnRuntimeException Key: MAPREDUCE-6897 URL:

[jira] [Commented] (MAPREDUCE-6895) Job end notification not send due to YarnRuntimeException

[ https://issues.apache.org/jira/browse/MAPREDUCE-6895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16047201#comment-16047201 ] Junping Du commented on MAPREDUCE-6895: --- Adding a UT is also a nice idea. Given this fix here is

[jira] [Commented] (MAPREDUCE-6895) Job end notification not send due to YarnRuntimeException

[ https://issues.apache.org/jira/browse/MAPREDUCE-6895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043574#comment-16043574 ] Junping Du commented on MAPREDUCE-6895: --- The patch LGTM as well. The only minor comments is:

[jira] [Updated] (MAPREDUCE-6654) Possible NPE in JobHistoryEventHandler#handleEvent

[ https://issues.apache.org/jira/browse/MAPREDUCE-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6654: -- Target Version/s: 2.9.0 (was: 2.8.1) > Possible NPE in JobHistoryEventHandler#handleEvent

[jira] [Updated] (MAPREDUCE-5889) Deprecate FileInputFormat.setInputPaths(Job, String) and FileInputFormat.addInputPaths(Job, String)

[ https://issues.apache.org/jira/browse/MAPREDUCE-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5889: -- Labels: (was: BB2015-05-TBR newbie) > Deprecate FileInputFormat.setInputPaths(Job,

[jira] [Updated] (MAPREDUCE-6868) License check for jdiff output files should be ignored

[ https://issues.apache.org/jira/browse/MAPREDUCE-6868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6868: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (MAPREDUCE-6868) License check for jdiff output files should be ignored

[ https://issues.apache.org/jira/browse/MAPREDUCE-6868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15942692#comment-15942692 ] Junping Du commented on MAPREDUCE-6868: --- Thanks [~ajisakaa] for reporting the issue and fixing

[jira] [Updated] (MAPREDUCE-6864) Hadoop streaming creates 2 mappers when the input has only one block

[ https://issues.apache.org/jira/browse/MAPREDUCE-6864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6864: -- Target Version/s: 2.8.1 > Hadoop streaming creates 2 mappers when the input has only one

[jira] [Updated] (MAPREDUCE-6852) Job#updateStatus() failed with NPE due to race condition

[ https://issues.apache.org/jira/browse/MAPREDUCE-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6852: -- Fix Version/s: 3.0.0-alpha3 > Job#updateStatus() failed with NPE due to race condition >

[jira] [Commented] (MAPREDUCE-6852) Job#updateStatus() failed with NPE due to race condition

[ https://issues.apache.org/jira/browse/MAPREDUCE-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15892827#comment-15892827 ] Junping Du commented on MAPREDUCE-6852: --- Thanks Jian for review and commit! >

[jira] [Updated] (MAPREDUCE-6852) Job#updateStatus() failed with NPE due to race condition

[ https://issues.apache.org/jira/browse/MAPREDUCE-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6852: -- Status: Patch Available (was: Open) > Job#updateStatus() failed with NPE due to race

[jira] [Updated] (MAPREDUCE-6852) Job#updateStatus() failed with NPE due to race condition

[ https://issues.apache.org/jira/browse/MAPREDUCE-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6852: -- Attachment: MAPREDUCE-6852-v2.patch Sounds reasonable. v2 patch incorporate comments here.

[jira] [Updated] (MAPREDUCE-6852) Job#updateStatus() failed with NPE due to race condition

[ https://issues.apache.org/jira/browse/MAPREDUCE-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6852: -- Status: Open (was: Patch Available) > Job#updateStatus() failed with NPE due to race

[jira] [Updated] (MAPREDUCE-6852) Job#updateStatus() failed with NPE due to race condition

[ https://issues.apache.org/jira/browse/MAPREDUCE-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6852: -- Attachment: MAPREDUCE-6852.patch Upload a quick patch to fix this issue. Not include any

[jira] [Updated] (MAPREDUCE-6852) Job#updateStatus() failed with NPE due to race condition

[ https://issues.apache.org/jira/browse/MAPREDUCE-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6852: -- Status: Patch Available (was: Open) > Job#updateStatus() failed with NPE due to race

[jira] [Created] (MAPREDUCE-6852) Job#updateStatus() failed with NPE due to race condition

Junping Du created MAPREDUCE-6852: - Summary: Job#updateStatus() failed with NPE due to race condition Key: MAPREDUCE-6852 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6852 Project: Hadoop

[jira] [Updated] (MAPREDUCE-6404) Allow AM to specify a port range for starting its webapp

[ https://issues.apache.org/jira/browse/MAPREDUCE-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6404: -- Release Note: Add a new configuration - "yarn.app.mapreduce.am.webapp.port-range" to

[jira] [Updated] (MAPREDUCE-6404) Allow AM to specify a port range for starting its webapp

[ https://issues.apache.org/jira/browse/MAPREDUCE-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6404: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (MAPREDUCE-6404) Allow AM to specify a port range for starting its webapp

[ https://issues.apache.org/jira/browse/MAPREDUCE-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15855394#comment-15855394 ] Junping Du commented on MAPREDUCE-6404: --- Thanks [~varun_saxena] for updating the patch which

[jira] [Commented] (MAPREDUCE-6404) Allow AM to specify a port range for starting its webapp

[ https://issues.apache.org/jira/browse/MAPREDUCE-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853674#comment-15853674 ] Junping Du commented on MAPREDUCE-6404: --- Patch looks good - just some checkstyle, white space

[jira] [Updated] (MAPREDUCE-6404) Allow AM to specify a port range for starting its webapp

[ https://issues.apache.org/jira/browse/MAPREDUCE-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6404: -- Status: Patch Available (was: In Progress) > Allow AM to specify a port range for starting

[jira] [Assigned] (MAPREDUCE-6404) Allow AM to specify a port range for starting its webapp

[ https://issues.apache.org/jira/browse/MAPREDUCE-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned MAPREDUCE-6404: - Assignee: Junping Du (was: Varun Saxena) > Allow AM to specify a port range for

[jira] [Assigned] (MAPREDUCE-6404) Allow AM to specify a port range for starting its webapp

[ https://issues.apache.org/jira/browse/MAPREDUCE-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned MAPREDUCE-6404: - Assignee: Varun Saxena (was: Junping Du) > Allow AM to specify a port range for

[jira] [Commented] (MAPREDUCE-6404) Allow AM to specify a port range for starting its webapp

[ https://issues.apache.org/jira/browse/MAPREDUCE-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853487#comment-15853487 ] Junping Du commented on MAPREDUCE-6404: --- HADOOP-12097 already get commit in. Submit the patch

[jira] [Updated] (MAPREDUCE-6338) MR AppMaster does not honor ephemeral port range

[ https://issues.apache.org/jira/browse/MAPREDUCE-6338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6338: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (MAPREDUCE-6825) YARNRunner#createApplicationSubmissionContext method is longer than 150 lines

[ https://issues.apache.org/jira/browse/MAPREDUCE-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15850821#comment-15850821 ] Junping Du commented on MAPREDUCE-6825: --- Thanks [~ctrezzo] for review! Patch LGTM too. However,

[jira] [Updated] (MAPREDUCE-6338) MR AppMaster does not honor ephemeral port range

[ https://issues.apache.org/jira/browse/MAPREDUCE-6338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6338: -- Status: Patch Available (was: Open) > MR AppMaster does not honor ephemeral port range >

[jira] [Commented] (MAPREDUCE-6338) MR AppMaster does not honor ephemeral port range

[ https://issues.apache.org/jira/browse/MAPREDUCE-6338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15834489#comment-15834489 ] Junping Du commented on MAPREDUCE-6338: --- Forget my comments above, I double check that we don't

[jira] [Updated] (MAPREDUCE-6711) JobImpl fails to handle preemption events on state COMMITTING

[ https://issues.apache.org/jira/browse/MAPREDUCE-6711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6711: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (MAPREDUCE-6670) TestJobListCache#testEviction sometimes fails on Windows with timeout

[ https://issues.apache.org/jira/browse/MAPREDUCE-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6670: -- Fix Version/s: (was: 2.9.0) > TestJobListCache#testEviction sometimes fails on Windows

[jira] [Updated] (MAPREDUCE-6801) Fix flaky TestKill.testKillJob()

[ https://issues.apache.org/jira/browse/MAPREDUCE-6801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6801: -- Fix Version/s: (was: 2.9.0) > Fix flaky TestKill.testKillJob() >

[jira] [Updated] (MAPREDUCE-6541) Exclude scheduled reducer memory when calculating available mapper slots from headroom to avoid deadlock

[ https://issues.apache.org/jira/browse/MAPREDUCE-6541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6541: -- Fix Version/s: (was: 2.9.0) > Exclude scheduled reducer memory when calculating

[jira] [Updated] (MAPREDUCE-2631) Potential resource leaks in BinaryProtocol$TeeOutputStream.java

[ https://issues.apache.org/jira/browse/MAPREDUCE-2631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-2631: -- Fix Version/s: (was: 2.9.0) > Potential resource leaks in

[jira] [Updated] (MAPREDUCE-6622) Add capability to set JHS job cache to a task-based limit

[ https://issues.apache.org/jira/browse/MAPREDUCE-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6622: -- Fix Version/s: (was: 2.9.0) > Add capability to set JHS job cache to a task-based limit

[jira] [Updated] (MAPREDUCE-6577) MR AM unable to load native library without MR_AM_ADMIN_USER_ENV set

[ https://issues.apache.org/jira/browse/MAPREDUCE-6577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6577: -- Fix Version/s: (was: 2.9.0) > MR AM unable to load native library without

[jira] [Updated] (MAPREDUCE-5883) "Total megabyte-seconds" in job counters is slightly misleading

[ https://issues.apache.org/jira/browse/MAPREDUCE-5883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5883: -- Fix Version/s: 2.8.0 > "Total megabyte-seconds" in job counters is slightly misleading >

[jira] [Updated] (MAPREDUCE-6387) Serialize the recently added Task#encryptedSpillKey field at the end

[ https://issues.apache.org/jira/browse/MAPREDUCE-6387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6387: -- Fix Version/s: 2.8.0 > Serialize the recently added Task#encryptedSpillKey field at the end

[jira] [Updated] (MAPREDUCE-6451) DistCp has incorrect chunkFilePath for multiple jobs when strategy is dynamic

[ https://issues.apache.org/jira/browse/MAPREDUCE-6451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6451: -- Fix Version/s: 2.8.0 > DistCp has incorrect chunkFilePath for multiple jobs when strategy

[jira] [Updated] (MAPREDUCE-6518) Set SO_KEEPALIVE on shuffle connections

[ https://issues.apache.org/jira/browse/MAPREDUCE-6518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6518: -- Fix Version/s: 2.8.0 > Set SO_KEEPALIVE on shuffle connections >

[jira] [Updated] (MAPREDUCE-6497) Fix wrong value of JOB_FINISHED event in JobHistoryEventHandler

[ https://issues.apache.org/jira/browse/MAPREDUCE-6497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6497: -- Fix Version/s: 2.8.0 > Fix wrong value of JOB_FINISHED event in JobHistoryEventHandler >

[jira] [Updated] (MAPREDUCE-6474) ShuffleHandler can possibly exhaust nodemanager file descriptors

[ https://issues.apache.org/jira/browse/MAPREDUCE-6474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6474: -- Fix Version/s: 2.8.0 > ShuffleHandler can possibly exhaust nodemanager file descriptors >

  1   2   3   4   5   6   7   >