[jira] [Updated] (MAPREDUCE-5817) Mappers get rescheduled on node transition even after all reducers are completed

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5817: -- Fix Version/s: 2.8.0 > Mappers get rescheduled on node transition even after all reducers

[jira] [Updated] (MAPREDUCE-5982) Task attempts that fail from the ASSIGNED state can disappear

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5982: -- Fix Version/s: 2.8.0 > Task attempts that fail from the ASSIGNED state can disappear >

[jira] [Updated] (MAPREDUCE-6191) TestJavaSerialization fails with getting incorrect MR job result

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6191: -- Fix Version/s: 2.8.0 > TestJavaSerialization fails with getting incorrect MR job result >

[jira] [Updated] (MAPREDUCE-6472) MapReduce AM should have java.io.tmpdir=./tmp to be consistent with tasks

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6472: -- Fix Version/s: 2.8.0 > MapReduce AM should have java.io.tmpdir=./tmp to be consistent with

[jira] [Updated] (MAPREDUCE-6621) Memory Leak in JobClient#submitJobInternal()

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6621: -- Fix Version/s: 2.8.0 > Memory Leak in JobClient#submitJobInternal() >

[jira] [Updated] (MAPREDUCE-6618) YarnClientProtocolProvider leaking the YarnClient thread.

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6618: -- Fix Version/s: 2.8.0 > YarnClientProtocolProvider leaking the YarnClient thread. >

[jira] [Updated] (MAPREDUCE-6637) Testcase Failure : TestFileInputFormat.testSplitLocationInfo

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6637: -- Fix Version/s: 2.8.0 > Testcase Failure : TestFileInputFormat.testSplitLocationInfo >

[jira] [Updated] (MAPREDUCE-6633) AM should retry map attempts if the reduce task encounters commpression related errors.

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6633: -- Fix Version/s: 2.8.0 > AM should retry map attempts if the reduce task encounters

[jira] [Updated] (MAPREDUCE-6549) multibyte delimiters with LineRecordReader cause duplicate records

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6549: -- Fix Version/s: 2.8.0 > multibyte delimiters with LineRecordReader cause duplicate records >

[jira] [Updated] (MAPREDUCE-6540) TestMRTimelineEventHandling fails

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6540: -- Fix Version/s: 2.8.0 > TestMRTimelineEventHandling fails >

[jira] [Updated] (MAPREDUCE-6426) TestShuffleHandler#testGetMapOutputInfo is failing

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6426: -- Fix Version/s: 2.8.0 > TestShuffleHandler#testGetMapOutputInfo is failing >

[jira] [Updated] (MAPREDUCE-6425) ShuffleHandler passes wrong "base" parameter to getMapOutputInfo if mapId is not in the cache.

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6425: -- Fix Version/s: 2.8.0 > ShuffleHandler passes wrong "base" parameter to getMapOutputInfo if

[jira] [Updated] (MAPREDUCE-6251) JobClient needs additional retries at a higher level to address not-immediately-consistent dfs corner cases

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6251: -- Fix Version/s: 2.8.0 > JobClient needs additional retries at a higher level to address >

[jira] [Updated] (MAPREDUCE-5649) Reduce cannot use more than 2G memory for the final merge

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5649: -- Fix Version/s: 2.8.0 > Reduce cannot use more than 2G memory for the final merge >

[jira] [Updated] (MAPREDUCE-4785) TestMRApp occasionally fails

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4785: -- Fix Version/s: 2.8.0 > TestMRApp occasionally fails > > >

[jira] [Updated] (MAPREDUCE-6259) IllegalArgumentException due to missing job submit time

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6259: -- Fix Version/s: 2.8.0 > IllegalArgumentException due to missing job submit time >

[jira] [Updated] (MAPREDUCE-6454) MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6454: -- Fix Version/s: 2.8.0 > MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in

[jira] [Updated] (MAPREDUCE-6554) MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6554: -- Fix Version/s: 2.8.0 > MRAppMaster servicestart failing with NPE in >

[jira] [Updated] (MAPREDUCE-6481) LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes.

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6481: -- Fix Version/s: 2.8.0 > LineRecordReader may give incomplete record and wrong position/key

[jira] [Updated] (MAPREDUCE-6492) AsyncDispatcher exit with NPE on TaskAttemptImpl#sendJHStartEventForAssignedFailTask

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6492: -- Fix Version/s: 2.8.0 > AsyncDispatcher exit with NPE on >

[jira] [Updated] (MAPREDUCE-6528) Memory leak for HistoryFileManager.getJobSummary()

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6528: -- Fix Version/s: 2.8.0 > Memory leak for HistoryFileManager.getJobSummary() >

[jira] [Updated] (MAPREDUCE-6410) Aggregated Logs Deletion doesnt work after refreshing Log Retention Settings in secure cluster

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6410: -- Fix Version/s: 2.8.0 > Aggregated Logs Deletion doesnt work after refreshing Log Retention

[jira] [Updated] (MAPREDUCE-6361) NPE issue in shuffle caused by concurrent issue between copySucceeded() in one thread and copyFailed() in another thread on the same host

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6361: -- Fix Version/s: 2.8.0 > NPE issue in shuffle caused by concurrent issue between

[jira] [Updated] (MAPREDUCE-5948) org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5948: -- Fix Version/s: 2.8.0 > org.apache.hadoop.mapred.LineRecordReader does not handle multibyte

[jira] [Updated] (MAPREDUCE-6339) Job history file is not flushed correctly because isTimerActive flag is not set true when flushTimerTask is scheduled.

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6339: -- Fix Version/s: 2.8.0 > Job history file is not flushed correctly because isTimerActive flag

[jira] [Updated] (MAPREDUCE-6238) MR2 can't run local jobs with -libjars command options which is a regression from MR1

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6238: -- Fix Version/s: 2.8.0 > MR2 can't run local jobs with -libjars command options which is a

[jira] [Updated] (MAPREDUCE-6514) Job hangs as ask is not updated after ramping down of all reducers

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6514: -- Fix Version/s: 2.8.0 > Job hangs as ask is not updated after ramping down of all reducers >

[jira] [Updated] (MAPREDUCE-6324) Uber jobs fail to update AMRM token when it rolls over

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6324: -- Fix Version/s: 2.8.0 > Uber jobs fail to update AMRM token when it rolls over >

[jira] [Updated] (MAPREDUCE-6334) Fetcher#copyMapOutput is leaking usedMemory upon IOException during InMemoryMapOutput shuffle handler

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6334: -- Fix Version/s: 2.8.0 > Fetcher#copyMapOutput is leaking usedMemory upon IOException during

[jira] [Updated] (MAPREDUCE-6675) TestJobImpl.testUnusableNode failed

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6675: -- Fix Version/s: (was: 2.9.0) > TestJobImpl.testUnusableNode failed >

[jira] [Updated] (MAPREDUCE-6716) Hadoop shell "mapred job -list" shows improper time format

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6716: -- Target Version/s: 2.9.0 (was: 2.8.0) Fix Version/s: (was: 2.8.0) Release

[jira] [Commented] (MAPREDUCE-6288) mapred job -status fails with AccessControlException

2016-12-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784247#comment-15784247 ] Junping Du commented on MAPREDUCE-6288: --- Revert MAPREDUCE-5875 from branch-2.8, so retarget it

[jira] [Updated] (MAPREDUCE-6288) mapred job -status fails with AccessControlException

2016-12-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6288: -- Target Version/s: 2.9.0, 3.0.0-beta1 (was: 2.8.0, 3.0.0-beta1) > mapred job -status fails

[jira] [Commented] (MAPREDUCE-6286) A typo in HistoryViewer makes some code useless, which causes counter limits are not reset correctly.

2016-12-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784241#comment-15784241 ] Junping Du commented on MAPREDUCE-6286: --- Revert it from branch-2.8 given we revert

[jira] [Updated] (MAPREDUCE-6286) A typo in HistoryViewer makes some code useless, which causes counter limits are not reset correctly.

2016-12-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6286: -- Fix Version/s: (was: 2.8.0) 2.9.0 > A typo in HistoryViewer makes

[jira] [Commented] (MAPREDUCE-5875) Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild

2016-12-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784235#comment-15784235 ] Junping Du commented on MAPREDUCE-5875: --- Revert from branch-2.8 given discussion in

[jira] [Updated] (MAPREDUCE-5875) Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild

2016-12-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5875: -- Fix Version/s: (was: 2.8.0) 2.9.0 > Make Counter limits consistent

[jira] [Commented] (MAPREDUCE-6728) Give fetchers hint when ShuffleHandler rejects a shuffling connection

2016-12-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752801#comment-15752801 ] Junping Du commented on MAPREDUCE-6728: --- Great. Thanks [~haibochen]! > Give fetchers hint when

[jira] [Commented] (MAPREDUCE-6728) Give fetchers hint when ShuffleHandler rejects a shuffling connection

2016-12-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752781#comment-15752781 ] Junping Du commented on MAPREDUCE-6728: --- Hi [~rkanter] and [~haibochen], do we consider to

[jira] [Commented] (MAPREDUCE-6814) mapred's FileAlreadyExistsException should be deprecated in favor of hadoop-common's one.

2016-12-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749675#comment-15749675 ] Junping Du commented on MAPREDUCE-6814: --- Hi [~boky01], I just add you into contributor list. For

[jira] [Updated] (MAPREDUCE-6814) mapred's FileAlreadyExistsException should be deprecated in favor of hadoop-common's one.

2016-12-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6814: -- Assignee: Andras Bokor (was: Boris Shkolnik) > mapred's FileAlreadyExistsException should

[jira] [Commented] (MAPREDUCE-6288) mapred job -status fails with AccessControlException

2016-12-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736482#comment-15736482 ] Junping Du commented on MAPREDUCE-6288: --- Thanks [~jlowe] for pushing this for 2.8 release. It

[jira] [Updated] (MAPREDUCE-6128) Automatic addition of bundled jars to distributed cache

2016-12-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6128: -- Labels: (was: BB2015-05-TBR) > Automatic addition of bundled jars to distributed cache >

[jira] [Updated] (MAPREDUCE-6164) "mapreduce.reduce.shuffle.fetch.retry.timeout-ms" should be set to 3 minutes instead of 30 seconds by default to be consistent with other retry timeout

2016-12-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6164: -- Resolution: Won't Fix Status: Resolved (was: Patch Available) Close this issue as

[jira] [Updated] (MAPREDUCE-6164) "mapreduce.reduce.shuffle.fetch.retry.timeout-ms" should be set to 3 minutes instead of 30 seconds by default to be consistent with other retry timeout

2016-12-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6164: -- Target Version/s: (was: 2.8.0) > "mapreduce.reduce.shuffle.fetch.retry.timeout-ms" should

[jira] [Updated] (MAPREDUCE-6241) Native compilation fails for Checksum.cc due to an incompatibility of assembler register constraint for PowerPC

2016-12-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6241: -- Target Version/s: 2.9.0 (was: 2.8.0) > Native compilation fails for Checksum.cc due to an

[jira] [Commented] (MAPREDUCE-6241) Native compilation fails for Checksum.cc due to an incompatibility of assembler register constraint for PowerPC

2016-12-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15717090#comment-15717090 ] Junping Du commented on MAPREDUCE-6241: --- Move it out of 2.8 given this issue is pending for more

[jira] [Updated] (MAPREDUCE-6442) Stack trace is missing when error occurs in client protocol provider's constructor

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6442: -- Fix Version/s: 2.8.0 > Stack trace is missing when error occurs in client protocol

[jira] [Updated] (MAPREDUCE-6439) AM may fail instead of retrying if RM shuts down during the allocate call

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6439: -- Fix Version/s: 2.8.0 > AM may fail instead of retrying if RM shuts down during the allocate

[jira] [Updated] (MAPREDUCE-6377) JHS sorting on state column not working in webUi

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6377: -- Fix Version/s: 2.8.0 > JHS sorting on state column not working in webUi >

[jira] [Updated] (MAPREDUCE-6273) HistoryFileManager should check whether summaryFile exists to avoid FileNotFoundException causing HistoryFileInfo into MOVE_FAILED state

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6273: -- Fix Version/s: 2.8.0 > HistoryFileManager should check whether summaryFile exists to avoid

[jira] [Updated] (MAPREDUCE-6565) Configuration to use host name in delegation token service is not read from job.xml during MapReduce job execution.

2016-11-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6565: -- Fix Version/s: (was: 2.8.0) 2.9.0 > Configuration to use host name

[jira] [Commented] (MAPREDUCE-6565) Configuration to use host name in delegation token service is not read from job.xml during MapReduce job execution.

2016-11-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15709498#comment-15709498 ] Junping Du commented on MAPREDUCE-6565: --- My bad... I forgot branch-2 and branch-2.8 has big gap

[jira] [Updated] (MAPREDUCE-6338) MR AppMaster does not honor ephemeral port range

2016-11-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6338: -- Labels: (was: BB2015-05-TBR) > MR AppMaster does not honor ephemeral port range >

[jira] [Updated] (MAPREDUCE-6338) MR AppMaster does not honor ephemeral port range

2016-11-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6338: -- Status: Open (was: Patch Available) > MR AppMaster does not honor ephemeral port range >

[jira] [Commented] (MAPREDUCE-6338) MR AppMaster does not honor ephemeral port range

2016-11-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15709330#comment-15709330 ] Junping Du commented on MAPREDUCE-6338: --- Also, we should have a central static IP pool instead

[jira] [Updated] (MAPREDUCE-6565) Configuration to use host name in delegation token service is not read from job.xml during MapReduce job execution.

2016-11-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6565: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status:

[jira] [Commented] (MAPREDUCE-6711) JobImpl fails to handle preemption events on state COMMITTING

2016-11-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703307#comment-15703307 ] Junping Du commented on MAPREDUCE-6711: --- Thanks [~Prabhu Joseph] for explanation. That sounds

[jira] [Commented] (MAPREDUCE-6565) Configuration to use host name in delegation token service is not read from job.xml during MapReduce job execution.

2016-11-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702867#comment-15702867 ] Junping Du commented on MAPREDUCE-6565: --- Patch LGTM too. > Configuration to use host name in

[jira] [Commented] (MAPREDUCE-6565) Configuration to use host name in delegation token service is not read from job.xml during MapReduce job execution.

2016-11-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15677579#comment-15677579 ] Junping Du commented on MAPREDUCE-6565: --- bq. I think the tarball is muddying the waters here.

[jira] [Commented] (MAPREDUCE-6565) Configuration to use host name in delegation token service is not read from job.xml during MapReduce job execution.

2016-11-17 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674969#comment-15674969 ] Junping Du commented on MAPREDUCE-6565: --- bq. We just have the main tarball for the cluster and

[jira] [Commented] (MAPREDUCE-6565) Configuration to use host name in delegation token service is not read from job.xml during MapReduce job execution.

2016-11-17 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674604#comment-15674604 ] Junping Du commented on MAPREDUCE-6565: --- I probably won't agree it could be safe to let job.xml

[jira] [Commented] (MAPREDUCE-6565) Configuration to use host name in delegation token service is not read from job.xml during MapReduce job execution.

2016-11-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669320#comment-15669320 ] Junping Du commented on MAPREDUCE-6565: --- [~jlowe], thanks for your comments! For client

[jira] [Commented] (MAPREDUCE-6565) Configuration to use host name in delegation token service is not read from job.xml during MapReduce job execution.

2016-11-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668024#comment-15668024 ] Junping Du commented on MAPREDUCE-6565: --- I think MR over distributed cache shouldn't load

[jira] [Commented] (MAPREDUCE-6711) JobImpl fails to handle preemption events on state COMMITTING

2016-11-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15651572#comment-15651572 ] Junping Du commented on MAPREDUCE-6711: --- The patch is quite straighforward. However, [~Prabhu

[jira] [Commented] (MAPREDUCE-6803) MR AppMaster should assign container that is closest to the data

2016-11-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15632654#comment-15632654 ] Junping Du commented on MAPREDUCE-6803: --- Sorry for replying a bit late as busy in travel

[jira] [Updated] (MAPREDUCE-6792) Allow user's full principal name as owner of MapReduce staging directory in JobSubmissionFiles#JobStagingDir()

2016-10-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6792: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (MAPREDUCE-6792) Allow user's full principal name as owner of MapReduce staging directory in JobSubmissionFiles#JobStagingDir()

2016-10-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15591907#comment-15591907 ] Junping Du commented on MAPREDUCE-6792: --- Thanks [~snayak] for addressing my comments above. The

[jira] [Updated] (MAPREDUCE-6792) Allow user's full principal name as owner of MapReduce staging directory in JobSubmissionFiles#JobStagingDir()

2016-10-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6792: -- Target Version/s: 3.0.0-alpha1, 2.9.0 (was: 3.0.0-alpha1) > Allow user's full principal

[jira] [Updated] (MAPREDUCE-6792) Allow user's full principal name as owner of MapReduce staging directory in JobSubmissionFiles#JobStagingDir()

2016-10-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6792: -- Status: Patch Available (was: Open) Submit the patch for kick off Jenkins' test. The patch

[jira] [Commented] (MAPREDUCE-6792) Allow user's full principal name as owner of MapReduce staging directory in JobSubmissionFiles#JobStagingDir()

2016-10-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571558#comment-15571558 ] Junping Du commented on MAPREDUCE-6792: --- Hi [~snayak], thanks for reporting the issue and your

[jira] [Updated] (MAPREDUCE-6792) Allow user's full principal name as owner of MapReduce staging directory in JobSubmissionFiles#JobStagingDir()

2016-10-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6792: -- Assignee: Santhosh G Nayak > Allow user's full principal name as owner of MapReduce staging

[jira] [Updated] (MAPREDUCE-6726) YARN Registry based AM discovery with retry and in-flight task persistent via JHS

2016-09-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6726: -- Attachment: MAPREDUCE-6726-MAPREDUCE-6608.001.patch Just create precommit job for

[jira] [Commented] (MAPREDUCE-6706) Update TaskUmbilicalProtocol to use ProtobufRPCEngine

2016-09-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500791#comment-15500791 ] Junping Du commented on MAPREDUCE-6706: --- Hi [~drankye] and [~asuresh], thanks for proposing the

[jira] [Commented] (MAPREDUCE-6454) MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.

2016-08-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15448842#comment-15448842 ] Junping Du commented on MAPREDUCE-6454: --- [~andrew.wang], Yes. this and MAPREDUCE-6619 only for

[jira] [Commented] (MAPREDUCE-6654) Possible NPE in JobHistoryEventHandler#handleEvent

2016-08-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15402707#comment-15402707 ] Junping Du commented on MAPREDUCE-6654: --- bq. We depend on reliable persistence of these events

[jira] [Commented] (MAPREDUCE-6654) Possible NPE in JobHistoryEventHandler#handleEvent

2016-08-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15402288#comment-15402288 ] Junping Du commented on MAPREDUCE-6654: --- The checkstyle and unit test failure in Jenkins report

[jira] [Commented] (MAPREDUCE-6654) Possible NPE in JobHistoryEventHandler#handleEvent

2016-08-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15402286#comment-15402286 ] Junping Du commented on MAPREDUCE-6654: --- Thanks [~vvasudev] for review and comments! bq.

[jira] [Updated] (MAPREDUCE-6654) Possible NPE in JobHistoryEventHandler#handleEvent

2016-08-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6654: -- Attachment: MAPREDUCE-6654-v2.1.patch Fix the issue involved as refactor in v2. > Possible

[jira] [Commented] (MAPREDUCE-6654) Possible NPE in JobHistoryEventHandler#handleEvent

2016-08-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15401995#comment-15401995 ] Junping Du commented on MAPREDUCE-6654: --- bq. My knowledge on MR/YARN is limited, if you want

[jira] [Updated] (MAPREDUCE-6654) Possible NPE in JobHistoryEventHandler#handleEvent

2016-08-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6654: -- Attachment: MAPREDUCE-6654-v2.patch Update the patch to fix Jenkins' complain and Xiao's

[jira] [Updated] (MAPREDUCE-6654) Possible NPE in JobHistoryEventHandler#handleEvent

2016-07-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6654: -- Status: Patch Available (was: Open) > Possible NPE in JobHistoryEventHandler#handleEvent >

[jira] [Commented] (MAPREDUCE-6654) Possible NPE in JobHistoryEventHandler#handleEvent

2016-07-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399659#comment-15399659 ] Junping Du commented on MAPREDUCE-6654: --- bq. I think you meant to say so no NPE get throw. Yep.

[jira] [Updated] (MAPREDUCE-6654) Possible NPE in JobHistoryEventHandler#handleEvent

2016-07-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6654: -- Attachment: MAPREDUCE-6654.patch > Possible NPE in JobHistoryEventHandler#handleEvent >

[jira] [Updated] (MAPREDUCE-6654) Possible NPE in JobHistoryEventHandler#handleEvent

2016-07-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6654: -- Target Version/s: 2.8.0 > Possible NPE in JobHistoryEventHandler#handleEvent >

[jira] [Updated] (MAPREDUCE-6654) Possible NPE in JobHistoryEventHandler#handleEvent

2016-07-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6654: -- Priority: Critical (was: Minor) > Possible NPE in JobHistoryEventHandler#handleEvent >

[jira] [Commented] (MAPREDUCE-6654) Possible NPE in JobHistoryEventHandler#handleEvent

2016-07-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399537#comment-15399537 ] Junping Du commented on MAPREDUCE-6654: --- Thanks [~xiaochen] for reporting this issue. We run

[jira] [Assigned] (MAPREDUCE-6654) Possible NPE in JobHistoryEventHandler#handleEvent

2016-07-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned MAPREDUCE-6654: - Assignee: Junping Du > Possible NPE in JobHistoryEventHandler#handleEvent >

[jira] [Updated] (MAPREDUCE-6738) TestJobListCache.testAddExisting failed intermiddently in slow VM testbed

2016-07-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6738: -- Status: Patch Available (was: Open) > TestJobListCache.testAddExisting failed

[jira] [Updated] (MAPREDUCE-6738) TestJobListCache.testAddExisting failed intermiddently in slow VM testbed

2016-07-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6738: -- Attachment: MAPREDUCE-6738.patch Upload a quick patch to fix it. >

[jira] [Commented] (MAPREDUCE-6738) TestJobListCache.testAddExisting failed intermiddently in slow VM testbed

2016-07-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386438#comment-15386438 ] Junping Du commented on MAPREDUCE-6738: --- It is very occasionally to reproduce the failure

[jira] [Created] (MAPREDUCE-6738) TestJobListCache.testAddExisting failed intermiddently in slow VM testbed

2016-07-20 Thread Junping Du (JIRA)
Junping Du created MAPREDUCE-6738: - Summary: TestJobListCache.testAddExisting failed intermiddently in slow VM testbed Key: MAPREDUCE-6738 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6738

[jira] [Updated] (MAPREDUCE-6733) MapReduce JerseyTest tests failing with "java.net.BindException: Address already in use"

2016-07-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6733: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status:

[jira] [Commented] (MAPREDUCE-6733) MapReduce JerseyTest tests failing with "java.net.BindException: Address already in use"

2016-07-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15379806#comment-15379806 ] Junping Du commented on MAPREDUCE-6733: --- +1. Trunk patch LGTM. Will commit it shortly. >

[jira] [Created] (MAPREDUCE-6726) YARN Registry based AM discovery with retry and in-flight task persistent via JHS

2016-06-24 Thread Junping Du (JIRA)
Junping Du created MAPREDUCE-6726: - Summary: YARN Registry based AM discovery with retry and in-flight task persistent via JHS Key: MAPREDUCE-6726 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6726

[jira] [Commented] (MAPREDUCE-6711) JobImpl fails to handle preemption events on state COMMITTING

2016-06-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344766#comment-15344766 ] Junping Du commented on MAPREDUCE-6711: --- Hi [~Prabhu Joseph], thanks for the patch. I will

[jira] [Updated] (MAPREDUCE-6711) JobImpl fails to handle preemption events on state COMMITTING

2016-06-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6711: -- Fix Version/s: (was: 2.7.3) > JobImpl fails to handle preemption events on state

[jira] [Updated] (MAPREDUCE-6197) Cache MapOutputLocations in ShuffleHandler

2016-06-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6197: -- Fix Version/s: (was: 2.8.0) 2.9.0 > Cache MapOutputLocations in

[jira] [Commented] (MAPREDUCE-6197) Cache MapOutputLocations in ShuffleHandler

2016-06-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342783#comment-15342783 ] Junping Du commented on MAPREDUCE-6197: --- Thanks [~jianhe] for review and commit! > Cache

[jira] [Commented] (MAPREDUCE-6197) Cache MapOutputLocations in ShuffleHandler

2016-06-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15333791#comment-15333791 ] Junping Du commented on MAPREDUCE-6197: --- Thanks [~jianhe] for review and comments. bq. one

<    1   2   3   4   5   6   7   >