[jira] [Commented] (MAPREDUCE-6197) Cache MapOutputLocations in ShuffleHandler

[ https://issues.apache.org/jira/browse/MAPREDUCE-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328449#comment-15328449 ] Junping Du commented on MAPREDUCE-6197: --- The similar issue get fixed for Hive in HIVE-9912.

[jira] [Updated] (MAPREDUCE-6197) Cache MapOutputLocations in ShuffleHandler

[ https://issues.apache.org/jira/browse/MAPREDUCE-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6197: -- Target Version/s: 2.9.0 Status: Patch Available (was: Open) > Cache

[jira] [Updated] (MAPREDUCE-6197) Cache MapOutputLocations in ShuffleHandler

[ https://issues.apache.org/jira/browse/MAPREDUCE-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6197: -- Attachment: MAPREDUCE-6197.patch > Cache MapOutputLocations in ShuffleHandler >

[jira] [Updated] (MAPREDUCE-6197) Cache MapOutputLocations in ShuffleHandler

[ https://issues.apache.org/jira/browse/MAPREDUCE-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6197: -- Assignee: Junping Du > Cache MapOutputLocations in ShuffleHandler >

[jira] [Updated] (MAPREDUCE-6608) Work Preserving AM Restart for MapReduce

[ https://issues.apache.org/jira/browse/MAPREDUCE-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6608: -- Target Version/s: MAPREDUCE-6608 > Work Preserving AM Restart for MapReduce >

[jira] [Commented] (MAPREDUCE-6608) Work Preserving AM Restart for MapReduce

[ https://issues.apache.org/jira/browse/MAPREDUCE-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15318652#comment-15318652 ] Junping Du commented on MAPREDUCE-6608: --- I have create branch MAPREDUCE-6608 for this

[jira] [Updated] (MAPREDUCE-6657) job history server can fail on startup when NameNode is in start phase

[ https://issues.apache.org/jira/browse/MAPREDUCE-6657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6657: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status:

[jira] [Commented] (MAPREDUCE-6657) job history server can fail on startup when NameNode is in start phase

[ https://issues.apache.org/jira/browse/MAPREDUCE-6657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15285726#comment-15285726 ] Junping Du commented on MAPREDUCE-6657: --- The test failure is not related. 007 patch LGTM. +1.

[jira] [Commented] (MAPREDUCE-6657) job history server can fail on startup when NameNode is in start phase

[ https://issues.apache.org/jira/browse/MAPREDUCE-6657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283178#comment-15283178 ] Junping Du commented on MAPREDUCE-6657: --- bq. I think the HDFS change is trivial and it would be

[jira] [Updated] (MAPREDUCE-6146) Reduce tar ball size for MR over distributed cache

[ https://issues.apache.org/jira/browse/MAPREDUCE-6146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6146: -- Labels: (was: BB2015-05-TBR) > Reduce tar ball size for MR over distributed cache >

[jira] [Updated] (MAPREDUCE-6146) Reduce tar ball size for MR over distributed cache

[ https://issues.apache.org/jira/browse/MAPREDUCE-6146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6146: -- Target Version/s: (was: 2.8.0) > Reduce tar ball size for MR over distributed cache >

[jira] [Commented] (MAPREDUCE-6657) job history server can fail on startup when NameNode is in start phase

[ https://issues.apache.org/jira/browse/MAPREDUCE-6657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281517#comment-15281517 ] Junping Du commented on MAPREDUCE-6657: --- bq. Do you think we should create a subclass of

[jira] [Commented] (MAPREDUCE-6657) job history server can fail on startup when NameNode is in start phase

[ https://issues.apache.org/jira/browse/MAPREDUCE-6657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15280564#comment-15280564 ] Junping Du commented on MAPREDUCE-6657: --- Thanks for updating the patch, [~haibochen]. My above

[jira] [Commented] (MAPREDUCE-6657) job history server can fail on startup when NameNode is in start phase

[ https://issues.apache.org/jira/browse/MAPREDUCE-6657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15280426#comment-15280426 ] Junping Du commented on MAPREDUCE-6657: --- Thanks [~haibochen] for the patch. The hard code of

[jira] [Commented] (MAPREDUCE-6672) TestTeraSort fails on Windows

[ https://issues.apache.org/jira/browse/MAPREDUCE-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264066#comment-15264066 ] Junping Du commented on MAPREDUCE-6672: --- Thanks Tibor updating the patch and Chris proposing the

[jira] [Commented] (MAPREDUCE-6680) JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc.)

[ https://issues.apache.org/jira/browse/MAPREDUCE-6680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251894#comment-15251894 ] Junping Du commented on MAPREDUCE-6680: --- Thanks [~jianhe] for review and commit! > JHS

[jira] [Comment Edited] (MAPREDUCE-6608) Work Preserving AM Restart for MapReduce

[ https://issues.apache.org/jira/browse/MAPREDUCE-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248151#comment-15248151 ] Junping Du edited comment on MAPREDUCE-6608 at 4/19/16 4:46 PM:

[jira] [Commented] (MAPREDUCE-6608) Work Preserving AM Restart for MapReduce

[ https://issues.apache.org/jira/browse/MAPREDUCE-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248151#comment-15248151 ] Junping Du commented on MAPREDUCE-6608: --- [~vinodkv], thanks for review and comments. I think

[jira] [Updated] (MAPREDUCE-6680) JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc.)

[ https://issues.apache.org/jira/browse/MAPREDUCE-6680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6680: -- Labels: Azure S3 (was: ) > JHS UserLogDir scan algorithm sometime could skip directory

[jira] [Commented] (MAPREDUCE-6680) JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc.)

[ https://issues.apache.org/jira/browse/MAPREDUCE-6680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246735#comment-15246735 ] Junping Du commented on MAPREDUCE-6680: --- bq. (T1 != T3) or (T1 == T3 but T1.toSeconds >=

[jira] [Updated] (MAPREDUCE-6680) JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc.)

[ https://issues.apache.org/jira/browse/MAPREDUCE-6680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6680: -- Attachment: MAPREDUCE-6680-v3.patch > JHS UserLogDir scan algorithm sometime could skip

[jira] [Updated] (MAPREDUCE-6680) JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc.)

[ https://issues.apache.org/jira/browse/MAPREDUCE-6680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6680: -- Attachment: (was: MAPREDUCE-6680-v3.patch) > JHS UserLogDir scan algorithm sometime

[jira] [Updated] (MAPREDUCE-6680) JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc.)

[ https://issues.apache.org/jira/browse/MAPREDUCE-6680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6680: -- Attachment: MAPREDUCE-6680-v3.patch > JHS UserLogDir scan algorithm sometime could skip

[jira] [Commented] (MAPREDUCE-6680) JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc.)

[ https://issues.apache.org/jira/browse/MAPREDUCE-6680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246699#comment-15246699 ] Junping Du commented on MAPREDUCE-6680: --- bq. we can record latest scanning time on userDir as

[jira] [Updated] (MAPREDUCE-6680) JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc.)

[ https://issues.apache.org/jira/browse/MAPREDUCE-6680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6680: -- Attachment: MAPREDUCE-6680-v2.patch v2 patch fix checkstyle issue. > JHS UserLogDir scan

[jira] [Updated] (MAPREDUCE-6680) JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc.)

[ https://issues.apache.org/jira/browse/MAPREDUCE-6680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6680: -- Status: Patch Available (was: Open) > JHS UserLogDir scan algorithm sometime could skip

[jira] [Updated] (MAPREDUCE-6680) JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc.)

[ https://issues.apache.org/jira/browse/MAPREDUCE-6680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6680: -- Attachment: MAPREDUCE-6680.patch Put a patch with proper fix. The unit test could be very

[jira] [Commented] (MAPREDUCE-6680) JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc.)

[ https://issues.apache.org/jira/browse/MAPREDUCE-6680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245731#comment-15245731 ] Junping Du commented on MAPREDUCE-6680: --- Given analysis in description, the solution is: we can

[jira] [Updated] (MAPREDUCE-6680) JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc.)

[ https://issues.apache.org/jira/browse/MAPREDUCE-6680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6680: -- Description: In our cluster based on a Cloud FileSystem, we notice JHS sometimes could skip

[jira] [Created] (MAPREDUCE-6680) JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc.)

Junping Du created MAPREDUCE-6680: - Summary: JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc.) Key: MAPREDUCE-6680 URL:

[jira] [Updated] (MAPREDUCE-6670) TestJobListCache#testEviction sometimes fails on Windows with timeout

[ https://issues.apache.org/jira/browse/MAPREDUCE-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6670: -- Fix Version/s: 2.7.3 2.8.0 Release Note: Backport the fix to 2.7 and

[jira] [Commented] (MAPREDUCE-6670) TestJobListCache#testEviction sometimes fails on Windows with timeout

[ https://issues.apache.org/jira/browse/MAPREDUCE-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15237511#comment-15237511 ] Junping Du commented on MAPREDUCE-6670: --- Sure. I will backport it to 2.7 and 2.8. >

[jira] [Commented] (MAPREDUCE-6672) TestTeraSort fails on Windows

[ https://issues.apache.org/jira/browse/MAPREDUCE-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15237333#comment-15237333 ] Junping Du commented on MAPREDUCE-6672: --- Thanks for the patch, [~kis...@freemail.hu]. The fix

[jira] [Commented] (MAPREDUCE-6660) Add MR Counters for bytes-read-by-network-distance FileSystem metrics

[ https://issues.apache.org/jira/browse/MAPREDUCE-6660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15233200#comment-15233200 ] Junping Du commented on MAPREDUCE-6660: --- Thanks [~mingma] for delivering the patch! Quickly go

[jira] [Updated] (MAPREDUCE-6670) TestJobListCache#testEviction sometimes fails on Windows with timeout

[ https://issues.apache.org/jira/browse/MAPREDUCE-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6670: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status:

[jira] [Commented] (MAPREDUCE-6670) TestJobListCache#testEviction sometimes fails on Windows with timeout

[ https://issues.apache.org/jira/browse/MAPREDUCE-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15228346#comment-15228346 ] Junping Du commented on MAPREDUCE-6670: --- +1. Will commit it shortly. >

[jira] [Commented] (MAPREDUCE-6670) TestJobListCache#testEviction sometimes fails on Windows with timeout

[ https://issues.apache.org/jira/browse/MAPREDUCE-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15226588#comment-15226588 ] Junping Du commented on MAPREDUCE-6670: --- Thanks [~GergelyNovak] for updating the patch. +1 on

[jira] [Commented] (MAPREDUCE-6670) TestJobListCache#testEviction sometimes fails on Windows with timeout

[ https://issues.apache.org/jira/browse/MAPREDUCE-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15226555#comment-15226555 ] Junping Du commented on MAPREDUCE-6670: --- Thanks [~GergelyNovak] for the patch. Agree that 1000

[jira] [Commented] (MAPREDUCE-5705) mapreduce.task.io.sort.mb hardcoded cap at 2047

[ https://issues.apache.org/jira/browse/MAPREDUCE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15224234#comment-15224234 ] Junping Du commented on MAPREDUCE-5705: --- MAPREDUCE-2308 is a very old JIRA for MRv1 age. Let's

[jira] [Reopened] (MAPREDUCE-5705) mapreduce.task.io.sort.mb hardcoded cap at 2047

[ https://issues.apache.org/jira/browse/MAPREDUCE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reopened MAPREDUCE-5705: --- > mapreduce.task.io.sort.mb hardcoded cap at 2047 >

[jira] [Updated] (MAPREDUCE-6655) Fix a typo (STRICT_IE6) in Encrypted Shuffle

[ https://issues.apache.org/jira/browse/MAPREDUCE-6655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6655: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status:

[jira] [Commented] (MAPREDUCE-6655) Fix a typo (STRICT_IE6) in Encrypted Shuffle

[ https://issues.apache.org/jira/browse/MAPREDUCE-6655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213616#comment-15213616 ] Junping Du commented on MAPREDUCE-6655: --- Patch LGTM. +1. Will commit it shortly. > Fix a typo

[jira] [Commented] (MAPREDUCE-6424) Store MR counters as timeline metrics instead of event

[ https://issues.apache.org/jira/browse/MAPREDUCE-6424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15208571#comment-15208571 ] Junping Du commented on MAPREDUCE-6424: --- Sure. I just assign this JIRA to you. Thanks for

[jira] [Updated] (MAPREDUCE-6424) Store MR counters as timeline metrics instead of event

[ https://issues.apache.org/jira/browse/MAPREDUCE-6424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6424: -- Assignee: Naganarasimha G R (was: Junping Du) > Store MR counters as timeline metrics

[jira] [Commented] (MAPREDUCE-6338) MR AppMaster does not honor ephemeral port range

[ https://issues.apache.org/jira/browse/MAPREDUCE-6338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193346#comment-15193346 ] Junping Du commented on MAPREDUCE-6338: --- It sounds like many ports for RPC client has this issue

[jira] [Commented] (MAPREDUCE-6608) Work Preserving AM Restart for MapReduce

[ https://issues.apache.org/jira/browse/MAPREDUCE-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163297#comment-15163297 ] Junping Du commented on MAPREDUCE-6608: --- bq. Please let me know your recommendation on Issue 1

[jira] [Updated] (MAPREDUCE-6635) Unsafe long to int conversion in UncompressedSplitLineReader and IndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/MAPREDUCE-6635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6635: -- Priority: Critical (was: Major) > Unsafe long to int conversion in

[jira] [Updated] (MAPREDUCE-6635) Unsafe long to int conversion in UncompressedSplitLineReader and IndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/MAPREDUCE-6635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6635: -- Status: Patch Available (was: Open) > Unsafe long to int conversion in

[jira] [Updated] (MAPREDUCE-6635) Unsafe long to int conversion in UncompressedSplitLineReader and IndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/MAPREDUCE-6635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6635: -- Target Version/s: 2.8.0, 2.7.3, 2.6.5 > Unsafe long to int conversion in

[jira] [Updated] (MAPREDUCE-6635) Unsafe long to int conversion in UncompressedSplitLineReader and IndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/MAPREDUCE-6635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6635: -- Attachment: MAPREDUCE-6635.patch Thanks [~sershe] for reporting this issue. Upload a patch

[jira] [Assigned] (MAPREDUCE-6635) Unsafe long to int conversion in UncompressedSplitLineReader and IndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/MAPREDUCE-6635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned MAPREDUCE-6635: - Assignee: Junping Du > Unsafe long to int conversion in UncompressedSplitLineReader

[jira] [Updated] (MAPREDUCE-6621) Memory Leak in JobClient#submitJobInternal()

[ https://issues.apache.org/jira/browse/MAPREDUCE-6621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6621: -- Target Version/s: 2.6.4 > Memory Leak in JobClient#submitJobInternal() >

[jira] [Updated] (MAPREDUCE-6618) YarnClientProtocolProvider leaking the YarnClient thread.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6618: -- Target Version/s: 2.6.4 > YarnClientProtocolProvider leaking the YarnClient thread. >

[jira] [Updated] (MAPREDUCE-6554) MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory

[ https://issues.apache.org/jira/browse/MAPREDUCE-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6554: -- Target Version/s: 2.6.4 > MRAppMaster servicestart failing with NPE in >

[jira] [Updated] (MAPREDUCE-6363) [NNBench] Lease mismatch error when running with multiple mappers

[ https://issues.apache.org/jira/browse/MAPREDUCE-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6363: -- Target Version/s: 2.8.0, 2.6.4 (was: 2.8.0) > [NNBench] Lease mismatch error when running

[jira] [Updated] (MAPREDUCE-5982) Task attempts that fail from the ASSIGNED state can disappear

[ https://issues.apache.org/jira/browse/MAPREDUCE-5982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5982: -- Target Version/s: 2.6.4 > Task attempts that fail from the ASSIGNED state can disappear >

[jira] [Commented] (MAPREDUCE-6595) Fix findbugs warnings in OutputCommitter and FileOutputCommitter

[ https://issues.apache.org/jira/browse/MAPREDUCE-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15121199#comment-15121199 ] Junping Du commented on MAPREDUCE-6595: --- Thanks [~ajisakaa] for reporting the issue and fix it.

[jira] [Updated] (MAPREDUCE-6595) Fix findbugs warnings in OutputCommitter and FileOutputCommitter

[ https://issues.apache.org/jira/browse/MAPREDUCE-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6595: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status:

[jira] [Updated] (MAPREDUCE-6558) multibyte delimiters with compressed input files generate duplicate records

[ https://issues.apache.org/jira/browse/MAPREDUCE-6558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6558: -- Target Version/s: 2.8.0, 2.7.3, 2.6.5 (was: 2.8.0, 2.7.3, 2.6.4) > multibyte delimiters

[jira] [Commented] (MAPREDUCE-6558) multibyte delimiters with compressed input files generate duplicate records

[ https://issues.apache.org/jira/browse/MAPREDUCE-6558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15119968#comment-15119968 ] Junping Du commented on MAPREDUCE-6558: --- Move it to 2.6.5 as 2.6.4 is almost there. > multibyte

[jira] [Updated] (MAPREDUCE-6542) HistoryViewer use SimpleDateFormat,But SimpleDateFormat is not threadsafe

[ https://issues.apache.org/jira/browse/MAPREDUCE-6542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6542: -- Target Version/s: 2.7.3, 2.6.5 (was: 2.7.3, 2.6.4) > HistoryViewer use

[jira] [Commented] (MAPREDUCE-6542) HistoryViewer use SimpleDateFormat,But SimpleDateFormat is not threadsafe

[ https://issues.apache.org/jira/browse/MAPREDUCE-6542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120154#comment-15120154 ] Junping Du commented on MAPREDUCE-6542: --- Sorry for late response, [~piaoyu zhang]. I haven't get

[jira] [Updated] (MAPREDUCE-6492) AsyncDispatcher exit with NPE on TaskAttemptImpl#sendJHStartEventForAssignedFailTask

[ https://issues.apache.org/jira/browse/MAPREDUCE-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6492: -- Target Version/s: 2.6.4 > AsyncDispatcher exit with NPE on >

[jira] [Updated] (MAPREDUCE-6619) HADOOP_CLASSPATH is overwritten in MR container

[ https://issues.apache.org/jira/browse/MAPREDUCE-6619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6619: -- Attachment: MAPREDUCE-6619-branch-2.patch It sounds like MAPREDUCE-6454 only went to

[jira] [Updated] (MAPREDUCE-6619) HADOOP_CLASSPATH is overwritten in MR container

[ https://issues.apache.org/jira/browse/MAPREDUCE-6619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6619: -- Target Version/s: 2.8.0, 2.7.3, 2.6.4 Status: Patch Available (was: Open) >

[jira] [Commented] (MAPREDUCE-6454) MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117460#comment-15117460 ] Junping Du commented on MAPREDUCE-6454: --- MAPREDUCE-6619 is filed to track/fix this issue. Thanks

[jira] [Updated] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5485: -- Fix Version/s: 2.8.0 > Allow repeating job commit by extending OutputCommitter API >

[jira] [Commented] (MAPREDUCE-6608) Work Preserving AM Restart for MapReduce

[ https://issues.apache.org/jira/browse/MAPREDUCE-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105267#comment-15105267 ] Junping Du commented on MAPREDUCE-6608: --- Thanks [~srikanth.sampath] and [~raju.bairishetti] for

[jira] [Moved] (MAPREDUCE-6608) Work Preserving AM Restart for MapReduce

[ https://issues.apache.org/jira/browse/MAPREDUCE-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du moved YARN-3972 to MAPREDUCE-6608: - Key: MAPREDUCE-6608 (was: YARN-3972) Project: Hadoop

[jira] [Commented] (MAPREDUCE-6608) Work Preserving AM Restart for MapReduce

[ https://issues.apache.org/jira/browse/MAPREDUCE-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105251#comment-15105251 ] Junping Du commented on MAPREDUCE-6608: --- Move it to MAPREDUCE project given most work in YARN

[jira] [Commented] (MAPREDUCE-6608) Work Preserving AM Restart for MapReduce

[ https://issues.apache.org/jira/browse/MAPREDUCE-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106139#comment-15106139 ] Junping Du commented on MAPREDUCE-6608: --- bq. I am just thinking that will it be ended up having

[jira] [Updated] (MAPREDUCE-6068) Illegal progress value warnings in map tasks

[ https://issues.apache.org/jira/browse/MAPREDUCE-6068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6068: -- Labels: (was: BB2015-05-RFC) > Illegal progress value warnings in map tasks >

[jira] [Updated] (MAPREDUCE-6068) Illegal progress value warnings in map tasks

[ https://issues.apache.org/jira/browse/MAPREDUCE-6068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6068: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status:

[jira] [Commented] (MAPREDUCE-5718) MR job will fail after commit fail

[ https://issues.apache.org/jira/browse/MAPREDUCE-5718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15092352#comment-15092352 ] Junping Du commented on MAPREDUCE-5718: --- Given MAPREDUCE-5485 is already commit in, shall we

[jira] [Commented] (MAPREDUCE-5982) Task attempts that fail from the ASSIGNED state can disappear

[ https://issues.apache.org/jira/browse/MAPREDUCE-5982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15092535#comment-15092535 ] Junping Du commented on MAPREDUCE-5982: --- Thanks [~jlowe]! > Task attempts that fail from the

[jira] [Commented] (MAPREDUCE-6068) Illegal progress value warnings in map tasks

[ https://issues.apache.org/jira/browse/MAPREDUCE-6068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15091297#comment-15091297 ] Junping Du commented on MAPREDUCE-6068: --- Forget to mention, there is still another place in

[jira] [Commented] (MAPREDUCE-6068) Illegal progress value warnings in map tasks

[ https://issues.apache.org/jira/browse/MAPREDUCE-6068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089172#comment-15089172 ] Junping Du commented on MAPREDUCE-6068: --- 002 patch LGTM. +1. Will commit it shortly. > Illegal

[jira] [Updated] (MAPREDUCE-6577) MR AM unable to load native library without MR_AM_ADMIN_USER_ENV set

[ https://issues.apache.org/jira/browse/MAPREDUCE-6577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6577: -- Target Version/s: 2.6.4 > MR AM unable to load native library without MR_AM_ADMIN_USER_ENV

[jira] [Commented] (MAPREDUCE-5982) Task attempts that fail from the ASSIGNED state can disappear

[ https://issues.apache.org/jira/browse/MAPREDUCE-5982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15080561#comment-15080561 ] Junping Du commented on MAPREDUCE-5982: --- Hi [~jlowe], do you think we should backport the fix to

[jira] [Commented] (MAPREDUCE-6436) JobHistory cache issue

[ https://issues.apache.org/jira/browse/MAPREDUCE-6436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056154#comment-15056154 ] Junping Du commented on MAPREDUCE-6436: --- I think the impact of this issue could be more severe

[jira] [Updated] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5485: -- Release Note: Previously, the MR job will get failed if AM get restarted for some reason

[jira] [Commented] (MAPREDUCE-6549) multibyte delimiters with LineRecordReader cause duplicate records

[ https://issues.apache.org/jira/browse/MAPREDUCE-6549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034114#comment-15034114 ] Junping Du commented on MAPREDUCE-6549: --- Sounds good to have it in 2.6.3. Thanks Jason! >

[jira] [Updated] (MAPREDUCE-6558) multibyte delimiters with compressed input files generate duplicate records

[ https://issues.apache.org/jira/browse/MAPREDUCE-6558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6558: -- Target Version/s: 2.8.0, 2.7.3, 2.6.4 (was: 2.8.0, 2.6.3, 2.7.3) > multibyte delimiters

[jira] [Commented] (MAPREDUCE-6558) multibyte delimiters with compressed input files generate duplicate records

[ https://issues.apache.org/jira/browse/MAPREDUCE-6558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033566#comment-15033566 ] Junping Du commented on MAPREDUCE-6558: --- Thanks [~wilfreds], moving this to 2.6.4. > multibyte

[jira] [Commented] (MAPREDUCE-6549) multibyte delimiters with LineRecordReader cause duplicate records

[ https://issues.apache.org/jira/browse/MAPREDUCE-6549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033565#comment-15033565 ] Junping Du commented on MAPREDUCE-6549: --- Hi [~wilfreds], [~rkanter] and [~jlowe], I noticed that

[jira] [Commented] (MAPREDUCE-6542) HistoryViewer use SimpleDateFormat,But SimpleDateFormat is not threadsafe

[ https://issues.apache.org/jira/browse/MAPREDUCE-6542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033748#comment-15033748 ] Junping Du commented on MAPREDUCE-6542: --- Moving target releases to 2.6.4. > HistoryViewer use

[jira] [Updated] (MAPREDUCE-6542) HistoryViewer use SimpleDateFormat,But SimpleDateFormat is not threadsafe

[ https://issues.apache.org/jira/browse/MAPREDUCE-6542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6542: -- Target Version/s: 2.7.3, 2.6.4 (was: 2.6.3, 2.7.3) > HistoryViewer use

[jira] [Commented] (MAPREDUCE-6542) HistoryViewer use SimpleDateFormat,But SimpleDateFormat is not threadsafe

[ https://issues.apache.org/jira/browse/MAPREDUCE-6542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030116#comment-15030116 ] Junping Du commented on MAPREDUCE-6542: --- Hi, can we move this out of 2.6.3? Thanks! >

[jira] [Updated] (MAPREDUCE-6355) 2.5 client cannot communicate with 2.5 job on 2.6 cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-6355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6355: -- Target Version/s: 2.7.2 (was: 2.7.2, 2.6.3) > 2.5 client cannot communicate with 2.5 job

[jira] [Commented] (MAPREDUCE-6558) multibyte delimiters with compressed input files generate duplicate records

[ https://issues.apache.org/jira/browse/MAPREDUCE-6558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030114#comment-15030114 ] Junping Du commented on MAPREDUCE-6558: --- Hi, can we move this out of 2.6.3? Thanks! > multibyte

[jira] [Updated] (MAPREDUCE-6557) Some tests in mapreduce-client-app are writing outside of target

[ https://issues.apache.org/jira/browse/MAPREDUCE-6557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6557: -- Attachment: MAPREDUCE-6557.004.patch Hi [~ajisakaa], I mark cleanup method as static in 004

[jira] [Commented] (MAPREDUCE-6557) Some tests in mapreduce-client-app are writing outside of target

[ https://issues.apache.org/jira/browse/MAPREDUCE-6557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027059#comment-15027059 ] Junping Du commented on MAPREDUCE-6557: --- Sounds like we are updating patch at the same time. :)

[jira] [Commented] (MAPREDUCE-6557) Some tests in mapreduce-client-app are writing outside of target

[ https://issues.apache.org/jira/browse/MAPREDUCE-6557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027030#comment-15027030 ] Junping Du commented on MAPREDUCE-6557: --- Oh. Forget to mention, test will run failed because

[jira] [Updated] (MAPREDUCE-6557) Some tests in mapreduce-client-app are writing outside of target

[ https://issues.apache.org/jira/browse/MAPREDUCE-6557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6557: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0

[jira] [Commented] (MAPREDUCE-6555) TestMRAppMaster fails on trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027006#comment-15027006 ] Junping Du commented on MAPREDUCE-6555: --- Thanks [~varun_saxena] for reporting it and [~ozawa]

[jira] [Commented] (MAPREDUCE-6557) Some tests in mapreduce-client-app are writing outside of target

[ https://issues.apache.org/jira/browse/MAPREDUCE-6557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027262#comment-15027262 ] Junping Du commented on MAPREDUCE-6557: --- Sure. Thanks for reminding here, [~aw]! > Some tests

[jira] [Commented] (MAPREDUCE-6555) TestMRAppMaster fails on trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026732#comment-15026732 ] Junping Du commented on MAPREDUCE-6555: --- bq. TestMRAppMaster is using directory other than

[jira] [Commented] (MAPREDUCE-6555) TestMRAppMaster fails on trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026767#comment-15026767 ] Junping Du commented on MAPREDUCE-6555: --- bq. I'm checking by running the test case. Please wait

[jira] [Commented] (MAPREDUCE-6557) Some tests in mapreduce-client-app are writing outside of target

[ https://issues.apache.org/jira/browse/MAPREDUCE-6557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026770#comment-15026770 ] Junping Du commented on MAPREDUCE-6557: --- 03 patch LGTM. +1 pending on Jenkins report. > Some

[jira] [Commented] (MAPREDUCE-6557) Some tests in mapreduce-client-app are writing outside of target

[ https://issues.apache.org/jira/browse/MAPREDUCE-6557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026743#comment-15026743 ] Junping Du commented on MAPREDUCE-6557: --- Thanks for the patch, [~ajisakaa]! As I just mentioned

<    1   2   3   4   5   6   7   >