[jira] [Commented] (MAPREDUCE-6638) Jobs with encrypted spills don't recover if the AM goes down

[ https://issues.apache.org/jira/browse/MAPREDUCE-6638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436245#comment-15436245 ] Hadoop QA commented on MAPREDUCE-6638: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (MAPREDUCE-6754) Container Ids for an yarn application should be monotonically increasing in the scope of the application

[ https://issues.apache.org/jira/browse/MAPREDUCE-6754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436220#comment-15436220 ] Jian He commented on MAPREDUCE-6754: Thanks for the feedback, Jason, Vinod. I think we can add a

[jira] [Updated] (MAPREDUCE-6638) Jobs with encrypted spills don't recover if the AM goes down

[ https://issues.apache.org/jira/browse/MAPREDUCE-6638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6638: -- Status: Patch Available (was: Open) > Jobs with encrypted spills don't recover if the AM

[jira] [Updated] (MAPREDUCE-6638) Jobs with encrypted spills don't recover if the AM goes down

[ https://issues.apache.org/jira/browse/MAPREDUCE-6638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6638: -- Attachment: mapreduce6638.002.patch Uploading a new patch to address the unit test failure

[jira] [Updated] (MAPREDUCE-6638) Jobs with encrypted spills don't recover if the AM goes down

[ https://issues.apache.org/jira/browse/MAPREDUCE-6638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6638: -- Status: Open (was: Patch Available) > Jobs with encrypted spills don't recover if the AM

[jira] [Commented] (MAPREDUCE-6767) TestSlive fails after a common change

[ https://issues.apache.org/jira/browse/MAPREDUCE-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436138#comment-15436138 ] Hudson commented on MAPREDUCE-6767: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10340

[jira] [Commented] (MAPREDUCE-6754) Container Ids for an yarn application should be monotonically increasing in the scope of the application

[ https://issues.apache.org/jira/browse/MAPREDUCE-6754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436130#comment-15436130 ] Vinod Kumar Vavilapalli commented on MAPREDUCE-6754: bq. Approach A: Include

[jira] [Updated] (MAPREDUCE-6767) TestSlive fails after a common change

[ https://issues.apache.org/jira/browse/MAPREDUCE-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated MAPREDUCE-6767: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Updated] (MAPREDUCE-6767) TestSlive fails after a common change

[ https://issues.apache.org/jira/browse/MAPREDUCE-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated MAPREDUCE-6767: - Target Version/s: 3.0.0-alpha1 > TestSlive fails after a common change >

[jira] [Commented] (MAPREDUCE-6767) TestSlive fails after a common change

[ https://issues.apache.org/jira/browse/MAPREDUCE-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436103#comment-15436103 ] Akira Ajisaka commented on MAPREDUCE-6767: -- LGTM, +1 > TestSlive fails after a common change

[jira] [Commented] (MAPREDUCE-6767) TestSlive fails after a common change

[ https://issues.apache.org/jira/browse/MAPREDUCE-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436073#comment-15436073 ] Hadoop QA commented on MAPREDUCE-6767: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (MAPREDUCE-6767) TestSlive fails after a common change

[ https://issues.apache.org/jira/browse/MAPREDUCE-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435883#comment-15435883 ] Daniel Templeton commented on MAPREDUCE-6767: - Oops. Thanks, [~chris.douglas]. >

[jira] [Commented] (MAPREDUCE-6638) Jobs with encrypted spills don't recover if the AM goes down

[ https://issues.apache.org/jira/browse/MAPREDUCE-6638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435876#comment-15435876 ] Hadoop QA commented on MAPREDUCE-6638: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (MAPREDUCE-6767) TestSlive fails after a common change

[ https://issues.apache.org/jira/browse/MAPREDUCE-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-6767: - Status: Patch Available (was: Open) > TestSlive fails after a common change >

[jira] [Comment Edited] (MAPREDUCE-6765) MR should not schedule container requests in cases where reducer or mapper containers demand resource larger than the maximum supported

[ https://issues.apache.org/jira/browse/MAPREDUCE-6765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435862#comment-15435862 ] Haibo Chen edited comment on MAPREDUCE-6765 at 8/24/16 10:42 PM: -

[jira] [Commented] (MAPREDUCE-6765) MR should not schedule container requests in cases where reducer or mapper containers demand resource larger than the maximum supported

[ https://issues.apache.org/jira/browse/MAPREDUCE-6765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435862#comment-15435862 ] Haibo Chen commented on MAPREDUCE-6765: --- Tested it on a pseudo-distributed cluster, ran a pi

[jira] [Updated] (MAPREDUCE-6638) Jobs with encrypted spills don't recover if the AM goes down

[ https://issues.apache.org/jira/browse/MAPREDUCE-6638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6638: -- Status: Patch Available (was: Open) > Jobs with encrypted spills don't recover if the AM

[jira] [Updated] (MAPREDUCE-6638) Jobs with encrypted spills don't recover if the AM goes down

[ https://issues.apache.org/jira/browse/MAPREDUCE-6638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6638: -- Attachment: mapreduce6638.001.patch The patch skips recovery if spill encryption is enabled

[jira] [Updated] (MAPREDUCE-6767) TestSlive fails after a common change

[ https://issues.apache.org/jira/browse/MAPREDUCE-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated MAPREDUCE-6767: Attachment: MAPREDUCE-6767.001.patch This resolves the Slive failures. >

[jira] [Assigned] (MAPREDUCE-6767) TestSlive fails after a common change

[ https://issues.apache.org/jira/browse/MAPREDUCE-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned MAPREDUCE-6767: --- Assignee: Daniel Templeton > TestSlive fails after a common change >

[jira] [Commented] (MAPREDUCE-6767) TestSlive fails after a common change

[ https://issues.apache.org/jira/browse/MAPREDUCE-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435706#comment-15435706 ] Kihwal Lee commented on MAPREDUCE-6767: --- E.g.

[jira] [Commented] (MAPREDUCE-6501) Improve reducer preemption

[ https://issues.apache.org/jira/browse/MAPREDUCE-6501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435690#comment-15435690 ] Haibo Chen commented on MAPREDUCE-6501: --- Task 2 is already implemented with taskAttemptProgress,

[jira] [Commented] (MAPREDUCE-6767) TestSlive fails after a common change

[ https://issues.apache.org/jira/browse/MAPREDUCE-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435619#comment-15435619 ] Daniel Templeton commented on MAPREDUCE-6767: - Any details you can give? > TestSlive

[jira] [Updated] (MAPREDUCE-6767) TestSlive fails after a common change

[ https://issues.apache.org/jira/browse/MAPREDUCE-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated MAPREDUCE-6767: -- Description: It looks like this was broken after HADOOP-12726. > TestSlive fails after a

[jira] [Created] (MAPREDUCE-6767) TestSlive fails after a common change

Kihwal Lee created MAPREDUCE-6767: - Summary: TestSlive fails after a common change Key: MAPREDUCE-6767 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6767 Project: Hadoop Map/Reduce

[jira] [Commented] (MAPREDUCE-6765) MR should not schedule container requests in cases where reducer or mapper containers demand resource larger than the maximum supported

[ https://issues.apache.org/jira/browse/MAPREDUCE-6765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435547#comment-15435547 ] Hadoop QA commented on MAPREDUCE-6765: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (MAPREDUCE-6765) MR should not schedule container requests in cases where reducer or mapper containers demand resource larger than the maximum supported

[ https://issues.apache.org/jira/browse/MAPREDUCE-6765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6765: -- Status: Patch Available (was: Open) > MR should not schedule container requests in cases

[jira] [Updated] (MAPREDUCE-6765) MR should not schedule container requests in cases where reducer or mapper containers demand resource larger than the maximum supported

[ https://issues.apache.org/jira/browse/MAPREDUCE-6765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6765: -- Attachment: mapreduce6765.001.patch The patch is trivial. In cases where the resource

[jira] [Commented] (MAPREDUCE-6765) MR should not schedule container requests in cases where reducer or mapper containers demand resource larger than the maximum supported

[ https://issues.apache.org/jira/browse/MAPREDUCE-6765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435334#comment-15435334 ] Haibo Chen commented on MAPREDUCE-6765: --- Not a 100% sure, it seems that you'll have to be added

[jira] [Commented] (MAPREDUCE-6754) Container Ids for an yarn application should be monotonically increasing in the scope of the application

[ https://issues.apache.org/jira/browse/MAPREDUCE-6754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435248#comment-15435248 ] Jason Lowe commented on MAPREDUCE-6754: --- I don't understand the concern about changing the

[jira] [Updated] (MAPREDUCE-6766) Concurrent local job failures due to uniqueNumberGenerator = new AtomicLong(System.currentTimeMillis())

[ https://issues.apache.org/jira/browse/MAPREDUCE-6766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark S updated MAPREDUCE-6766: -- Summary: Concurrent local job failures due to uniqueNumberGenerator = new

[jira] [Created] (MAPREDUCE-6766) Concurrent Local Job Failures due to uniqueNumberGenerator = new AtomicLong(System.currentTimeMillis())

Mark S created MAPREDUCE-6766: - Summary: Concurrent Local Job Failures due to uniqueNumberGenerator = new AtomicLong(System.currentTimeMillis()) Key: MAPREDUCE-6766 URL:

[jira] [Updated] (MAPREDUCE-6766) Concurrent Local Job Failures due to uniqueNumberGenerator = new AtomicLong(System.currentTimeMillis())

[ https://issues.apache.org/jira/browse/MAPREDUCE-6766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark S updated MAPREDUCE-6766: -- Affects Version/s: 2.7.1 > Concurrent Local Job Failures due to uniqueNumberGenerator = new >

[jira] [Commented] (MAPREDUCE-6761) Regression when handling providers - invalid configuration ServiceConfiguration causes Cluster initialization failure

[ https://issues.apache.org/jira/browse/MAPREDUCE-6761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435071#comment-15435071 ] Hudson commented on MAPREDUCE-6761: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10337

[jira] [Updated] (MAPREDUCE-6761) Regression when handling providers - invalid configuration ServiceConfiguration causes Cluster initialization failure

[ https://issues.apache.org/jira/browse/MAPREDUCE-6761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6761: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status:

[jira] [Commented] (MAPREDUCE-6578) Add support for HDFS heterogeneous storage testing to TestDFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435030#comment-15435030 ] Hudson commented on MAPREDUCE-6578: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10336

[jira] [Commented] (MAPREDUCE-6628) Potential memory leak in CryptoOutputStream

[ https://issues.apache.org/jira/browse/MAPREDUCE-6628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435024#comment-15435024 ] Mariappan Asokan commented on MAPREDUCE-6628: - The test failures seem to be unrelated to

[jira] [Commented] (MAPREDUCE-6578) Add support for HDFS heterogeneous storage testing to TestDFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435019#comment-15435019 ] Kai Zheng commented on MAPREDUCE-6578: -- Please ignore the above messy building message. It

[jira] [Updated] (MAPREDUCE-6578) Add support for HDFS heterogeneous storage testing to TestDFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated MAPREDUCE-6578: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha1

[jira] [Commented] (MAPREDUCE-6578) Add support for HDFS heterogeneous storage testing to TestDFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435005#comment-15435005 ] Hadoop QA commented on MAPREDUCE-6578: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (MAPREDUCE-6578) Add support for HDFS heterogeneous storage testing to TestDFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated MAPREDUCE-6578: - Attachment: MAPREDUCE-6578.04.patch This fixed the minor style. > Add support for HDFS

[jira] [Commented] (MAPREDUCE-6578) Add support for HDFS heterogeneous storage testing to TestDFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434999#comment-15434999 ] Kai Zheng commented on MAPREDUCE-6578: -- +1 on the updated patch except the minor style. Will

[jira] [Commented] (MAPREDUCE-6578) Add support for HDFS heterogeneous storage testing to TestDFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434807#comment-15434807 ] Hadoop QA commented on MAPREDUCE-6578: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (MAPREDUCE-6578) Add support for HDFS heterogeneous storage testing to TestDFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434646#comment-15434646 ] SammiChen commented on MAPREDUCE-6578: -- Thanks Kai's suggestion. If the user input

[jira] [Updated] (MAPREDUCE-6578) Add support for HDFS heterogeneous storage testing to TestDFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated MAPREDUCE-6578: - Attachment: MAPREDUCE-6578.03.patch Uploading the updated patch provided by [~Sammi]. Thanks!

[jira] [Commented] (MAPREDUCE-6754) Container Ids for an yarn application should be monotonically increasing in the scope of the application

[ https://issues.apache.org/jira/browse/MAPREDUCE-6754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434421#comment-15434421 ] Jian He commented on MAPREDUCE-6754: Hi [~jlowe], mind help shedding some light on this ? any