[jira] [Commented] (HDFS-4266) BKJM: Separate write and ack quorum
[ https://issues.apache.org/jira/browse/HDFS-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325751#comment-14325751 ] Hudson commented on HDFS-4266: -- FAILURE: Integrated in Hadoop-Yarn-trunk #842 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/842/]) HDFS-4266. BKJM: Separate write and ack quorum (Rakesh R via umamahesh) (umamahesh: rev f0412de1c1d42b3c2a92531f81d97a24df920523) * hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/src/test/java/org/apache/hadoop/contrib/bkjournal/TestBookKeeperJournalManager.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/src/main/java/org/apache/hadoop/contrib/bkjournal/BookKeeperJournalManager.java BKJM: Separate write and ack quorum --- Key: HDFS-4266 URL: https://issues.apache.org/jira/browse/HDFS-4266 Project: Hadoop HDFS Issue Type: Sub-task Components: ha Reporter: Ivan Kelly Assignee: Rakesh R Fix For: 2.7.0 Attachments: 001-HDFS-4266.patch, 002-HDFS-4266.patch, 003-HDFS-4266.patch, 004-HDFS-4266.patch, 005-HDFS-4266.patch BOOKKEEPER-208 allows the ack and write quorums to be different sizes to allow writes to be unaffected by any bookie failure. BKJM should be able to take advantage of this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-4266) BKJM: Separate write and ack quorum
[ https://issues.apache.org/jira/browse/HDFS-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325788#comment-14325788 ] Hudson commented on HDFS-4266: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #108 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/108/]) HDFS-4266. BKJM: Separate write and ack quorum (Rakesh R via umamahesh) (umamahesh: rev f0412de1c1d42b3c2a92531f81d97a24df920523) * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/src/test/java/org/apache/hadoop/contrib/bkjournal/TestBookKeeperJournalManager.java * hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/src/main/java/org/apache/hadoop/contrib/bkjournal/BookKeeperJournalManager.java BKJM: Separate write and ack quorum --- Key: HDFS-4266 URL: https://issues.apache.org/jira/browse/HDFS-4266 Project: Hadoop HDFS Issue Type: Sub-task Components: ha Reporter: Ivan Kelly Assignee: Rakesh R Fix For: 2.7.0 Attachments: 001-HDFS-4266.patch, 002-HDFS-4266.patch, 003-HDFS-4266.patch, 004-HDFS-4266.patch, 005-HDFS-4266.patch BOOKKEEPER-208 allows the ack and write quorums to be different sizes to allow writes to be unaffected by any bookie failure. BKJM should be able to take advantage of this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-4266) BKJM: Separate write and ack quorum
[ https://issues.apache.org/jira/browse/HDFS-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325911#comment-14325911 ] Hudson commented on HDFS-4266: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #99 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/99/]) HDFS-4266. BKJM: Separate write and ack quorum (Rakesh R via umamahesh) (umamahesh: rev f0412de1c1d42b3c2a92531f81d97a24df920523) * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/src/test/java/org/apache/hadoop/contrib/bkjournal/TestBookKeeperJournalManager.java * hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/src/main/java/org/apache/hadoop/contrib/bkjournal/BookKeeperJournalManager.java BKJM: Separate write and ack quorum --- Key: HDFS-4266 URL: https://issues.apache.org/jira/browse/HDFS-4266 Project: Hadoop HDFS Issue Type: Sub-task Components: ha Reporter: Ivan Kelly Assignee: Rakesh R Fix For: 2.7.0 Attachments: 001-HDFS-4266.patch, 002-HDFS-4266.patch, 003-HDFS-4266.patch, 004-HDFS-4266.patch, 005-HDFS-4266.patch BOOKKEEPER-208 allows the ack and write quorums to be different sizes to allow writes to be unaffected by any bookie failure. BKJM should be able to take advantage of this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-4266) BKJM: Separate write and ack quorum
[ https://issues.apache.org/jira/browse/HDFS-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325937#comment-14325937 ] Hudson commented on HDFS-4266: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2040 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/2040/]) HDFS-4266. BKJM: Separate write and ack quorum (Rakesh R via umamahesh) (umamahesh: rev f0412de1c1d42b3c2a92531f81d97a24df920523) * hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/src/test/java/org/apache/hadoop/contrib/bkjournal/TestBookKeeperJournalManager.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/src/main/java/org/apache/hadoop/contrib/bkjournal/BookKeeperJournalManager.java BKJM: Separate write and ack quorum --- Key: HDFS-4266 URL: https://issues.apache.org/jira/browse/HDFS-4266 Project: Hadoop HDFS Issue Type: Sub-task Components: ha Reporter: Ivan Kelly Assignee: Rakesh R Fix For: 2.7.0 Attachments: 001-HDFS-4266.patch, 002-HDFS-4266.patch, 003-HDFS-4266.patch, 004-HDFS-4266.patch, 005-HDFS-4266.patch BOOKKEEPER-208 allows the ack and write quorums to be different sizes to allow writes to be unaffected by any bookie failure. BKJM should be able to take advantage of this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-4266) BKJM: Separate write and ack quorum
[ https://issues.apache.org/jira/browse/HDFS-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14326031#comment-14326031 ] Hudson commented on HDFS-4266: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2059 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2059/]) HDFS-4266. BKJM: Separate write and ack quorum (Rakesh R via umamahesh) (umamahesh: rev f0412de1c1d42b3c2a92531f81d97a24df920523) * hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/src/test/java/org/apache/hadoop/contrib/bkjournal/TestBookKeeperJournalManager.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/src/main/java/org/apache/hadoop/contrib/bkjournal/BookKeeperJournalManager.java BKJM: Separate write and ack quorum --- Key: HDFS-4266 URL: https://issues.apache.org/jira/browse/HDFS-4266 Project: Hadoop HDFS Issue Type: Sub-task Components: ha Reporter: Ivan Kelly Assignee: Rakesh R Fix For: 2.7.0 Attachments: 001-HDFS-4266.patch, 002-HDFS-4266.patch, 003-HDFS-4266.patch, 004-HDFS-4266.patch, 005-HDFS-4266.patch BOOKKEEPER-208 allows the ack and write quorums to be different sizes to allow writes to be unaffected by any bookie failure. BKJM should be able to take advantage of this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-4266) BKJM: Separate write and ack quorum
[ https://issues.apache.org/jira/browse/HDFS-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325998#comment-14325998 ] Hudson commented on HDFS-4266: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #109 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/109/]) HDFS-4266. BKJM: Separate write and ack quorum (Rakesh R via umamahesh) (umamahesh: rev f0412de1c1d42b3c2a92531f81d97a24df920523) * hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/src/main/java/org/apache/hadoop/contrib/bkjournal/BookKeeperJournalManager.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/src/test/java/org/apache/hadoop/contrib/bkjournal/TestBookKeeperJournalManager.java BKJM: Separate write and ack quorum --- Key: HDFS-4266 URL: https://issues.apache.org/jira/browse/HDFS-4266 Project: Hadoop HDFS Issue Type: Sub-task Components: ha Reporter: Ivan Kelly Assignee: Rakesh R Fix For: 2.7.0 Attachments: 001-HDFS-4266.patch, 002-HDFS-4266.patch, 003-HDFS-4266.patch, 004-HDFS-4266.patch, 005-HDFS-4266.patch BOOKKEEPER-208 allows the ack and write quorums to be different sizes to allow writes to be unaffected by any bookie failure. BKJM should be able to take advantage of this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-4266) BKJM: Separate write and ack quorum
[ https://issues.apache.org/jira/browse/HDFS-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325375#comment-14325375 ] Rakesh R commented on HDFS-4266: Thanks a lot [~umamaheswararao] for the reviews and committing the patch. BKJM: Separate write and ack quorum --- Key: HDFS-4266 URL: https://issues.apache.org/jira/browse/HDFS-4266 Project: Hadoop HDFS Issue Type: Sub-task Components: ha Reporter: Ivan Kelly Assignee: Rakesh R Fix For: 2.7.0 Attachments: 001-HDFS-4266.patch, 002-HDFS-4266.patch, 003-HDFS-4266.patch, 004-HDFS-4266.patch, 005-HDFS-4266.patch BOOKKEEPER-208 allows the ack and write quorums to be different sizes to allow writes to be unaffected by any bookie failure. BKJM should be able to take advantage of this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-4266) BKJM: Separate write and ack quorum
[
https://issues.apache.org/jira/browse/HDFS-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14324350#comment-14324350
]
Uma Maheswara Rao G commented on HDFS-4266:
---
BTW, I ran the test to confirm above test failures unrelated.
{noformat}
---
T E S T S
---
Running org.apache.hadoop.contrib.bkjournal.TestBookKeeperAsHASharedDir
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 59.855 sec - in
org.apache.hadoop.contrib.bkjournal.TestBookKeeperAsHASharedDir
Picked up _JAVA_OPTIONS: -Djava.net.preferIPv4Stack=true
Running org.apache.hadoop.contrib.bkjournal.TestBookKeeperConfiguration
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.023 sec - in o
rg.apache.hadoop.contrib.bkjournal.TestBookKeeperConfiguration
Picked up _JAVA_OPTIONS: -Djava.net.preferIPv4Stack=true
Running org.apache.hadoop.contrib.bkjournal.TestBookKeeperEditLogStreams
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.212 sec - in o
rg.apache.hadoop.contrib.bkjournal.TestBookKeeperEditLogStreams
Picked up _JAVA_OPTIONS: -Djava.net.preferIPv4Stack=true
Running org.apache.hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 123.727 sec - in
org.apache.hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints
Picked up _JAVA_OPTIONS: -Djava.net.preferIPv4Stack=true
Running org.apache.hadoop.contrib.bkjournal.TestBookKeeperJournalManager
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.647 sec - in
org.apache.hadoop.contrib.bkjournal.TestBookKeeperJournalManager
Picked up _JAVA_OPTIONS: -Djava.net.preferIPv4Stack=true
Running org.apache.hadoop.contrib.bkjournal.TestBookKeeperSpeculativeRead
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.643 sec - in
org.apache.hadoop.contrib.bkjournal.TestBookKeeperSpeculativeRead
Picked up _JAVA_OPTIONS: -Djava.net.preferIPv4Stack=true
Running org.apache.hadoop.contrib.bkjournal.TestBootstrapStandbyWithBKJM
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.036 sec - in
org.apache.hadoop.contrib.bkjournal.TestBootstrapStandbyWithBKJM
Picked up _JAVA_OPTIONS: -Djava.net.preferIPv4Stack=true
Running org.apache.hadoop.contrib.bkjournal.TestCurrentInprogress
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.782 sec - in o
rg.apache.hadoop.contrib.bkjournal.TestCurrentInprogress
Picked up _JAVA_OPTIONS: -Djava.net.preferIPv4Stack=true
Results :
Tests run: 38, Failures: 0, Errors: 0, Skipped: 0
{noformat}
BKJM: Separate write and ack quorum
---
Key: HDFS-4266
URL: https://issues.apache.org/jira/browse/HDFS-4266
Project: Hadoop HDFS
Issue Type: Sub-task
Components: ha
Reporter: Ivan Kelly
Assignee: Rakesh R
Attachments: 001-HDFS-4266.patch, 002-HDFS-4266.patch,
003-HDFS-4266.patch, 004-HDFS-4266.patch, 005-HDFS-4266.patch
BOOKKEEPER-208 allows the ack and write quorums to be different sizes to
allow writes to be unaffected by any bookie failure. BKJM should be able to
take advantage of this.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-4266) BKJM: Separate write and ack quorum
[ https://issues.apache.org/jira/browse/HDFS-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14324348#comment-14324348 ] Uma Maheswara Rao G commented on HDFS-4266: --- +1 Latest patch looks good to me. BKJM: Separate write and ack quorum --- Key: HDFS-4266 URL: https://issues.apache.org/jira/browse/HDFS-4266 Project: Hadoop HDFS Issue Type: Sub-task Components: ha Reporter: Ivan Kelly Assignee: Rakesh R Attachments: 001-HDFS-4266.patch, 002-HDFS-4266.patch, 003-HDFS-4266.patch, 004-HDFS-4266.patch, 005-HDFS-4266.patch BOOKKEEPER-208 allows the ack and write quorums to be different sizes to allow writes to be unaffected by any bookie failure. BKJM should be able to take advantage of this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-4266) BKJM: Separate write and ack quorum
[ https://issues.apache.org/jira/browse/HDFS-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14324379#comment-14324379 ] Hudson commented on HDFS-4266: -- FAILURE: Integrated in Hadoop-trunk-Commit #7127 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/7127/]) HDFS-4266. BKJM: Separate write and ack quorum (Rakesh R via umamahesh) (umamahesh: rev f0412de1c1d42b3c2a92531f81d97a24df920523) * hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/src/main/java/org/apache/hadoop/contrib/bkjournal/BookKeeperJournalManager.java * hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/src/test/java/org/apache/hadoop/contrib/bkjournal/TestBookKeeperJournalManager.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt BKJM: Separate write and ack quorum --- Key: HDFS-4266 URL: https://issues.apache.org/jira/browse/HDFS-4266 Project: Hadoop HDFS Issue Type: Sub-task Components: ha Reporter: Ivan Kelly Assignee: Rakesh R Fix For: 2.7.0 Attachments: 001-HDFS-4266.patch, 002-HDFS-4266.patch, 003-HDFS-4266.patch, 004-HDFS-4266.patch, 005-HDFS-4266.patch BOOKKEEPER-208 allows the ack and write quorums to be different sizes to allow writes to be unaffected by any bookie failure. BKJM should be able to take advantage of this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-4266) BKJM: Separate write and ack quorum
[ https://issues.apache.org/jira/browse/HDFS-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14322400#comment-14322400 ] Rakesh R commented on HDFS-4266: It seems test case failure is not related to this patch. [~umamaheswararao] could you please have a look at the latest patch. Thanks! BKJM: Separate write and ack quorum --- Key: HDFS-4266 URL: https://issues.apache.org/jira/browse/HDFS-4266 Project: Hadoop HDFS Issue Type: Sub-task Components: ha Reporter: Ivan Kelly Assignee: Rakesh R Attachments: 001-HDFS-4266.patch, 002-HDFS-4266.patch, 003-HDFS-4266.patch, 004-HDFS-4266.patch, 005-HDFS-4266.patch BOOKKEEPER-208 allows the ack and write quorums to be different sizes to allow writes to be unaffected by any bookie failure. BKJM should be able to take advantage of this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-4266) BKJM: Separate write and ack quorum
[
https://issues.apache.org/jira/browse/HDFS-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321397#comment-14321397
]
Hadoop QA commented on HDFS-4266:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12698899/004-HDFS-4266.patch
against trunk revision 6804d68.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in
hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal:
org.apache.hadoop.contrib.bkjournal.TestBookKeeperJournalManager
Test results:
https://builds.apache.org/job/PreCommit-HDFS-Build/9584//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9584//console
This message is automatically generated.
BKJM: Separate write and ack quorum
---
Key: HDFS-4266
URL: https://issues.apache.org/jira/browse/HDFS-4266
Project: Hadoop HDFS
Issue Type: Sub-task
Components: ha
Reporter: Ivan Kelly
Assignee: Rakesh R
Attachments: 001-HDFS-4266.patch, 002-HDFS-4266.patch,
003-HDFS-4266.patch, 004-HDFS-4266.patch
BOOKKEEPER-208 allows the ack and write quorums to be different sizes to
allow writes to be unaffected by any bookie failure. BKJM should be able to
take advantage of this.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-4266) BKJM: Separate write and ack quorum
[
https://issues.apache.org/jira/browse/HDFS-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321703#comment-14321703
]
Hadoop QA commented on HDFS-4266:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12698916/005-HDFS-4266.patch
against trunk revision ef950ea.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in
hadoop-hdfs-project/hadoop-hdfs:
org.apache.hadoop.hdfs.server.namenode.ha.TestBootstrapStandby
org.apache.hadoop.hdfs.TestEncryptionZonesWithKMS
org.apache.hadoop.hdfs.TestGetBlocks
The following test timeouts occurred in
hadoop-hdfs-project/hadoop-hdfs:
org.apache.hadoop.hdfs.server.namenode.TestFSDirectory
Test results:
https://builds.apache.org/job/PreCommit-HDFS-Build/9585//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9585//console
This message is automatically generated.
BKJM: Separate write and ack quorum
---
Key: HDFS-4266
URL: https://issues.apache.org/jira/browse/HDFS-4266
Project: Hadoop HDFS
Issue Type: Sub-task
Components: ha
Reporter: Ivan Kelly
Assignee: Rakesh R
Attachments: 001-HDFS-4266.patch, 002-HDFS-4266.patch,
003-HDFS-4266.patch, 004-HDFS-4266.patch, 005-HDFS-4266.patch
BOOKKEEPER-208 allows the ack and write quorums to be different sizes to
allow writes to be unaffected by any bookie failure. BKJM should be able to
take advantage of this.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-4266) BKJM: Separate write and ack quorum
[ https://issues.apache.org/jira/browse/HDFS-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066305#comment-14066305 ] Ivan Kelly commented on HDFS-4266: -- That would work. BKJM: Separate write and ack quorum --- Key: HDFS-4266 URL: https://issues.apache.org/jira/browse/HDFS-4266 Project: Hadoop HDFS Issue Type: Sub-task Components: ha Reporter: Ivan Kelly Assignee: Rakesh R Attachments: 001-HDFS-4266.patch, 002-HDFS-4266.patch BOOKKEEPER-208 allows the ack and write quorums to be different sizes to allow writes to be unaffected by any bookie failure. BKJM should be able to take advantage of this. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HDFS-4266) BKJM: Separate write and ack quorum
[ https://issues.apache.org/jira/browse/HDFS-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066353#comment-14066353 ] Rakesh R commented on HDFS-4266: Attached latest patch addressing the comments. Please have a look at it. Thanks! BKJM: Separate write and ack quorum --- Key: HDFS-4266 URL: https://issues.apache.org/jira/browse/HDFS-4266 Project: Hadoop HDFS Issue Type: Sub-task Components: ha Reporter: Ivan Kelly Assignee: Rakesh R Attachments: 001-HDFS-4266.patch, 002-HDFS-4266.patch, 003-HDFS-4266.patch BOOKKEEPER-208 allows the ack and write quorums to be different sizes to allow writes to be unaffected by any bookie failure. BKJM should be able to take advantage of this. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HDFS-4266) BKJM: Separate write and ack quorum
[ https://issues.apache.org/jira/browse/HDFS-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066357#comment-14066357 ] Ivan Kelly commented on HDFS-4266: -- lgtm + 1 BKJM: Separate write and ack quorum --- Key: HDFS-4266 URL: https://issues.apache.org/jira/browse/HDFS-4266 Project: Hadoop HDFS Issue Type: Sub-task Components: ha Reporter: Ivan Kelly Assignee: Rakesh R Attachments: 001-HDFS-4266.patch, 002-HDFS-4266.patch, 003-HDFS-4266.patch BOOKKEEPER-208 allows the ack and write quorums to be different sizes to allow writes to be unaffected by any bookie failure. BKJM should be able to take advantage of this. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HDFS-4266) BKJM: Separate write and ack quorum
[
https://issues.apache.org/jira/browse/HDFS-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066379#comment-14066379
]
Hadoop QA commented on HDFS-4266:
-
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12656509/003-HDFS-4266.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-HDFS-Build/7385//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7385//console
This message is automatically generated.
BKJM: Separate write and ack quorum
---
Key: HDFS-4266
URL: https://issues.apache.org/jira/browse/HDFS-4266
Project: Hadoop HDFS
Issue Type: Sub-task
Components: ha
Reporter: Ivan Kelly
Assignee: Rakesh R
Attachments: 001-HDFS-4266.patch, 002-HDFS-4266.patch,
003-HDFS-4266.patch
BOOKKEEPER-208 allows the ack and write quorums to be different sizes to
allow writes to be unaffected by any bookie failure. BKJM should be able to
take advantage of this.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HDFS-4266) BKJM: Separate write and ack quorum
[ https://issues.apache.org/jira/browse/HDFS-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064990#comment-14064990 ] Rakesh R commented on HDFS-4266: Yes [~ikelly], you are right. I think setting BookKeeper's 'addEntryTimeoutSec' to a higher value will avoid this ensemble reformation and will make the test case more reliable. What do you feel? BKJM: Separate write and ack quorum --- Key: HDFS-4266 URL: https://issues.apache.org/jira/browse/HDFS-4266 Project: Hadoop HDFS Issue Type: Sub-task Components: ha Reporter: Ivan Kelly Assignee: Rakesh R Attachments: 001-HDFS-4266.patch, 002-HDFS-4266.patch BOOKKEEPER-208 allows the ack and write quorums to be different sizes to allow writes to be unaffected by any bookie failure. BKJM should be able to take advantage of this. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HDFS-4266) BKJM: Separate write and ack quorum
[ https://issues.apache.org/jira/browse/HDFS-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057654#comment-14057654 ] Ivan Kelly commented on HDFS-4266: -- Looks good to me, but the test could be a little flakey as it seems to rely on the fact that it will finish before the client socket read timeout triggers, which would cause the client to try to replace the sleeping bookie, and then fail because it can't build an ensemble. This behaviour is something we plan to change (if you have ack quorum, the client shouldn't fail) but we haven't done so yet. BKJM: Separate write and ack quorum --- Key: HDFS-4266 URL: https://issues.apache.org/jira/browse/HDFS-4266 Project: Hadoop HDFS Issue Type: Sub-task Components: ha Reporter: Ivan Kelly Assignee: Rakesh R Attachments: 001-HDFS-4266.patch, 002-HDFS-4266.patch BOOKKEEPER-208 allows the ack and write quorums to be different sizes to allow writes to be unaffected by any bookie failure. BKJM should be able to take advantage of this. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HDFS-4266) BKJM: Separate write and ack quorum
[
https://issues.apache.org/jira/browse/HDFS-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14056313#comment-14056313
]
Rakesh R commented on HDFS-4266:
Thanks [~ikelly] for the review.
bq.The patch makes an ack quorum mandatory. This breaks existing configs. The
ack quorum should default to the write quorum, if the configuration is missing.
Hdfs configuration will return the 'quorumSize' if the configuration is missing.
{code}
ackQuorumSize = conf.getInt(BKJM_BOOKKEEPER_ACK_QUORUM_SIZE, quorumSize);
{code}
I've included test case to verify this behavior. Could you have a look at the
latest patch.Thanks!
BKJM: Separate write and ack quorum
---
Key: HDFS-4266
URL: https://issues.apache.org/jira/browse/HDFS-4266
Project: Hadoop HDFS
Issue Type: Sub-task
Components: ha
Reporter: Ivan Kelly
Assignee: Rakesh R
Attachments: 001-HDFS-4266.patch, 002-HDFS-4266.patch
BOOKKEEPER-208 allows the ack and write quorums to be different sizes to
allow writes to be unaffected by any bookie failure. BKJM should be able to
take advantage of this.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HDFS-4266) BKJM: Separate write and ack quorum
[
https://issues.apache.org/jira/browse/HDFS-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14056326#comment-14056326
]
Hadoop QA commented on HDFS-4266:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12654811/002-HDFS-4266.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:red}-1 javac{color:red}. The patch appears to cause the build to
fail.
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7303//console
This message is automatically generated.
BKJM: Separate write and ack quorum
---
Key: HDFS-4266
URL: https://issues.apache.org/jira/browse/HDFS-4266
Project: Hadoop HDFS
Issue Type: Sub-task
Components: ha
Reporter: Ivan Kelly
Assignee: Rakesh R
Attachments: 001-HDFS-4266.patch, 002-HDFS-4266.patch
BOOKKEEPER-208 allows the ack and write quorums to be different sizes to
allow writes to be unaffected by any bookie failure. BKJM should be able to
take advantage of this.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HDFS-4266) BKJM: Separate write and ack quorum
[ https://issues.apache.org/jira/browse/HDFS-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13713821#comment-13713821 ] Ivan Kelly commented on HDFS-4266: -- The patch makes an ack quorum mandatory. This breaks existing configs. The ack quorum should default to the write quorum, if the configuration is missing. BKJM: Separate write and ack quorum --- Key: HDFS-4266 URL: https://issues.apache.org/jira/browse/HDFS-4266 Project: Hadoop HDFS Issue Type: Sub-task Components: ha Reporter: Ivan Kelly Assignee: Rakesh R Attachments: 001-HDFS-4266.patch BOOKKEEPER-208 allows the ack and write quorums to be different sizes to allow writes to be unaffected by any bookie failure. BKJM should be able to take advantage of this. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
