[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303287#comment-15303287 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- If we do have the check for stale storages

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303272#comment-15303272 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- I looked into why the test

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334862#comment-15334862 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- Failed tests don't seem to be introduced by

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347427#comment-15347427 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- Thanks for the review Colin. I have addressed

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: HDFS-10301.007.patch > BlockReport retransmissions may lead to

[jira] [Assigned] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi reassigned HDFS-10301: Assignee: Vinitha Reddy Gankidi (was: Colin Patrick McCabe) > BlockReport

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: HDFS-10301.006.patch > BlockReport retransmissions may lead to

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15333146#comment-15333146 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- I uploaded another patch (006) that is

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: HDFS-10301.004.patch > BlockReport retransmissions may lead to

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297563#comment-15297563 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- I uploaded the patch HDFS-10301.004.patch. I

[jira] [Assigned] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi reassigned HDFS-10301: Assignee: Vinitha Reddy Gankidi (was: Colin Patrick McCabe) > BlockReport

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297526#comment-15297526 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- Assigning the ticket to myself so that I can

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299255#comment-15299255 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- Thanks for your review [~cmccabe]. By legacy

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400179#comment-15400179 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- Added a patch for branch-2.7. > BlockReport

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: HDFS-10301.branch-2.7.patch > BlockReport retransmissions may lead to

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15402734#comment-15402734 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- [~ebadger] Thanks for reporting this.

[jira] [Updated] (HDFS-10712) Fix TestDataNodeVolumeFailure on 2.* branches.

[ https://issues.apache.org/jira/browse/HDFS-10712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10712: - Attachment: HDFS-10712.001.patch > Fix TestDataNodeVolumeFailure on 2.* branches.

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416357#comment-15416357 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- [~daryn] That is a good suggestion. Zombies

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375518#comment-15375518 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- I apologize for attaching a wrong patch.

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: HDFS-10301.008.patch > BlockReport retransmissions may lead to

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386922#comment-15386922 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- Thanks for the review [~liuml07]. I have

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: HDFS-10301.012.patch > BlockReport retransmissions may lead to

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15382959#comment-15382959 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- Attached a new patch (009) addressing

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: HDFS-10301.009.patch > BlockReport retransmissions may lead to

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383224#comment-15383224 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- I have made STORAGE_REPORT {{static final}}

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: HDFS-10301.010.patch > BlockReport retransmissions may lead to

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384611#comment-15384611 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- > For example, an RPC could have gotten

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: HDFS-10301.011.patch > BlockReport retransmissions may lead to

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384955#comment-15384955 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- Patch 011 fixes the two checkstyle issues and

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: HDFS-10301.013.patch > BlockReport retransmissions may lead to

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15410364#comment-15410364 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- The real problem is the state associated with

[jira] [Updated] (HDFS-10712) Fix TestDataNodeVolumeFailure on 2.* branches.

[ https://issues.apache.org/jira/browse/HDFS-10712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10712: - Attachment: HDFS-10712.001.patch > Fix TestDataNodeVolumeFailure on 2.* branches.

[jira] [Commented] (HDFS-10712) Fix TestDataNodeVolumeFailure on 2.* branches.

[ https://issues.apache.org/jira/browse/HDFS-10712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15402938#comment-15402938 ] Vinitha Reddy Gankidi commented on HDFS-10712: -- Done. > Fix TestDataNodeVolumeFailure on 2.*

[jira] [Updated] (HDFS-10712) Fix TestDataNodeVolumeFailure on 2.* branches.

[ https://issues.apache.org/jira/browse/HDFS-10712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10712: - Attachment: HDFS-10712.branch-2.patch > Fix TestDataNodeVolumeFailure on 2.*

[jira] [Commented] (HDFS-10712) Fix TestDataNodeVolumeFailure on 2.* branches.

[ https://issues.apache.org/jira/browse/HDFS-10712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15402881#comment-15402881 ] Vinitha Reddy Gankidi commented on HDFS-10712: -- [~shv] I have attached a patch. Can you

[jira] [Updated] (HDFS-10712) Fix TestDataNodeVolumeFailure on 2.* branches.

[ https://issues.apache.org/jira/browse/HDFS-10712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10712: - Attachment: HDFS-10712.branch-2.7.patch > Fix TestDataNodeVolumeFailure on 2.*

[jira] [Updated] (HDFS-10712) Fix TestDataNodeVolumeFailure on 2.* branches.

[ https://issues.apache.org/jira/browse/HDFS-10712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10712: - Attachment: (was: HDFS-10712.001.patch) > Fix TestDataNodeVolumeFailure on

[jira] [Updated] (HDFS-10712) Fix TestDataNodeVolumeFailure on 2.* branches.

[ https://issues.apache.org/jira/browse/HDFS-10712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10712: - Attachment: (was: HDFS-10712.001.patch) > Fix TestDataNodeVolumeFailure on

[jira] [Assigned] (HDFS-10712) Fix TestDataNodeVolumeFailure on 2.* branches.

[ https://issues.apache.org/jira/browse/HDFS-10712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi reassigned HDFS-10712: Assignee: Vinitha Reddy Gankidi > Fix TestDataNodeVolumeFailure on 2.*

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427460#comment-15427460 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- Thanks [~shv] for summarizing how zombies can

[jira] [Commented] (HDFS-10814) Add assertion for getNumEncryptionZones when no EZ is created

[ https://issues.apache.org/jira/browse/HDFS-10814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449598#comment-15449598 ] Vinitha Reddy Gankidi commented on HDFS-10814: -- Thanks Zhe and Andrew! > Add assertion for

[jira] [Commented] (HDFS-10809) getNumEncryptionZones causes NPE in branch-2.7

[ https://issues.apache.org/jira/browse/HDFS-10809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449841#comment-15449841 ] Vinitha Reddy Gankidi commented on HDFS-10809: -- Thanks [~zhz]. I could not reproduce the test

[jira] [Updated] (HDFS-10809) getNumEncryptionZones causes NPE in branch-2.7

[ https://issues.apache.org/jira/browse/HDFS-10809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10809: - Attachment: HDFS-10809.001.patch > getNumEncryptionZones causes NPE in branch-2.7

[jira] [Commented] (HDFS-10809) getNumEncryptionZones causes NPE in branch-2.7

[ https://issues.apache.org/jira/browse/HDFS-10809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447449#comment-15447449 ] Vinitha Reddy Gankidi commented on HDFS-10809: -- [~zhz] I have uploaded a patch. Please take a

[jira] [Updated] (HDFS-10814) Add assertion for getNumEncryptionZones when no EZ is created

[ https://issues.apache.org/jira/browse/HDFS-10814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10814: - Attachment: HDFS-10814.001.patch > Add assertion for getNumEncryptionZones when

[jira] [Updated] (HDFS-10809) getNumEncryptionZones causes NPE in branch-2.7

[ https://issues.apache.org/jira/browse/HDFS-10809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10809: - Attachment: HDFS-10809-branch-2.7.001.patch > getNumEncryptionZones causes NPE in

[jira] [Assigned] (HDFS-10814) Add assertion for getNumEncryptionZones when no EZ is created

[ https://issues.apache.org/jira/browse/HDFS-10814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi reassigned HDFS-10814: Assignee: Vinitha Reddy Gankidi > Add assertion for getNumEncryptionZones

[jira] [Created] (HDFS-10814) Add assertion for getNumEncryptionZones when no EZ is created

Vinitha Reddy Gankidi created HDFS-10814: Summary: Add assertion for getNumEncryptionZones when no EZ is created Key: HDFS-10814 URL: https://issues.apache.org/jira/browse/HDFS-10814 Project:

[jira] [Updated] (HDFS-10809) getNumEncryptionZones causes NPE in branch-2.7

[ https://issues.apache.org/jira/browse/HDFS-10809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10809: - Attachment: (was: HDFS-10809.001.patch) > getNumEncryptionZones causes NPE in

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491142#comment-15491142 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- [~arpiagariu] Storage reports are anyway

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485884#comment-15485884 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- Upon thorough investigation of heartbeat

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: HDFS-10301.014.patch > BlockReport retransmissions may lead to

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485956#comment-15485956 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- [~arpiagariu] In the latest patch, BR lease

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15495211#comment-15495211 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- [~jingzhao] ??Then can this cover DN hotswap

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15518131#comment-15518131 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- i) When BRs are split into multiple RPCS: Say

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15517992#comment-15517992 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- Why do we need to detect the last-report? I

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: HDFS-10301.015.patch > BlockReport retransmissions may lead to

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546390#comment-15546390 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- Patch 15 has the changes mentioned in

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546645#comment-15546645 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- The test failure seems unrelated. It passes

[jira] [Commented] (HDFS-8028) TestNNHandlesBlockReportPerStorage/TestNNHandlesCombinedBlockReport Failed after patched HDFS-7704

[ https://issues.apache.org/jira/browse/HDFS-8028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556846#comment-15556846 ] Vinitha Reddy Gankidi commented on HDFS-8028: - These tests fail on branch 2-7 after HDFS-7704

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504561#comment-15504561 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- [~arpiagariu] I understand that we may

[jira] [Assigned] (HDFS-10733) NameNode terminated after full GC thinking QJM is unresponsive.

[ https://issues.apache.org/jira/browse/HDFS-10733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi reassigned HDFS-10733: Assignee: Vinitha Reddy Gankidi > NameNode terminated after full GC

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: HDFS-10301.branch-2.7.015.patch > BlockReport retransmissions may

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583534#comment-15583534 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- Attached the patch for branch-2.7. >

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: (was: HDFS-10301.015.patch) > BlockReport retransmissions may

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572936#comment-15572936 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- Updated the patch. The conflict was due to a

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: (was: HDFS-10301.016.patch) > BlockReport retransmissions may

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: HDFS-10301.015.patch > BlockReport retransmissions may lead to

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: HDFS-10301.016.patch > BlockReport retransmissions may lead to

[jira] [Commented] (HDFS-10712) Fix TestDataNodeVolumeFailure on 2.* branches.

[ https://issues.apache.org/jira/browse/HDFS-10712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15575943#comment-15575943 ] Vinitha Reddy Gankidi commented on HDFS-10712: -- [~shv] Somehow lost track of this one. Can

[jira] [Updated] (HDFS-10733) NameNode terminated after full GC thinking QJM is unresponsive.

[ https://issues.apache.org/jira/browse/HDFS-10733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10733: - Attachment: HDFS-10733.002.patch > NameNode terminated after full GC thinking QJM

[jira] [Commented] (HDFS-10733) NameNode terminated after full GC thinking QJM is unresponsive.

[ https://issues.apache.org/jira/browse/HDFS-10733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816705#comment-15816705 ] Vinitha Reddy Gankidi commented on HDFS-10733: -- [~shv] I agree. Attached a new patch with

[jira] [Updated] (HDFS-10733) NameNode terminated after full GC thinking QJM is unresponsive.

[ https://issues.apache.org/jira/browse/HDFS-10733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10733: - Status: Patch Available (was: Open) > NameNode terminated after full GC thinking

[jira] [Commented] (HDFS-11313) Segmented Block Reports

[ https://issues.apache.org/jira/browse/HDFS-11313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816933#comment-15816933 ] Vinitha Reddy Gankidi commented on HDFS-11313: -- [~shv] This idea seems promising. I would

[jira] [Commented] (HDFS-10733) NameNode terminated after full GC thinking QJM is unresponsive.

[ https://issues.apache.org/jira/browse/HDFS-10733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812538#comment-15812538 ] Vinitha Reddy Gankidi commented on HDFS-10733: -- [~kihwal] Thanks for the great suggestion.

[jira] [Updated] (HDFS-10733) NameNode terminated after full GC thinking QJM is unresponsive.

[ https://issues.apache.org/jira/browse/HDFS-10733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10733: - Attachment: HDFS-10733.001.patch > NameNode terminated after full GC thinking QJM

[jira] [Commented] (HDFS-11313) Segmented Block Reports

[ https://issues.apache.org/jira/browse/HDFS-11313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15941294#comment-15941294 ] Vinitha Reddy Gankidi commented on HDFS-11313: -- Assigning it to myself. Will attach a design

[jira] [Assigned] (HDFS-11313) Segmented Block Reports

[ https://issues.apache.org/jira/browse/HDFS-11313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi reassigned HDFS-11313: Assignee: Vinitha Reddy Gankidi > Segmented Block Reports >

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949593#comment-15949593 ] Vinitha Reddy Gankidi commented on HDFS-11384: -- Two other approaches to fix this: 1. In

[jira] [Comment Edited] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949757#comment-15949757 ] Vinitha Reddy Gankidi edited comment on HDFS-11384 at 3/30/17 8:36 PM:

[jira] [Comment Edited] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949757#comment-15949757 ] Vinitha Reddy Gankidi edited comment on HDFS-11384 at 3/30/17 8:36 PM:

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949757#comment-15949757 ] Vinitha Reddy Gankidi commented on HDFS-11384: -- If we were to offload the calls to DN,

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949978#comment-15949978 ] Vinitha Reddy Gankidi commented on HDFS-11384: -- [~shv] I'm leaning towards reading from (4)

[jira] [Comment Edited] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949978#comment-15949978 ] Vinitha Reddy Gankidi edited comment on HDFS-11384 at 3/30/17 10:29 PM:

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963707#comment-15963707 ] Vinitha Reddy Gankidi commented on HDFS-11384: -- [~shv] The delay logic looks good to me. It

[jira] [Updated] (HDFS-11313) Segmented Block Reports

[ https://issues.apache.org/jira/browse/HDFS-11313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-11313: - Attachment: SegmentedBlockReports.pdf > Segmented Block Reports >

[jira] [Commented] (HDFS-11313) Segmented Block Reports

[ https://issues.apache.org/jira/browse/HDFS-11313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965511#comment-15965511 ] Vinitha Reddy Gankidi commented on HDFS-11313: -- Attached the design doc. Please take a look.

[jira] [Commented] (HDFS-11634) Optimize BlockIterator when interating starts in the middle.

[ https://issues.apache.org/jira/browse/HDFS-11634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15966967#comment-15966967 ] Vinitha Reddy Gankidi commented on HDFS-11634: -- It's a good improvement. One minor nit:

[jira] [Assigned] (HDFS-11808) Backport HDFS-8549 to branch-2.7: Abort the balancer if an upgrade is in progress

[ https://issues.apache.org/jira/browse/HDFS-11808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi reassigned HDFS-11808: Assignee: (was: Vinitha Reddy Gankidi) > Backport HDFS-8549 to

[jira] [Created] (HDFS-11808) Backport HDFS-8549 to branch-2.7: Abort the balancer if an upgrade is in progress

Vinitha Reddy Gankidi created HDFS-11808: Summary: Backport HDFS-8549 to branch-2.7: Abort the balancer if an upgrade is in progress Key: HDFS-11808 URL: https://issues.apache.org/jira/browse/HDFS-11808

[jira] [Commented] (HDFS-11838) Backport HDFS-7990 to branch-2.7: IBR delete ack should not be delayed

[ https://issues.apache.org/jira/browse/HDFS-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015059#comment-16015059 ] Vinitha Reddy Gankidi commented on HDFS-11838: -- Good catch. Thanks Konstantin. Attached a new

[jira] [Updated] (HDFS-11838) Backport HDFS-7990 to branch-2.7: IBR delete ack should not be delayed

[ https://issues.apache.org/jira/browse/HDFS-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-11838: - Attachment: HDFS-7990-branch-2.7.01.patch > Backport HDFS-7990 to branch-2.7: IBR

[jira] [Updated] (HDFS-11838) Backport HDFS-7990 to branch-2.7: IBR delete ack should not be delayed

[ https://issues.apache.org/jira/browse/HDFS-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-11838: - Status: Patch Available (was: Open) > Backport HDFS-7990 to branch-2.7: IBR

[jira] [Commented] (HDFS-11837) Backport HDFS-9710 to branch-2.7: Change DN to send block receipt IBRs in batches

[ https://issues.apache.org/jira/browse/HDFS-11837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013604#comment-16013604 ] Vinitha Reddy Gankidi commented on HDFS-11837: -- This patch depends on two other patches that

[jira] [Updated] (HDFS-11838) Backport HDFS-7990 to branch-2.7: IBR delete ack should not be delayed

[ https://issues.apache.org/jira/browse/HDFS-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-11838: - Attachment: HDFS-7990-branch-2.7.00.patch > Backport HDFS-7990 to branch-2.7: IBR

[jira] [Commented] (HDFS-11838) Backport HDFS-7990 to branch-2.7: IBR delete ack should not be delayed

[ https://issues.apache.org/jira/browse/HDFS-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013623#comment-16013623 ] Vinitha Reddy Gankidi commented on HDFS-11838: -- [~shv] Please review the patch > Backport

[jira] [Created] (HDFS-11837) Backport HDFS-9710 to branch-2.7: Change DN to send block receipt IBRs in batches

Vinitha Reddy Gankidi created HDFS-11837: Summary: Backport HDFS-9710 to branch-2.7: Change DN to send block receipt IBRs in batches Key: HDFS-11837 URL: https://issues.apache.org/jira/browse/HDFS-11837

[jira] [Updated] (HDFS-11837) Backport HDFS-9710 to branch-2.7: Change DN to send block receipt IBRs in batches

[ https://issues.apache.org/jira/browse/HDFS-11837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-11837: - Description: As per discussussion in [mailling

[jira] [Created] (HDFS-11839) Backport HDFS-9726 to branch-2.7: Refactor IBR code to a new class

Vinitha Reddy Gankidi created HDFS-11839: Summary: Backport HDFS-9726 to branch-2.7: Refactor IBR code to a new class Key: HDFS-11839 URL: https://issues.apache.org/jira/browse/HDFS-11839

[jira] [Created] (HDFS-11838) Backport HDFS-7990 to branch-2.7: IBR delete ack should not be delayed

Vinitha Reddy Gankidi created HDFS-11838: Summary: Backport HDFS-7990 to branch-2.7: IBR delete ack should not be delayed Key: HDFS-11838 URL: https://issues.apache.org/jira/browse/HDFS-11838

  1   2   >