[
https://issues.apache.org/jira/browse/HDFS-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10375:
--
Attachment: (was: HDFS-10375.001.patch)
> Remove redundant TestMiniDFSCluster.testDualClusters
>
[
https://issues.apache.org/jira/browse/HDFS-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10375:
--
Attachment: HDFS-10375.002.patch
> Remove redundant TestMiniDFSCluster.testDualClusters
>
[
https://issues.apache.org/jira/browse/HDFS-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10375:
--
Attachment: HDFS-10375.003.patch
> Remove redundant TestMiniDFSCluster.testDualClusters
>
[
https://issues.apache.org/jira/browse/HDFS-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316964#comment-15316964
]
Jiayi Zhou commented on HDFS-10375:
---
So I only need to git commit again on my local machine?
> Remove
[
https://issues.apache.org/jira/browse/HDFS-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10375:
--
Attachment: HDFS-10375.001.patch
> Remove redundent TestMiniDFSCluster.testDualClusters
>
[
https://issues.apache.org/jira/browse/HDFS-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou reassigned HDFS-10375:
-
Assignee: Jiayi Zhou
> Remove redundent TestMiniDFSCluster.testDualClusters
>
[
https://issues.apache.org/jira/browse/HDFS-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10375:
--
Fix Version/s: 2.8.0
Release Note: Remove redundent TestMiniDFSCluster.testDualClusters to save
[
https://issues.apache.org/jira/browse/HDFS-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10375:
--
Status: Open (was: Patch Available)
> Remove redundent TestMiniDFSCluster.testDualClusters
>
[
https://issues.apache.org/jira/browse/HDFS-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10375:
--
Status: Open (was: Patch Available)
> Remove redundant TestMiniDFSCluster.testDualClusters
>
[
https://issues.apache.org/jira/browse/HDFS-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10375:
--
Status: Patch Available (was: Open)
> Remove redundant TestMiniDFSCluster.testDualClusters
>
[
https://issues.apache.org/jira/browse/HDFS-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10375:
--
Status: Patch Available (was: Open)
> Remove redundant TestMiniDFSCluster.testDualClusters
>
[
https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330013#comment-15330013
]
Jiayi Zhou commented on HDFS-10519:
---
Maybe I got something wrong, but isn't the MetaRecoveryContext
Jiayi Zhou created HDFS-10519:
-
Summary: Add a configuration option to enable in-progress edit log
tailing
Key: HDFS-10519
URL: https://issues.apache.org/jira/browse/HDFS-10519
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10519:
--
Attachment: HDFS-10519.001.patch
> Add a configuration option to enable in-progress edit log tailing
>
[
https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10519:
--
Release Note: Add a configuration option to enable in-progress edit tailing
and a related unit test
[
https://issues.apache.org/jira/browse/HDFS-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317341#comment-15317341
]
Jiayi Zhou commented on HDFS-10375:
---
Hi John, how can I run this Hadoop QA again? I think I have fixed
[
https://issues.apache.org/jira/browse/HDFS-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10375:
--
Attachment: (was: HDFS-10375.003.patch)
> Remove redundant TestMiniDFSCluster.testDualClusters
>
[
https://issues.apache.org/jira/browse/HDFS-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10375:
--
Attachment: HDFS-10375.003.patch
> Remove redundant TestMiniDFSCluster.testDualClusters
>
[
https://issues.apache.org/jira/browse/HDFS-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317410#comment-15317410
]
Jiayi Zhou commented on HDFS-10375:
---
HI've merged them into 1 commit now. How about this new patch 003?
[
https://issues.apache.org/jira/browse/HDFS-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317410#comment-15317410
]
Jiayi Zhou edited comment on HDFS-10375 at 6/6/16 10:31 PM:
I've merged them
[
https://issues.apache.org/jira/browse/HDFS-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10375:
--
Attachment: HDFS-10375.004.patch
> Remove redundant TestMiniDFSCluster.testDualClusters
>
[
https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10519:
--
Attachment: HDFS-10519.002.patch
> Add a configuration option to enable in-progress edit log tailing
>
[
https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou reassigned HDFS-3077:
Assignee: Jiayi Zhou (was: Todd Lipcon)
> Quorum-based protocol for reading and writing edit logs
[
https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-3077:
-
Assignee: (was: Jiayi Zhou)
> Quorum-based protocol for reading and writing edit logs
>
[
https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10519:
--
Attachment: HDFS-10519.011.patch
> Add a configuration option to enable in-progress edit log tailing
>
[
https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10519:
--
Attachment: HDFS-10519.012.patch
> Add a configuration option to enable in-progress edit log tailing
>
[
https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10519:
--
Attachment: HDFS-10519.012.patch
Fix style problems. Failed test is unrelated.
> Add a configuration
[
https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10519:
--
Attachment: (was: HDFS-10519.012.patch)
> Add a configuration option to enable in-progress edit log
[
https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10519:
--
Attachment: (was: HDFS-10519.012.patch)
> Add a configuration option to enable in-progress edit log
[
https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10519:
--
Attachment: HDFS-10519.012.patch
> Add a configuration option to enable in-progress edit log tailing
>
[
https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10519:
--
Attachment: HDFS-10519.004.patch
Add a unit test which I forgot to add in the previous patch.
> Add a
[
https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373773#comment-15373773
]
Jiayi Zhou edited comment on HDFS-10519 at 7/12/16 10:19 PM:
-
Add a unit test
[
https://issues.apache.org/jira/browse/HDFS-10628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378367#comment-15378367
]
Jiayi Zhou commented on HDFS-10628:
---
Versions updated as comment.
> Log HDFS Balancer exit message to
[
https://issues.apache.org/jira/browse/HDFS-10628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10628:
--
Affects Version/s: 2.8.0
Target Version/s: 2.8.0
> Log HDFS Balancer exit message to its own log
>
[
https://issues.apache.org/jira/browse/HDFS-10628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10628:
--
Attachment: HDFS-10628.001.patch
> Log HDFS Balancer exit message to its own log
>
[
https://issues.apache.org/jira/browse/HDFS-10628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10628:
--
Status: Patch Available (was: Open)
Simply log the exit message in Balancer log
> Log HDFS Balancer
Jiayi Zhou created HDFS-10628:
-
Summary: Log HDFS Balancer exit message to its own log
Key: HDFS-10628
URL: https://issues.apache.org/jira/browse/HDFS-10628
Project: Hadoop HDFS
Issue Type:
[
https://issues.apache.org/jira/browse/HDFS-10628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10628:
--
Description: Currently, the exit message is logged to stderr. It would be
more convenient if we also
[
https://issues.apache.org/jira/browse/HDFS-10628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10628:
--
Attachment: HDFS-10628.002.patch
Checkstyle fixed. Failure tests are not related as it's just a simple
[
https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15396027#comment-15396027
]
Jiayi Zhou edited comment on HDFS-10519 at 7/27/16 5:33 PM:
Failed test is
[
https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15396027#comment-15396027
]
Jiayi Zhou commented on HDFS-10519:
---
Failed test is unrelated. It is filed in another jira.
[
https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10519:
--
Attachment: HDFS-10519.010.patch
Fix some style problems. Remove committedTxId check from
[
https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10702:
--
Attachment: HDFS-10702.001.patch
> Add a Client API and Proxy Provider to enable stale read from
[
https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10702:
--
Comment: was deleted
(was: This JIRA gives us a more up-to-date data on Standby NN.)
> Add a Client
[
https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10702:
--
Status: Patch Available (was: Open)
> Add a Client API and Proxy Provider to enable stale read from
[
https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10702:
--
Attachment: StaleReadfromStandbyNN.pdf
HDFS-10702.001.patch
Upload the first patch and
[
https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10702:
--
Attachment: HDFS-10702.001.patch
> Add a Client API and Proxy Provider to enable stale read from
[
https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10702:
--
Attachment: (was: HDFS-10702.001.patch)
> Add a Client API and Proxy Provider to enable stale read
[
https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10702:
--
Attachment: StaleReadfromStandbyNN.pdf
> Add a Client API and Proxy Provider to enable stale read from
Jiayi Zhou created HDFS-10702:
-
Summary: Add a Client API and Proxy Provider to enable stale read
from Standby
Key: HDFS-10702
URL: https://issues.apache.org/jira/browse/HDFS-10702
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10702:
--
Attachment: (was: StaleReadfromStandbyNN.pdf)
> Add a Client API and Proxy Provider to enable stale
[
https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10702:
--
Attachment: (was: HDFS-10702.001.patch)
> Add a Client API and Proxy Provider to enable stale read
[
https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15398345#comment-15398345
]
Jiayi Zhou commented on HDFS-10702:
---
This JIRA gives us a more up-to-date data on Standby NN.
> Add a
[
https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10519:
--
Attachment: HDFS-10519.013.patch
Undo some whitespace changes and update test strings instead of adding
[
https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10519:
--
Attachment: HDFS-10519.006.patch
Also add a boolean flag in Journal for the same purpose.
> Add a
[
https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10519:
--
Attachment: HDFS-10519.005.patch
Fix bugs and checkstyle problems. Add a boolean flag in
[
https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10519:
--
Attachment: HDFS-10519.007.patch
Add a new parameter isTail to selectInputStream() on the NameNode side
[
https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10519:
--
Attachment: HDFS-10519.009.patch
Fix some problems according to Andrew's recent comment.
> Add a
[
https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10519:
--
Attachment: HDFS-10519.008.patch
> Add a configuration option to enable in-progress edit log tailing
>
[
https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385131#comment-15385131
]
Jiayi Zhou commented on HDFS-10519:
---
Thanks Andrew for the review. I have attached a new patch to solve
[
https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10519:
--
Attachment: HDFS-10519.003.patch
Add a fake sendedits to make committed txn id more up-to-date. This
[
https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10702:
--
Attachment: HDFS-10702.003.patch
Fix checkstyle. Some of the style problems are intentionally
[
https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10702:
--
Attachment: HDFS-10702.002.patch
> Add a Client API and Proxy Provider to enable stale read from
[
https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10702:
--
Attachment: (was: HDFS-10702.002.patch)
> Add a Client API and Proxy Provider to enable stale read
[
https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10702:
--
Attachment: HDFS-10702.002.patch
Update a new patch which could apply to trunk.
> Add a Client API and
[
https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10702:
--
Attachment: HDFS-10702.005.patch
> Add a Client API and Proxy Provider to enable stale read from
[
https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15429014#comment-15429014
]
Jiayi Zhou commented on HDFS-10702:
---
Test failed due to an improper default value for StaleBound. Upload
[
https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15428772#comment-15428772
]
Jiayi Zhou commented on HDFS-10702:
---
Upload a path to fix some of the issues commented by Andrew. I
[
https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Zhou updated HDFS-10702:
--
Attachment: HDFS-10702.004.patch
> Add a Client API and Proxy Provider to enable stale read from
[
https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15428772#comment-15428772
]
Jiayi Zhou edited comment on HDFS-10702 at 8/19/16 8:35 PM:
Upload a patch to
70 matches
Mail list logo
