[
https://issues.apache.org/jira/browse/HDFS-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373663#comment-15373663
]
Elliott Clark commented on HDFS-10564:
--
It doesn't seem to be working. We have multiple times per day
[
https://issues.apache.org/jira/browse/HDFS-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15362879#comment-15362879
]
Elliott Clark commented on HDFS-10564:
--
Yeah sorry Draining means decommissioning.
> UNDER MIN
Elliott Clark created HDFS-10564:
Summary: UNDER MIN REPL'D BLOCKS should be prioritized for
replication
Key: HDFS-10564
URL: https://issues.apache.org/jira/browse/HDFS-10564
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-9859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313207#comment-15313207
]
Elliott Clark commented on HDFS-9859:
-
That would be great.
> Backport HDFS-6440 to branch-2
>
[
https://issues.apache.org/jira/browse/HDFS-9906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181894#comment-15181894
]
Elliott Clark commented on HDFS-9906:
-
+1
> Remove spammy log spew when a datanode is restarted
>
Elliott Clark created HDFS-9906:
---
Summary: Remove spammy log spew when a datanode is restarted
Key: HDFS-9906
URL: https://issues.apache.org/jira/browse/HDFS-9906
Project: Hadoop HDFS
Issue
[
https://issues.apache.org/jira/browse/HDFS-9859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-9859:
Affects Version/s: 2.8.0
> Backport HDFS-6440 to branch-2
> --
>
>
Elliott Clark created HDFS-9859:
---
Summary: Backport HDFS-6440 to branch-2
Key: HDFS-9859
URL: https://issues.apache.org/jira/browse/HDFS-9859
Project: Hadoop HDFS
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15143279#comment-15143279
]
Elliott Clark commented on HDFS-9669:
-
Nope I just missed it on a pull. Sorry about the confusion.
[
https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15131403#comment-15131403
]
Elliott Clark commented on HDFS-9669:
-
Thanks [~cmccabe] any chance of getting this on branch-2 ?
>
[
https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15116012#comment-15116012
]
Elliott Clark commented on HDFS-9669:
-
Ping?
This is running in production and removes thousands of
[
https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-9669:
Attachment: HDFS-9669.1.patch
> TcpPeerServer should respect ipc.server.listen.queue.size
>
[
https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-9669:
Attachment: HDFS-9669.1.patch
Checkstyle nit.
> TcpPeerServer should respect
[
https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-9669:
Attachment: HDFS-9669.0.patch
Straight forward patch to make sure that all the places that bind use
[
https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark reassigned HDFS-9669:
---
Assignee: Elliott Clark
> TcpPeerServer should respect ipc.server.listen.queue.size
>
[
https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-9669:
Affects Version/s: 2.7.2
Status: Patch Available (was: Open)
> TcpPeerServer should
Elliott Clark created HDFS-9669:
---
Summary: TcpPeerServer should respect ipc.server.listen.queue.size
Key: HDFS-9669
URL: https://issues.apache.org/jira/browse/HDFS-9669
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15086320#comment-15086320
]
Elliott Clark commented on HDFS-6440:
-
+1 for branch-2 please.
> Support more than 2 NameNodes
>
[
https://issues.apache.org/jira/browse/HDFS-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-9087:
Resolution: Fixed
Status: Resolved (was: Patch Available)
This was pushed a while ago.
>
[
https://issues.apache.org/jira/browse/HDFS-9266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-9266:
Summary: Avoid unsafe split and append on fields that might be IPv6
literals (was: hadoop-hdfs -
[
https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971590#comment-14971590
]
Elliott Clark commented on HDFS-9289:
-
It had all of the data and the same md5sums when I checked. So
[
https://issues.apache.org/jira/browse/HDFS-9266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-9266:
Resolution: Fixed
Status: Resolved (was: Patch Available)
> Avoid unsafe split and append
[
https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-9289:
Priority: Critical (was: Major)
> check genStamp when complete file
>
[
https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14969890#comment-14969890
]
Elliott Clark commented on HDFS-9289:
-
We just had this something very similar happen on a prod
[
https://issues.apache.org/jira/browse/HDFS-9266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14969896#comment-14969896
]
Elliott Clark commented on HDFS-9266:
-
+1 lets get this in and then we can rebase on master.
>
[
https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14969933#comment-14969933
]
Elliott Clark commented on HDFS-9289:
-
Also can we add the expected and encountered genstamps to the
[
https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14970213#comment-14970213
]
Elliott Clark commented on HDFS-9289:
-
{code}
15/10/22 09:37:36 INFO BlockStateChange: BLOCK
[
https://issues.apache.org/jira/browse/HDFS-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-8664:
Status: Open (was: Patch Available)
> Allow wildcards in dfs.datanode.data.dir
>
[
https://issues.apache.org/jira/browse/HDFS-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-8664:
Status: Patch Available (was: Open)
> Allow wildcards in dfs.datanode.data.dir
>
[
https://issues.apache.org/jira/browse/HDFS-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-9087:
Attachment: HDFS-9087-v2.patch
> Add some jitter to DataNode.checkDiskErrorThread
>
[
https://issues.apache.org/jira/browse/HDFS-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905189#comment-14905189
]
Elliott Clark commented on HDFS-9087:
-
bq.Do we really need to add this configuration key?
Nope not
[
https://issues.apache.org/jira/browse/HDFS-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-9087:
Attachment: HDFS-9087-v3.patch
> Add some jitter to DataNode.checkDiskErrorThread
>
[
https://issues.apache.org/jira/browse/HDFS-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-9087:
Attachment: HDFS-9087-v1.patch
> Add some jitter to DataNode.checkDiskErrorThread
>
[
https://issues.apache.org/jira/browse/HDFS-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14790740#comment-14790740
]
Elliott Clark commented on HDFS-9087:
-
Yeah HDFS-8845 makes things better however it still is bad to
[
https://issues.apache.org/jira/browse/HDFS-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14790746#comment-14790746
]
Elliott Clark commented on HDFS-9087:
-
On a large enough cluster anything that can thundering herd will
[
https://issues.apache.org/jira/browse/HDFS-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-9087:
Attachment: HDFS-9087-v0.patch
Add 5 seconds of jitter. This has the added benefit of adding more
[
https://issues.apache.org/jira/browse/HDFS-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-9087:
Status: Patch Available (was: Open)
> Add some jitter to DataNode.checkDiskErrorThread
>
[
https://issues.apache.org/jira/browse/HDFS-7492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark resolved HDFS-7492.
-
Resolution: Duplicate
Fixed in HDFS-7531. Since there are no more locks on FsVolumeList there
Elliott Clark created HDFS-9087:
---
Summary: Add some jitter to DataNode.checkDiskErrorThread
Key: HDFS-9087
URL: https://issues.apache.org/jira/browse/HDFS-9087
Project: Hadoop HDFS
Issue Type:
[
https://issues.apache.org/jira/browse/HDFS-7492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14746491#comment-14746491
]
Elliott Clark commented on HDFS-7492:
-
I'm going to grab this one. We're seeing this in production.
[
https://issues.apache.org/jira/browse/HDFS-7492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark reassigned HDFS-7492:
---
Assignee: Elliott Clark
> If multiple threads call FsVolumeList#checkDirs at the same time,
[
https://issues.apache.org/jira/browse/HDFS-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-5274:
Resolution: Fixed
Status: Resolved (was: Patch Available)
Add Tracing to HDFS
[
https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628763#comment-14628763
]
Elliott Clark commented on HDFS-8078:
-
PING?
HDFS client gets errors trying to to
[
https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14592426#comment-14592426
]
Elliott Clark commented on HDFS-8078:
-
+1 (non-binding) on the latest patch.
I agree
[
https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586351#comment-14586351
]
Elliott Clark commented on HDFS-8078:
-
I don't think that a feature branch is really
[
https://issues.apache.org/jira/browse/HDFS-7834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-7834:
Attachment: HDFS-7834-branch-2-0.patch
Here's a patch for branch-2.
Allow HDFS to bind to ipv6
Elliott Clark created HDFS-7834:
---
Summary: Allow HDFS to bind to ipv6 conditionally
Key: HDFS-7834
URL: https://issues.apache.org/jira/browse/HDFS-7834
Project: Hadoop HDFS
Issue Type:
[
https://issues.apache.org/jira/browse/HDFS-7834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-7834:
Affects Version/s: 2.6.0
Fix Version/s: 2.7.0
Allow HDFS to bind to ipv6 conditionally
[
https://issues.apache.org/jira/browse/HDFS-4670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-4670:
Resolution: Won't Fix
Status: Resolved (was: Patch Available)
Style Hadoop HDFS web ui's
[
https://issues.apache.org/jira/browse/HDFS-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13971846#comment-13971846
]
Elliott Clark commented on HDFS-5274:
-
Please don't add htrace-zpikin as a dependency.
[
https://issues.apache.org/jira/browse/HDFS-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13833293#comment-13833293
]
Elliott Clark commented on HDFS-5274:
-
Ping ?
Add Tracing to HDFS
[
https://issues.apache.org/jira/browse/HDFS-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-5274:
Attachment: HDFS-5274-6.patch
Here's a patch that adds annotations for DFSInputStream.seek
Add
[
https://issues.apache.org/jira/browse/HDFS-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-5274:
Attachment: HDFS-5274-4.patch
Here's a lot more rigorous testing.
Add Tracing to HDFS
[
https://issues.apache.org/jira/browse/HDFS-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-5274:
Attachment: Zipkin Trace d0f0d66b8a258a69.png
Another example
Add Tracing to HDFS
[
https://issues.apache.org/jira/browse/HDFS-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-5274:
Attachment: HDFS-5274-5.patch
Add Tracing to HDFS
---
Key:
[
https://issues.apache.org/jira/browse/HDFS-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-5274:
Attachment: Zipkin Trace a06e941b0172ec73.png
Here's an example of what I have currently. I'm
[
https://issues.apache.org/jira/browse/HDFS-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-5274:
Attachment: HDFS-5274-2.patch
Instrumented Sender and Receiver (Though some of those code paths are
[
https://issues.apache.org/jira/browse/HDFS-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-5274:
Attachment: HDFS-5274-3.patch
Fix for tests.
Add Tracing to HDFS
---
[
https://issues.apache.org/jira/browse/HDFS-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-5274:
Affects Version/s: 2.1.1-beta
Status: Patch Available (was: Open)
Add Tracing to
[
https://issues.apache.org/jira/browse/HDFS-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-5274:
Attachment: HDFS-5274-1.patch
WIP path.
This one has testing for the read and write paths started.
Elliott Clark created HDFS-5274:
---
Summary: Add Tracing to HDFS
Key: HDFS-5274
URL: https://issues.apache.org/jira/browse/HDFS-5274
Project: Hadoop HDFS
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/HDFS-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-5274:
Attachment: HDFS-5274-0.patch
Here's an initial implementation of the tracing. Some more
[
https://issues.apache.org/jira/browse/HDFS-4670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13629829#comment-13629829
]
Elliott Clark commented on HDFS-4670:
-
bq.In that case, can you help me understand the
[
https://issues.apache.org/jira/browse/HDFS-4670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13627012#comment-13627012
]
Elliott Clark commented on HDFS-4670:
-
[~azuryy]
I'll have to check but I thought that
Elliott Clark created HDFS-4670:
---
Summary: Style Hadoop HDFS web ui's with Twitter's bootstrap.
Key: HDFS-4670
URL: https://issues.apache.org/jira/browse/HDFS-4670
Project: Hadoop HDFS
Issue
[
https://issues.apache.org/jira/browse/HDFS-4670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13625687#comment-13625687
]
Elliott Clark commented on HDFS-4670:
-
[~adityaacharya] [~andrew.wang] And I have a
[
https://issues.apache.org/jira/browse/HDFS-4670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-4670:
Attachment: HDFS-4670-0.patch
Style Hadoop HDFS web ui's with Twitter's bootstrap.
[
https://issues.apache.org/jira/browse/HDFS-4670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-4670:
Description: A users' first experience of Apache Hadoop is often looking at
the web ui. This
[
https://issues.apache.org/jira/browse/HDFS-4670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-4670:
Status: Patch Available (was: Open)
Style Hadoop HDFS web ui's with Twitter's bootstrap.
[
https://issues.apache.org/jira/browse/HDFS-4670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13625913#comment-13625913
]
Elliott Clark commented on HDFS-4670:
-
Mostly the styling isn't current. The Web ui
[
https://issues.apache.org/jira/browse/HDFS-4670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13626153#comment-13626153
]
Elliott Clark commented on HDFS-4670:
-
This patch has all of the HDFS web ui's
[
https://issues.apache.org/jira/browse/HDFS-4670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-4670:
Attachment: Hadoop NameNode.png
hdfs_browser.png
Hadoop
[
https://issues.apache.org/jira/browse/HDFS-4670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark updated HDFS-4670:
Attachment: HDFS-4670-1.patch
Updated patch to pass tests and findbugs.
Style
73 matches
Mail list logo