[jira] [Updated] (HDFS-9669) TcpPeerServer should respect ipc.server.listen.queue.size

[ https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9669: --- Resolution: Fixed Fix Version/s: 2.7.3 Target Version/s: 2.7.3

[jira] [Updated] (HDFS-9669) TcpPeerServer should respect ipc.server.listen.queue.size

[ https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9669: --- Issue Type: Improvement (was: Bug) > TcpPeerServer should respect

[jira] [Commented] (HDFS-9700) DFSClient and DFSOutputStream do not respect TCP_NODELAY config in two spots

[ https://issues.apache.org/jira/browse/HDFS-9700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128971#comment-15128971 ] Colin Patrick McCabe commented on HDFS-9700: Good find, [~ghelmling]. bq. [~iwasakims] wrote:

[jira] [Updated] (HDFS-9260) Improve the performance and GC friendliness of NameNode startup and full block reports

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9260: --- Summary: Improve the performance and GC friendliness of NameNode startup and full

[jira] [Commented] (HDFS-9669) TcpPeerServer should respect ipc.server.listen.queue.size

[ https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128789#comment-15128789 ] Colin Patrick McCabe commented on HDFS-9669: +1. Thanks, [~eclark]. > TcpPeerServer should

[jira] [Updated] (HDFS-9260) Improve the performance and GC friendliness of NameNode startup and full block reports

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9260: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-9395) HDFS operations vary widely in which failures they put in the audit log and which they leave out

[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9395: --- Summary: HDFS operations vary widely in which failures they put in the audit log and

[jira] [Updated] (HDFS-9395) HDFS operations vary widely in which failures they put in the audit log and which they leave out

[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9395: --- Description: So, the big question here is what should go in the audit log? All

[jira] [Commented] (HDFS-9395) getContentSummary and other FS operations are audit logged as success even if failed

[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129094#comment-15129094 ] Colin Patrick McCabe commented on HDFS-9395: So, the big question here is what should go in the

[jira] [Comment Edited] (HDFS-9395) HDFS operations vary widely in which failures they put in the audit log and which they leave out

[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129094#comment-15129094 ] Colin Patrick McCabe edited comment on HDFS-9395 at 2/2/16 9:46 PM: So,

[jira] [Comment Edited] (HDFS-9395) HDFS operations vary widely in which failures they put in the audit log and which they leave out

[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15094501#comment-15094501 ] Colin Patrick McCabe edited comment on HDFS-9395 at 2/2/16 9:47 PM:

[jira] [Comment Edited] (HDFS-9395) HDFS operations vary widely in which failures they put in the audit log and which they leave out

[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15094501#comment-15094501 ] Colin Patrick McCabe edited comment on HDFS-9395 at 2/2/16 9:48 PM:

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127238#comment-15127238 ] Colin Patrick McCabe commented on HDFS-9260: Thanks, [~sfriberg]. The unit test failures

[jira] [Commented] (HDFS-8829) Make SO_RCVBUF and SO_SNDBUF size configurable for DataTransferProtocol sockets and allow configuring auto-tuning

[ https://issues.apache.org/jira/browse/HDFS-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127097#comment-15127097 ] Colin Patrick McCabe commented on HDFS-8829: bq. There is one corner cases: Old linux kernels

[jira] [Commented] (HDFS-9446) tSize of libhdfs in hadoop-2.7.1 is still int32_t

[ https://issues.apache.org/jira/browse/HDFS-9446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124454#comment-15124454 ] Colin Patrick McCabe commented on HDFS-9446: The new hdfsStreamBuilder API added in HDFS-9541

[jira] [Comment Edited] (HDFS-9446) tSize of libhdfs in hadoop-2.7.1 is still int32_t

[ https://issues.apache.org/jira/browse/HDFS-9446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032684#comment-15032684 ] Colin Patrick McCabe edited comment on HDFS-9446 at 1/29/16 11:51 PM: --

[jira] [Resolved] (HDFS-9446) tSize of libhdfs in hadoop-2.7.1 is still int32_t

[ https://issues.apache.org/jira/browse/HDFS-9446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-9446. Resolution: Duplicate > tSize of libhdfs in hadoop-2.7.1 is still int32_t >

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124467#comment-15124467 ] Colin Patrick McCabe commented on HDFS-9260: Thanks, [~sfriberg]. {code} 4194

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124260#comment-15124260 ] Colin Patrick McCabe commented on HDFS-9260: Hmm. Let's make the compaction time a tunable,

[jira] [Commented] (HDFS-7764) DirectoryScanner shouldn't abort the scan if one directory had an error

[ https://issues.apache.org/jira/browse/HDFS-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124201#comment-15124201 ] Colin Patrick McCabe commented on HDFS-7764: Thanks for working on this! Sorry that it took a

[jira] [Updated] (HDFS-7764) DirectoryScanner shouldn't abort the scan if one directory had an error

[ https://issues.apache.org/jira/browse/HDFS-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7764: --- Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-9598) Use heap buffer in PacketReceiver If hdfs client has no enough free direct buffer.

[ https://issues.apache.org/jira/browse/HDFS-9598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15122915#comment-15122915 ] Colin Patrick McCabe commented on HDFS-9598: It seems like at least the first time this

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15122898#comment-15122898 ] Colin Patrick McCabe commented on HDFS-9260: Thanks, [~sfriberg]. bq. 7. The reason for

[jira] [Commented] (HDFS-9611) DiskBalancer : Replace htrace json imports with jackson

[ https://issues.apache.org/jira/browse/HDFS-9611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15122875#comment-15122875 ] Colin Patrick McCabe commented on HDFS-9611: Ah. Thanks for clarifying that. > DiskBalancer :

[jira] [Commented] (HDFS-7764) DirectoryScanner shouldn't abort the scan if one directory had an error

[ https://issues.apache.org/jira/browse/HDFS-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15122902#comment-15122902 ] Colin Patrick McCabe commented on HDFS-7764: +1. Thanks, [~rakeshr]. > DirectoryScanner

[jira] [Commented] (HDFS-9610) test_libhdfs_threaded_hdfs_static generates a lot of noise on stderr which looks like a failure even though it isn't

[ https://issues.apache.org/jira/browse/HDFS-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120033#comment-15120033 ] Colin Patrick McCabe commented on HDFS-9610: The cmakebuilder maven plugin always puts stderr

[jira] [Updated] (HDFS-9541) Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB

[ https://issues.apache.org/jira/browse/HDFS-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9541: --- Status: Patch Available (was: In Progress) > Add hdfsStreamBuilder API to libhdfs to

[jira] [Commented] (HDFS-9579) Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level

[ https://issues.apache.org/jira/browse/HDFS-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117815#comment-15117815 ] Colin Patrick McCabe commented on HDFS-9579: Thanks for this patch, [~mingma]. As [~sjlee0]

[jira] [Commented] (HDFS-9598) Use heap buffer in PacketReceiver If hdfs client has no enough free direct buffer.

[ https://issues.apache.org/jira/browse/HDFS-9598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117906#comment-15117906 ] Colin Patrick McCabe commented on HDFS-9598: Hmm. It looks like the code already has a

[jira] [Commented] (HDFS-9541) Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB

[ https://issues.apache.org/jira/browse/HDFS-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117909#comment-15117909 ] Colin Patrick McCabe commented on HDFS-9541: Thanks, [~zhz]. > Add hdfsStreamBuilder API to

[jira] [Commented] (HDFS-9611) DiskBalancer : Replace htrace json imports with jackson

[ https://issues.apache.org/jira/browse/HDFS-9611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117921#comment-15117921 ] Colin Patrick McCabe commented on HDFS-9611: Thanks for this, [~anu]. Just one small

[jira] [Commented] (HDFS-9610) cmake tests don't fail when they should?

[ https://issues.apache.org/jira/browse/HDFS-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117935#comment-15117935 ] Colin Patrick McCabe commented on HDFS-9610: This is not a bug.

[jira] [Commented] (HDFS-9641) IOException in hdfs write process causes file leases not released

[ https://issues.apache.org/jira/browse/HDFS-9641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118023#comment-15118023 ] Colin Patrick McCabe commented on HDFS-9641: This seems like a duplicate of HDFS-4504. >

[jira] [Updated] (HDFS-9610) test_libhdfs_threaded_hdfs_static generates a lot of noise on stderr which looks like a failure even though it isn't

[ https://issues.apache.org/jira/browse/HDFS-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9610: --- Summary: test_libhdfs_threaded_hdfs_static generates a lot of noise on stderr which

[jira] [Commented] (HDFS-9610) test_libhdfs_threaded_hdfs_static generates a lot of noise on stderr which looks like a failure even though it isn't

[ https://issues.apache.org/jira/browse/HDFS-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118129#comment-15118129 ] Colin Patrick McCabe commented on HDFS-9610: Also, the native unit tests in Hadoop include more

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118269#comment-15118269 ] Colin Patrick McCabe commented on HDFS-9260: bq. Should I convert storages field to private?

[jira] [Comment Edited] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118269#comment-15118269 ] Colin Patrick McCabe edited comment on HDFS-9260 at 1/26/16 11:30 PM: --

[jira] [Commented] (HDFS-9663) Optimize some RPC call using lighter weight construct than DatanodeInfo

[ https://issues.apache.org/jira/browse/HDFS-9663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15116634#comment-15116634 ] Colin Patrick McCabe commented on HDFS-9663: Is that stuff actually sent over the wire in every

[jira] [Commented] (HDFS-7694) FSDataInputStream should support "unbuffer"

[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15116622#comment-15116622 ] Colin Patrick McCabe commented on HDFS-7694: Hi, [~djp]. This change is compatible, since

[jira] [Commented] (HDFS-9541) Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB

[ https://issues.apache.org/jira/browse/HDFS-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15113998#comment-15113998 ] Colin Patrick McCabe commented on HDFS-9541: Thanks for the review, [~zhz] bq. Should it be

[jira] [Updated] (HDFS-9541) Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB

[ https://issues.apache.org/jira/browse/HDFS-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9541: --- Attachment: HDFS-9541.002.patch > Add hdfsStreamBuilder API to libhdfs to support

[jira] [Commented] (HDFS-9674) The HTrace span for OpWriteBlock should record the maxWriteToDisk time

[ https://issues.apache.org/jira/browse/HDFS-9674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15112873#comment-15112873 ] Colin Patrick McCabe commented on HDFS-9674: Thanks, [~zhz]. > The HTrace span for

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15112866#comment-15112866 ] Colin Patrick McCabe commented on HDFS-9260: bq. This comment is simply copied from the method

[jira] [Commented] (HDFS-9668) Many long-time BLOCKED threads on FsDatasetImpl in a tiered storage test

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15112852#comment-15112852 ] Colin Patrick McCabe commented on HDFS-9668: I am -1 on creating a new FsDatasetSpi subclass

[jira] [Resolved] (HDFS-8949) hdfsOpenFile() in HDFS C API does not support block sizes larger than 2GB

[ https://issues.apache.org/jira/browse/HDFS-8949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-8949. Resolution: Duplicate Duplicate of HDFS-9541 > hdfsOpenFile() in HDFS C API does

[jira] [Updated] (HDFS-9674) The HTrace span for OpWriteBlock should record the maxWriteToDisk time

[ https://issues.apache.org/jira/browse/HDFS-9674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9674: --- Attachment: HTRACE-9674.001.patch > The HTrace span for OpWriteBlock should record the

[jira] [Updated] (HDFS-9674) The HTrace span for OpWriteBlock should record the maxWriteToDisk time

[ https://issues.apache.org/jira/browse/HDFS-9674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9674: --- Status: Patch Available (was: Open) > The HTrace span for OpWriteBlock should record

[jira] [Created] (HDFS-9674) The HTrace span for OpWriteBlock should record the maxWriteToDisk time

Colin Patrick McCabe created HDFS-9674: -- Summary: The HTrace span for OpWriteBlock should record the maxWriteToDisk time Key: HDFS-9674 URL: https://issues.apache.org/jira/browse/HDFS-9674

[jira] [Commented] (HDFS-9576) HTrace: collect position/length information on read operations

[ https://issues.apache.org/jira/browse/HDFS-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109234#comment-15109234 ] Colin Patrick McCabe commented on HDFS-9576: +1. Thanks, [~zhz]. > HTrace: collect

[jira] [Updated] (HDFS-9576) HTrace: collect position/length information on read operations

[ https://issues.apache.org/jira/browse/HDFS-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9576: --- Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-9668) Many long-time BLOCKED threads on FsDatasetImpl in a tiered storage test

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109821#comment-15109821 ] Colin Patrick McCabe commented on HDFS-9668: The idea seems good. However, I don't understand

[jira] [Commented] (HDFS-9576) HTrace: collect position/length information on read operations

[ https://issues.apache.org/jira/browse/HDFS-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107522#comment-15107522 ] Colin Patrick McCabe commented on HDFS-9576: Thanks, [~zhz]. {code} 993 int retLen =

[jira] [Comment Edited] (HDFS-6255) fuse_dfs will not adhere to ACL permissions in some cases

[ https://issues.apache.org/jira/browse/HDFS-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=13988286#comment-13988286 ] Colin Patrick McCabe edited comment on HDFS-6255 at 1/18/16 11:23 PM: --

[jira] [Commented] (HDFS-7764) DirectoryScanner shouldn't abort the scan if one directory had an error

[ https://issues.apache.org/jira/browse/HDFS-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15101973#comment-15101973 ] Colin Patrick McCabe commented on HDFS-7764: Thanks for working on this, [~rakeshr]. {code} @@

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15102574#comment-15102574 ] Colin Patrick McCabe commented on HDFS-9260: Thanks for working on this, [~sfriberg]. It looks

[jira] [Resolved] (HDFS-3290) Use a better local directory layout for the datanode

[ https://issues.apache.org/jira/browse/HDFS-3290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-3290. Resolution: Duplicate > Use a better local directory layout for the datanode >

[jira] [Updated] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6984: --- Description: FileStatus was a Writable in Hadoop 2 and earlier. Originally, we used

[jira] [Updated] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6984: --- Summary: In Hadoop 3, make FileStatus serialize itself via protobuf (was: In Hadoop

[jira] [Updated] (HDFS-6984) In Hadoop 3, make FileStatus no longer a Writable

[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6984: --- Attachment: HDFS-6984.002.patch I guess making it no longer Writable is probably too

[jira] [Commented] (HDFS-9576) HTrace: collect position/length information on read operations

[ https://issues.apache.org/jira/browse/HDFS-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098791#comment-15098791 ] Colin Patrick McCabe commented on HDFS-9576: bq. So how about only reporting "returned length"

[jira] [Commented] (HDFS-9517) Make TestDistCpUtils.testUnpackAttributes testable

[ https://issues.apache.org/jira/browse/HDFS-9517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15097346#comment-15097346 ] Colin Patrick McCabe commented on HDFS-9517: +1. Thanks, [~jojochuang]. > Make

[jira] [Updated] (HDFS-9517) Fix missing @Test annotation on TestDistCpUtils.testUnpackAttributes

[ https://issues.apache.org/jira/browse/HDFS-9517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9517: --- Summary: Fix missing @Test annotation on TestDistCpUtils.testUnpackAttributes (was:

[jira] [Commented] (HDFS-9466) TestShortCircuitCache#testDataXceiverCleansUpSlotsOnFailure is flaky

[ https://issues.apache.org/jira/browse/HDFS-9466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15097350#comment-15097350 ] Colin Patrick McCabe commented on HDFS-9466: Hmm. Can you be clearer on what the race

[jira] [Updated] (HDFS-9517) Fix missing @Test annotation on TestDistCpUtils.testUnpackAttributes

[ https://issues.apache.org/jira/browse/HDFS-9517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9517: --- Resolution: Fixed Fix Version/s: 2.9.0 Target Version/s: 2.9.0

[jira] [Commented] (HDFS-9576) HTrace: collect position/length information on read operations

[ https://issues.apache.org/jira/browse/HDFS-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15095489#comment-15095489 ] Colin Patrick McCabe commented on HDFS-9576: Cool. This sounds useful for profiling

[jira] [Commented] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15094590#comment-15094590 ] Colin Patrick McCabe commented on HDFS-8562: While it's true that we use {{FileInputStream}} /

[jira] [Commented] (HDFS-9395) getContentSummary is audit logged as success even if failed

[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15094501#comment-15094501 ] Colin Patrick McCabe commented on HDFS-9395: If I understand correctly, the relevant code block

[jira] [Commented] (HDFS-9047) Retire libwebhdfs

[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15093085#comment-15093085 ] Colin Patrick McCabe commented on HDFS-9047: I was on vacation so I couldn't comment earlier.

[jira] [Commented] (HDFS-9466) TestShortCircuitCache#testDataXceiverCleansUpSlotsOnFailure is flaky

[ https://issues.apache.org/jira/browse/HDFS-9466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15092457#comment-15092457 ] Colin Patrick McCabe commented on HDFS-9466: Thanks for looking at this, [~jojochuang]. The

[jira] [Commented] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069932#comment-15069932 ] Colin Patrick McCabe commented on HDFS-8562: Thanks, [~drankye]. bq. I'm worrying about a

[jira] [Commented] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068512#comment-15068512 ] Colin Patrick McCabe commented on HDFS-8562: Thanks, [~drankye]. {code} public void

[jira] [Commented] (HDFS-9589) Block files which have been hardlinked should be duplicated before the DataNode appends to the them

[ https://issues.apache.org/jira/browse/HDFS-9589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068443#comment-15068443 ] Colin Patrick McCabe commented on HDFS-9589: Thanks, [~eddyxu]. The test failures appear to be

[jira] [Updated] (HDFS-9589) Block files which have been hardlinked should be duplicated before the DataNode appends to the them

[ https://issues.apache.org/jira/browse/HDFS-9589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9589: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-9557) Reduce object allocation in PB conversion

[ https://issues.apache.org/jira/browse/HDFS-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066881#comment-15066881 ] Colin Patrick McCabe commented on HDFS-9557: Thanks, [~daryn]. > Reduce object allocation in

[jira] [Comment Edited] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066822#comment-15066822 ] Colin Patrick McCabe edited comment on HDFS-8562 at 12/21/15 6:13 PM: --

[jira] [Commented] (HDFS-7784) load fsimage in parallel

[ https://issues.apache.org/jira/browse/HDFS-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066949#comment-15066949 ] Colin Patrick McCabe commented on HDFS-7784: Thanks, [~kihwal]. Unfortunately, that's what

[jira] [Commented] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066822#comment-15066822 ] Colin Patrick McCabe commented on HDFS-8562: Hi [~drankye], Thanks for looking at this. 003a

[jira] [Commented] (HDFS-9589) Block files which have been hardlinked should be duplicated before the DataNode appends to the them

[ https://issues.apache.org/jira/browse/HDFS-9589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067158#comment-15067158 ] Colin Patrick McCabe commented on HDFS-9589: Thanks to [~eddyxu] and [~twu] for pointing out

[jira] [Updated] (HDFS-9589) Block files which have been hardlinked should be duplicated before the DataNode appends to the them

[ https://issues.apache.org/jira/browse/HDFS-9589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9589: --- Status: Patch Available (was: Open) > Block files which have been hardlinked should

[jira] [Updated] (HDFS-9589) Block files which have been hardlinked should be duplicated before the DataNode appends to the them

[ https://issues.apache.org/jira/browse/HDFS-9589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9589: --- Attachment: HDFS-9589.001.patch > Block files which have been hardlinked should be

[jira] [Created] (HDFS-9589) Block files which have been hardlinked should be duplicated before the DataNode appends to the them

Colin Patrick McCabe created HDFS-9589: -- Summary: Block files which have been hardlinked should be duplicated before the DataNode appends to the them Key: HDFS-9589 URL:

[jira] [Commented] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15064323#comment-15064323 ] Colin Patrick McCabe commented on HDFS-8562: Thanks, [~ywang261]. Is there a bug tracker link

[jira] [Commented] (HDFS-9350) Avoid creating temprorary strings in Block.toString() and getBlockName()

[ https://issues.apache.org/jira/browse/HDFS-9350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15064295#comment-15064295 ] Colin Patrick McCabe commented on HDFS-9350: That makes sense. +1. Thanks, [~sfriberg]. >

[jira] [Updated] (HDFS-9350) Avoid creating temprorary strings in Block.toString() and getBlockName()

[ https://issues.apache.org/jira/browse/HDFS-9350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9350: --- Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-9557) Reduce object allocation in PB conversion

[ https://issues.apache.org/jira/browse/HDFS-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15058611#comment-15058611 ] Colin Patrick McCabe commented on HDFS-9557: +1 pending jenkins. Long-term, I think we might

[jira] [Commented] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15058718#comment-15058718 ] Colin Patrick McCabe commented on HDFS-8562: That's frustrating. Unfortunately, I don't think

[jira] [Comment Edited] (HDFS-9557) Reduce object allocation in PB conversion

[ https://issues.apache.org/jira/browse/HDFS-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15058611#comment-15058611 ] Colin Patrick McCabe edited comment on HDFS-9557 at 12/15/15 8:16 PM: --

[jira] [Commented] (HDFS-9520) PeerCache evicts too frequently causing connection restablishments

[ https://issues.apache.org/jira/browse/HDFS-9520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15058753#comment-15058753 ] Colin Patrick McCabe commented on HDFS-9520: Right. {{dfs.client.socketcache.capacity}} is the

[jira] [Updated] (HDFS-9541) Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB

[ https://issues.apache.org/jira/browse/HDFS-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9541: --- Status: In Progress (was: Patch Available) > Add hdfsStreamBuilder API to libhdfs to

[jira] [Updated] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8562: --- Attachment: HDFS-8562.002.patch > HDFS Performance is impacted by FileInputStream

[jira] [Updated] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8562: --- Status: Patch Available (was: Open) > HDFS Performance is impacted by FileInputStream

[jira] [Updated] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8562: --- Attachment: HDFS-8562.002b.patch > HDFS Performance is impacted by FileInputStream

[jira] [Updated] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8562: --- Attachment: (was: HDFS-8562.002.patch) > HDFS Performance is impacted by

[jira] [Commented] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056755#comment-15056755 ] Colin Patrick McCabe commented on HDFS-8562: HBase keeps open many HDFS files. Because of the

[jira] [Commented] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056403#comment-15056403 ] Colin Patrick McCabe commented on HDFS-7923: We have tested this on large (300 node) clusters.

[jira] [Commented] (HDFS-9281) Change TestDeleteBlockPool to not explicitly use File to check block pool existence.

[ https://issues.apache.org/jira/browse/HDFS-9281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056383#comment-15056383 ] Colin Patrick McCabe commented on HDFS-9281: +1. Thanks, [~eddyxu]. > Change

[jira] [Updated] (HDFS-9541) Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB

[ https://issues.apache.org/jira/browse/HDFS-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9541: --- Affects Version/s: (was: 1.0.0) 0.20.1 Issue

[jira] [Created] (HDFS-9541) Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB

Colin Patrick McCabe created HDFS-9541: -- Summary: Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB Key: HDFS-9541 URL: https://issues.apache.org/jira/browse/HDFS-9541

[jira] [Updated] (HDFS-9541) Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB

[ https://issues.apache.org/jira/browse/HDFS-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9541: --- Status: Patch Available (was: Open) > Add hdfsStreamBuilder API to libhdfs to support

[jira] [Updated] (HDFS-9541) Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB

[ https://issues.apache.org/jira/browse/HDFS-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9541: --- Attachment: HDFS-9541.001.patch > Add hdfsStreamBuilder API to libhdfs to support

<    1   2   3   4   5   6   7   8   9   10   >