[jira] [Updated] (HDFS-9576) HTrace: collect path/offset/length information on read and write operations

2016-01-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9576: Attachment: HDFS-9576.01.patch Updating patch to fix the checkstyle issue. > HTrace: collect

[jira] [Commented] (HDFS-8346) libwebhdfs build fails during link due to unresolved external symbols.

2016-01-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081758#comment-15081758 ] Kihwal Lee commented on HDFS-8346: -- I don't see a point of maintaining libwebhdfs in 2.6 and 2.7. We might

[jira] [Commented] (HDFS-8346) libwebhdfs build fails during link due to unresolved external symbols.

2016-01-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081572#comment-15081572 ] Chris Nauroth commented on HDFS-8346: - bq. This comes to my radar per Kihwal Lee's comments... I see.

[jira] [Updated] (HDFS-9469) DiskBalancer : Add Planner

2016-01-04 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9469: --- Attachment: HDFS-9469-HDFS-1312.005.patch Fix the findbug issue - unused variable. > DiskBalancer :

[jira] [Updated] (HDFS-9445) Datanode may deadlock while handling a bad volume

2016-01-04 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-9445: Attachment: HDFS-9445-branch-2.6.02.patch bq. -1 patch Looks like the name of the patch is not in

[jira] [Commented] (HDFS-9445) Datanode may deadlock while handling a bad volume

2016-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15080845#comment-15080845 ] Hadoop QA commented on HDFS-9445: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8430) Erasure coding: update DFSClient.getFileChecksum() logic for stripe files

2016-01-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15080962#comment-15080962 ] Tsz Wo Nicholas Sze commented on HDFS-8430: --- {quote} > cell checksum (MD5, CRC64 or other

[jira] [Commented] (HDFS-8430) Erasure coding: update DFSClient.getFileChecksum() logic for stripe files

2016-01-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081045#comment-15081045 ] Kai Zheng commented on HDFS-8430: - See. So the cell level checksum instead of the block level one would

[jira] [Updated] (HDFS-9603) Erasure Coding: Use ErasureCoder to encode/decode a block group

2016-01-04 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HDFS-9603: - Attachment: HDFS-9603.1.patch Upload a patch for review. It only changes how we encode data. [~drankye] please let

[jira] [Commented] (HDFS-9607) Advance Hadoop Architecture (AHA) - HDFS

2016-01-04 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081048#comment-15081048 ] Steve Loughran commented on HDFS-9607: -- We have something called the Posix specification to tell us

[jira] [Updated] (HDFS-9603) Erasure Coding: Use ErasureCoder to encode/decode a block group

2016-01-04 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HDFS-9603: - Status: Patch Available (was: Open) > Erasure Coding: Use ErasureCoder to encode/decode a block group >

[jira] [Commented] (HDFS-8430) Erasure coding: update DFSClient.getFileChecksum() logic for stripe files

2016-01-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15080938#comment-15080938 ] Kai Zheng commented on HDFS-8430: - Thanks for the clarifying in details. bq. It sounds good. We may add a

[jira] [Commented] (HDFS-9601) NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block

2016-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15080933#comment-15080933 ] Hadoop QA commented on HDFS-9601: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8430) Erasure coding: update DFSClient.getFileChecksum() logic for stripe files

2016-01-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15080894#comment-15080894 ] Tsz Wo Nicholas Sze commented on HDFS-8430: --- > ... The impact might be big for existing clusters

[jira] [Commented] (HDFS-9469) DiskBalancer : Add Planner

2016-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081931#comment-15081931 ] Hadoop QA commented on HDFS-9469: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9576) HTrace: collect path/offset/length information on read and write operations

2016-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081828#comment-15081828 ] Hadoop QA commented on HDFS-9576: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9469) DiskBalancer : Add Planner

2016-01-04 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081934#comment-15081934 ] Anu Engineer commented on HDFS-9469: Test failures don't seem to be related to this patch. >

[jira] [Created] (HDFS-9611) DiskBalancer : Replace htrace json imports with jackson

2016-01-04 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-9611: -- Summary: DiskBalancer : Replace htrace json imports with jackson Key: HDFS-9611 URL: https://issues.apache.org/jira/browse/HDFS-9611 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-7661) Erasure coding: support hflush and hsync

2016-01-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082062#comment-15082062 ] Zhe Zhang commented on HDFS-7661: - Agreed that "versioning" the parity {{blk_}} files is the most

[jira] [Commented] (HDFS-9403) Erasure coding: some EC tests are missing timeout

2016-01-04 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082069#comment-15082069 ] GAO Rui commented on HDFS-9403: --- It is marked as *Deprecated* in the Junit 4.12 document:

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2016-01-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081991#comment-15081991 ] Chris Trezzo commented on HDFS-8578: Hi [~szetszwo], thanks for the updated patch! One comment so far:

[jira] [Commented] (HDFS-8030) HDFS Erasure Coding Phase II -- EC with contiguous layout

2016-01-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082090#comment-15082090 ] Zhe Zhang commented on HDFS-8030: - Thanks Kai. Yes I think this feature requires a branch. I'll create one

[jira] [Created] (HDFS-9612) DistCp worker threads are not terminated after jobs are done.

2016-01-04 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-9612: - Summary: DistCp worker threads are not terminated after jobs are done. Key: HDFS-9612 URL: https://issues.apache.org/jira/browse/HDFS-9612 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9610) cmake tests don't fail when they should?

2016-01-04 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-9610: --- Attachment: LastTest.log LastTest.log: output of errors. > cmake tests don't fail when they

[jira] [Created] (HDFS-9610) cmake tests don't fail when they should?

2016-01-04 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HDFS-9610: -- Summary: cmake tests don't fail when they should? Key: HDFS-9610 URL: https://issues.apache.org/jira/browse/HDFS-9610 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-9403) Erasure coding: some EC tests are missing timeout

2016-01-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081926#comment-15081926 ] Zhe Zhang commented on HDFS-9403: - Thanks for the update Rui. I don't think we should switch JUnit

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2016-01-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082039#comment-15082039 ] Chris Trezzo commented on HDFS-8578: [~szetszwo] Also, we might want to break this into a few subtasks.

[jira] [Commented] (HDFS-9608) Disk IO imbalance in HDFS with heterogeneous storages

2016-01-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082288#comment-15082288 ] Kai Zheng commented on HDFS-9608: - Thanks Wei for the work. The patch makes sense to me. * In addition to

[jira] [Commented] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

2016-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082328#comment-15082328 ] Hadoop QA commented on HDFS-8344: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9603) Erasure Coding: Use ErasureCoder to encode/decode a block group

2016-01-04 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082210#comment-15082210 ] Rui Li commented on HDFS-9603: -- Thanks Kai for the review. I used the concrete class because we already have

[jira] [Commented] (HDFS-9612) DistCp worker threads are not terminated after jobs are done.

2016-01-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082241#comment-15082241 ] Kai Zheng commented on HDFS-9612: - Oh, the patch is rather messy. You need to update to the latest trunk

[jira] [Updated] (HDFS-9612) DistCp worker threads are not terminated after jobs are done.

2016-01-04 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9612: -- Attachment: HDFS-9612.002.patch I am sorry for not rebasing the patch -- rev02 is a patch

[jira] [Updated] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

2016-01-04 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-8344: --- Attachment: HDFS-8344.10.patch Here's a patch for trunk > NameNode doesn't recover lease for files

[jira] [Updated] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

2016-01-04 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-8344: --- Status: Patch Available (was: Open) > NameNode doesn't recover lease for files with missing blocks >

[jira] [Commented] (HDFS-9603) Erasure Coding: Use ErasureCoder to encode/decode a block group

2016-01-04 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082217#comment-15082217 ] Rui Li commented on HDFS-9603: -- Hi Kai, I got one more question about {{ECBlock}}. I remember you said we're

[jira] [Commented] (HDFS-9603) Erasure Coding: Use ErasureCoder to encode/decode a block group

2016-01-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082223#comment-15082223 ] Kai Zheng commented on HDFS-9603: - bq. I used the concrete class because we already have methods like

[jira] [Commented] (HDFS-7661) Erasure coding: support hflush and hsync

2016-01-04 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082272#comment-15082272 ] Walter Su commented on HDFS-7661: - bq. But, the older parity internal block comes back later, then we have

[jira] [Commented] (HDFS-8430) Erasure coding: update DFSClient.getFileChecksum() logic for stripe files

2016-01-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082130#comment-15082130 ] Kai Zheng commented on HDFS-8430: - Hi [~szetszwo], with a fresh mind I looked at your new algorithms again.

[jira] [Commented] (HDFS-9611) DiskBalancer : Replace htrace json imports with jackson

2016-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082167#comment-15082167 ] Hadoop QA commented on HDFS-9611: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8430) Erasure coding: update DFSClient.getFileChecksum() logic for stripe files

2016-01-04 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082228#comment-15082228 ] Walter Su commented on HDFS-8430: - Thanks [~szetszwo] for clarifying. {{New Algorithm 2}} looks good. And

[jira] [Updated] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

2016-01-04 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9294: --- Attachment: HDFS-9294-branch-2.6.patch > DFSClient deadlock when close file and

[jira] [Commented] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

2016-01-04 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082291#comment-15082291 ] Brahma Reddy Battula commented on HDFS-9294: [~djp] and [~szetszwo] uploaded the branch-2.6

[jira] [Commented] (HDFS-9603) Erasure Coding: Use ErasureCoder to encode/decode a block group

2016-01-04 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082268#comment-15082268 ] Rui Li commented on HDFS-9603: -- Thanks Kai for clarifying! > Erasure Coding: Use ErasureCoder to

[jira] [Commented] (HDFS-7661) Erasure coding: support hflush and hsync

2016-01-04 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082366#comment-15082366 ] GAO Rui commented on HDFS-7661: --- See the {{4. Scenario 4: flush/sync was invoked more than one time in the

[jira] [Commented] (HDFS-7661) Erasure coding: support hflush and hsync

2016-01-04 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082145#comment-15082145 ] GAO Rui commented on HDFS-7661: --- Hi [~zhz], it's a good idea to store the length info in {{.meta}} file.

[jira] [Commented] (HDFS-8346) libwebhdfs build fails during link due to unresolved external symbols.

2016-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082159#comment-15082159 ] Junping Du commented on HDFS-8346: -- So Kihwal, you are preferring to push HDFS-9047 (deprecate/remove

[jira] [Commented] (HDFS-9612) DistCp worker threads are not terminated after jobs are done.

2016-01-04 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082248#comment-15082248 ] Wei-Chiu Chuang commented on HDFS-9612: --- Again, this will likely need more testing to ensure its

[jira] [Updated] (HDFS-9445) Datanode may deadlock while handling a bad volume

2016-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9445: - Resolution: Fixed Fix Version/s: 2.6.4 Status: Resolved (was: Patch Available) I have

[jira] [Commented] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

2016-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081208#comment-15081208 ] Junping Du commented on HDFS-9294: -- Thanks for your confirmation, Nicholas. I tried to cherry-pick to

[jira] [Commented] (HDFS-9603) Erasure Coding: Use ErasureCoder to encode/decode a block group

2016-01-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081090#comment-15081090 ] Kai Zheng commented on HDFS-9603: - Thanks Rui for the nice patch! For this util, {{public static

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages EC schemas

2016-01-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081093#comment-15081093 ] Kai Zheng commented on HDFS-7866: - Hi [~walter.k.su], thanks for your reminding. Yes I was aware the

[jira] [Commented] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

2016-01-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081210#comment-15081210 ] Kihwal Lee commented on HDFS-9220: -- This one goes with HDFS-4660 and HDFS-8722. HDFS-4660 fixed a data

[jira] [Commented] (HDFS-9603) Erasure Coding: Use ErasureCoder to encode/decode a block group

2016-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081148#comment-15081148 ] Hadoop QA commented on HDFS-9603: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9521) TransferFsImage.receiveFile should account and log separate times for image download and fsync to disk

2016-01-04 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082446#comment-15082446 ] Harsh J commented on HDFS-9521: --- Patch's approach looks good to me. Agreed with [~liuml07], that we can keep

[jira] [Commented] (HDFS-9455) In distcp, Invalid Argument Error thrown in case of filesystem operation failure

2016-01-04 Thread Daisuke Kobayashi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082528#comment-15082528 ] Daisuke Kobayashi commented on HDFS-9455: - Thanks. Hmm, with which scenario does it occur? I've

[jira] [Commented] (HDFS-9613) Minor improvement and clean up in distcp

2016-01-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082559#comment-15082559 ] Yongjun Zhang commented on HDFS-9613: - HI [~drankye], Thanks for your work here. I have a question, my

[jira] [Commented] (HDFS-9613) Minor improvement and clean up in distcp

2016-01-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082569#comment-15082569 ] Kai Zheng commented on HDFS-9613: - Hi [~yzhangal], Thanks for your review and good question! My

[jira] [Updated] (HDFS-9613) Minor improvement and clean up in distcp

2016-01-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9613: Status: Patch Available (was: Open) > Minor improvement and clean up in distcp >

[jira] [Updated] (HDFS-9613) Minor improvement and clean up in distcp

2016-01-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9613: Attachment: HDFS-9613-v1.patch Uploaded a patch for the review. Thanks. > Minor improvement and clean up in

[jira] [Commented] (HDFS-8430) Erasure coding: update DFSClient.getFileChecksum() logic for stripe files

2016-01-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082496#comment-15082496 ] Kai Zheng commented on HDFS-8430: - bq. we need a new DataTransferProtocol instead of blockChecksum ... Do

[jira] [Commented] (HDFS-9613) Minor improvement and clean up in distcp

2016-01-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082599#comment-15082599 ] Kai Zheng commented on HDFS-9613: - Hi Yongjun, I have a question in understanding the current codes. When

[jira] [Created] (HDFS-9613) Minor improvement and clean up in distcp

2016-01-04 Thread Kai Zheng (JIRA)
Kai Zheng created HDFS-9613: --- Summary: Minor improvement and clean up in distcp Key: HDFS-9613 URL: https://issues.apache.org/jira/browse/HDFS-9613 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-9613) Minor improvement and clean up in distcp

2016-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082489#comment-15082489 ] Hadoop QA commented on HDFS-9613: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9445) Datanode may deadlock while handling a bad volume

2016-01-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081254#comment-15081254 ] Kihwal Lee commented on HDFS-9445: -- The branch build failure might be related to HDFS-8346. We might want

[jira] [Created] (HDFS-9609) libhfds++: Allow seek to EOF

2016-01-04 Thread Bob Hansen (JIRA)
Bob Hansen created HDFS-9609: Summary: libhfds++: Allow seek to EOF Key: HDFS-9609 URL: https://issues.apache.org/jira/browse/HDFS-9609 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-9192) Add valgrind suppression for statically initialized library objects

2016-01-04 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081289#comment-15081289 ] James Clampffer commented on HDFS-9192: --- I'm marking this as resolved. All of the objects turned out

[jira] [Commented] (HDFS-8346) libwebhdfs build fails during link due to unresolved external symbols.

2016-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081268#comment-15081268 ] Junping Du commented on HDFS-8346: -- Hi [~cnauroth], do we need this fix in branch-2.6/branch-2.7? >

[jira] [Commented] (HDFS-9493) Test o.a.h.hdfs.server.namenode.TestMetaSave fails in trunk

2016-01-04 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081284#comment-15081284 ] Tony Wu commented on HDFS-9493: --- Hi [~eddyxu], Could you take a look at the latest patch (v3) and let me

[jira] [Commented] (HDFS-7163) WebHdfsFileSystem should retry reads according to the configured retry policy.

2016-01-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081251#comment-15081251 ] Kihwal Lee commented on HDFS-7163: -- The build failure is in libwebhdfs native builds. This is in contrib

[jira] [Assigned] (HDFS-9609) libhfds++: Allow seek to EOF

2016-01-04 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen reassigned HDFS-9609: Assignee: Bob Hansen > libhfds++: Allow seek to EOF > > >

[jira] [Updated] (HDFS-9609) libhfds++: Allow seek to EOF

2016-01-04 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9609: - Attachment: HDFS-9609.HDFS-8707.000.patch Patch: allow seeks equal to filesize > libhfds++: Allow seek to

[jira] [Commented] (HDFS-9445) Datanode may deadlock while handling a bad volume

2016-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081272#comment-15081272 ] Junping Du commented on HDFS-9445: -- Thanks [~kihwal] for reminding on this. I have ping Chris on

[jira] [Resolved] (HDFS-9192) Add valgrind suppression for statically initialized library objects

2016-01-04 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer resolved HDFS-9192. --- Resolution: Won't Fix > Add valgrind suppression for statically initialized library objects >

[jira] [Commented] (HDFS-9601) NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block

2016-01-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081320#comment-15081320 ] Kihwal Lee commented on HDFS-9601: -- +1 the patch looks good. Thanks [~iwasakims]. >

[jira] [Commented] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

2016-01-04 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081394#comment-15081394 ] Brahma Reddy Battula commented on HDFS-9294: will upload the patch soon for branch-2.6.. >

[jira] [Updated] (HDFS-9611) DiskBalancer : Replace htrace json imports with jackson

2016-01-04 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9611: --- Attachment: HDFS-9611-HDFS-1312.001.patch > DiskBalancer : Replace htrace json imports with jackson >

[jira] [Updated] (HDFS-9611) DiskBalancer : Replace htrace json imports with jackson

2016-01-04 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9611: --- Status: Patch Available (was: Open) > DiskBalancer : Replace htrace json imports with jackson >

[jira] [Updated] (HDFS-9612) DistCp worker threads are not terminated after jobs are done.

2016-01-04 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9612: -- Attachment: HDFS-9612.001.patch Rev01: In this patch, I created a test case that demonstrates

[jira] [Commented] (HDFS-8346) libwebhdfs build fails during link due to unresolved external symbols.

2016-01-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081463#comment-15081463 ] Chris Nauroth commented on HDFS-8346: - IMO, this is not worthwhile for a backport to branch-2.7 or

[jira] [Commented] (HDFS-8767) RawLocalFileSystem.listStatus() returns null for UNIX pipefile

2016-01-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081460#comment-15081460 ] Chris Nauroth commented on HDFS-8767: - +1 for merging to branch-2.6. It looks like it will be a clean

[jira] [Commented] (HDFS-9600) do not check replication if the block is under construction

2016-01-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081324#comment-15081324 ] Kihwal Lee commented on HDFS-9600: -- bq. I think, its the problem with docker image used to run branch-2.6.

[jira] [Commented] (HDFS-8346) libwebhdfs build fails during link due to unresolved external symbols.

2016-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081516#comment-15081516 ] Junping Du commented on HDFS-8346: -- Thanks Chris for clarification on this. I agree that this is not a