[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14733446#comment-14733446 ]
Kai Sasaki commented on HDFS-8287: ---------------------------------- I updated a patch. In the course of creating {{CompletionService}}, we needed to copy current cell buffer for {{ParityGenerateTask}}. If there are any better way to avoid double using of cell buffer rather than copying, please let me know that. And also this patch does not include unit test code. Should we do a white test of {{ParityGeneratorTask}} and {{writeChunk}} methods which is private from test code? If all we should do is to test the client behaviour, current {{TestDFSStripedOutputStream}} might be sufficient, I think. > DFSStripedOutputStream.writeChunk should not wait for writing parity > --------------------------------------------------------------------- > > Key: HDFS-8287 > URL: https://issues.apache.org/jira/browse/HDFS-8287 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs-client > Reporter: Tsz Wo Nicholas Sze > Assignee: Kai Sasaki > Attachments: HDFS-8287-HDFS-7285.00.patch, > HDFS-8287-HDFS-7285.01.patch, HDFS-8287-HDFS-7285.02.patch, > HDFS-8287-HDFS-7285.03.patch, HDFS-8287-HDFS-7285.04.patch, > HDFS-8287-HDFS-7285.05.patch, HDFS-8287-HDFS-7285.06.patch > > > When a stripping cell is full, writeChunk computes and generates parity > packets. It sequentially calls waitAndQueuePacket so that user client cannot > continue to write data until it finishes. > We should allow user client to continue writing instead but not blocking it > when writing parity. -- This message was sent by Atlassian JIRA (v6.3.4#6332)