[
https://issues.apache.org/jira/browse/HDDS-9659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17784347#comment-17784347
]
Attila Doroszlai edited comment on HDDS-9659 at 11/9/23 10:14 AM:
------------------------------------------------------------------
Other possible intermittent failure in same test:
{code}
java.lang.NullPointerException
at
org.apache.hadoop.ozone.client.io.ECBlockOutputStreamEntry.calculateChecksum(ECBlockOutputStreamEntry.java:412)
at
org.apache.hadoop.ozone.client.io.ECKeyOutputStream.commitStripeWrite(ECKeyOutputStream.java:266)
at
org.apache.hadoop.ozone.client.io.ECKeyOutputStream.flushStripeToDatanodes(ECKeyOutputStream.java:585)
at
org.apache.hadoop.ozone.client.io.ECKeyOutputStream.flushStripeFromQueue(ECKeyOutputStream.java:567)
{code}
This can happen because
[{{checkStream()}}|https://github.com/apache/ozone/blob/1cf54f34af36b65ff5a59a8a4749d138f9b8f283/hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/io/ECBlockOutputStreamEntry.java#L92-L105]
exposes {{blockOutputStreams}} array with {{null}} entries before creating
entries in a loop. It should create a local array, then set
{{blockOutputStreams}} after creating all streams.
It may also happen if stream with index=0 is not created during re-try.
was (Author: adoroszlai):
Other possible intermittent failure in same test:
{code}
java.lang.NullPointerException
at
org.apache.hadoop.ozone.client.io.ECBlockOutputStreamEntry.calculateChecksum(ECBlockOutputStreamEntry.java:412)
at
org.apache.hadoop.ozone.client.io.ECKeyOutputStream.commitStripeWrite(ECKeyOutputStream.java:266)
at
org.apache.hadoop.ozone.client.io.ECKeyOutputStream.flushStripeToDatanodes(ECKeyOutputStream.java:585)
at
org.apache.hadoop.ozone.client.io.ECKeyOutputStream.flushStripeFromQueue(ECKeyOutputStream.java:567)
{code}
This can happen because
[{{checkStream()}}|https://github.com/apache/ozone/blob/1cf54f34af36b65ff5a59a8a4749d138f9b8f283/hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/io/ECBlockOutputStreamEntry.java#L92-L105]
exposes {{blockOutputStreams}} array with {{null}} entries before creating
entries in a loop. It should create a local array, then set
{{blockOutputStreams}} after creating all streams.
> Intermittent failure in
> TestOzoneECClient#testPartialStripeWithPartialChunkRetry
> --------------------------------------------------------------------------------
>
> Key: HDDS-9659
> URL: https://issues.apache.org/jira/browse/HDDS-9659
> Project: Apache Ozone
> Issue Type: Sub-task
> Components: EC
> Reporter: Attila Doroszlai
> Priority: Major
>
> {code:title=https://github.com/adoroszlai/ozone-build-results/blob/master/2023/11/08/26553/unit/hadoop-ozone/client/org.apache.hadoop.ozone.client.TestOzoneECClient.txt}
> org.apache.hadoop.ozone.client.TestOzoneECClient.testPartialStripeWithPartialChunkRetry
> Time elapsed: 1.028 s <<< ERROR!
> java.lang.IndexOutOfBoundsException: Index: -1
> at java.util.Collections$EmptyList.get(Collections.java:4456)
> at java.util.Collections$UnmodifiableList.get(Collections.java:1311)
> at
> org.apache.hadoop.ozone.client.io.ECBlockOutputStreamEntry.calculateChecksum(ECBlockOutputStreamEntry.java:416)
> at
> org.apache.hadoop.ozone.client.io.ECKeyOutputStream.commitStripeWrite(ECKeyOutputStream.java:266)
> at
> org.apache.hadoop.ozone.client.io.ECKeyOutputStream.flushStripeToDatanodes(ECKeyOutputStream.java:585)
> at
> org.apache.hadoop.ozone.client.io.ECKeyOutputStream.flushStripeFromQueue(ECKeyOutputStream.java:567)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
