[
https://issues.apache.org/jira/browse/HDDS-8160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17701398#comment-17701398
]
Attila Doroszlai edited comment on HDDS-8160 at 3/17/23 7:10 AM:
-----------------------------------------------------------------
While working on HDDS-8069 and going through the logs for it, we saw that there
were some compaction entries in which input and output compaction files were
exactly same. Which causes the loop in the DAG and make it non-DAG.
Fix is to skip the compaction entry from being written to compaction log and
file nodes get added to DAG, if input and output files are exactly the same.
was (Author: JIRAUSER297350):
While working on [HDDS-8069|https://issues.apache.org/jira/browse/HDDS-8069]
and going through [the
logs|https://jira.cloudera.com/secure/attachment/666849/0000000000000000000.log]
for it, we saw that there were some compaction entries in which input and
output compaction files were exactly same. Which causes the loop in the DAG and
make it non-DAG.
Fix is to skip the compaction entry from being written to compaction log and
file nodes get added to DAG, if input and output files are exactly the same.
> [snapshot] Snapshot Diff timeout
> --------------------------------
>
> Key: HDDS-8160
> URL: https://issues.apache.org/jira/browse/HDDS-8160
> Project: Apache Ozone
> Issue Type: Sub-task
> Components: Snapshot
> Affects Versions: 1.4.0
> Reporter: Attila Doroszlai
> Assignee: Hemant Kumar
> Priority: Critical
> Labels: ozone-snapshot, pull-request-available
> Attachments: log.html, om.log
>
>
> Encountered timeout in snapshot diff acceptance test in _acceptance
> (unsecure)_ in one of my branches. The only
> [change|https://github.com/apache/ozone/compare/master...adoroszlai:hadoop-ozone:HDDS-7975#diff-2be73cab1b66d3165c7fdf1e5b3d1e769f8051d23ee83dce26735398a1babc23]
> in unsecure acceptance test in this branch compared to {{master}} is removal
> of S3 and Ozone FS tests.
> {code:title=https://github.com/adoroszlai/hadoop-ozone/actions/runs/4418335086/jobs/7745572874#step:5:956}
> Snapshot Diff | FAIL |
> Test timeout 5 minutes exceeded.
> {code}
> {code:title=OM log}
> om_1 | java.lang.RuntimeException: Graph traversal level exceeded
> allowed maximum (1000000). This could be due to invalid input generating a
> loop in the traversal path. Same SSTs found so far: [000064, 000074],
> different SSTs: []
> om_1 | at
> org.apache.ozone.rocksdiff.RocksDBCheckpointDiffer.internalGetSSTDiffList(RocksDBCheckpointDiffer.java:896)
> om_1 | at
> org.apache.ozone.rocksdiff.RocksDBCheckpointDiffer.getSSTDiffList(RocksDBCheckpointDiffer.java:794)
> om_1 | at
> org.apache.ozone.rocksdiff.RocksDBCheckpointDiffer.getSSTDiffListWithFullPath(RocksDBCheckpointDiffer.java:762)
> om_1 | at
> org.apache.hadoop.ozone.om.snapshot.SnapshotDiffManager.getDeltaFiles(SnapshotDiffManager.java:375)
> om_1 | at
> org.apache.hadoop.ozone.om.snapshot.SnapshotDiffManager.getSnapshotDiffReport(SnapshotDiffManager.java:222)
> om_1 | at
> org.apache.hadoop.ozone.om.OmSnapshotManager.getSnapshotDiffReport(OmSnapshotManager.java:279)
> om_1 | at
> org.apache.hadoop.ozone.om.OzoneManager.snapshotDiff(OzoneManager.java:4483)
> om_1 | at
> org.apache.hadoop.ozone.protocolPB.OzoneManagerRequestHandler.snapshotDiff(OzoneManagerRequestHandler.java:1223)
> om_1 | at
> org.apache.hadoop.ozone.protocolPB.OzoneManagerRequestHandler.handleReadRequest(OzoneManagerRequestHandler.java:300)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
