Shahrukh created MAPREDUCE-7345:
-----------------------------------

             Summary: SnapshotDiff not showing correct report 
                 Key: MAPREDUCE-7345
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7345
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: distcp
    Affects Versions: 3.1.1
         Environment: We are using HDP 3.1.0.0-78

 
            Reporter: Shahrukh
         Attachments: image2021-4-26_17-7-53.png, image2021-4-26_17-9-14.png

We are doing incremental backup of hive tables using distcp -diff on the basis 
of two snapshots.

But sometimes this distcp is failing with error that particular file is not 
present in snapshots source directory.

 

When we do Snapshodiff between two snapshots, it shows some of the files are 
added

but when we do 'hdfs dfs -ls' for these files on snapshot folders. it shows 
file not present.

 

We suspect
 * its issue with Snapshotdiff.
 * or related hive compaction, as we get error only for hive delta/base files.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org

Reply via email to