[
https://issues.apache.org/jira/browse/HDFS-17174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ke Han updated HDFS-17174:
--------------------------
Description:
After starting up the 4-node HDFS cluster for 3.2.4, I executed some commands
to put a folder in local fs to HDFS. I used -{_}put -p to preserve access and
modification times{_}.
However, when I use the -checksum command to retrieve the checksum, I noticed
that it will change the modification time of the file I just uploaded. (Side
effects)
{code:java}
dfs -mkdir /lSFVKIFi
dfs -put -f -p -d /tmp/vFrDCyPAiJY /lSFVKIFi/
// READ COMMAND
// First read
> dfs -ls -h -t -S -u /lSFVKIFi/vFrDCyPAiJY
Found 2 items
-rw-r--r-- 1 root 6345 0 2023-08-30 22:03
/lSFVKIFi/vFrDCyPAiJY/-setSpaceQuota.txt
-rw-r--r-- 1 20001 6345 24 K 2023-08-30 18:38 /lSFVKIFi/vFrDCyPAiJY/mfHU
// Execute the check sum
dfs -checksum /lSFVKIFi/PWXVE/z/eJMiAwNEO
// Second read
> dfs -ls -h -t -S -u /lSFVKIFi/vFrDCyPAiJY
Found 2 items
-rw-r--r-- 1 20001 6345 24 K 2023-08-30 22:03 /lSFVKIFi/vFrDCyPAiJY/mfHU
-rw-r--r-- 1 root 6345 0 2023-08-30 22:03
/lSFVKIFi/vFrDCyPAiJY/-setSpaceQuota.txt{code}
The modification is changed. However, checksum shouldn't have any side effects
according to its specification.
was:
After starting up 4-nodes hdfs cluster for 3.2.4. I executed some commands to
put a folder in local fs to hdfs. I used -{_}put -p to preserves access and
modification times{_}.
However, when I use -checksum command to retrieve the checksum, I noticed that
it will change the modification time of the file I just uploaded. (Side effects)
{code:java}
dfs -mkdir /lSFVKIFi
dfs -put -f -p -d /tmp/vFrDCyPAiJY /lSFVKIFi/
// READ COMMAND
// First read
> dfs -ls -h -t -S -u /lSFVKIFi/vFrDCyPAiJY
Found 2 items
-rw-r--r-- 1 root 6345 0 2023-08-30 22:03
/lSFVKIFi/vFrDCyPAiJY/-setSpaceQuota.txt
-rw-r--r-- 1 20001 6345 24 K 2023-08-30 18:38 /lSFVKIFi/vFrDCyPAiJY/mfHU
// Execute the check sum
dfs -checksum /lSFVKIFi/PWXVE/z/eJMiAwNEO
// Second read
> dfs -ls -h -t -S -u /lSFVKIFi/vFrDCyPAiJY
Found 2 items
-rw-r--r-- 1 20001 6345 24 K 2023-08-30 22:03 /lSFVKIFi/vFrDCyPAiJY/mfHU
-rw-r--r-- 1 root 6345 0 2023-08-30 22:03
/lSFVKIFi/vFrDCyPAiJY/-setSpaceQuota.txt{code}
The modification is changed. However, checksum shouldn't have any side effects
according to its specification.
> Side effect of checksum command: wrongly changes the modification time of a
> file
> --------------------------------------------------------------------------------
>
> Key: HDFS-17174
> URL: https://issues.apache.org/jira/browse/HDFS-17174
> Project: Hadoop HDFS
> Issue Type: Bug
> Affects Versions: 3.2.4
> Reporter: Ke Han
> Priority: Major
> Attachments: vFrDCyPAiJY.tar.gz
>
>
> After starting up the 4-node HDFS cluster for 3.2.4, I executed some commands
> to put a folder in local fs to HDFS. I used -{_}put -p to preserve access and
> modification times{_}.
> However, when I use the -checksum command to retrieve the checksum, I noticed
> that it will change the modification time of the file I just uploaded. (Side
> effects)
> {code:java}
> dfs -mkdir /lSFVKIFi
> dfs -put -f -p -d /tmp/vFrDCyPAiJY /lSFVKIFi/
> // READ COMMAND
> // First read
> > dfs -ls -h -t -S -u /lSFVKIFi/vFrDCyPAiJY
> Found 2 items
> -rw-r--r-- 1 root 6345 0 2023-08-30 22:03
> /lSFVKIFi/vFrDCyPAiJY/-setSpaceQuota.txt
> -rw-r--r-- 1 20001 6345 24 K 2023-08-30 18:38
> /lSFVKIFi/vFrDCyPAiJY/mfHU
> // Execute the check sum
> dfs -checksum /lSFVKIFi/PWXVE/z/eJMiAwNEO
> // Second read
> > dfs -ls -h -t -S -u /lSFVKIFi/vFrDCyPAiJY
> Found 2 items
> -rw-r--r-- 1 20001 6345 24 K 2023-08-30 22:03
> /lSFVKIFi/vFrDCyPAiJY/mfHU
> -rw-r--r-- 1 root 6345 0 2023-08-30 22:03
> /lSFVKIFi/vFrDCyPAiJY/-setSpaceQuota.txt{code}
> The modification is changed. However, checksum shouldn't have any side
> effects according to its specification.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
