Felix N created HADOOP-17634:
--------------------------------
Summary: Fedbalance only copies data partially when there's
existing opened file
Key: HADOOP-17634
URL: https://issues.apache.org/jira/browse/HADOOP-17634
Project: Hadoop Common
Issue Type: Bug
Reporter: Felix N
If there are opened files when fedbalance is run and data is being written to
these files, fedbalance might skip the newly written data.
Steps to recreate the issue:
# Create a dummy file /test/file with some data: {{echo "start" | hdfs dfs
-appendToFile /test/file}}
# Start writing to the file: {{hdfs dfs -appendToFile /test/file}} but do not
stop writing
# Run fedbalance: {{hadoop fedbalance submit hdfs://ns1/test hdfs://ns2/test}}
# Write something to the file while fedbalance is running, "end" for example,
then stop writing
# After fedbalance is done, {{hdfs://ns2/test/file}} should only contain
"start" while {{hdfs://ns1/user/hadoop/.Trash/Current/test/file}} contains
"start\nend"
Fedbalance is run with default configs and arguments so no diff should happen.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
