Add dfsadmin -waitDatanodes feature to block until DNs have reported
Key: HDFS-528
URL: https://issues.apache.org/jira/browse/HDFS-528
Project: Hadoop HDFS
Issue Type: New
[
https://issues.apache.org/jira/browse/HDFS-262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon resolved HDFS-262.
--
Resolution: Cannot Reproduce
Assignee: Todd Lipcon
Hi Jim,
I believe this is the behavior already
Datanode behaves badly when one disk is very low on space
-
Key: HDFS-788
URL: https://issues.apache.org/jira/browse/HDFS-788
Project: Hadoop HDFS
Issue Type: Bug
Components:
Potential deadlock in TestOverReplicatedBlocks
--
Key: HDFS-863
URL: https://issues.apache.org/jira/browse/HDFS-863
Project: Hadoop HDFS
Issue Type: Bug
Components: test
Potential deadlock rolling edit logs
Key: HDFS-864
URL: https://issues.apache.org/jira/browse/HDFS-864
Project: Hadoop HDFS
Issue Type: Bug
Components: name-node
Affects Versions: 0.22.0
Potential deadlock in HdfsConfiguration
---
Key: HDFS-865
URL: https://issues.apache.org/jira/browse/HDFS-865
Project: Hadoop HDFS
Issue Type: Bug
Affects Versions: 0.22.0
Reporter: Todd
TestHDFSFileContextMainOperations fails on weirdly configured DNS hosts
---
Key: HDFS-874
URL: https://issues.apache.org/jira/browse/HDFS-874
Project: Hadoop HDFS
Issue
Client-driven checksum verification not functioning
---
Key: HDFS-877
URL: https://issues.apache.org/jira/browse/HDFS-877
Project: Hadoop HDFS
Issue Type: Bug
Affects Versions: 0.20.1,
Corrupt replicas are not tracked correctly through block report from DN
---
Key: HDFS-900
URL: https://issues.apache.org/jira/browse/HDFS-900
Project: Hadoop HDFS
Issue
[
https://issues.apache.org/jira/browse/HDFS-745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon resolved HDFS-745.
--
Resolution: Fixed
Fix Version/s: 0.20.2
Assignee: Tsz Wo (Nicholas), SZE
This was fixed
[
https://issues.apache.org/jira/browse/HDFS-877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon reopened HDFS-877:
--
This bug fix should go in 0.21 as well, I think. The current patch doesn't
apply, but I'll try to get to
Refactor DFSOutputStream and DFSInputStream out of DFSClient
Key: HDFS-914
URL: https://issues.apache.org/jira/browse/HDFS-914
Project: Hadoop HDFS
Issue Type: Improvement
DFSInputStream retries too many times for new block locations
-
Key: HDFS-927
URL: https://issues.apache.org/jira/browse/HDFS-927
Project: Hadoop HDFS
Issue Type: Bug
Failing DFSOutputStream does not throw exception back to client
---
Key: HDFS-931
URL: https://issues.apache.org/jira/browse/HDFS-931
Project: Hadoop HDFS
Issue Type: Bug
TestProxyUtil failing test-patch builds
---
Key: HDFS-936
URL: https://issues.apache.org/jira/browse/HDFS-936
Project: Hadoop HDFS
Issue Type: Bug
Components: contrib/hdfsproxy, test
Affects
FSImage.saveFSImage can lose edits
--
Key: HDFS-955
URL: https://issues.apache.org/jira/browse/HDFS-955
Project: Hadoop HDFS
Issue Type: Bug
Affects Versions: 0.21.0, 0.22.0
Reporter: Todd
Improper synchronization in some FSNamesystem methods
-
Key: HDFS-956
URL: https://issues.apache.org/jira/browse/HDFS-956
Project: Hadoop HDFS
Issue Type: Bug
Affects Versions: 0.21.0,
DelegationTokenSecretManager lifecycle is inconsistent
--
Key: HDFS-967
URL: https://issues.apache.org/jira/browse/HDFS-967
Project: Hadoop HDFS
Issue Type: Bug
Affects Versions:
Convert FSNamesystem lock to ReadWriteLock
--
Key: HDFS-980
URL: https://issues.apache.org/jira/browse/HDFS-980
Project: Hadoop HDFS
Issue Type: Improvement
Components: name-node
Affects
DataXceiver client should use TCP_NODELAY
-
Key: HDFS-1037
URL: https://issues.apache.org/jira/browse/HDFS-1037
Project: Hadoop HDFS
Issue Type: Improvement
Components: hdfs client
Make sleep after failure in nextBlockOutputStream smarter and configurable
--
Key: HDFS-1054
URL: https://issues.apache.org/jira/browse/HDFS-1054
Project: Hadoop HDFS
BlockReceiver records block length in replicaInfo before flushing
-
Key: HDFS-1057
URL: https://issues.apache.org/jira/browse/HDFS-1057
Project: Hadoop HDFS
Issue Type: Bug
reading from file under construction fails if it reader beats writer to DN for
new block
Key: HDFS-1058
URL: https://issues.apache.org/jira/browse/HDFS-1058
completeFile loops forever if the block's only replica has become corrupt
-
Key: HDFS-1059
URL: https://issues.apache.org/jira/browse/HDFS-1059
Project: Hadoop HDFS
Append/flush should support concurrent tailer use case
Key: HDFS-1060
URL: https://issues.apache.org/jira/browse/HDFS-1060
Project: Hadoop HDFS
Issue Type: Bug
Components:
Improve error messages for failed completeFile
--
Key: HDFS-1062
URL: https://issues.apache.org/jira/browse/HDFS-1062
Project: Hadoop HDFS
Issue Type: Improvement
Components: hdfs
[
https://issues.apache.org/jira/browse/HDFS-133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon resolved HDFS-133.
--
Resolution: Duplicate
This fix is covered by HDFS-988
setPermssion locks FSNamesystem across logSync.
Replica recovery doesn't distinguish between flushed-but-corrupted last chunk
and unflushed last chunk
--
Key: HDFS-1103
URL:
[
https://issues.apache.org/jira/browse/HDFS-877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon resolved HDFS-877.
--
Resolution: Fixed
Re-resolving this since the 21 branch is going to die anyway (this was already
put in
Forward-port TestFileAppend4 tests from 20-append branch
Key: HDFS-1139
URL: https://issues.apache.org/jira/browse/HDFS-1139
Project: Hadoop HDFS
Issue Type: Test
completeFile does not check lease ownership
---
Key: HDFS-1141
URL: https://issues.apache.org/jira/browse/HDFS-1141
Project: Hadoop HDFS
Issue Type: Bug
Components: name-node
Affects
Convert FSDataset to ReadWriteLock
--
Key: HDFS-1148
URL: https://issues.apache.org/jira/browse/HDFS-1148
Project: Hadoop HDFS
Issue Type: Improvement
Components: data-node
Reporter:
Lease reassignment is not persisted to edit log
---
Key: HDFS-1149
URL: https://issues.apache.org/jira/browse/HDFS-1149
Project: Hadoop HDFS
Issue Type: Bug
Components: name-node
appendFile does not recheck lease in second synchronized block
--
Key: HDFS-1152
URL: https://issues.apache.org/jira/browse/HDFS-1152
Project: Hadoop HDFS
Issue Type: Bug
[
https://issues.apache.org/jira/browse/HDFS-419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon resolved HDFS-419.
--
Resolution: Won't Fix
Add Thrift interface to JobTracker/TaskTracker
[
https://issues.apache.org/jira/browse/HDFS-1165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon resolved HDFS-1165.
---
Resolution: Duplicate
Since HDFS-988 is marked blocker, and I should have a unit test for it ready
Blocks in newly completed files are considered under-replicated too quickly
---
Key: HDFS-1172
URL: https://issues.apache.org/jira/browse/HDFS-1172
Project: Hadoop HDFS
0.20: DNs should interrupt writers at start of recovery
---
Key: HDFS-1186
URL: https://issues.apache.org/jira/browse/HDFS-1186
Project: Hadoop HDFS
Issue Type: Bug
Components:
0.20: TestFileAppend3.testTC2 failure
-
Key: HDFS-1197
URL: https://issues.apache.org/jira/browse/HDFS-1197
Project: Hadoop HDFS
Issue Type: Bug
Components: data-node, hdfs client, name-node
DataBlockScanner throws NPE when updated before initialized
---
Key: HDFS-1202
URL: https://issues.apache.org/jira/browse/HDFS-1202
Project: Hadoop HDFS
Issue Type: Bug
DataNode should sleep before reentering service loop after an exception
---
Key: HDFS-1203
URL: https://issues.apache.org/jira/browse/HDFS-1203
Project: Hadoop HDFS
Issue
0.20: Lease expiration should recover single files, not entire lease holder
---
Key: HDFS-1204
URL: https://issues.apache.org/jira/browse/HDFS-1204
Project: Hadoop HDFS
0.20 append: Block receiver should not log rewind packets at INFO level
-
Key: HDFS-1211
URL: https://issues.apache.org/jira/browse/HDFS-1211
Project: Hadoop HDFS
Issue
[
https://issues.apache.org/jira/browse/HDFS-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon resolved HDFS-1215.
---
Assignee: Todd Lipcon
Resolution: Fixed
Dhruba committed to 20-append branch
TestNodeCount
20 append: Blocks recovered on startup should be treated with lower priority
during block synchronization
-
Key: HDFS-1218
URL:
0.20 append: Add test for appendFile() race solved in HDFS-142
--
Key: HDFS-1242
URL: https://issues.apache.org/jira/browse/HDFS-1242
Project: Hadoop HDFS
Issue Type: Test
0.20 append: Replication tests in TestFileAppend4 should not expect immediate
replication
-
Key: HDFS-1243
URL: https://issues.apache.org/jira/browse/HDFS-1243
Manual tool to test sync against a real cluster
---
Key: HDFS-1246
URL: https://issues.apache.org/jira/browse/HDFS-1246
Project: Hadoop HDFS
Issue Type: Test
Components: test
Affects
Improvements to HDFS-1204 test
--
Key: HDFS-1247
URL: https://issues.apache.org/jira/browse/HDFS-1247
Project: Hadoop HDFS
Issue Type: Test
Components: test
Affects Versions: 0.20-append
Misc cleanup/logging improvements for branch-20-append
--
Key: HDFS-1248
URL: https://issues.apache.org/jira/browse/HDFS-1248
Project: Hadoop HDFS
Issue Type: Improvement
TestDFSConcurrentFileOperations broken in 0.20-appendj
--
Key: HDFS-1252
URL: https://issues.apache.org/jira/browse/HDFS-1252
Project: Hadoop HDFS
Issue Type: Test
Components:
[
https://issues.apache.org/jira/browse/HDFS-1246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon resolved HDFS-1246.
---
Resolution: Won't Fix
Sure, resolving won't fix. Just wanted to share the code.
Manual tool to test
Failed pipeline creation during append leaves lease hanging on NN
-
Key: HDFS-1262
URL: https://issues.apache.org/jira/browse/HDFS-1262
Project: Hadoop HDFS
Issue Type: Bug
0.20: in tryUpdateBlock, the meta file is renamed away before genstamp
validation is done
-
Key: HDFS-1263
URL: https://issues.apache.org/jira/browse/HDFS-1263
Missing license headers in branch-20-append
---
Key: HDFS-1266
URL: https://issues.apache.org/jira/browse/HDFS-1266
Project: Hadoop HDFS
Issue Type: Task
Affects Versions: 0.20-append
[
https://issues.apache.org/jira/browse/HDFS-1263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon resolved HDFS-1263.
---
Resolution: Duplicate
Yep. Initially wasn't entirely clear they were the same, but I think you're
[
https://issues.apache.org/jira/browse/HDFS-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon resolved HDFS-1229.
---
Resolution: Cannot Reproduce
Thanks for checking against the append branch, marking as resolved since
Remove or support dfs.web.ugi
-
Key: HDFS-1390
URL: https://issues.apache.org/jira/browse/HDFS-1390
Project: Hadoop HDFS
Issue Type: Bug
Components: name-node, security
Affects Versions: 0.22.0
TestNodeCount logic incorrect in branch-0.20
Key: HDFS-1404
URL: https://issues.apache.org/jira/browse/HDFS-1404
Project: Hadoop HDFS
Issue Type: Bug
Components: name-node, test
[
https://issues.apache.org/jira/browse/HDFS-1412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon resolved HDFS-1412.
---
Resolution: Duplicate
Dup of HADOOP-6378
Broken symlinks break the local filesystem implementation
TestFileStatus fails on some hosts
--
Key: HDFS-1470
URL: https://issues.apache.org/jira/browse/HDFS-1470
Project: Hadoop HDFS
Issue Type: Bug
Components: hdfs client, test
Affects Versions:
TestHDFSTrash times out on trunk
Key: HDFS-1471
URL: https://issues.apache.org/jira/browse/HDFS-1471
Project: Hadoop HDFS
Issue Type: Bug
Affects Versions: 0.22.0
Reporter: Todd Lipcon
Refactor storage management into separate classes than fsimage file
reading/writing
---
Key: HDFS-1473
URL: https://issues.apache.org/jira/browse/HDFS-1473
Project:
Write pipeline sequence numbers should be sequential with no skips or duplicates
Key: HDFS-1497
URL: https://issues.apache.org/jira/browse/HDFS-1497
Project: Hadoop HDFS
TestOfflineImageViewer failing on trunk
---
Key: HDFS-1500
URL: https://issues.apache.org/jira/browse/HDFS-1500
Project: Hadoop HDFS
Issue Type: Bug
Components: test, tools
Affects Versions:
[
https://issues.apache.org/jira/browse/HDFS-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon resolved HDFS-1470.
---
Resolution: Duplicate
TestFileStatus fails on some hosts
--
saveNamespace appears to succeed even if all directories fail to save
-
Key: HDFS-1505
URL: https://issues.apache.org/jira/browse/HDFS-1505
Project: Hadoop HDFS
Issue Type:
[
https://issues.apache.org/jira/browse/HDFS-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon reopened HDFS-1467:
---
Reopening, I'm going to ask Eli to revert this patch until we figure out what's
going on.
Append
Incorrect handling of interrupts in waitForAckedSeqno can cause deadlock
Key: HDFS-1529
URL: https://issues.apache.org/jira/browse/HDFS-1529
Project: Hadoop HDFS
Issue
Clean up stack traces due to duplicate MXBean registration
--
Key: HDFS-1531
URL: https://issues.apache.org/jira/browse/HDFS-1531
Project: Hadoop HDFS
Issue Type: Bug
Exclude Findbugs warning in FSImageFormat$Saver
---
Key: HDFS-1532
URL: https://issues.apache.org/jira/browse/HDFS-1532
Project: Hadoop HDFS
Issue Type: Bug
Components: test
Affects
Refactor more startup and image loading code out of FSImage
---
Key: HDFS-1538
URL: https://issues.apache.org/jira/browse/HDFS-1538
Project: Hadoop HDFS
Issue Type: Sub-task
Deadlock in Configuration.writeXml when serialized form is larger than one DFS
block
Key: HDFS-1542
URL: https://issues.apache.org/jira/browse/HDFS-1542
Project:
Improve DataXceiver error logging
-
Key: HDFS-1568
URL: https://issues.apache.org/jira/browse/HDFS-1568
Project: Hadoop HDFS
Issue Type: Improvement
Components: data-node
Affects Versions:
LeaseChecker thread name trace not that useful
--
Key: HDFS-1573
URL: https://issues.apache.org/jira/browse/HDFS-1573
Project: Hadoop HDFS
Issue Type: Improvement
Components: hdfs client
HDFS cannot be browsed from web UI while in safe mode
-
Key: HDFS-1574
URL: https://issues.apache.org/jira/browse/HDFS-1574
Project: Hadoop HDFS
Issue Type: Bug
Components:
Browsing a block on the wrong datanode through web UI has unintuitive results
-
Key: HDFS-1579
URL: https://issues.apache.org/jira/browse/HDFS-1579
Project: Hadoop HDFS
Misplaced assertion in FSEditLog.logSync
Key: HDFS-1597
URL: https://issues.apache.org/jira/browse/HDFS-1597
Project: Hadoop HDFS
Issue Type: Bug
Affects Versions: 0.22.0
Reporter:
Pipeline ACKs are sent as lots of tiny TCP packets
--
Key: HDFS-1601
URL: https://issues.apache.org/jira/browse/HDFS-1601
Project: Hadoop HDFS
Issue Type: Improvement
Components:
[
https://issues.apache.org/jira/browse/HDFS-1607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon resolved HDFS-1607.
---
Resolution: Fixed
Hadoop Flags: [Reviewed]
Verified that this patch compiles against the
seek() on closed DFS input stream throws NPE
Key: HDFS-1615
URL: https://issues.apache.org/jira/browse/HDFS-1615
Project: Hadoop HDFS
Issue Type: Bug
Reporter: Todd Lipcon
Fix references to hadoop-common-${version} in build.xml
---
Key: HDFS-1621
URL: https://issues.apache.org/jira/browse/HDFS-1621
Project: Hadoop HDFS
Issue Type: Bug
Reporter:
TestDataNodeMXBean fails if disk space usage changes during test run
Key: HDFS-1625
URL: https://issues.apache.org/jira/browse/HDFS-1625
Project: Hadoop HDFS
Issue Type:
If dfs.name.dir points to an empty dir, namenode format shouldn't require
confirmation
--
Key: HDFS-1636
URL: https://issues.apache.org/jira/browse/HDFS-1636
[
https://issues.apache.org/jira/browse/HDFS-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon reopened HDFS-1731:
---
Reopening to address issue on cygwin reported by Nicholas
Allow using a file to exclude certain tests
Improve error message when starting secure DN without jsvc
--
Key: HDFS-1759
URL: https://issues.apache.org/jira/browse/HDFS-1759
Project: Hadoop HDFS
Issue Type: Improvement
HDFS ivy dependencies aren't on classpath of bin/hdfs script
Key: HDFS-1771
URL: https://issues.apache.org/jira/browse/HDFS-1771
Project: Hadoop HDFS
Issue Type: Bug
[
https://issues.apache.org/jira/browse/HDFS-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon reopened HDFS-1521:
---
For some reason this is causing TestBackupNode to fail - surprised we didn't
see this in the Hudson QA
Not enough xcievers error should propagate to client
--
Key: HDFS-1787
URL: https://issues.apache.org/jira/browse/HDFS-1787
Project: Hadoop HDFS
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/HDFS-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon resolved HDFS-1521.
---
Resolution: Fixed
Committed to the HDFS-1073 branch. We will address the BackupNode issues
mentioned
Add code to detect valid length of an edits file
Key: HDFS-1792
URL: https://issues.apache.org/jira/browse/HDFS-1792
Project: Hadoop HDFS
Issue Type: Sub-task
Reporter: Todd
Add code to inspect a storage directory with txid-based filenames
-
Key: HDFS-1793
URL: https://issues.apache.org/jira/browse/HDFS-1793
Project: Hadoop HDFS
Issue Type:
New findbugs warning introduced by HDFS-1120
Key: HDFS-1797
URL: https://issues.apache.org/jira/browse/HDFS-1797
Project: Hadoop HDFS
Issue Type: Bug
Affects Versions: 0.23.0
[
https://issues.apache.org/jira/browse/HDFS-1793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon resolved HDFS-1793.
---
Resolution: Fixed
Add code to inspect a storage directory with txid-based filenames
Refactor log rolling and filename management out of FSEditLog
-
Key: HDFS-1799
URL: https://issues.apache.org/jira/browse/HDFS-1799
Project: Hadoop HDFS
Issue Type: Sub-task
Extend image checksumming to function with multiple fsimage files
-
Key: HDFS-1800
URL: https://issues.apache.org/jira/browse/HDFS-1800
Project: Hadoop HDFS
Issue Type:
Remove use of timestamps to identify checkpoints and logs
-
Key: HDFS-1801
URL: https://issues.apache.org/jira/browse/HDFS-1801
Project: Hadoop HDFS
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/HDFS-1799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon resolved HDFS-1799.
---
Resolution: Fixed
I synced up with Ivan offline, and he is going to rebase HDFS-1580 on top of
this.
Add state management variables to FSEditLog
---
Key: HDFS-1858
URL: https://issues.apache.org/jira/browse/HDFS-1858
Project: Hadoop HDFS
Issue Type: Sub-task
Reporter: Todd Lipcon
[
https://issues.apache.org/jira/browse/HDFS-1858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon resolved HDFS-1858.
---
Resolution: Fixed
Fix Version/s: Edit log branch (HDFS-1073)
Add state management variables
1 - 100 of 387 matches
Mail list logo