Dear Wiki user, You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.
The "Release-2.6.1-Working-Notes" page has been changed by VinodKumarVavilapalli: https://wiki.apache.org/hadoop/Release-2.6.1-Working-Notes?action=diff&rev1=20&rev2=21 Comment: Updating progress on local cherry-picks ||38b031d6bab8527698bd186887d301bd6a63cf01 ||HDFS-8127. NameNode Failover during HA upgrade can cause DataNode to finalize upgrade. Con || || ||minor issues || ||e7cbecddc3e7ca5386c71aa4deb67f133611415c ||YARN-3493. RM fails to come up with error "Failed to load/recover state" when mem settings ||Applied locally || ||No, merge conflict in RMAppManager.java, SchedulerUtils.java, TestSchedulerUtils.java || ||3316cd4357ff6ccc4c76584813092adb1c2b4d43 ||YARN-3487. CapacityScheduler scheduler lock obtained unnecessarily when calling getQueue ( ||Applied locally || ||Yes || + ||f4d6c5e337e76dc408c9c8f19e306c3f4ba80d8e|| MAPREDUCE-6267. Refactor JobSubmitter#copyAndConfigureFiles into it's own class. (Chris Trezzo via kasha) || Applied locally || ADDED as a dependency for MAPREDUCE-6238. Two conflicts in Job.java and JobSumitter.java || + ||756c2542930756fef1cbff82056b418070f8d55f ||MAPREDUCE-6238. MR2 can't run local jobs with -libjars command options which is a regressi ||Applied locally ||Yes, added MAPREDUCE-6267 as a dependency || - - || - f4d6c5e337e76dc408c9c8f19e306c3f4ba80d8e|| MAPREDUCE-6267. Refactor JobSubmitter#copyAndConfigureFiles into it's own class. (Chris Trezzo via kasha) || Applied locally || ADDED as a dependency for MAPREDUCE-6238. Two conflicts in Job.java and JobSumitter.java || ||756c2542930756fef1cbff82056b418070f8d55f ||MAPREDUCE-6238. MR2 can't run local jobs with -libjars command options which is a regressi ||Applied locally ||Yes, added MAPREDUCE-6267 as a dependency || ||1544c63602089b690e850e0e30af4589513a2371 ||HADOOP-11812. Implement listLocatedStatus for ViewFileSystem to speed up split calculation ||Applied locally || ||Yes || ||a6a5d1d6b5ee76c829ba7b54a4ad619f7b986681 ||HADOOP-11730. Regression: s3n read failure recovery broken. (Takenori Sato via stevel) ||Applied locally || ||Yes || ||788b76761d5dfadf688406d50169e95401fe5d33 ||HADOOP-11802. DomainSocketWatcher thread terminates sometimes after there is an I/O error ||Skipped ||Yes ||Dropped. We will need to commit HDFS-7915 first. If we commit HDFS-7915, we need to commit HDFS-8070 as well. || @@ -112, +111 @@ ||4045c41afe440b773d006e962bf8a5eae3fdc284 ||YARN-3464. Race condition in LocalizerRunner kills localizer before localizing all resourc ||Applied locally || ||No, merge conflict in 3 files || ||32dc13d907a416049bdb7deff429725bd6dbcb49 ||MAPREDUCE-6324. Fixed MapReduce uber jobs to not fail the udpate of AM-RM tokens when they ||Applied locally || ||Yes || ||58970d69de8a1662e4548cd6d4ca460dd70562f8 ||HADOOP-11491. HarFs incorrectly declared as requiring an authority. (Brahma Reddy Battula ||Applied locally || ||Yes || - ||87c2d915f1cc799cb4020c945c04d3ecb82ee963 ||MAPREDUCE-5649. Reduce cannot use more than 2G memory for the final merge. Contributed by || || + ||87c2d915f1cc799cb4020c945c04d3ecb82ee963 ||MAPREDUCE-5649. Reduce cannot use more than 2G memory for the final merge. Contributed by ||Applied locally || ||Yes || ||e68e8b3b5cff85bfd8bb5b00b9033f63577856d6 ||HDFS-8219. setStoragePolicy with folder behavior is different after cluster restart. (sure || || ||minor issues || ||4e1f2eb3955a97a70cf127dc97ae49201a90f5e0 ||HDFS-7980. Incremental BlockReport will dramatically slow down namenode startup. Contribu || || ||non-trivial changes (dropped TestBlockManager.java changes) || ||d817fbb34d6e34991c6e512c20d71387750a98f4 ||YARN-2918. RM should not fail on startup if queue's configured labels do not exist in clus || || ||802a5775f3522c57c60ae29ecb9533dbbfecfe76 ||HDFS-7894. Rolling upgrade readiness is not updated in jmx until query command is issued. || || ||yes || ||f264a5aeede7e144af11f5357c7f901993de8e12 ||HDFS-8245. Standby namenode doesn't process DELETED_BLOCK if the addblock request is in ed || || ||minor issues || - ||fb5b0ebb459cc8812084090a7ce7ac29e2ad147c ||MAPREDUCE-6361. NPE issue in shuffle caused by concurrent issue between copySucceeded() in || || + ||fb5b0ebb459cc8812084090a7ce7ac29e2ad147c ||MAPREDUCE-6361. NPE issue in shuffle caused by concurrent issue between copySucceeded() in ||Applied locally || || No, merge conflict in TestShuffleScheduler || - ||a81ad814610936a02e55964fbe08f7b33fe29b23 ||YARN-3641. NodeManager: stopRecoveryStore() shouldn't be skipped when exceptions happen in || || + ||a81ad814610936a02e55964fbe08f7b33fe29b23 ||YARN-3641. NodeManager: stopRecoveryStore() shouldn't be skipped when exceptions happen in ||Applied locally || || yes || - ||802676e1be350785d8c0ad35f6676eeb85b2467b ||YARN-3526. ApplicationMaster tracking URL is incorrectly redirected on a QJM cluster. Cont || || + ||802676e1be350785d8c0ad35f6676eeb85b2467b ||YARN-3526. ApplicationMaster tracking URL is incorrectly redirected on a QJM cluster. Cont ||Applied locally || || yes || ||536b9ee6d6e5b8430fda23cbdcfd859c299fa8ad ||HDFS-8404. Pending block replication can get stuck using older genstamp. Contributed by Na || || ||minor issues || - ||d3193fd1d7395bf3e7c8dfa70d1aec08b0f147e6 ||Move YARN-2918 from 2.8.0 to 2.7.1 (cherry picked from commit 03f897fd1a3779251023bae3582 || || + ||d3193fd1d7395bf3e7c8dfa70d1aec08b0f147e6 ||Move YARN-2918 from 2.8.0 to 2.7.1 (cherry picked from commit 03f897fd1a3779251023bae3582 ||Applied locally || || yes || - ||839f81a6326b2f8b3d5183178382c1551b0bc259 ||YARN-3700. Made generic history service load a number of latest applications according to || || + ||839f81a6326b2f8b3d5183178382c1551b0bc259 ||YARN-3700. Made generic history service load a number of latest applications according to ||Applied locally || || No, merge conflicts in WebServices.java, AppsBlock.java. Had to rewrite the documentation in apt || ||25db34127811fbadb9a698fa3a76e24d426fb0f6 ||HDFS-8431. hdfs crypto class not found in Windows. Contributed by Anu Engineer. (cherry p || || ||minor issues || ||33648268ce0f79bf51facafa3d151612e3d00ddb ||HADOOP-11934. Use of JavaKeyStoreProvider in LdapGroupsMapping causes infinite loop. Contr ||Skipped || ||Dropped. Cannot apply to branch-2.6 due to java.nio package. || ||17fb442a4c4e43105374c97fccd68dd966729a19 ||HDFS-7609. Avoid retry cache collision when Standby NameNode loading edits. Contributed by || || ||non-trivial changes || - ||4fee8b320276bac86278e1ae0a3397592a78aa18 ||YARN-2900. Application (Attempt and Container) Not Found in AHS results in Internal Server || || + ||4fee8b320276bac86278e1ae0a3397592a78aa18 ||YARN-2900. Application (Attempt and Container) Not Found in AHS results in Internal Server ||Applied locally || || No, minor import issues || ||a3734f67d35e714690ecdf21d80bce8a355381e3 ||YARN-3725. App submission via REST API is broken in secure mode due to Timeline DT service || || ||17e369511dd18d6e25e10ddb0cd9511f7ec8f469 ||HDFS-8486. DN startup may cause severe data loss (Daryn Sharp via Colin P. McCabe) (cher || || ||remove; already committed || ||066e45bcb667bb0c37ef70fd297b24e4f26383eb ||HDFS-8270. create() always retried with hardcoded timeout when file already exists with op || ||yes ||used the 2.6 patch || @@ -136, +135 @@ ||344b7509153cdd993218cd5104c7e5c07cd35d3c ||Add missing test file of YARN-3733 (cherry picked from commit 405bbcf68c32d8fd8a83e46e686 || || ||80697e4f324948ec32b4cad3faccba55287be652 ||HADOOP-7139. Allow appending to existing SequenceFiles (Contributed by kanaka kumar avvaru || || ||remove; already committed || ||cbd11681ce8a51d187d91748b67a708681e599de ||HDFS-8480. Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve || || ||non-trivial changes (dropped TestDFSUpgrade.java changes) || - ||15b1800b1289d239cbebc5cfd66cfe156d45a2d3 ||YARN-3832. Resource Localization fails on a cluster due to existing cache directories. Con || || + ||15b1800b1289d239cbebc5cfd66cfe156d45a2d3 ||YARN-3832. Resource Localization fails on a cluster due to existing cache directories. Con ||Applied locally || ||Yes || ||55427fb66c6d52ce98b4d68a29b592a734014c28 ||HADOOP-8151. Error handling in snappy decompressor throws invalid exceptions. Contributed ||Applied locally || ||Yes || - ||0221d19f4e398c386f4ca3990b0893562aa8dacf ||YARN-3850. NM fails to read files from full disks which can lead to container logs being l || || + ||0221d19f4e398c386f4ca3990b0893562aa8dacf ||YARN-3850. NM fails to read files from full disks which can lead to container logs being l ||Applied locally || ||No, minor conflict in TestLogAggregation.java || ||516bbf1c20547dc513126df0d9f0934bb65c10c7 ||HDFS-7314. When the DFSClient lease cannot be renewed, abort open-for-write files rather t || || ||minor issues || - ||c31e3ba92132f232bd56b257f3854ffe430fbab9 ||YARN-3990. AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected || || + ||c31e3ba92132f232bd56b257f3854ffe430fbab9 ||YARN-3990. AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected ||Applied locally || ||Yes || ||d2b941f94a835f7bdde7714d21a470b505aa582b ||HDFS-8850. VolumeScanner thread exits with exception if there is no block pool to be scann || || ||remove; does not apply to 2.6. vinodkv: Sangjin, why? || ||5950c1f6f8ac6f514f8d2e8bfbd1f71747b097de ||HADOOP-11932. MetricsSinkAdapter may hang when being stopped. Contributed by Brahma Reddy ||Applied locally ||Yes ||No, conflict in TestMetricsSystemImpl. ||
