Hadoop 2.7 is now switching to apache-commons-io v2.4. Hbase 1.0 is also using commons-io v2.4. Flume is currently at 2.1. Flume runs into issues like this when tests run against them:
testSequenceFile(org.apache.flume.sink.hdfs.TestUseRawLocalFileSystem) Time elapsed: 77 sec <<< ERROR! java.lang.NoClassDefFoundError: org/apache/commons/io/Charsets at org.apache.hadoop.io.SequenceFile$Writer.<init>(SequenceFile.java:854) at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:273) at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:582) at org.apache.flume.sink.hdfs.HDFSSequenceFile.open(HDFSSequenceFile.java:98) at org.apache.flume.sink.hdfs.HDFSSequenceFile.open(HDFSSequenceFile.java:78) at org.apache.flume.sink.hdfs.HDFSSequenceFile.open(HDFSSequenceFile.java:69) at org.apache.flume.sink.hdfs.TestUseRawLocalFileSystem.testSequenceFile(TestUseRawLocalFileSystem.java:89) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) I am planning to submit a patch to upgrade commons-io to 2.4. Just wanted to be cautious and check if we have witnessed has been any issue in the past when upgrading apache commons libraries. -roshan
