(Karaf/Pax URL intercepts all URLs). On 12/10/2013 05:08 PM, dealbitte wrote:
Task: To store a file residing on Windows 7 PC in HDFS (running on Ubuntu). Both the machines are in the same networkThe following java code works without any issues outside Karaf. It copies a file from Windows machine to the HDFS But when I use the same code inside one of the bundle in Karaf, I get the following exception. I am using Karaf 2.3.3. I am not able to copy file from windows to HDFS *Java Code:* private void storeDataInArchive(final String archivePath, final File source) throws Exception { if (null != archivePath) { UserGroupInformation ugi = UserGroupInformation.createRemoteUser(hadoopUser); ugi.doAs(new PrivilegedExceptionAction<Void>() { @Override public Void run() throws Exception { LOG.info("Attempting to store data in " + source.getName() + " HDFS store"); Configuration config = new Configuration(); config.set("fs.default.name", hadoopURL); Path srcPath = new Path("file:///" + source.getAbsolutePath()); Path destPath = new Path("hdfs:" + archivePath + source.getName()); LOG.info("Source Path :" + srcPath); LOG.info("Destination Path :" + destPath); FileSystem destFs = destPath.getFileSystem(config); destFs.copyFromLocalFile(srcPath, destPath); return null; } }); } else { LOG.error("Archive Path is Null. Cannot store " + source.getName() + " for step " + getStepID()); } } *Exception in Karaf Console:* java.io.IOException: No FileSystem for scheme: hdfs at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1443)[199:wrap_mvn_org.apache.hadoop_hadoop-core_1.2.1:0] at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67)[199:wrap_mvn_org.apache.hadoop_hadoop-core_1.2.1:0] at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1464)[199:wrap_mvn_org.apache.hadoop_hadoop-core_1.2.1:0] at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:263)[199:wrap_mvn_org.apache.hadoop_hadoop-core_1.2.1:0] at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)[199:wrap_mvn_org.apache.hadoop_hadoop-core_1.2.1:0] at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187)[199:wrap_mvn_org.apache.hadoop_hadoop-core_1.2.1:0] Could this be class dependency/Classpath issue? Please let me know what is wrong in my Java code. Thanks in advance -- View this message in context: http://karaf.922171.n3.nabble.com/Working-with-Karaf-Hadoop-HDFS-tp4030617.html Sent from the Karaf - User mailing list archive at Nabble.com.
-- Jean-Baptiste Onofré [email protected] http://blog.nanthrax.net Talend - http://www.talend.com
