Hi You can use a dot as prefix for the file name and Camel will skip it. And then rename it to its correct filename afterwards. If you use Camel to write the file also, there is a tempPrefix option you can use for that.
On Thu, Jul 23, 2009 at 2:21 PM, Claus Ibsen<[email protected]> wrote: > Hi > > You cannot easily test writing files while consuming them in the same > JVM as the java IO file locks are JVM-wide, and implemented > differently depending on the target OS. > > So its best to text using 2 JVM's one that writes the big files, and > the other with Camel that consumes them. > > You can try the different readLock options provided by Camel, for > instance the: rename as it will try to rename the file before > consuming and that tend to work on most OS platforms (i.e. not using > file locks). > > However the best is to also write a file using a temp filename and > then after the write is done, rename it to the correct name, aka like > the FTP client apps does when you download files using them. > > > > 2009/7/20 Rafal Janik <[email protected]>: >> Hi - i have problem with big files processing in camel. >> >> I've got osgi bundle in FuseESB (servicemix) which is using the camel . >> In camel-context.xml file there is : >> >> <route> >> <from >> uri="file://inbox/upload-file-simple?consumer.delay=2000&consumer.initialDelay=2000&noop=true" >> /> >> <to uri="..." /> <choice> >> <when> >> <groovy>Integer.parseInt(request.headers['file-size']) > >> 20000</groovy> >> <to uri="A..." /> >> </when> >> <otherwise> >> <to uri="B" /> >> </otherwise> >> </choice> >> </route> >> >> >> >> The result depends on the delay. If the delay is to short only a part of >> the file is sent to "next uri". >> >> To check it i wrote a simple application: >> >> package test.camel; >> >> import java.io.File; >> import java.io.FileInputStream; >> import java.io.FileNotFoundException; >> import java.io.FileOutputStream; >> import java.io.IOException; >> import java.io.InputStream; >> import java.io.OutputStream; >> >> import org.apache.camel.CamelContext; >> import org.apache.camel.Exchange; >> import org.apache.camel.Processor; >> import org.apache.camel.builder.RouteBuilder; >> import org.apache.camel.impl.DefaultCamelContext; >> >> public class CamelTest { >> >> private final static String TEST_FILE_NAME = "test.dat"; >> private final static String TEST_FILE_DIR = "src/main/resources"; >> private final static String INBOX_DIR = "inbox"; >> private final static String OUTBOX_DIR = "outbox"; >> >> /** >> * @param args >> * @throws Exception >> * @throws Exception >> */ >> public static void main(String[] args) { >> >> System.out.println("Camel store file test start"); >> CamelContext context; >> try { >> context = getCamelContext(); >> context.start(); >> copyFileToInbox(); >> } catch (FileNotFoundException e) { >> System.out.println("Cannot fonde test file " + TEST_FILE_NAME); >> } catch (Exception e) { >> System.out.println("contextStart Error:"); >> e.printStackTrace(); >> } >> boolean work = true; >> while (work) { >> } >> } >> >> public static CamelContext getCamelContext() { >> System.out.println("Start congire Camel... "); >> CamelContext context = new DefaultCamelContext(); >> try { >> context.addRoutes(new RouteBuilder() { >> public void configure() { >> from("file://" + INBOX_DIR + "?noop=true").to("file://" + >> OUTBOX_DIR); >> from("file://" + OUTBOX_DIR + "?noop=true").process(new >> Processor() { >> >> public void process(Exchange e) { >> System.out.println("Received in outbox: " + >> e.getIn()); >> } >> }); >> } >> }); >> } catch (Exception e) { >> System.out.println("getCamelContext Error:"); >> e.printStackTrace(); >> >> } >> return context; >> } >> >> public static void copyFileToInbox() throws FileNotFoundException { >> >> File file = new File(TEST_FILE_DIR, TEST_FILE_NAME); >> System.out.println("File " + file.getName() + " exists: " + >> file.exists() + " (" + file.length() >> + "b)"); >> >> File f2 = new File(INBOX_DIR, TEST_FILE_NAME); >> InputStream in = new FileInputStream(file); >> OutputStream out = new FileOutputStream(f2); >> >> byte[] buf = new byte[1024]; >> int len; >> try { >> while ((len = in.read(buf)) > 0) { >> out.write(buf, 0, len); >> } >> } catch (IOException e) { >> System.out.println("copyFileToInbox Error:"); >> e.printStackTrace(); >> } finally { >> try { >> in.close(); >> out.close(); >> } catch (IOException e) { >> System.out.println("Error while closing streams"); >> } >> } >> } >> } >> >> >> And the resul was similiar - while uploading large files (about 100-300MB) >> in outbox folder there was only a part of orginal file, >> so i tried to set "noop=true" and the result was surprising - in outbox >> folder i got the much more bigger file than was sent to inbox. >> >> What options should be set to process the whole file? >> What i do wrong? >> >> Best Regards, >> rafal >> >> >> > > > > -- > Claus Ibsen > Apache Camel Committer > > Open Source Integration: http://fusesource.com > Blog: http://davsclaus.blogspot.com/ > Twitter: http://twitter.com/davsclaus > -- Claus Ibsen Apache Camel Committer Open Source Integration: http://fusesource.com Blog: http://davsclaus.blogspot.com/ Twitter: http://twitter.com/davsclaus
