Hi Mark, Late last night I decided to add the ASCII files into separate folders. one file for one folder and ran the batch deploy. And I did get one file in ---> one file out. So now I can at least work on some of the data as it gets processed and not have to wait for the entire thing to get done at once. It will definately save me severals days in my project schedule.
I guess I'm still getting familiar with how FME handles different data structures. (We probably deal with 10 to 15 different data formats here) thx for the help! --- In [email protected], "mark2atsafe" <[EMAIL PROTECTED]> wrote: > > > > > Hi Mark, > > > > Batch deploy appears to be reading all the files into memory first > > then sending to the output. > > > > Shouldn't it be one file in --> one file out? > > > > It should. But I'm wondering if the problem is in the source data > format. It's CSV isn't it? FME treats CSV as a folder based format; ie > each CSV file in the same folder is a feature type in the same dataset > - not a separate dataset. > > Confirm the problem by putting one of the CSV in a separate folder and > trying the process again. Does the separated CSV get read separately? > > If so, I'm not sure about the fix. How are you specifying the source > files? By selecting the folder or the files? Selecting a folder might > make FME assume it is a single dataset. Try selecting the files > individually. > > Let me know what you find. It's interesting how batch deploy regards > different data structures; annoying at times, but always perfectly > logical once you see the trick. > > Mark > For insights into what's up at Safe Software and what's on the development horizon, visit Safe's blog at spatial-etl.blogspot.com. Safe Software has also made slides available that outline enhancements planned for FME 2007. The slides are from the "Road Ahead" presentation given on Day 2 of the FME Worldwide Users Conference. To view these slides, visit www.safe.com/2006uc. Yahoo! Groups Links <*> To visit your group on the web, go to: http://groups.yahoo.com/group/fme/ <*> Your email settings: Individual Email | Traditional <*> To change settings online go to: http://groups.yahoo.com/group/fme/join (Yahoo! ID required) <*> To change settings via email: mailto:[EMAIL PROTECTED] mailto:[EMAIL PROTECTED] <*> To unsubscribe from this group, send an email to: [EMAIL PROTECTED] <*> Your use of Yahoo! Groups is subject to: http://docs.yahoo.com/info/terms/
