Glad it's working. I've filed an enhancement request for batch deploy - an option to treat each file in a folder dataset as a separate dataset. It sort of goes against the logic of how FME works, but it will help prevent this sort of confusion. Similar issues occur on writing data to multiple outputs; getting one folder per source file, rather than the expected one folder/multi-files. Again it's not a fault, but it too is filed as an enhancement request.
Regards, Mark --- In [email protected], "kcheng888_007" <[EMAIL PROTECTED]> wrote: > > Hi Mark, > > Late last night I decided to add the ASCII files into separate > folders. one file for one folder and ran the batch deploy. And I > did get one file in ---> one file out. So now I can at least work > on some of the data as it gets processed and not have to wait for > the entire thing to get done at once. It will definately save me > severals days in my project schedule. > > I guess I'm still getting familiar with how FME handles different > data structures. (We probably deal with 10 to 15 different data > formats here) > > thx for the help! > > > > --- In [email protected], "mark2atsafe" <mark.ireland@> wrote: > > > > > > > > Hi Mark, > > > > > > Batch deploy appears to be reading all the files into memory > first > > > then sending to the output. > > > > > > Shouldn't it be one file in --> one file out? > > > > > > > It should. But I'm wondering if the problem is in the source data > > format. It's CSV isn't it? FME treats CSV as a folder based > format; ie > > each CSV file in the same folder is a feature type in the same > dataset > > - not a separate dataset. > > > > Confirm the problem by putting one of the CSV in a separate folder > and > > trying the process again. Does the separated CSV get read > separately? > > > > If so, I'm not sure about the fix. How are you specifying the > source > > files? By selecting the folder or the files? Selecting a folder > might > > make FME assume it is a single dataset. Try selecting the files > > individually. > > > > Let me know what you find. It's interesting how batch deploy > regards > > different data structures; annoying at times, but always perfectly > > logical once you see the trick. > > > > Mark > > > For insights into what's up at Safe Software and what's on the development horizon, visit Safe's blog at spatial-etl.blogspot.com. Safe Software has also made slides available that outline enhancements planned for FME 2007. The slides are from the "Road Ahead" presentation given on Day 2 of the FME Worldwide Users Conference. To view these slides, visit www.safe.com/2006uc. Yahoo! Groups Links <*> To visit your group on the web, go to: http://groups.yahoo.com/group/fme/ <*> Your email settings: Individual Email | Traditional <*> To change settings online go to: http://groups.yahoo.com/group/fme/join (Yahoo! ID required) <*> To change settings via email: mailto:[EMAIL PROTECTED] mailto:[EMAIL PROTECTED] <*> To unsubscribe from this group, send an email to: [EMAIL PROTECTED] <*> Your use of Yahoo! Groups is subject to: http://docs.yahoo.com/info/terms/
