One tip (that Pierre's message reminded me of) is that you should set the fme_temp location to be the faster disk you have available. FME occasionally writes a lot of temp information to disk so it helps to be the fastest disk available to you.
This tip is available on fmepedia - on which there is an entire performance tuning and log interpretation section. http://www.fmepedia.com/index.php/FME_Performance_Tuning Pierre - those were all great ideas. Feel free to share them by adding to the fmepedia performance tuning page. Regards, Mark Mark Ireland, Product Support Engineer Safe Software Inc. Surrey, BC, CANADA [EMAIL PROTECTED] http://www.safe.com Solutions for Spatial Data Translation, Distribution and Access --- In [email protected], "Marchand, Pierre \(IWMI\)" <[EMAIL PROTECTED]> wrote: > > Dear Michael, > > A simple trick I use to boost the performance of a specific task is to > upgrade the priority level of the target task through the task manager > process tab, right click on the task and elevate to "high". This might > work but also may not do much difference - I never tried it with FME ... > your system is likely to appear as if it was frozen while the task is > running because it's consuming the high priority over all other OS > operations. In most cases there is a significant improvement of > performance but rarely a fantastic improvement - I've not had a > "fantastic" improvement moment since I upgraded to Pentium Pro from a > P66 ;^) > > Another test you might want to look into is to read your data from one > drive and write the converted data to another drive. Obviously reading > and writing from the same disk is an overhead for the hdd ... despite > the high performance of modern drives I still am impressed by how > separating processes on different drives for processing workflows is an > efficient performance driver. > > If you have the time and patience in trying to isolate the bottleneck of > your operation the performance console (under control panel/admin tools) > provides you with a wealth of indicators to monitor the evolution of > critical performance parameters when running your operation. I recommend > to first look at CPU, memory and disk access indicators. Is your > operation running at 100% CPU throughout ? If not what are the other > indicators that seem to max out ? Can you make changes that will impact > these indicats ? If yes do these changes impact the operation ? etc etc > .... > > Finally the computer should not be running anti-virus software or data > downloading such as bear share, limewire, etc and free of > adware/freeware/any_junk - all of this eats lots of resources on the > CPU/hdd side - it's better that the computer is unplugged from > LAN/internet for obvious reasons while performing your operation. > > I hope this helps, cheers, > > Pierre > > > -----Original Message----- > From: [email protected] [mailto:[EMAIL PROTECTED] On Behalf Of > mark2atsafe > Sent: Tuesday, March 28, 2006 2:51 AM > To: [email protected] > Subject: [fme] Re: FME performance > > Hi Michael, > I suspect with those specs you'll be getting as good a performance as > anyone. You could confirm by running the benchmark workspaces on > fmepedia.com > (http://www.fmepedia.com/index.php/FME_Benchmark_Workspaces) and > comparing your results to other folk. > > If my math skills are correct 100 files in 30 minutes is sub 20 > seconds per file. That doesn't seem too bad to me, but I'd ask... > > 1) What format are you writing to? A database format would probably > slow things considerably. > 2) How are you writing multiple outputs? As I've found recently a > Dataset Fanout doesn't give the best performance. > 3) Batching with a Command File will be better than a single BAT file > since you won't be stopping and starting FME for every translation. > There's a memory downside, but with 4GB you shouldn't have problems. > 4) Are you using Workbench - if so close the log window when you run > the translation else it will be slower. > 5) Can you post the log file? It might provide some clues as to what > parts of the translation are taking the time. > > Mark > > Mark Ireland, Product Support Engineer > Safe Software Inc. Surrey, BC, CANADA > [EMAIL PROTECTED] http://www.safe.com > Solutions for Spatial Data Translation, Distribution and Access > > --- In [email protected], Michael Muilenburg > <michael.muilenburg@> wrote: > > > > I'm running into very long conversion times, (up to 6 hours without > transformers) and I wanted to see if this is typical. The longest > conversion times typically occur when I'm working with CAD files. A > test sample consisting of 102 files and 76.5MB in size with an average > size of 500KB took 30 minutes to run giving a rate of about 2.5 MB/sec. > > > > I've tried the conversion on 3 different systems with similar > results on each: > > > > Workstation with a 10,000 RPM SATA drive and a 2.8GHz Xeon CPU with > 1 GB of Ram, 20kb of L1, 1024kb L2 cache, and a front side bus of > 800Mhz. > > Workstation with a 10,000 RPM SATA array, dual core AMD 3600 with 2 > GB of Ram, 128kb L1, 2000kb L2 cache, and a front side bus of 2000Mhz. > > Server with a 15,000 RPM SCCI array, 2 Xeon dual core 3.06 GHz CPUs, > 4 GB of Ram, 2 x 28kb L1 and 2 x 2MB L2 cache, and a front side bus of > 533MHz. > > > > Any incites as to this being typical performance would be greatly > appreciated. > > > > Best regards, > > > > Michael Muilenburg > > Manager of GIS > > Consolidated Utility Services, Inc. > > dba Great Plains Locating Service > > dba ProMark Utility Locators > > michael.muilenburg@ > > 1001 Office Park Rd. Suite 209 > > West Des Moines, IA 50265 > > (515) 225-2520 x2 Office > > (402) 216-0351 VoIP > > (402) 960-3646 Cell > > > > > > > > > > > Get the maximum benefit from your FME, FME Objects, or SpatialDirect via > our Professional Services team. Visit www.safe.com/services for > details. > Yahoo! Groups Links > Get the maximum benefit from your FME, FME Objects, or SpatialDirect via our Professional Services team. Visit www.safe.com/services for details. Yahoo! Groups Links <*> To visit your group on the web, go to: http://groups.yahoo.com/group/fme/ <*> To unsubscribe from this group, send an email to: [EMAIL PROTECTED] <*> Your use of Yahoo! Groups is subject to: http://docs.yahoo.com/info/terms/
