Re: [Matplotlib-users] Computer specs for fast matplotlib and basemap processing

2009-04-09 Thread Anton Vasilescu
Thanks a lot Chris for the detailed answer. I had the same doubts about 64bits and multiple cores. I just found out about Gdal and yes, Jeff's grib tools seem to be exactly what I needed. I'll stay with a fast dual core and 32 bit os and I'll get a 1 rpm hdd. That should be more than enoug

Re: [Matplotlib-users] Computer specs for fast matplotlib and basemap processing

2009-04-09 Thread Christopher Barker
Eric Firing wrote: >> The biggest bottleneck is happening because I'm unpacking grib files to csv >> files using Degrib in command line. That operation is usually around half an disk speed -- you might want to try SATA RAID 0 (striping) -- I"d get a good hardware vendor's advise in maximizing you

Re: [Matplotlib-users] Computer specs for fast matplotlib and basemap processing

2009-04-09 Thread Jose Gómez-Dans
On Wednesday 08 April 2009 21:57:21 antonv wrote: > The biggest bottleneck is happening because I'm unpacking grib files to csv > files using Degrib in command line. That operation is usually around half > an hour using no more than 50% of the processor but it maxes out the memory > usage and it de

Re: [Matplotlib-users] Computer specs for fast matplotlib and basemap processing

2009-04-08 Thread Eric Firing
antonv wrote: > I know that using the csv files is very slow but I have no knowledge of > working with the netcdf format and I was in a bit of a rush when I wrote > this. I will take a look again at it. How would you translate a grib in > netcdf? Are there any secific applications or straight throu

Re: [Matplotlib-users] Computer specs for fast matplotlib and basemap processing

2009-04-08 Thread Anton Vasilescu
@lists.sourceforge.net Sent: Wednesday, April 8, 2009 4:02:22 PM Subject: Re: [Matplotlib-users] Computer specs for fast matplotlib and basemap processing antonv wrote: > I know that using the csv files is very slow but I have no knowledge of > working with the netcdf format and I was in a bi

Re: [Matplotlib-users] Computer specs for fast matplotlib and basemap processing

2009-04-08 Thread Jeff Whitaker
antonv wrote: > I know that using the csv files is very slow but I have no knowledge of > working with the netcdf format and I was in a bit of a rush when I wrote > this. I will take a look again at it. How would you translate a grib in > netcdf? Are there any secific applications or straight throu

Re: [Matplotlib-users] Computer specs for fast matplotlib and basemap processing

2009-04-08 Thread antonv
I know that using the csv files is very slow but I have no knowledge of working with the netcdf format and I was in a bit of a rush when I wrote this. I will take a look again at it. How would you translate a grib in netcdf? Are there any secific applications or straight through numpy? As for pyn

Re: [Matplotlib-users] Computer specs for fast matplotlib and basemap processing

2009-04-08 Thread Eric Firing
antonv wrote: > I have a bit of experience programming and I am pretty sure I get my parts of > the code pretty well optimized. I made sure that in the loop I have only the > stuff needed and I'm loading all the stuff before. > > The biggest bottleneck is happening because I'm unpacking grib files

Re: [Matplotlib-users] Computer specs for fast matplotlib and basemap processing

2009-04-08 Thread antonv
I have a bit of experience programming and I am pretty sure I get my parts of the code pretty well optimized. I made sure that in the loop I have only the stuff needed and I'm loading all the stuff before. The biggest bottleneck is happening because I'm unpacking grib files to csv files using Deg

Re: [Matplotlib-users] Computer specs for fast matplotlib and basemap processing

2009-04-08 Thread João Luís Silva
antonv wrote: > Hi all, > > I am processing a lot of grib data from noaa with the use of matplotlib and > basemap. On my actual laptop (p4 3ghz, 512mb ram) the whole process takes > close to 3 hours... so it's time for a new machine but still on a very tight > budget :) > You should profile your

Re: [Matplotlib-users] Computer specs for fast matplotlib and basemap processing

2009-04-08 Thread Eric Firing
antonv wrote: > Hi all, > > I am processing a lot of grib data from noaa with the use of matplotlib and > basemap. On my actual laptop (p4 3ghz, 512mb ram) the whole process takes > close to 3 hours... so it's time for a new machine but still on a very tight > budget :) > > My main question is wh

[Matplotlib-users] Computer specs for fast matplotlib and basemap processing

2009-04-08 Thread antonv
Hi all, I am processing a lot of grib data from noaa with the use of matplotlib and basemap. On my actual laptop (p4 3ghz, 512mb ram) the whole process takes close to 3 hours... so it's time for a new machine but still on a very tight budget :) My main question is what should i emphasize more, a