On 4/24/2012 6:08 PM, Ted Roche wrote: > And what is the problem you're trying to solve? Are your data scripts > adding new data (INSERT/UPDATE) or querying (SELECT) and what's the > problem? I'd guess slow response, but... there's that saying about > ASSuME....
Mostly, it's SELECT queries. I load the data, add the appropriate indexes on the key fields in my WHERE clauses (very common usually...not much variance in my queries. E.g.., "...where region = ?cRegion and expcat = ?cExpcat and product = ?cProduct" so I have a compound index on region+expcat+product), and then query away. > > Which data storage engine are you using? Why? I had defaulted to InnoDB, and chose that for less chance of crashes. I was actually going to lookup the prevailing current-day wisdom on using the MyISAM engine again, but last I read, InnoDB was supposedly just as fast now. > > Does the database have to be on a laptop? The first, cheapest database > performance optimization is "spindles, spindles and more spindles:" OS > on its own disk, data on one, index on another, logs on a third. Disk > I/O is orders of magnitude slower than CPU or memory performance and > is cheap, cheap, cheap to solve... on a box, not a laptop. As I said to Steve, we've got these spare laptops (2.4 GHz processor with 3.5 GB RAM running Windows XP) and I'm not sure they'd allow us to buy a separate dedicated box for this data work since it's just 2 months out of the year annually. I'm betting the idea of asking for a new dedicated server box would get a response something akin to "we can get it done with what we've got." > > Throwing RAM at the problem can't hurt, with dirt-cheap RAM prices. > But if it's write I/O you're optimizing, you might not see much of a > performance increase unless you tweak cache settings. I set my ini file to actual like a big server, trying to get the maximum cache settings. -- Mike Babcock, MCP MB Software Solutions, LLC President, Chief Software Architect http://mbsoftwaresolutions.com http://fabmate.com http://twitter.com/mbabcock16 _______________________________________________ Post Messages to: [email protected] Subscription Maintenance: http://leafe.com/mailman/listinfo/profox OT-free version of this list: http://leafe.com/mailman/listinfo/profoxtech Searchable Archive: http://leafe.com/archives/search/profox This message: http://leafe.com/archives/byMID/profox/[email protected] ** All postings, unless explicitly stated otherwise, are the opinions of the author, and do not constitute legal or medical advice. This statement is added to the messages for those lawyers who are too stupid to see the obvious.
