Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-15 Thread Chris Angelico
On Mon, Apr 15, 2013 at 9:45 PM, rusi wrote: > I am trying to understand your points Chris. On the one hand you say: > > On Apr 14, 6:22 pm, Chris Angelico wrote: >> No, no, a thousand times no! If I am doing financial transactions, >> even if I'm alone on my machine, I will demand full ACID comp

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-15 Thread rusi
I am trying to understand your points Chris. On the one hand you say: On Apr 14, 6:22 pm, Chris Angelico wrote: > No, no, a thousand times no! If I am doing financial transactions, > even if I'm alone on my machine, I will demand full ACID compliance. On the other you describe a bookmark stora

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-14 Thread Roy Smith
In article , Tim Chase wrote: > I'd really love if there was a simple DNS-lookup module available in > the stdlib, especially if it allowed overriding the server to ask. pip install dnspython -- http://mail.python.org/mailman/listinfo/python-list

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-14 Thread Chris Angelico
On Mon, Apr 15, 2013 at 2:40 AM, Ned Deily wrote: > In article > , > Chris Angelico wrote: > > Actually, this is one place where I disagree with the current decision >> of the Python core devs: I think bindings for other popular databases >> (most notably PostgreSQL, and probably MySQL since it

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-14 Thread Tim Chase
On 2013-04-14 09:40, Ned Deily wrote: > DNS client lookups use published, well-understood > Internet-standard protocols, not at all like talking to a > third-party database, be it open-source or not. That said, even though DNS is a publicly documented standard, I've reached for DNS code in the Py

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-14 Thread Cousin Stanley
Steven D'Aprano wrote: > On Fri, 12 Apr 2013 23:26:05 +, Cousin Stanley wrote: > >> The firefox browser keeps different sqlite database files for various >> uses > > Yes, and I *really* wish they wouldn't. > > It's my number 1 cause of major problems with Firefox. Problems with so

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-14 Thread Ned Deily
In article , Chris Angelico wrote: > Actually, this is one place where I disagree with the current decision > of the Python core devs: I think bindings for other popular databases > (most notably PostgreSQL, and probably MySQL since it's so widely > used) ought to be included in core, rather th

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-14 Thread Chris Angelico
On Sun, Apr 14, 2013 at 9:17 PM, rusi wrote: > On Apr 14, 12:56 pm, Steven D'Aprano +comp.lang.pyt...@pearwood.info> wrote: >> I've given my view on >> application developers -- specifically, Firefox -- using a not-quite ACID >> database in a way that is fragile, can cause data loss, > > FUD > Ar

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-14 Thread rusi
On Apr 14, 12:56 pm, Steven D'Aprano wrote: > On Sat, 13 Apr 2013 10:02:18 -0700, rusi wrote: > > To the OP: > > Steven is welcome to his views about use of databases. > > I haven't given any views about databases. You are twisting "use of databases" to just "about databases" And heres what you

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-14 Thread Steven D'Aprano
On Sat, 13 Apr 2013 10:02:18 -0700, rusi wrote: > To the OP: > Steven is welcome to his views about use of databases. I haven't given any views about databases. I've given my view on application developers -- specifically, Firefox -- using a not-quite ACID database in a way that is fragile, can

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-13 Thread someone
On 04/14/2013 12:34 AM, Chris Angelico wrote: On Sun, Apr 14, 2013 at 5:34 AM, someone wrote: I think maybe I'll experiment a bit with both mySql (small/medium sized databases) and for critical/important stuff I should go with PostgreSQL PostgreSQL isn't majorly slower than MySQL, and it's a

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-13 Thread someone
On 04/14/2013 12:54 AM, Chris Angelico wrote: On Sun, Apr 14, 2013 at 8:31 AM, someone wrote: Ok, thank you. I just came across a blog that said pytables is also a very good option? http://www.pytables.org/moin/PyTables?action=AttachFile&do=view&target=non-indexed.png From what I gather, th

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-13 Thread Chris Angelico
On Sun, Apr 14, 2013 at 8:31 AM, someone wrote: > Ok, thank you. I just came across a blog that said pytables is also a very > good option? > > http://www.pytables.org/moin/PyTables?action=AttachFile&do=view&target=non-indexed.png >From what I gather, that's looking at performance of a non-indexa

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-13 Thread Chris Angelico
On Sun, Apr 14, 2013 at 6:01 AM, Dennis Lee Bieber wrote: > On Sun, 14 Apr 2013 00:03:25 +1000, Chris Angelico > declaimed the following in gmane.comp.python.general: > >> True ACID compliance demands support at every level: >> >> 1) The application has to operate in logical units of work, which

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-13 Thread someone
On 04/14/2013 12:22 AM, Walter Hurry wrote: On Sat, 13 Apr 2013 21:34:38 +0200, someone wrote: On 04/13/2013 04:56 PM, Walter Hurry wrote: On Sat, 13 Apr 2013 16:39:12 +0200, someone wrote: I'm not so rich, so I prefer to go for a free database solution rather than an expensive license (

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-13 Thread Chris Angelico
On Sun, Apr 14, 2013 at 5:34 AM, someone wrote: > I think maybe I'll experiment a bit with both mySql (small/medium sized > databases) and for critical/important stuff I should go with PostgreSQL PostgreSQL isn't majorly slower than MySQL, and it's a lot more trustworthy in terms of database cons

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-13 Thread Walter Hurry
On Sat, 13 Apr 2013 21:34:38 +0200, someone wrote: > On 04/13/2013 04:56 PM, Walter Hurry wrote: >> On Sat, 13 Apr 2013 16:39:12 +0200, someone wrote: >> >>> I'm not so rich, so I prefer to go for a free database solution rather >>> than an expensive license >> ( but I do care about ACID complia

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-13 Thread Roy Smith
In article , someone wrote: > > Some of the early Unix file systems were very fragile. One of the > > (often under-appreciated) major advances in BSD (it was certainly in > > 4.2, not sure how much earlier) was a new filesystem which was much more > > robust in the face of hardware failures and

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-13 Thread someone
On 04/13/2013 10:01 PM, Dennis Lee Bieber wrote: On Sun, 14 Apr 2013 00:03:25 +1000, Chris Angelico declaimed the following in gmane.comp.python.general: [ ] * Create a table with a number of rows with an ID and a counter, initialized to 0 * Repeatedly, in parallel, perform a transaction

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-13 Thread someone
On 04/13/2013 07:02 PM, rusi wrote: On Apr 13, 9:15 pm, Chris Angelico wrote: On Sun, Apr 14, 2013 at 12:39 AM, someone wrote: On 04/13/2013 04:03 PM, Chris Angelico wrote: . . Failure at any level means the overall system is not ACID compliant. Ok, it would be nice to hear/read th

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-13 Thread someone
On 04/13/2013 06:15 PM, Chris Angelico wrote: On Sun, Apr 14, 2013 at 12:39 AM, someone wrote: On 04/13/2013 04:03 PM, Chris Angelico wrote: Failure at any level means the overall system is not ACID compliant. Roger... But google says sqlite is supposed to be ACID compliant (although maybe n

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-13 Thread someone
On 04/13/2013 04:56 PM, Walter Hurry wrote: On Sat, 13 Apr 2013 16:39:12 +0200, someone wrote: I'm not so rich, so I prefer to go for a free database solution rather than an expensive license ( but I do care about ACID compliance) Sounds to me that PostgreSQL is your man, then. Oh, ok. Th

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-13 Thread someone
On 04/13/2013 04:36 PM, Roy Smith wrote: In article , Chris Angelico wrote: 2) The database engine must employ some form of write-ahead log. [...] one way or another, there must be a way to detect half-done transactions. 3) The operating system and filesystem must support a forced file sync

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-13 Thread rusi
On Apr 13, 9:15 pm, Chris Angelico wrote: > On Sun, Apr 14, 2013 at 12:39 AM, someone wrote: > > On 04/13/2013 04:03 PM, Chris Angelico wrote: > >> Failure at any level means the overall system is not ACID compliant. > > > Roger... But google says sqlite is supposed to be ACID compliant (although

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-13 Thread Chris Angelico
On Sun, Apr 14, 2013 at 12:39 AM, someone wrote: > On 04/13/2013 04:03 PM, Chris Angelico wrote: >> Failure at any level means the overall system is not ACID compliant. > > Roger... But google says sqlite is supposed to be ACID compliant (although > maybe not "fully" as you indicate, I'm not sure

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-13 Thread Walter Hurry
On Sat, 13 Apr 2013 16:39:12 +0200, someone wrote: > I'm not so rich, so I prefer to go for a free database solution rather > than an expensive license ( but I do care about ACID compliance) Sounds to me that PostgreSQL is your man, then. -- http://mail.python.org/mailman/listinfo/python-list

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-13 Thread someone
On 04/13/2013 04:03 PM, Chris Angelico wrote: On Sat, Apr 13, 2013 at 11:30 PM, someone wrote: On 04/13/2013 01:39 PM, Chris Angelico wrote: Note that there's a caveat: You have to tell SQLite to be ACID compliant, effectively. So, you're saying to me that by default SQLite isn't ACID compl

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-13 Thread Roy Smith
In article , Chris Angelico wrote: > 2) The database engine must employ some form of write-ahead log. > [...] > one way or another, there must be a way to detect half-done > transactions. > > 3) The operating system and filesystem must support a forced file > synchronization (fsync/fdatasync),

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-13 Thread Chris Angelico
On Sat, Apr 13, 2013 at 11:30 PM, someone wrote: > On 04/13/2013 01:39 PM, Chris Angelico wrote: >> Note that there's a caveat: You have to tell SQLite to be ACID >> compliant, effectively. > > > So, you're saying to me that by default SQLite isn't ACID compliant, if I > begin to use it in my own

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-13 Thread someone
On 04/13/2013 01:39 PM, Chris Angelico wrote: On Sat, Apr 13, 2013 at 9:08 PM, someone wrote: I just had to google what ACID compliance means and accordingly to this: http://en.wikipedia.org/wiki/SQLite "SQLite is ACID-compliant and implements most of the SQL standard, using a dynamically and

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-13 Thread Chris Angelico
On Sat, Apr 13, 2013 at 9:08 PM, someone wrote: > I just had to google what ACID compliance means and accordingly to this: > > http://en.wikipedia.org/wiki/SQLite > > "SQLite is ACID-compliant and implements most of the SQL standard, using a > dynamically and weakly typed SQL syntax that does not

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-13 Thread someone
On 04/13/2013 03:44 AM, Steven D'Aprano wrote: On Fri, 12 Apr 2013 23:26:05 +, Cousin Stanley wrote: The firefox browser keeps different sqlite database files for various uses Yes, and I *really* wish they wouldn't. It's my number 1 cause of major problems with Firefox. E.g. h

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-12 Thread Steven D'Aprano
On Fri, 12 Apr 2013 23:26:05 +, Cousin Stanley wrote: > The firefox browser keeps different sqlite database files for various > uses Yes, and I *really* wish they wouldn't. It's my number 1 cause of major problems with Firefox. E.g. http://kb.mozillazine.org/Bookmarks_history_and_t

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-12 Thread someone
On 04/13/2013 01:26 AM, Cousin Stanley wrote: someone wrote: So SQLite is very good for "practicing" Yes it is but it is also very good for much more than just practice Check the wikipedia info http://en.wikipedia.org/wiki/Sqlite Very interesting...

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-12 Thread Cousin Stanley
someone wrote: > > So SQLite is very good for "practicing" > Yes it is but it is also very good for much more than just practice Check the wikipedia info http://en.wikipedia.org/wiki/Sqlite "It is arguably the most widely deployed database engine, as

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-12 Thread someone
On 04/12/2013 06:58 PM, Cousin Stanley wrote: someone wrote: As you can see, on my system I had to use: print row[0] , row[1] instead of: print row[ 'xtime' ] , row[ 'col4' ] I'm not sure exactly why The magic there is setting up the row_factory after the database connection .

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-12 Thread Cousin Stanley
someone wrote: > As you can see, on my system I > had to use: > > print row[0] , row[1] > > instead of: > > print row[ 'xtime' ] , row[ 'col4' ] > > I'm not sure exactly why The magic there is setting up the row_factory after the database connection dbc = DBM.connect( 'some.s

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-12 Thread someone
On 2013-04-11 20:44, Cousin Stanley wrote: Cousin Stanley wrote: The stand-alone sqlite interpreter can first be used to create an empty database named some.sql3 and create a table named xdata in that data base sqlite3 some.sql3 '.read xdata_create.sql' This step can

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-12 Thread someone
On 2013-04-11 19:58, Cousin Stanley wrote: someone wrote: I want to put this table into an appropriate container such that afterwards I want to: 1) Put the data into a mySql-table You might consider using sqlite3 as a database manager since it is "batteries included" with p

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-11 Thread someone
On 04/11/2013 07:58 PM, Cousin Stanley wrote: someone wrote: You can be creative with the data selections and pass them off to be plotted as needed If mysql is used instead of sqlite3 you should only have to monkey with the data type declarations in xdata_create.sql and th

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-11 Thread Cousin Stanley
Cousin Stanley wrote: > The stand-alone sqlite interpreter can first be used > to create an empty database named some.sql3 > and create a table named xdata in that data base > > sqlite3 some.sql3 '.read xdata_create.sql' This step can also be done in python without using th

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-11 Thread Cousin Stanley
someone wrote: > > I want to put this table into an appropriate container > such that afterwards I want to: > > 1) Put the data into a mySql-table > You might consider using sqlite3 as a database manager since it is "batteries included" with python The stand-alone sqlite

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-11 Thread someone
On 2013-04-11 10:49, someone wrote: On 2013-04-11 03:39, Cousin Stanley wrote: Is there any clever way of avoiding this for loop, for either this container or another clever container type? Ah, I see - I can also just add a numpy array, i.e: -- import matplotlib.p

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-11 Thread someone
On 2013-04-11 03:39, Cousin Stanley wrote: for row in list_tuples : print ' ' , row.date , row.time , row.col1 , row.col3 , row.col4 file_source.close() Oh, that's great - thank you - I didn't know this named-tuple container before... I'm still wondering whether or not it's the optimal

Re: python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-10 Thread Cousin Stanley
someone wrote: > > I want to put this table into an appropriate container > such that afterwards I want to: > > 1) Put the data into a mySql-table > 2) Be able to easily plot column 1 vs. either of the other columns > using matplotlib etc... > Consider editing your data file into

python-noob - which container is appropriate for later exporting into mySql + matplotlib ?

2013-04-10 Thread someone
Hi, Here's my data: --- 20130315T071500 39000. 10 26 48000. 1 40 20130315T071501 39000. 10 26 48000. 2 42 20130315T071501 39000. 10 26 47520. 15 69 20130315T071501 39000. 10 26 47160. 1 70 20130315T071501 3