Re: Extended date and time
On Nov 10, 10:37 am, Jeremy Sanders jeremy [EMAIL PROTECTED] wrote: Hi - I need to add support to a program for dates and times. The built-in Python library seems to be okay for many purposes, but what I would like would be Unix epoch style times (seconds relative to some date), covering a large period from the past to the future. What would be nice would be a library which can take floating point seconds from an epoch. Does anyone know of a library which can convert from human style dates and times to a floating point epoch and back again? I expect I could fudge the fractional seconds with the built-in library, but I can't see how to get dates in the past. Thanks, Jeremy. -- Jeremy Sandershttp://www.jeremysanders.net/ Have you looked at mx.DateTime: http://www.egenix.com/products/python/mxBase/mxDateTime/ In matplotlib, I also use their Dates modules functions for conversions (see the near bottom of the page): http://matplotlib.sourceforge.net/matplotlib.dates.html In the scipy sandbox, you can also build a package called 'TimeSeries': http://www.scipy.org/SciPyPackages/TimeSeries I also have trouble with date/times with whats available. Off the top of my head... converting a numpy array of epochs to some datetime object and back. If I had the time I'd contribute additional functionality to Pierre's and Matt's TimeSeries module (the one in scipy). -dieter -- http://mail.python.org/mailman/listinfo/python-list
Re: Extended date and time
On Nov 11, 4:46 pm, D.Hering [EMAIL PROTECTED] wrote: On Nov 10, 10:37 am, Jeremy Sanders jeremy I also have trouble with date/times with whats available. Off the top of my head... converting a numpy array of epochs to some datetime object and back. If I had the time I'd contribute additional functionality to Pierre's and Matt's TimeSeries module (the one in scipy). -dieter I made a request for this to Pierre and Matt on the scipy-user list. -- http://mail.python.org/mailman/listinfo/python-list
Re: Python IDE
On Nov 3, 9:11 am, Simon Pickles [EMAIL PROTECTED] wrote: Hi, I have recently moved from Windows XP to Ubuntu Gutsy. I need a Python IDE and debugger, but have yet to find one as good as Pyscripter for Windows. Can anyone recommend anything? What are you all using? Coming from a Visual Studio background, editing text files and using the terminal to execute them offends my sensibilities :) Thanks Si Eric4 is and excellent graphical IDE with built-in debugger, profiler, project management, a RAD Qt4 builder (Qt designer), and all sorts of other goodies. http://www.die-offenbachs.de/eric/index.html IMO, it's the way to go for Python development. And since I prefer KDE (Kubuntu) over Gnome (Ubuntu) there's an even greater attraction! Gotta love KDE. -dieter -- http://mail.python.org/mailman/listinfo/python-list
Re: Binary search tree
On Nov 9, 4:06 pm, [EMAIL PROTECTED] wrote: Hi, I have to get list of URLs one by one and to find the URLs that I have more than one time(can't be more than twice). I thought to put them into binary search tree, this way they'll be sorted and I'll be able to check if the URL already exist. Couldn't find any python library that implements trees. Is there some library of this kind in python? Or can I find it somewhere else? Can you use set() or set.difference()? -- http://mail.python.org/mailman/listinfo/python-list
Re: Python good for data mining?
On Nov 5, 10:29 am, Maarten [EMAIL PROTECTED] wrote: On Nov 5, 1:51 pm, Jens [EMAIL PROTECTED] wrote: On 5 Nov., 04:42, D.Hering [EMAIL PROTECTED] wrote: On Nov 3, 9:02 pm, Jens [EMAIL PROTECTED] wrote: I then leaned C and then C++. I am now coming home to Python realizing after my self-eduction, that programming in Python is truly a pleasure and the performance is not the concern I first considered to be. Here's why: Python is very easily extended to near C speed. The Idea that FINALLY sunk in, was that I should first program my ideas in Python WITHOUT CONCERN FOR PERFOMANCE. Then, profile the application to find the bottlenecks and extend those blocks of code to C or C++. Cython/ Pyrex/Sip are my preferences for python extension frameworks. Numpy/Scipy are excellent libraries for optimized mathematical operations. Pytables is my preferential python database because of it's excellent API to the acclaimed HDF5 database (used by very many scientists and government organizations). So what you're saying is, don't worry about performance when you start coding, but use profiling and optimization in C/C++. Sounds reasonable. It's been 10 years ago since I've done any programming in C ++, so I have to pick up on that soon I guess. Premature optimization is the root of all evil, to quote a famous person. And he's right, as most people working larger codes will confirm. On Nov 5, 10:29 am, Maarten [EMAIL PROTECTED] wrote: On Nov 5, 1:51 pm, Jens [EMAIL PROTECTED] wrote: On 5 Nov., 04:42, D.Hering [EMAIL PROTECTED] wrote: On Nov 3, 9:02 pm, Jens [EMAIL PROTECTED] wrote: I then leaned C and then C++. I am now coming home to Python realizing after my self-eduction, that programming in Python is truly a pleasure and the performance is not the concern I first considered to be. Here's why: Python is very easily extended to near C speed. The Idea that FINALLY sunk in, was that I should first program my ideas in Python WITHOUT CONCERN FOR PERFOMANCE. Then, profile the application to find the bottlenecks and extend those blocks of code to C or C++. Cython/ Pyrex/Sip are my preferences for python extension frameworks. Numpy/Scipy are excellent libraries for optimized mathematical operations. Pytables is my preferential python database because of it's excellent API to the acclaimed HDF5 database (used by very many scientists and government organizations). So what you're saying is, don't worry about performance when you start coding, but use profiling and optimization in C/C++. Sounds reasonable. It's been 10 years ago since I've done any programming in C ++, so I have to pick up on that soon I guess. Premature optimization is the root of all evil, to quote a famous person. And he's right, as most people working larger codes will confirm. As for pytables: it is the most elegant programming interface for HDF on any platform that I've encountered so far. Most other platforms stay close the HDF5 library C-interface, which is low-level, and quite complex. PyTables was written with the end-user in mind, and it shows. One correction though: PyTables is not a database: it is a storage for (large) arrays, datablocks that you don't want in a database. Use a database for the metadata to find the right file and field within that file. Keep in mind though that I mostly work with externally created HDF-5 files, not with files created in pytables. PyTables Pro has an indexing feature which may be helpful for datamining (if you write the hdf-5 files from python). Maarten Hi Maarten, I respectfully disagree that HDF5 is not a DB. Its true that HDF5 on its prima facie is not relational but rather hierarchical. Hierarchical is truely a much more natural/elegant[1] design from my perspective. HDF has always had meta-data capabilities and with the new 1.8beta version available, it is increasing its ability with 'references/links' allowing for pure/partial relational datasets, groups, and files as well as storing self implemented indexing. The C API is obviously much more low level, and Pytables does not yet support these new features. [1] Anything/everything that is physical/virtual, or can be conceived is hierarchical... if the system itself is not random/chaotic. Thats a lovely revelation I've had... EVERYTHING is hierarchical. If it has context it has hierarchy. -- http://mail.python.org/mailman/listinfo/python-list
Re: SIP won't compile on OSX 10.3
On Nov 5, 10:41 pm, Benjamin [EMAIL PROTECTED] wrote: Hi! I'm trying to install SIP on my Mac with the eventual aim of installing PyQt. The python configure.py stage works fine, but when I type make this is what I see: cc -c -pipe -Os -w -I. -o main.o main.c cc -c -pipe -Os -w -I. -o transform.o transform.c cc -c -pipe -Os -w -I. -o gencode.o gencode.c cc -c -pipe -Os -w -I. -o export.o export.c cc -c -pipe -Os -w -I. -o heap.o heap.c cc -c -pipe -Os -w -I. -o parser.o parser.c cc -c -pipe -Os -w -I. -o lexer.o lexer.c c++ -headerpad_max_install_names -o sip main.o transform.o gencode.o export.o heap.o parser.o lexer.o cc -c -pipe -fPIC -Os -w -I. -I/Library/Frameworks/Python.framework/ Versions/2.5/include/python2.5 -o siplib.o siplib.c cc -c -pipe -fPIC -Os -w -I. -I/Library/Frameworks/Python.framework/ Versions/2.5/include/python2.5 -o qtlib.o qtlib.c cc -c -pipe -fPIC -Os -w -I. -I/Library/Frameworks/Python.framework/ Versions/2.5/include/python2.5 -o threads.o threads.c cc -c -pipe -fPIC -Os -w -I. -I/Library/Frameworks/Python.framework/ Versions/2.5/include/python2.5 -o objmap.o objmap.c c++ -c -pipe -fPIC -Os -w -I. -I/Library/Frameworks/Python.framework/ Versions/2.5/include/python2.5 -o bool.o bool.cpp c++ -headerpad_max_install_names -bundle -F/Library/Frameworks - framework Python -o sip.so siplib.o qtlib.o threads.o objmap.o bool.o ld: Undefined symbols: _fstatvfs referenced from Python expected to be defined in libSystem _lchown referenced from Python expected to be defined in libSystem _statvfs referenced from Python expected to be defined in libSystem make[1]: *** [sip.so] Error 1 make: *** [all] Error 2 I'm not an expert at linking, but it looks like the Python lib was built incorrectly. Or is this a SIP problem? Thanks. Do a google search for _fstatvfs, _lchown, _statvfs. I don't use mac but I'd guess your missing a needed library. -- http://mail.python.org/mailman/listinfo/python-list
Re: Python good for data mining?
On Nov 3, 9:02 pm, Jens [EMAIL PROTECTED] wrote: I'm starting a project indatamining, and I'm considering Python and Java as possible platforms. I'm conserned by performance. Most benchmarks report that Java is about 10-15 times faster than Python, and my own experiments confirms this. I could imagine this to become a problem for very large datasets. How good is the integration with MySQL in Python? What about user interfaces? How easy is it to use Tkinter for developing a user interface without an IDE? And with an IDE? (which IDE?) What if I were to use my Python libraries with a web site written in PHP, Perl or Java - how do I intergrate with Python? I really like Python for a number of reasons, and would like to avoid Java. Sorry - lot of questions here - but I look forward to your replies! All of my programming is data centric. Data mining is foundational there in. I started learning computer science via Python in 2003. I too was concerned about it's performance, especially considering my need for literally trillions of iterations of financial data tables with mathematical algorithms. I then leaned C and then C++. I am now coming home to Python realizing after my self-eduction, that programming in Python is truly a pleasure and the performance is not the concern I first considered to be. Here's why: Python is very easily extended to near C speed. The Idea that FINALLY sunk in, was that I should first program my ideas in Python WITHOUT CONCERN FOR PERFOMANCE. Then, profile the application to find the bottlenecks and extend those blocks of code to C or C++. Cython/ Pyrex/Sip are my preferences for python extension frameworks. Numpy/Scipy are excellent libraries for optimized mathematical operations. Pytables is my preferential python database because of it's excellent API to the acclaimed HDF5 database (used by very many scientists and government organizations). As for GUI framework, I have studied Qt intensely and would therefore, very highly recommend PyQt. After four years of intense study, I can say that with out a doubt, Python is most certainly the way to go. I personally don't understand why, generally, there is any attraction to Java, though I have yet to study it further. -- http://mail.python.org/mailman/listinfo/python-list
Re: attaching someconfusing results in webbrowser.open on gnulinux
krishnakant Mane wrote: hello all, I had mentioned previously that I can't open html files in python. I have my username as krishna and there is a documents folder. so when I give webbrowser.open(file:///home/krishna/documents/tut.html) on python prompt I get true as return value but web browser (firefox ) opens with page not found. and the address bar shows the following address which indeed is wrong. file:///home/krishna/file:///home/krishna/documents/tut.html I can't understand what is happening. regards, Krishnakant. I'm not familiar with the module, but maybe a comparison with this cookbook example will help: http://aspn.activestate.com/ASPN/Cookbook/Python/Recipe/347810 -- http://mail.python.org/mailman/listinfo/python-list
Re: Downloading from a clean url
Evan Klitzke wrote: On 6/20/07, D.Hering [EMAIL PROTECTED] wrote: General: How do I download a page's data from a clean url. Specific: I'm using PyQt's QHttp and QUrl classes for requests and acquiring the response, but I can't figure out how to access a page's data without knowing the file of the url's path. For instance http://kde.org If the page is omitted, as in your example of http://kde.org, the page is / Right, but so far I'm not able to get a response unless I actually provide the actual page and it's extension in the path of the url. For instance /page.html or /this/path/to/page.html ...etc. -- Evan Klitzke [EMAIL PROTECTED] -- http://mail.python.org/mailman/listinfo/python-list
Downloading from a clean url
General: How do I download a page's data from a clean url. Specific: I'm using PyQt's QHttp and QUrl classes for requests and acquiring the response, but I can't figure out how to access a page's data without knowing the file of the url's path. For instance http://kde.org Thanks, -Dieter -- http://mail.python.org/mailman/listinfo/python-list
Re: Shared Memory Space - Accross Apps Network
On May 23, 4:04 am, Tim Golden [EMAIL PROTECTED] wrote: Robert Rawlins - Think Blue wrote: I've got an application that runs on an embedded system, the application uses a whole bunch or dicts and other data types to store state and other important information. I'm looking to build a small network of these embedded systems, and I'd love to have them all share the same set or data. Is it possible to share the applications variables across multiple applications, so certain lists are like a 'pool' written to by the different systems? I'm sure I could cobble something together by writing the lists to shared files instead of keeping them in RAM, but that feels a little inefficient. I'd like to try and configure some form of master/slave relationship between my applications if possible. I was really surprised you hadn't received a whole slew of answers for this (even if they were: search the newsgroup for the last time this was asked!) But then I noticed that the post hadn't appeared on Google Groups, at least. I read things via the mailing list; is it possible your post hasn't made it across to Usenet either? Just to get the ball rolling, I'd suggest two things: Pyro -http://pyro.sf.net This is actively maintained and has been going for a while. We use it here (on a fairly small scale) and I know that others use it elsewhere for bigger things. It's based on a threaded socket server so whenever someone starts to say: I know; I'll roll my own threaded socket server, I'm inclined to say: Don't reinvent the wheel; try Pyro. PyLinda -http://www-users.cs.york.ac.uk/~aw/pylinda/ This implements the tuplespace paradigm. It's great fun to use, but as far as I know this implementation was a PhD project and lacks the robustness and wide use of other things. That said, it works perfectly well within its remit and might be a good match for what you're trying to do. No doubt other people can chime in with suggestions TJG Possibly, IPython's new interactive parallel environment is what you are looking for: http://ipython.scipy.org/moin/Parallel_Computing -- http://mail.python.org/mailman/listinfo/python-list
Re: Shared Memory Space - Accross Apps Network
On May 23, 4:04 am, Tim Golden [EMAIL PROTECTED] wrote: Robert Rawlins - Think Blue wrote: I've got an application that runs on an embedded system, the application uses a whole bunch or dicts and other data types to store state and other important information. I'm looking to build a small network of these embedded systems, and I'd love to have them all share the same set or data. Is it possible to share the applications variables across multiple applications, so certain lists are like a 'pool' written to by the different systems? I'm sure I could cobble something together by writing the lists to shared files instead of keeping them in RAM, but that feels a little inefficient. I'd like to try and configure some form of master/slave relationship between my applications if possible. I was really surprised you hadn't received a whole slew of answers for this (even if they were: search the newsgroup for the last time this was asked!) But then I noticed that the post hadn't appeared on Google Groups, at least. I read things via the mailing list; is it possible your post hasn't made it across to Usenet either? Just to get the ball rolling, I'd suggest two things: Pyro -http://pyro.sf.net This is actively maintained and has been going for a while. We use it here (on a fairly small scale) and I know that others use it elsewhere for bigger things. It's based on a threaded socket server so whenever someone starts to say: I know; I'll roll my own threaded socket server, I'm inclined to say: Don't reinvent the wheel; try Pyro. PyLinda -http://www-users.cs.york.ac.uk/~aw/pylinda/ This implements the tuplespace paradigm. It's great fun to use, but as far as I know this implementation was a PhD project and lacks the robustness and wide use of other things. That said, it works perfectly well within its remit and might be a good match for what you're trying to do. No doubt other people can chime in with suggestions TJG Possibly, IPython's new interactive parallel environment is what you are looking for: http://ipython.scipy.org/moin/Parallel_Computing -- http://mail.python.org/mailman/listinfo/python-list
Re: PyDoc -g call to Alt-Installed Python
On Mar 28, 3:09 am, Peter Otten [EMAIL PROTECTED] wrote: D.Hering wrote: I have both python2.4 and 2.5 installed on a (k)ubuntu linux box. I'm trying to get the call to pydoc -g (pydoc server called from the system console) to recognize python2.5 rather than the system's default 2.4 release. I've tried several different things so far, to no avail. My console scripting knowledge, so far, is minimal. Any help here is appreciated. Copy Tools/scripts/pydoc from the Python2.5 source distribution into ~/bin. Then change its first line from #!/usr/bin/env python to #!/usr/bin/env python2.5 Peter Thanks Pete -- http://mail.python.org/mailman/listinfo/python-list
PyDoc -g call to Alt-Installed Python
I have both python2.4 and 2.5 installed on a (k)ubuntu linux box. I'm trying to get the call to pydoc -g (pydoc server called from the system console) to recognize python2.5 rather than the system's default 2.4 release. I've tried several different things so far, to no avail. My console scripting knowledge, so far, is minimal. Any help here is appreciated. Thanks, -Dieter -- http://mail.python.org/mailman/listinfo/python-list
Re: Using Which Version of Linux
And for complete control and customization of your os and hardware... There's nothing like Gentoo! -- http://mail.python.org/mailman/listinfo/python-list
Re: Objects with different data views
Paul Rubin wrote: Steven D'Aprano [EMAIL PROTECTED] writes: class Parrot(object): x = property(getx, setx) y = property(gety, sety) def getx(self): return self.a + self.b def setx(self, x): y = self.y # calls gety self.a, self.b = 2*x - y, y-x def gety(self): return self.a + 2*self.b def sety(self, y): x = self.x# calls getx self.a, self.b = 2*x - y, y-x class Parrot(object): def getx(self): return self.a + self.b def setx(self, x): y = self.y # calls gety self.a, self.b = 2*x - y, y-x def gety(self): return self.a + 2*self.b def sety(self, y): x = self.x# calls getx self.a, self.b = 2*x - y, y-x x = property(getx, setx) y = property(gety, sety) -- http://mail.python.org/mailman/listinfo/python-list
Re: morphological image processing in Python
Take a look at ADaM and it's python wrappers: http://datamining.itsc.uah.edu/adam/documentation.html -- http://mail.python.org/mailman/listinfo/python-list
Re: Poor man's OCR: need performance improvement tips
Hi Take a look at ADaM's image processing functionality. I'd also suggest seeing if Numarray of Scipy can be utilized. Here's ADaM's site. I'm sure your familiar with the others mentioned. http://datamining.itsc.uah.edu/adam/ hth, Dieter -- http://mail.python.org/mailman/listinfo/python-list
Re: Poor man's OCR: need performance improvement tips
I'm working on essentially the same thing for a real-time context. No formal schema developed yet, but I know that I'll be using some combination of the following: ADaM, ESML (Binary data format unification...xml config), Numarray/Scipy, Pytables (DataBase), PIL, Cairo (svg), and MatPlotlib. -- http://mail.python.org/mailman/listinfo/python-list
Re: Poor man's OCR: need performance improvement tips
I thought I should correct and clarify the use of EMSL (even though this isn't specific toward your request, qvx.) http://esml.itsc.uah.edu/index.jsp It's more for data format recognition and conversion. Here's a description from the site. The sw was developed for earth science, but is very useful for any domain. ESML is an interchange technology that enables data (both structural and semantic) interoperability with applications without enforcing a standard format. Users can write external files using ESML schema to describe the structure of the data file. Applications can utilize the ESML Library to parse this description file and decode the data format. As a result, software developers can now build data format independent applications utilizing the ESML technology. Furthermore, semantic tags can be added to the ESML files by linking different domain ontologies to provide a complete machine understandable data description. This ESML description file allows the development of intelligent applications that can now understand and use the data. -- http://mail.python.org/mailman/listinfo/python-list
Re: Line Scan and Removal
Take a look at ADaM ( ESML for unifying format) and see if some of their image processing tools can help you. http://datamining.itsc.uah.edu/adam/documentation.html Dieter -- http://mail.python.org/mailman/listinfo/python-list
Re: Barcode Recognition
Hi Rob, I think ADaM is exactly what your looking for. Let me know what you think about it. http://datamining.itsc.uah.edu/adam/ Dieter -- http://mail.python.org/mailman/listinfo/python-list
Re: Python 2.5 alpha
Hi Aahz, Yes thank you. To clarify the cvs dist README listed Python version 2.5 alpha 0. I should have realized before posting that replacing was a bad idea and another slot-ed version could be installed (package manager already has 2.3.5 2.4.1). I just installed 2.5a0 in an alternative directory (make altinstall) which build and tested out fine. I'm gonna now attempt to compile the module packages mentioned above. I'll report how it turns out for anyone interested. Thanks for your help! Dieter Thomas Jollans wrote: D.Hering wrote: under gentoo linux 2.6. that does not exist. gentoo labels installers 2005.0 etc, but I have never heard of version numbers. do you mean gentoo with linux 2.6 ? Hi Thomas, Yes, ambiguity/abridgement usage is troublesome at times..lol. Yeah the iso is 2005.0 and the linux kernal is gentoo sources version 2.6.12. Dieter -- http://mail.python.org/mailman/listinfo/python-list
Re: Python 2.5 alpha
So far so good. Numeric-24.0b2, numarray-1.3.3, pytables-1.1.1 (gonna wait alittle on the scipy install) all built. Tests passed except one trivial test in numarray but does function: 1 items had failures: 1 of 1205 in cache pass ***Test Failed*** 1 failures. File /usr/local/lib/python2.5/site-packages/numarray/numtest.py, line 3477, in cache pass Failed example: try: import Numeric except ImportError: pass else: a = arange(5) b = Numeric.arange(5) c = a + b Exception raised: Traceback (most recent call last): File /usr/local/lib/python2.5/doctest.py, line 1243, in __run compileflags, 1) in test.globs File doctest cache pass[1203], line 2, in ? File /usr/local/lib/python2.5/site-packages/Numeric/Numeric.py, line 358, in ? from dotblas import dot, innerproduct, vdot File /usr/local/lib/python2.5/site-packages/numarray/dotblas.py, line 5, in ? import generic as _gen File /usr/local/lib/python2.5/site-packages/numarray/generic.py, line 13, in ? import numerictypes as _nt File /usr/local/lib/python2.5/site-packages/numarray/numerictypes.py, line 168, in ? Byte = _register(Byte, Int8) File /usr/local/lib/python2.5/site-packages/numarray/numerictypes.py, line 68, in _register raise ValueError(Type %s has already been registered % name) ValueError: Type Byte has already been registered sh-3.00# python2.5 Python 2.5a0 (#1, Sep 18 2005, 10:20:55) [GCC 3.4.4 (Gentoo 3.4.4, ssp-3.4.4-1.0, pie-8.7.8)] on linux2 Type help, copyright, credits or license for more information. import numarray as na import Numeric as nu a = na.arange(5) b = nu.arange(5) c = a+b c array([0, 2, 4, 6, 8]) Anyway, looking forward to now play with the generator functionality and hoping the installs' continue to perform properly. :^) Dieter -- http://mail.python.org/mailman/listinfo/python-list
Python 2.5 alpha
Generally, what sort of compatibility problems should I expect if I were to replace 2.4.1 with 2.5 alpha (current cvs dist)? I'm working under gentoo linux 2.6. Specifically, should I expect any problems with Numarray, Scipy, or Pytables or IDE's. My degree of understanding such things is limited, and I'm anxious to use the new generator/coroutine functionality. Thanks for your comments, Dieter -- http://mail.python.org/mailman/listinfo/python-list
