New version of CodeInvestigator.
CodeInvestigator version 3.2.0 was released on August 21. Release notes: Bug fixes: - Chrome browser: search by value - less memory usage Changes: - nested iterations remain at selected iteration as much as possible - block colours now follow a set pattern - searches are now grouped in subgroups - user can now use middle-click to open functions in a sepatate tab - user can use refresh back forward and bookmarks - more shortcut keys - printout position retained over iterations - iteration tabs can now be scrolled through CodeInvestigator is a tracing tool for Python programs. Running a program through CodeInvestigator creates a recording. Program flow, function calls, variable values and conditions are all stored for every line the program executes. The recording is then viewed with an interface consisting of the code. The code can be clicked: A clicked variable displays its value,a clicked loop displays its iterations. You read code, and have at your disposal all the run time details of that code. A computerized desk check tool and another way to learn about your program. http://sourceforge.net/project/showfiles.php?group_id=183942 -- http://mail.python.org/mailman/listinfo/python-announce-list Support the Python Software Foundation: http://www.python.org/psf/donations/
Re: can't get utf8 / unicode strings from embedded python
I am very sorry that I have offended you to such a degree you feel it necessary to publicly eviscerate me. Perhaps I could have worded it like this: So far I have not seen any troubles including unicode characters in my strings, they *seem* to be fine for my use-case. What kind of trouble has been seen with this by others? Really, I wonder why you are so angry at me for having made a mistake? I'm going to guess that you don't have kids. -- http://mail.python.org/mailman/listinfo/python-list
Re: Improving the web page download code.
On Wednesday, 28 August 2013 04:03:15 UTC+5:30, MRAB wrote:
On 27/08/2013 21:53, mukesh tiwari wrote:
On Wednesday, 28 August 2013 01:49:59 UTC+5:30, MRAB wrote:
On 27/08/2013 20:41, mukesh tiwari wrote:
[snip]
if __name__== '__main__':
u = Downloader()
signal.signal( signal.SIGINT , u.handleexception)
thread.start_new_thread ( u.createurl , () )
for i in xrange ( 5 ) :
thread.start_new_thread ( u.downloadurl , () )
while True : pass
My preferred method when working with background threads is to put a
sentinel such as None at the end and then when a worker gets an item
from the queue and sees that it's the sentinel, it puts it back in
the queue for the other workers to see, and then returns
(terminates). The main thread can then call each worker thread's
.join method to wait for it to finish. You currently have the main
thread running in a 'busy loop', consuming processing time doing
nothing!
Hi MRAB,
Thank you for the reply. I wrote this while loop only because of
there is no thread.join in thread[1] library but I got your point. I
am simply running a while loop for doing nothing. So if somehow I can
block the main without too much computation then it will great.
Why don't you use the 'threading' module instead?
creator = threading.Thread(target=u.createurl)
workers = []
for i in xrange(5):
workers.append(threading.Thread(target=u.downloadurl))
creator.start()
for w in workers:
w.start()
creator.join()
for w in workers:
w.join()
Hi MRAB,
Initially I blocked the main using raw_input('') and it was working fine.
u = Downloader()
signal.signal( signal.SIGINT , u.handleexception)
thread.start_new_thread ( u.createurl , () )
for i in xrange ( 5 ) :
thread.start_new_thread ( u.downloadurl , () )
#This is for blocking main
raw_input('')
When I pressed ctrl-c then it's responding fine but now after switching to
threading module, I am not able to kill my program using SIGINT ( ctrl-c ). Any
idea how to signal SIGINT to threads ?
Now the changed code and I have to catch the SIGINT.
u = Downloader()
signal.signal( signal.SIGINT , u.handleexception)
urlcreator = threading.Thread ( target = u.createurl )
workers = []
for i in xrange ( 5 ):
workers.append ( threading.Thread( target = u.downloadurl ) )
urlcreator.start()
for w in workers:
w.start()
urlcreator.join()
for w in workers:
w.join()
-Mukesh Tiwari
--
http://mail.python.org/mailman/listinfo/python-list
Re: New VPS Provider needed
Op 27-08-13 18:18, Steven D'Aprano schreef: On Wed, 28 Aug 2013 00:41:17 +1000, Chris Angelico wrote: On Wed, Aug 28, 2013 at 12:25 AM, Grant Edwards invalid@invalid.invalid wrote: On 2013-08-27, ni...@superhost.gr wrote: Iam having major issues with my VPS provider and losign customers becaue the provider doesnt set thign u[ cprrectly. Perhaps he's also having problems with a faulty keyboard. Just a faulty key actuator, I think. Nothing unusual in this world. Guys, PLEASE stop baiting Nikos with snide remarks. It makes this a very unpleasant environment, and sets the tone of the community, badly. Why don't you tell Nikos he should stop baiting the list with off topic requestsm like whether someone is willing to provide him free hosting? I also think you are over reacting. One thread where people come with snide remarks doesn't turn the whole newsgroup/mailinglist into an unpleasant environment. -- Antoon Pardon -- http://mail.python.org/mailman/listinfo/python-list
Re: right adjusted strings containing umlauts
Am 08.08.2013 18:37, schrieb Chris Angelico:
On Thu, Aug 8, 2013 at 5:16 PM, Kurt Mueller
kurt.alfred.muel...@gmail.com wrote:
Am 08.08.2013 17:44, schrieb Peter Otten:
Kurt Mueller wrote:
What do I do, when input_strings/output_list has other codings like
iso-8859-1?
You have to know the actual encoding. With that information it's easy:
output_list
['\xc3\xb6', '\xc3\xbc', 'i', 's', 'f']
encoding = utf-8
output_list = [s.decode(encoding) for s in output_list]
print output_list
[u'\xf6', u'\xfc', u'i', u's', u'f']
How do I get to know the actual encoding?
I read from stdin. There can be different encondings.
Usually utf8 but also iso-8859-1/latin9 are to be expected.
But sys.stdin.encoding sais always 'None'.
If you can switch to Python 3, life becomes a LOT easier. The Python 3
input() function (which does the same job as raw_input() from Python
2) returns a Unicode string, meaning that it takes care of encodings
for you.
Because I cannot switch to Python 3 for now my life is not so easy:-)
For some text manipulation tasks I need a template to split lines
from stdin into a list of strings the way shlex.split() does it.
The encoding of the input can vary.
For further processing in Python I need the list of strings to be in unicode.
Here is template.py:
##
#!/usr/bin/env python
# vim: set fileencoding=utf-8 :
# split lines from stdin into a list of unicode strings
# Muk 2013-08-23
# Python 2.7.3
from __future__ import print_function
import sys
import shlex
import chardet
bool_cmnt = True # shlex: skip comments
bool_posx = True # shlex: posix mode (strings in quotes)
for inpt_line in sys.stdin:
print( 'inpt_line=' + repr( inpt_line ) )
enco_type = chardet.detect( inpt_line )[ 'encoding' ] #
{'encoding': 'EUC-JP', 'confidence': 0.99}
print( 'enco_type=' + repr( enco_type ) )
try:
strg_inpt = shlex.split( inpt_line, bool_cmnt, bool_posx, ) # shlex
does not work on unicode
except Exception, errr: # usually
'No closing quotation'
print( error='%s' on inpt_line='%s' % ( errr, inpt_line.rstrip(), ),
file=sys.stderr, )
continue
print( 'strg_inpt=' + repr( strg_inpt ) ) # list of
strings
strg_unic = [ strg.decode( enco_type ) for strg in strg_inpt ] # decode
the strings into unicode
print( 'strg_unic=' + repr( strg_unic ) ) # list of
unicode strings
##
$ cat some-file | template.py
Comments are welcome.
TIA
--
Kurt Mueller
--
Kurt Mueller
--
http://mail.python.org/mailman/listinfo/python-list
Re: New VPS Provider needed
Hello Steven, Iam not trying to beg for your sympathy, i'am just expressing my frustration for my web hosting issues and i do that because i wanted to ask you for an alternative web service(python 3 enabled). Its totally human for one to express his own feeling to a python related and web host related issue in a python newsgroup. Also is a matter of character each person has and iam an open human being and feel like makign friend easy. Let alone that it is also a business offer for someone that wants to host my limited/joomla websites and make money out of it. -- http://mail.python.org/mailman/listinfo/python-list
split lines from stdin into a list of unicode strings
This is a follow up to the Subject
right adjusted strings containing umlauts
For some text manipulation tasks I need a template to split lines
from stdin into a list of strings the way shlex.split() does it.
The encoding of the input can vary.
For further processing in Python I need the list of strings to be in unicode.
Here is template.py:
##
#!/usr/bin/env python
# vim: set fileencoding=utf-8 :
# split lines from stdin into a list of unicode strings
# Muk 2013-08-23
# Python 2.7.3
from __future__ import print_function
import sys
import shlex
import chardet
bool_cmnt = True # shlex: skip comments
bool_posx = True # shlex: posix mode (strings in quotes)
for inpt_line in sys.stdin:
print( 'inpt_line=' + repr( inpt_line ) )
enco_type = chardet.detect( inpt_line )[ 'encoding' ] #
{'encoding': 'EUC-JP', 'confidence': 0.99}
print( 'enco_type=' + repr( enco_type ) )
try:
strg_inpt = shlex.split( inpt_line, bool_cmnt, bool_posx, ) # shlex
does not work on unicode
except Exception, errr: # usually
'No closing quotation'
print( error='%s' on inpt_line='%s' % ( errr, inpt_line.rstrip(), ),
file=sys.stderr, )
continue
print( 'strg_inpt=' + repr( strg_inpt ) ) # list of
strings
strg_unic = [ strg.decode( enco_type ) for strg in strg_inpt ] # decode
the strings into unicode
print( 'strg_unic=' + repr( strg_unic ) ) # list of
unicode strings
##
$ cat some-file | template.py
Comments are welcome.
TIA
--
Kurt Mueller
--
http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
Τη Τρίτη, 27 Αυγούστου 2013 8:07:52 μ.μ. UTC+3, ο χρήστης Steven D'Aprano
έγραψε:
On Tue, 27 Aug 2013 18:04:23 +0300, Ferrous Cranus wrote:
So, in this line:
cur.execute('''SELECT ID FROM counters WHERE url = %s''', page )
the variable 'page' needs conversion to what?
You tell us. You want to be a programmer, *you* need to do the
programming, and not just keep asking others to solve every single bug.
You have been given all the clues to solve this problem. Start by
checking what the type of 'page' is, then decide what it ought to be.
Hint: you can use
print(type(page), file=open('path/to/some/file', 'w'))
to see the type of the variable 'page' without displaying it on your
website.
all that is stores is the location of a file
path = '/home/nikos/public_html/'
page = form.getvalue('page')
And what result does form.getvalue return?
What is its type? Is it a list, a tuple, a dict, a bytes object, a float,
a str object, something else? DON'T GUESS, and don't assume, find out for
sure, by inspecting the result.
if not page and os.path.exists( file ):
# it is an html template
page = file.replace( path, '' )
So chnage it to what?
What do you think you need to change it to? Pick one:
1) bytes
2) an integer
3) a string
4) a list of floats
5) something else
--
Steven
Hello Steven,
i tried to do what you said and iam receing this:
[Wed Aug 28 08:43:31 2013] [error] [client 108.162.231.120] Original exception
was:
[Wed Aug 28 08:43:31 2013] [error] [client 108.162.231.120] Traceback (most
recent call last):
[Wed Aug 28 08:43:31 2013] [error] [client 108.162.231.120] File
/home/nikos/public_html/cgi-bin/metrites.py, line 39, in module
[Wed Aug 28 08:43:31 2013] [error] [client 108.162.231.120] print(
type(page), file=open('../err.out', 'w') )
[Wed Aug 28 08:43:31 2013] [error] [client 108.162.231.120] PermissionError:
[Errno 13] \\u0386\\u03c1\\u03bd\\u03b7\\u03c3\\u03b7
\\u03c0\\u03c1\\u03cc\\u03c3\\u03b2\\u03b1\\u03c3\\u03b7\\u03c2: '../err.out'
[Wed Aug 28 08:43:31 2013] [error] [client 108.162.231.120] Premature end of
script headers: metrites.py
Also many times when i try to view the error_log by
tail -F /usr/local/apache/logs/error_log
i get realtime scrolling of other joomla webistes pho errors and i have hard
time trackign my own webistes erros.
is ther a work around for that?
--
http://mail.python.org/mailman/listinfo/python-list
Re: Improving the web page download code.
On Tue, 27 Aug 2013 12:41:10 -0700, mukesh tiwari wrote: Hello All, I am doing web stuff first time in python so I am looking for suggestions. I wrote this code to download the title of webpages using as much less resource ( server time, data download) as possible and should be fast enough. Initially I used BeautifulSoup for parsing but the person who is going to use this code asked me not to use this and use regular expressions ( The reason was BeautifulSoup is not fast enough ? ). By the time you have written enough RE to reliably parse HTML(I ma not sure that that is even strictly possible) you will have re-inverted BeautifullSoup, Badly. unless you are looking for a very explicit section of data in the page this is not a good idea. -- http://mail.python.org/mailman/listinfo/python-list
Why is str(None) == 'None' and not an empty string?
Hi! Having repr(None) == 'None' is sure the right thing but why does str(None) == 'None'? Wouldn't it be more correct if it was an empty string? Regards Piotr Dobrogost -- http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
In my attemtpt to be shwon only mesages pertaining to superhost.gr i try: alias err='tail -F /usr/local/apache/logs/error_log | grep nikos ' but now it only displays to me the lines that have '/home/nikos' within them and not all the relevant error lines. -- http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
Τη Τρίτη, 27 Αυγούστου 2013 6:22:32 μ.μ. UTC+3, ο χρήστης ishish έγραψε:
Am 27.08.2013 16:04, schrieb Ferrous Cranus:
Στις 27/8/2013 4:59 μμ, ο/η ishish έγραψε:
[Tue Aug 27 13:02:57 2013] [error] [client 110.202.175.189] Error
in
sys.excepthook:
[Tue Aug 27 13:02:57 2013] [error] [client 110.202.175.189]
ValueError: underlying buffer has been detached
[Tue Aug 27 13:02:57 2013] [error] [client 110.202.175.189]
[Tue Aug 27 13:02:57 2013] [error] [client 110.202.175.189]
Original
exception was:
[Tue Aug 27 13:02:57 2013] [error] [client 110.202.175.189]
Traceback
(most recent call last):
[Tue Aug 27 13:02:57 2013] [error] [client 110.202.175.189] File
/home/nikos/public_html/cgi-bin/metrites.py, line 169, in
module
[Tue Aug 27 13:02:57 2013] [error] [client 110.202.175.189]
cur.execute('''SELECT ID FROM counters WHERE url = %s''', page )
[Tue Aug 27 13:02:57 2013] [error] [client 110.202.175.189] File
/usr/local/bin/python/lib/python3.3/site-packages/pymysql/cursors.py,
line 108, in execute
[Tue Aug 27 13:02:57 2013] [error] [client 110.202.175.189]
query
= query % escaped_args
[Tue Aug 27 13:02:57 2013] [error] [client 110.202.175.189]
TypeError: unsupported operand type(s) for %: 'bytes' and 'str'
I quote from a Python 3 Guide
[http://python.about.com/od/python30/ss/30_strings_3.htm]:
The two data types, str and bytes, are mutually exclusive. One
cannot
legally combine them into one call. With the distinction between
text
and data, therefore, comes the need to convert between them.
So, in this line:
cur.execute('''SELECT ID FROM counters WHERE url = %s''', page )
the variable 'page' needs conversion to what?
all that is stores is the location of a file
path = '/home/nikos/public_html/'
page = form.getvalue('page')
if not page and os.path.exists( file ):
# it is an html template
page = file.replace( path, '' )
So chnage it to what?
--
What is now proved was at first only imagined!
The error occurs in file
/usr/local/bin/python/lib/python3.3/site-packages/pymysql/cursors.py,
line 108, in execute
query = query % escaped_args
You can check the actual values and data types using:
print repr(query)
print type(query)
print repr(escaped_args)
print type(escaped_args)
Always useful is a proper exception handling using try:/except:
hOW YOU MEAN PLEASE I TRY TO IMPLMENT WHAT YOU PROPOSE BUT I CANT.
try:
#find the needed counter for the page URL
if os.path.exists( path + page ) or os.path.exists( cgi_path +
page ):
cur.execute('''SELECT ID FROM counters WHERE url =
%s''', page )
data = cur.fetchone() #URL is unique, so
should only be one
print repr('''SELECT ID FROM counters WHERE url = %s''')
print type('''SELECT ID FROM counters WHERE url = %s''')
print repr(escaped_args)
print type(escaped_args)
I MEAN IF FAILS BEFORE IT TRIES TO GO INTO MY PRINT STAEMNT.
HOW AM I GONNA CPATURE THE QUERY?
--
http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
Am 28.08.2013 10:48, schrieb Ferrous Cranus:
I quote from a Python 3 Guide
[http://python.about.com/od/python30/ss/30_strings_3.htm]:
The two data types, str and bytes, are mutually exclusive. One
cannot
legally combine them into one call. With the distinction between
text
and data, therefore, comes the need to convert between them.
So, in this line:
cur.execute('''SELECT ID FROM counters WHERE url = %s''', page )
the variable 'page' needs conversion to what?
all that is stores is the location of a file
path = '/home/nikos/public_html/'
page = form.getvalue('page')
if not page and os.path.exists( file ):
# it is an html template
page = file.replace( path, '' )
So chnage it to what?
--
What is now proved was at first only imagined!
The error occurs in file
/usr/local/bin/python/lib/python3.3/site-packages/pymysql/cursors.py,
line 108, in execute
query = query % escaped_args
You can check the actual values and data types using:
print repr(query)
print type(query)
print repr(escaped_args)
print type(escaped_args)
Always useful is a proper exception handling using try:/except:
hOW YOU MEAN PLEASE I TRY TO IMPLMENT WHAT YOU PROPOSE BUT I CANT.
try:
#find the needed counter for the page URL
if os.path.exists( path + page ) or os.path.exists( cgi_path + page
):
cur.execute('''SELECT ID FROM counters WHERE url =
%s''', page )
data = cur.fetchone() #URL is unique, so
should only be one
print repr('''SELECT ID FROM counters WHERE url = %s''')
print type('''SELECT ID FROM counters WHERE url = %s''')
print repr(escaped_args)
print type(escaped_args)
I MEAN IF FAILS BEFORE IT TRIES TO GO INTO MY PRINT STAEMNT.
HOW AM I GONNA CPATURE THE QUERY?
http://i.stack.imgur.com/jiFfM.jpg
http://wiki.python.org/moin/HandlingExceptions
--
http://mail.python.org/mailman/listinfo/python-list
about pyyaml questions!
Hi Guys: Now I use pyyaml to load a yaml file, after I dump this load data,but I found an questions,before I load the yaml file,the file looks like: - -b -c - -e -x after I dump this data and write file, the file looks like: - -b -c - -e -x although when dump file, I have set default_flow_style=False Can the dumped file the same as original file? ths. -- http://mail.python.org/mailman/listinfo/python-list
Re: Why is str(None) == 'None' and not an empty string?
On 8/28/2013 4:57 AM, Piotr Dobrogost wrote: Having repr(None) == 'None' is sure the right thing but why does str(None) == 'None'? Wouldn't it be more correct if it was an empty string? No. There is no reason to be different. -- Terry Jan Reedy -- http://mail.python.org/mailman/listinfo/python-list
Re: right adjusted strings containing umlauts
On 28/8/2013 04:01, Kurt Mueller wrote: Because I cannot switch to Python 3 for now my life is not so easy:-) For some text manipulation tasks I need a template to split lines from stdin into a list of strings the way shlex.split() does it. The encoding of the input can vary. For further processing in Python I need the list of strings to be in unicode. According to: http://docs.python.org/2/library/shlex.html Prior to Python 2.7.3, this module did not support Unicode input I take that to mean that if you upgrade to Python 2.7.3, 2.7.4, or 2.7.5, you'll have Unicode support. Presumably that would mean you could decode the string before calling shlex.split(). -- DaveA -- http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
Τη Τετάρτη, 28 Αυγούστου 2013 1:11:05 μ.μ. UTC+3, ο χρήστης ishish έγραψε:
http://wiki.python.org/moin/HandlingExceptions
is this how you mean?
try:
#find the needed counter for the page URL
if os.path.exists( path + page ) or os.path.exists(
cgi_path + page ):
cur.execute('''SELECT ID FROM counters WHERE
url = %s''', page )
data = cur.fetchone() #URL is unique,
so should only be one
except:
print repr(query)
print type(query)
print repr(escaped_args)
print type(escaped_args)
but i cannot see the error_log because of constant scrolling of error output.
--
http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
Τη Τετάρτη, 28 Αυγούστου 2013 1:43:08 μ.μ. UTC+3, ο χρήστης Ferrous Cranus
έγραψε:
Τη Τετάρτη, 28 Αυγούστου 2013 1:11:05 μ.μ. UTC+3, ο χρήστης ishish έγραψε:
http://wiki.python.org/moin/HandlingExceptions
is this how you mean?
try:
#find the needed counter for the page URL
if os.path.exists( path + page ) or os.path.exists(
cgi_path + page ):
cur.execute('''SELECT ID FROM counters WHERE
url = %s''', page )
data = cur.fetchone() #URL is unique,
so should only be one
except:
print repr(query)
print type(query)
print repr(escaped_args)
print type(escaped_args)
but i cannot see the error_log because of constant scrolling of error output.
i try: tail -F /usr/local/apache/logs/error_log | grep nikos '
and see the follwing. if i dont grep at all i cannot stop the eroor output:
i...@superhost.gr [~]# [Wed Aug 28 10:44:22 2013] [error] [client
108.162.231.120] File /home/nikos/public_html/cgi-bin/metrites.py, line
173, in module
[Wed Aug 28 10:44:22 2013] [error] [client 108.162.231.120] File
/home/nikos/public_html/cgi-bin/metrites.py, line 176, in module
[Wed Aug 28 10:44:22 2013] [error] [client 108.162.231.120] File does not
exist: /home/nikos/public_html/500.shtml
--
http://mail.python.org/mailman/listinfo/python-list
Re: split lines from stdin into a list of unicode strings
On 28/8/2013 04:32, Kurt Mueller wrote:
This is a follow up to the Subject
right adjusted strings containing umlauts
You started a new thread, with a new subject line. So presumably we're
starting over with a clean slate.
For some text manipulation tasks I need a template to split lines
from stdin into a list of strings the way shlex.split() does it.
The encoding of the input can vary.
Does that mean it'll vary from one run of the program to the next, or
it'll vary from one line to the next? Your code below assumes the
latter. That can greatly increase the unreliability of the already
dubious chardet algorithm.
For further processing in Python I need the list of strings to be in unicode.
Here is template.py:
##
#!/usr/bin/env python
# vim: set fileencoding=utf-8 :
# split lines from stdin into a list of unicode strings
# Muk 2013-08-23
# Python 2.7.3
from __future__ import print_function
import sys
import shlex
import chardet
Is this the one ?
https://pypi.python.org/pypi/chardet
bool_cmnt = True # shlex: skip comments
bool_posx = True # shlex: posix mode (strings in quotes)
for inpt_line in sys.stdin:
print( 'inpt_line=' + repr( inpt_line ) )
enco_type = chardet.detect( inpt_line )[ 'encoding' ] #
{'encoding': 'EUC-JP', 'confidence': 0.99}
print( 'enco_type=' + repr( enco_type ) )
try:
strg_inpt = shlex.split( inpt_line, bool_cmnt, bool_posx, ) # shlex
does not work on unicode
But shlex does, since you're using Python 2.7.3
except Exception, errr: # usually
'No closing quotation'
print( error='%s' on inpt_line='%s' % ( errr, inpt_line.rstrip(),
), file=sys.stderr, )
continue
print( 'strg_inpt=' + repr( strg_inpt ) ) # list of
strings
strg_unic = [ strg.decode( enco_type ) for strg in strg_inpt ] # decode
the strings into unicode
print( 'strg_unic=' + repr( strg_unic ) ) # list of
unicode strings
##
$ cat some-file | template.py
Why not have a separate filter that converts from a (guessed) encoding
into utf-8, and have the later stage(s) assume utf-8 ? That way, the
filter could be fed clues by the user, or replaced entirely, without
affecting the main code you're working on.
Alternatively, just add a commandline argument with the encoding, and
parse it into enco_type.
--
DaveA
--
http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
Okey, continue trying and trying i came up with this:
try:
if os.path.exists( path + page ) or os.path.exists( cgi_path + page ):
cur.execute('''SELECT ID FROM counters WHERE url = %s''', page )
data = cur.fetchone()
except:
with open(err.out, a) as f:
f.write( repr(query), type(query) )
f.write( repr(escaped_args), type(escaped_args) )
But i cannot test it without looking at the error log which is scrolling like
hell and doesn't even quit with a ctrl+c
How will i manage to troubleshoot?
Please confirm the above is correct and is what you were propsoing i shoudl
test.
--
http://mail.python.org/mailman/listinfo/python-list
Re: right adjusted strings containing umlauts
On Wednesday, August 28, 2013 12:23:12 PM UTC+2, Dave Angel wrote:
On 28/8/2013 04:01, Kurt Mueller wrote:
Because I cannot switch to Python 3 for now my life is not so easy:-)
For some text manipulation tasks I need a template to split lines
from stdin into a list of strings the way shlex.split() does it.
The encoding of the input can vary.
For further processing in Python I need the list of strings to be in
unicode.
According to:
http://docs.python.org/2/library/shlex.html
Prior to Python 2.7.3, this module did not support Unicode
input
I take that to mean that if you upgrade to Python 2.7.3, 2.7.4, or
2.7.5, you'll have Unicode support.
I have Python 2.7.3
Presumably that would mean you could decode the string before calling
shlex.split().
Yes, see new template.py:
###
#!/usr/bin/env python
# vim: set fileencoding=utf-8 :
# split lines from stdin into a list of unicode strings
# decode before shlex
# Muk 2013-08-28
# Python 2.7.3
from __future__ import print_function
import sys
import shlex
import chardet
bool_cmnt = True # shlex: skip comments
bool_posx = True # shlex: posix mode (strings in quotes)
for inpt_line in sys.stdin:
print( 'inpt_line=' + repr( inpt_line ) )
enco_type = chardet.detect( inpt_line )[ 'encoding' ] #
{'encoding': 'EUC-JP', 'confidence': 0.99}
print( 'enco_type=' + repr( enco_type ) )
strg_unic = inpt_line.decode( enco_type ) # decode
the input line into unicode
print( 'strg_unic=' + repr( strg_unic ) ) # unicode
input line
try:
strg_inpt = shlex.split( strg_unic, bool_cmnt, bool_posx, ) # check if
shlex works on unicode
except Exception, errr: # usually
'No closing quotation'
print( error='%s' on inpt_line='%s' % ( errr, inpt_line.rstrip(), ),
file=sys.stderr, )
continue
print( 'strg_inpt=' + repr( strg_inpt ) ) # list of
strings
###
$ python -V
Python 2.7.3
$ echo -e a b c d e\na Ö u 1 2 | template.py
inpt_line='a b c d e\n'
enco_type='ascii'
strg_unic=u'a b c d e\n'
strg_inpt=['a', 'b', 'c', 'd', 'e']
inpt_line='a \xc3\x96 u 1 2\n'
enco_type='utf-8'
strg_unic=u'a \xd6 u 1 2\n'
error=''ascii' codec can't encode character u'\xd6' in position 2: ordinal not
in range(128)' on inpt_line='a Ö u 1 2'
$ echo -e a b c d e\na Ö u 1 2 | recode utf8..latin9 |
./split_shlex_unicode.py
inpt_line='a b c d e\n'
enco_type='ascii'
strg_unic=u'a b c d e\n'
strg_inpt=['a', 'b', 'c', 'd', 'e']
inpt_line='a \xd6 u 1 2\n'
enco_type='windows-1252'
strg_unic=u'a \xd6 u 1 2\n'
error=''ascii' codec can't encode character u'\xd6' in position 2: ordinal not
in range(128)' on inpt_line='a � u 1 2'
$
As can be seen, shlex does work only with unicode strings decoded from 'ascii'
strings. (Python 2.7.3)
--
Kurt Müller
--
http://mail.python.org/mailman/listinfo/python-list
Re: New VPS Provider needed
On Wed, 28 Aug 2013 09:19:40 +0200, Antoon Pardon wrote: Op 27-08-13 18:18, Steven D'Aprano schreef: On Wed, 28 Aug 2013 00:41:17 +1000, Chris Angelico wrote: On Wed, Aug 28, 2013 at 12:25 AM, Grant Edwards invalid@invalid.invalid wrote: On 2013-08-27, ni...@superhost.gr wrote: Iam having major issues with my VPS provider and losign customers becaue the provider doesnt set thign u[ cprrectly. Perhaps he's also having problems with a faulty keyboard. Just a faulty key actuator, I think. Nothing unusual in this world. Guys, PLEASE stop baiting Nikos with snide remarks. It makes this a very unpleasant environment, and sets the tone of the community, badly. Why don't you tell Nikos he should stop baiting the list with off topic requestsm like whether someone is willing to provide him free hosting? I quote: 1. I will pay for a full year upfront but it must be a low price for the 1st year, because i have already paid them and cant get my money back to use it to the new com opany. I get it. You don't like Nikos. I'm not suggesting you should. But misrepresenting him is Not Cool. He has offered to pay. Besides, Python-friendly web hosting is not off-topic. Plenty of people have asked for recommendations on hosting providers that support Python before. I also think you are over reacting. One thread where people come with snide remarks doesn't turn the whole newsgroup/mailinglist into an unpleasant environment. My wife often tells me it is a miracle that I don't forget my own name, but even my memory is not so bad as to forget just how unpleasant and hostile this list became a month or so ago when a whole bunch of people decided to drive Nikos away, and he decided to fight back. -- Steven -- http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
On 28/8/2013 07:14, Ferrous Cranus wrote: But i cannot test it without looking at the error log which is scrolling like hell and doesn't even quit with a ctrl+c I take it this 'error log is shared with other users, and you can't constrain them to cease and desist for a while? How will i manage to troubleshoot? Please confirm the above is correct and is what you were propsoing i shoudl test. You really have no directory in which you have write permissions? If so, perhaps you'd better solve that first. -- DaveA -- http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
Τη Τετάρτη, 28 Αυγούστου 2013 2:32:44 μ.μ. UTC+3, ο χρήστης Dave Angel έγραψε: On 28/8/2013 07:14, Ferrous Cranus wrote: But i cannot test it without looking at the error log which is scrolling like hell and doesn't even quit with a ctrl+c I take it this 'error log is shared with other users, and you can't constrain them to cease and desist for a while? How will i manage to troubleshoot? Please confirm the above is correct and is what you were propsoing i shoudl test. You really have no directory in which you have write permissions? If so, perhaps you'd better solve that first. hello Dave, no this is the general error log apache produces for all the server. Is there a way to grep error logging info, pertainign only to my specific nikos account or my superhost.gr domain? -- http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
Τη Τετάρτη, 28 Αυγούστου 2013 2:32:44 μ.μ. UTC+3, ο χρήστης Dave Angel έγραψε:
On 28/8/2013 07:14, Ferrous Cranus wrote:
But i cannot test it without looking at the error log which is scrolling
like hell and doesn't even quit with a ctrl+c
I take it this 'error log is shared with other users, and you can't
constrain them to cease and desist for a while?
How will i manage to troubleshoot?
Please confirm the above is correct and is what you were propsoing i shoudl
test.
You really have no directory in which you have write permissions? If
so, perhaps you'd better solve that first.
--
DaveA
[Wed Aug 28 11:34:36 2013] [error] [client 108.162.231.120] Error in
sys.excepthook:
[Wed Aug 28 11:34:36 2013] [error] [client 108.162.231.120] ValueError:
underlying buffer has been detached
[Wed Aug 28 11:34:36 2013] [error] [client 108.162.231.120]
[Wed Aug 28 11:34:36 2013] [error] [client 108.162.231.120] Original exception
was:
[Wed Aug 28 11:34:36 2013] [error] [client 108.162.231.120] Traceback (most
recent call last):
[Wed Aug 28 11:34:36 2013] [error] [client 108.162.231.120] File
/home/nikos/public_html/cgi-bin/metrites.
py, line 173, in module
[Wed Aug 28 11:34:36 2013] [error] [client 108.162.231.120]
cur.execute('''SELECT ID FROM counters WHERE
url = %s''', page )
[Wed Aug 28 11:34:36 2013] [error] [client 108.162.231.120] File
/usr/local/bin/python/lib/python3.3/site-
packages/pymysql/cursors.py, line
108, in execute
[Wed Aug 28 11:34:36 2013] [error] [client 108.162.231.120] query = query %
escaped_args
[Wed Aug 28 11:34:36 2013] [error] [client 108.162.231.120] TypeError:
unsupported operand type(s) for %: 'by
tes' and 'str'
[Wed Aug 28 11:34:36 2013] [error] [client 108.162.231.120]
[Wed Aug 28 11:34:36 2013] [error] [client 108.162.231.120] During handling of
the above exception, another e
xception occurred:
[Wed Aug 28 11:34:36 2013] [error] [client 108.162.231.120]
[Wed Aug 28 11:34:36 2013] [error] [client 108.162.231.120] Traceback (most
recent call last):
[Wed Aug 28 11:34:36 2013] [error] [client 108.162.231.120] File
/home/nikos/public_html/cgi-bin/metrites.
py, line 176, in module
[Wed Aug 28 11:34:36 2013] [error] [client 108.162.231.120] with
open(err.out, a) as f:
[Wed Aug 28 11:34:36 2013] [error] [client 108.162.231.120] PermissionError:
[Errno 13] \\u0386\\u03c1\\u03bd
\\u03b7\\u03c3\\u03b7
\\u03c0\\u03c1\\u03cc\\u03c3\\u03b2\\u03b1\\u03c3\\u03b7\\u03c2: 'err.out'
[Wed Aug 28 11:34:36 2013] [error] [client 108.162.231.120] File does not
exist: /home/nikos/public_html/500.
shtml
--
http://mail.python.org/mailman/listinfo/python-list
Rép : Why is str(None) == 'None' and not an empty string?
On 8/28/2013 4:57 AM, Piotr Dobrogost wrote: Having repr(None) == 'None' is sure the right thing but why does str(None) == 'None'? Wouldn't it be more correct if it was an empty string? the point of str(obj) is to return a string containing the obj (a sequence of characters if it is unbound or not built-in, etc.)... If you set the rule str(None)==, then you will cause plenty of problems. For instance, if you want to build a string like request=SELECT X+IN Y+WHERE B=+String(B) to prepare a sequel request, and the field B happens to be sometimes None, you would automatically end up with SELECT X IN Y WHERE B='' instead of SELECT X IN Y WHERE B='None', and your sql request will fall into limbos... -- http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
Am 28.08.2013 12:14, schrieb Ferrous Cranus:
Okey, continue trying and trying i came up with this:
try:
if os.path.exists( path + page ) or os.path.exists( cgi_path + page
):
cur.execute('''SELECT ID FROM counters WHERE url = %s''', page )
data = cur.fetchone()
except:
with open(err.out, a) as f:
f.write( repr(query), type(query) )
f.write( repr(escaped_args), type(escaped_args) )
But i cannot test it without looking at the error log which is
scrolling like hell and doesn't even quit with a ctrl+c
How will i manage to troubleshoot?
Please confirm the above is correct and is what you were propsoing i
shoudl test.
A simple way I always use if it comes to exception handling:
import sys
import traceback
# Exception Identification
def formatExceptionInfo(maxTBlevel=5):
cla, exc, trbk = sys.exc_info()
excName = cla.__name__
try:
excArgs = exc.__dict__[args]
except KeyError:
excArgs = no args
excTb = traceback.format_tb(trbk, maxTBlevel)
return (excName, excArgs, excTb)
try:
# Your code
except:
print formatExceptionInfo()
--
http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
Τη Τετάρτη, 28 Αυγούστου 2013 2:32:44 μ.μ. UTC+3, ο χρήστης Dave Angel έγραψε: On 28/8/2013 07:14, Ferrous Cranus wrote: But i cannot test it without looking at the error log which is scrolling like hell and doesn't even quit with a ctrl+c I take it this 'error log is shared with other users, and you can't constrain them to cease and desist for a while? How will i manage to troubleshoot? Please confirm the above is correct and is what you were propsoing i shoudl test. You really have no directory in which you have write permissions? If so, perhaps you'd better solve that first. of cours ei ahve write permissions. Here: ni...@superhost.gr [~]# ls -ld www/ drwxr-x--- 4 nikos nobody 4096 Jul 13 10:33 www// ni...@superhost.gr [~]# ls -ld www/cgi-bin/ drwxr-xr-x 2 nikos nikos 4096 Aug 28 10:41 www/cgi-bin// whick make it a mysterya s to why with open(../err.out, a) as f: fails to write the file. -- http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
Τη Τετάρτη, 28 Αυγούστου 2013 2:51:03 μ.μ. UTC+3, ο χρήστης ishish έγραψε:
Am 28.08.2013 12:14, schrieb Ferrous Cranus:
Okey, continue trying and trying i came up with this:
try:
if os.path.exists( path + page ) or os.path.exists( cgi_path + page
):
cur.execute('''SELECT ID FROM counters WHERE url = %s''', page )
data = cur.fetchone()
except:
with open(err.out, a) as f:
f.write( repr(query), type(query) )
f.write( repr(escaped_args), type(escaped_args) )
But i cannot test it without looking at the error log which is
scrolling like hell and doesn't even quit with a ctrl+c
How will i manage to troubleshoot?
Please confirm the above is correct and is what you were propsoing i
shoudl test.
A simple way I always use if it comes to exception handling:
import sys
import traceback
# Exception Identification
def formatExceptionInfo(maxTBlevel=5):
cla, exc, trbk = sys.exc_info()
excName = cla.__name__
try:
excArgs = exc.__dict__[args]
except KeyError:
excArgs = no args
excTb = traceback.format_tb(trbk, maxTBlevel)
return (excName, excArgs, excTb)
try:
# Your code
except:
print formatExceptionInfo()
ni...@superhost.gr [~/www]# [Wed Aug 28 12:02:53 2013] [error] [client
108.162.231.120] malformed header from script. Bad header=class 'str'
'index.html': metrites.py
[Wed Aug 28 12:02:53 2013] [error] [client 108.162.231.120] Error in
sys.excepthook:
[Wed Aug 28 12:02:53 2013] [error] [client 108.162.231.120] ValueError:
underlying buffer has been detached
[Wed Aug 28 12:02:53 2013] [error] [client 108.162.231.120]
[Wed Aug 28 12:02:53 2013] [error] [client 108.162.231.120] Original exception
was:
[Wed Aug 28 12:02:53 2013] [error] [client 108.162.231.120] Traceback (most
recent call last):
[Wed Aug 28 12:02:53 2013] [error] [client 108.162.231.120] File
/home/nikos/public_html/cgi-bin/metrites.py, line 191, in module
[Wed Aug 28 12:02:53 2013] [error] [client 108.162.231.120] if not data:
[Wed Aug 28 12:02:53 2013] [error] [client 108.162.231.120] NameError: name
'data' is not defined
[Wed Aug 28 12:02:53 2013] [error] [client 108.162.231.120] File does not
exist: /home/nikos/public_html/500.shtml
--
http://mail.python.org/mailman/listinfo/python-list
Re: can't get utf8 / unicode strings from embedded python
On Tue, 27 Aug 2013 22:57:45 -0700, David M. Cotter wrote: I am very sorry that I have offended you to such a degree you feel it necessary to publicly eviscerate me. You know David, you are right. I did over-react. And I apologise for that. I am sorry, I was excessively confrontational. (Although I think eviscerate is a bit strong.) Putting aside my earlier sarcasm, the basic message remains the same: Python byte strings are not designed to work with Unicode characters, and if they do work, it is an accident, not defined behaviour. Perhaps I could have worded it like this: So far I have not seen any troubles including unicode characters in my strings, they *seem* to be fine for my use-case. What kind of trouble has been seen with this by others? Exactly the same sort of trouble you were having earlier when you were inadvertently decoding the source file as MacRoman rather than UTF-8. Mojibake, garbage characters in your text, corrupted data. http://en.wikipedia.org/wiki/Mojibake The point is, you might not see these errors, because by accident all the relevant factors conspire to give you the correct result. You might test it on a Mac and on Windows and it all works well. You might even test it on a dozen different machines, and it works fine on all of them. But since you're relying on an accident of implementation, none of this is guaranteed. And then in eighteen months time, *something* changes -- a minor update to Python, a different version of Mac OS/X, an unusual Registry setting in Windows, who knows what?, and all of a sudden the factors no longer line up to give you the correct results and it all comes tumbling down in a big stinking mess. If you are lucky you will get a nice clear exception telling you something is broken, but more likely you'll just get corrupted data and mojibake and you, or the poor guy who maintains the code after you, will have no idea why. And you'll probably come here asking for our help to solve it. If you came back and said I tried it with the u prefix, and it broke a bunch of other code, and I don't have time to fix it now so I'm reverting to the u-less byte string form I wouldn't *like* it but I could *accept* it as one of those sub-optimal compromises people make in Real Life. I've done the same thing myself, we probably all have: written code we knew was broken, but fixing it was too hard or too low a priority. Really, I wonder why you are so angry at me for having made a mistake? I'm going to guess that you don't have kids. What do kids have to do with this? Are you an adult or a child? *wink* You didn't offend me so much as frustrate me. You had multiple people telling you the same thing, don't embed Unicode characters in a byte string, but you choose to not just ignore them but effectively declare that they were all wrong to give that advice, not just the people here but essentially the entire Python development community responsible for adding Unicode strings to the language. Can you blame me for feeling that your reply seemed rather arrogant? In any case, I'm glad you responded with a little more restraint than I did, and I hope you can see my point of view and hopefully I haven't soured you on this forum. -- Steven -- http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
On Wed, 28 Aug 2013 01:46:01 -0700, Ferrous Cranus wrote:
Τη Τρίτη, 27 Αυγούστου 2013 8:07:52 μ.μ. UTC+3, ο χρήστης Steven
D'Aprano έγραψε:
Hint: you can use
print(type(page), file=open('path/to/some/file', 'w'))
to see the type of the variable 'page' without displaying it on your
website.
i tried to do what you said and iam receing this:
[Wed Aug 28 08:43:31 2013] [error] [client 108.162.231.120] Original
exception was: [Wed Aug 28 08:43:31 2013] [error] [client
108.162.231.120] Traceback (most recent call last): [Wed Aug 28 08:43:31
2013] [error] [client 108.162.231.120] File
/home/nikos/public_html/cgi-bin/metrites.py, line 39, in module [Wed
Aug 28 08:43:31 2013] [error] [client 108.162.231.120] print(
type(page), file=open('../err.out', 'w') ) [Wed Aug 28 08:43:31 2013]
[error] [client 108.162.231.120] PermissionError: [Errno 13]
\\u0386\\u03c1\\u03bd\\u03b7\\u03c3\\u03b7
\\u03c0\\u03c1\\u03cc\\u03c3\\u03b2\\u03b1\\u03c3\\u03b7\\u03c2:
'../err.out' [Wed Aug 28 08:43:31 2013] [error] [client 108.162.231.120]
Premature end of script headers: metrites.py
Then pick a different location, one where you have permission to write
files!
Honestly Nikos, I'm not trying to be rude, but if you cannot think of
this on your own after all this time we've been helping you, perhaps
programming is not the right vocation for you. Perhaps you need to
consider a change of career.
If you do decide to stay as a web developer, you need to start thinking:
* What is this error message telling me? (Permission denied)
* How can I fix that? (I need permission to read the file. Maybe try a
different file?)
Also many times when i try to view the error_log by
tail -F /usr/local/apache/logs/error_log
i get realtime scrolling of other joomla webistes pho errors and i have
hard time trackign my own webistes erros.
is ther a work around for that?
That's an apache logging issue, not Python, and I don't know enough about
apache to do more than guess that there probably is a solution but I have
no idea what it is.
--
Steven
--
http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
Well there you have it: File /home/nikos/public_html/cgi-bin/metrites.py, line 191, in module if not data: NameError: name 'data' is not defined -- http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
Τη Τετάρτη, 28 Αυγούστου 2013 3:11:07 μ.μ. UTC+3, ο χρήστης Steven D'Aprano
έγραψε:
On Wed, 28 Aug 2013 01:46:01 -0700, Ferrous Cranus wrote:
Τη Τρίτη, 27 Αυγούστου 2013 8:07:52 μ.μ. UTC+3, ο χρήστης Steven
D'Aprano έγραψε:
Hint: you can use
print(type(page), file=open('path/to/some/file', 'w'))
to see the type of the variable 'page' without displaying it on your
website.
i tried to do what you said and iam receing this:
[Wed Aug 28 08:43:31 2013] [error] [client 108.162.231.120] Original
exception was: [Wed Aug 28 08:43:31 2013] [error] [client
108.162.231.120] Traceback (most recent call last): [Wed Aug 28 08:43:31
2013] [error] [client 108.162.231.120] File
/home/nikos/public_html/cgi-bin/metrites.py, line 39, in module [Wed
Aug 28 08:43:31 2013] [error] [client 108.162.231.120] print(
type(page), file=open('../err.out', 'w') ) [Wed Aug 28 08:43:31 2013]
[error] [client 108.162.231.120] PermissionError: [Errno 13]
\\u0386\\u03c1\\u03bd\\u03b7\\u03c3\\u03b7
\\u03c0\\u03c1\\u03cc\\u03c3\\u03b2\\u03b1\\u03c3\\u03b7\\u03c2:
'../err.out' [Wed Aug 28 08:43:31 2013] [error] [client 108.162.231.120]
Premature end of script headers: metrites.py
Then pick a different location, one where you have permission to write
files!
Honestly Nikos, I'm not trying to be rude, but if you cannot think of
this on your own after all this time we've been helping you, perhaps
programming is not the right vocation for you. Perhaps you need to
consider a change of career.
If you do decide to stay as a web developer, you need to start thinking:
* What is this error message telling me? (Permission denied)
* How can I fix that? (I need permission to read the file. Maybe try a
different file?)
Also many times when i try to view the error_log by
tail -F /usr/local/apache/logs/error_log
i get realtime scrolling of other joomla webistes pho errors and i have
hard time trackign my own webistes erros.
is ther a work around for that?
That's an apache logging issue, not Python, and I don't know enough about
apache to do more than guess that there probably is a solution but I have
no idea what it is.
--
Steven
As i have pointed out i as the owner of the accoutn have read and write
perimssion bot at www/ and www/cgi-bin
i also chnage the filename and still cant write to the file.
if you as experts cannot help resolve this, how me as a newbiw can?
--
http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
On Wed, 28 Aug 2013 03:43:08 -0700, Ferrous Cranus wrote: but i cannot see the error_log because of constant scrolling of error output. Then don't use tail -F, use less. Or try tail -s 60 -F which will update only every 60 seconds. -- Steven -- http://mail.python.org/mailman/listinfo/python-list
Re: Why is str(None) == 'None' and not an empty string?
On Wed, 28 Aug 2013 01:57:16 -0700, Piotr Dobrogost wrote:
Hi!
Having repr(None) == 'None' is sure the right thing but why does
str(None) == 'None'? Wouldn't it be more correct if it was an empty
string?
Why do you think an empty string is more correct? Would you expect
str([]) or str(0.0) or str({}) to also give an empty string?
I can't see any reason for str(None) to return the empty string.
--
Steven
--
http://mail.python.org/mailman/listinfo/python-list
Re: New VPS Provider needed
Op 28-08-13 13:25, Steven D'Aprano schreef: On Wed, 28 Aug 2013 09:19:40 +0200, Antoon Pardon wrote: Op 27-08-13 18:18, Steven D'Aprano schreef: On Wed, 28 Aug 2013 00:41:17 +1000, Chris Angelico wrote: On Wed, Aug 28, 2013 at 12:25 AM, Grant Edwards invalid@invalid.invalid wrote: On 2013-08-27, ni...@superhost.gr wrote: Iam having major issues with my VPS provider and losign customers becaue the provider doesnt set thign u[ cprrectly. Perhaps he's also having problems with a faulty keyboard. Just a faulty key actuator, I think. Nothing unusual in this world. Guys, PLEASE stop baiting Nikos with snide remarks. It makes this a very unpleasant environment, and sets the tone of the community, badly. Why don't you tell Nikos he should stop baiting the list with off topic requestsm like whether someone is willing to provide him free hosting? I quote: 1. I will pay for a full year upfront but it must be a low price for the 1st year, because i have already paid them and cant get my money back to use it to the new com opany. You are quoting selectively. I get it. You don't like Nikos. I'm not suggesting you should. But misrepresenting him is Not Cool. He has offered to pay. IMO you are misrepresenting by quoting selectively. This from earlier in that same post: | So, if someone want to help me out it would be nice if he could | provide me with services free of charge for that time period, or at | least at the end of they year. That he offered to pay, doesn't contradict his primary request is for services free of charge. Besides, Python-friendly web hosting is not off-topic. Plenty of people have asked for recommendations on hosting providers that support Python before. He didn't ask for people experiences with various hosting providers. He was asking people here to provide hosting services for him. I also think you are over reacting. One thread where people come with snide remarks doesn't turn the whole newsgroup/mailinglist into an unpleasant environment. My wife often tells me it is a miracle that I don't forget my own name, but even my memory is not so bad as to forget just how unpleasant and hostile this list became a month or so ago when a whole bunch of people decided to drive Nikos away, and he decided to fight back. This list didn't became unpleasand and hostile. The hostility was contained to a few threads. It was easy enough to avoid the hostility if that was important enough to you. I also find your reporting on the facts misleading. People didn't just decide to drive Nikos away. People were getting fed up with the ongoing annoying behaviour of Nikos. It wasn't Nikos who decided to fight back, it were the people who had enough of Nikos's inconsiderate behaviour who decided to fight back. -- Antoon Pardon -- http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
Τη Τετάρτη, 28 Αυγούστου 2013 3:21:25 μ.μ. UTC+3, ο χρήστης Steven D'Aprano
έγραψε:
On Wed, 28 Aug 2013 03:43:08 -0700, Ferrous Cranus wrote:
but i cannot see the error_log because of constant scrolling of error
output.
Then don't use tail -F, use less.
Or try tail -s 60 -F which will update only every 60 seconds.
--
Steven
Very nice idea, than k you steven. Less work withiut scrilling like hell liek
tail -F did.
this is what i have now:
# Exception Identification
def formatExceptionInfo(maxTBlevel=5):
cla, exc, trbk = sys.exc_info()
excName = cla.__name__
try:
excArgs = exc.__dict__[args]
except KeyError:
excArgs = no args
excTb = traceback.format_tb(trbk, maxTBlevel)
return (excName, excArgs, excTb)
try:
#find the needed counter for the page URL
if os.path.exists( path + page ) or os.path.exists( cgi_path + page ):
cur.execute('''SELECT ID FROM counters WHERE url = %s''', page )
data = cur.fetchone() #URL is unique, so should only be one
except:
print( formatExceptionInfo() )
i see no error on what it used ot be isnteait comain at the follwing line which
is:
if not data:
#first time for page; primary key is automatic, hit is
defaulted
cur.execute('''INSERT INTO counters (url) VALUES
(%s)''', page )
cID = cur.lastrowid#get the primary key value
of the new record
else:
#found the page, save primary key and use it to issue
hit UPDATE
cID = data[0]
cur.execute('''UPDATE counters SET hits = hits + 1
WHERE ID = %s''', cID )
i jst dont follow. What ishsi proposed supposed to give us the error in the
query bit now it tells difefrent things.
shoudl i remove the function since it want any helopfull?
--
http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
On Wed, 28 Aug 2013 05:17:34 -0700, Ferrous Cranus wrote: As i have pointed out i as the owner of the accoutn have read and write perimssion bot at www/ and www/cgi-bin i also chnage the filename and still cant write to the file. If you type filenames as carelessly as you type requests for help, who knows what file name you are actually trying to open? Or to put it another way... If yuo tpye filnaems as carlesl yas y outype reqets for help, woh knwos wha tfile nmae oyu ar eactaly tying to oep n? Nikos, my Greek is completely non-existent, and I admire you for learning a second language. I know your English is good, because I have seen you write fluent, excellent English. But if you can't be bothered to type carefully and clearly when asking questions, then how can you expect others to be bothered to read and respond to your questions? if you as experts cannot help resolve this, how me as a newbiw can? Just because your account has write permission to a location doesn't mean that the script being run by the webserver has write permission. You need to write to a location where the script has permission to write. First you need to find out what account the script is being run under -- it may be apache, or possible nobody, but I don't know. It shouldn't be root, and almost certainly isn't nikos. I'm not an expert, but a few seconds googling came up with a lot of useful looking hits. Google on what user does apache run as and do your research. This is off-topic though. This is not a beginner's guide to apache forum, if you can't solve this problem yourself you'll have to take it elsewhere. -- Steven -- http://mail.python.org/mailman/listinfo/python-list
Re: split lines from stdin into a list of unicode strings
On Wednesday, August 28, 2013 1:13:36 PM UTC+2, Dave Angel wrote: On 28/8/2013 04:32, Kurt Mueller wrote: For some text manipulation tasks I need a template to split lines from stdin into a list of strings the way shlex.split() does it. The encoding of the input can vary. Does that mean it'll vary from one run of the program to the next, or it'll vary from one line to the next? Your code below assumes the latter. That can greatly increase the unreliability of the already dubious chardet algorithm. The encoding only varies from one launch to the other. The reason I process each line is memory usage. Option to have a better reliability of chardet: I could read all of the input, save the input lines for further processing in a list, feed the lines into chardet.universaldetector.UniversalDetector.feed()/close()/result() and then decode and split/shlex the lines in the list. That way the chardet oracle would be more reliable, but roughly twice as much memory will be used. import chardet Is this the one ? https://pypi.python.org/pypi/chardet Yes. $ cat some-file | template.py Why not have a separate filter that converts from a (guessed) encoding into utf-8, and have the later stage(s) assume utf-8 ? That way, the filter could be fed clues by the user, or replaced entirely, without affecting the main code you're working on. Working on UNIX-like systems (I am happy to work in a MSFZ) the processing pipe would be then: cat some-file | recode2utf8 | splitlines.py memory usage 2 * some-file ( plus chardet memory usage ) Alternatively, just add a commandline argument with the encoding, and parse it into enco_type. cat some-file | splitlines.py -e latin9 memory usage 1 * some-file or cat some-file | splitlines.py -e $( codingdetect some-file ) memory usage 1 * some-file So, because memory usage is not primary, I think I will go with the option described above. -- Kurt Müller -- http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
Τη Τετάρτη, 28 Αυγούστου 2013 3:38:11 μ.μ. UTC+3, ο χρήστης Steven D'Aprano έγραψε: On Wed, 28 Aug 2013 05:17:34 -0700, Ferrous Cranus wrote: As i have pointed out i as the owner of the accoutn have read and write perimssion bot at www/ and www/cgi-bin i also chnage the filename and still cant write to the file. If you type filenames as carelessly as you type requests for help, who knows what file name you are actually trying to open? Or to put it another way... If yuo tpye filnaems as carlesl yas y outype reqets for help, woh knwos wha tfile nmae oyu ar eactaly tying to oep n? Nikos, my Greek is completely non-existent, and I admire you for learning a second language. I know your English is good, because I have seen you write fluent, excellent English. But if you can't be bothered to type carefully and clearly when asking questions, then how can you expect others to be bothered to read and respond to your questions? if you as experts cannot help resolve this, how me as a newbiw can? Just because your account has write permission to a location doesn't mean that the script being run by the webserver has write permission. You need to write to a location where the script has permission to write. First you need to find out what account the script is being run under -- it may be apache, or possible nobody, but I don't know. It shouldn't be root, and almost certainly isn't nikos. I'm not an expert, but a few seconds googling came up with a lot of useful looking hits. Google on what user does apache run as and do your research. This is off-topic though. This is not a beginner's guide to apache forum, if you can't solve this problem yourself you'll have to take it elsewhere. -- Steven Hi steven , sorry for the typos. you are write my script is invoked by apache web server application which it runs under account 'nobody' Here is proof of that: ni...@superhost.gr [~]# ps aux | grep Apache nikos 8531 0.0 0.0 6372 680 pts/0R+ 12:44 0:00 grep Apache ni...@superhost.gr [~]# ps aux | grep apache root 1101 0.0 0.2 65576 4168 ?Ss 08:30 0:01 /usr/local/apache/bin/httpd -k start -DSSL root 8448 0.0 0.1 65576 1700 ?S12:42 0:00 /usr/local/apache/bin/httpd -k start -DSSL nobody8449 0.0 0.2 65712 3228 ?S12:42 0:00 /usr/local/apache/bin/httpd -k start -DSSL nobody8450 0.0 0.2 65848 3348 ?S12:42 0:00 /usr/local/apache/bin/httpd -k start -DSSL nobody8451 0.0 0.2 65848 3360 ?S12:42 0:00 /usr/local/apache/bin/httpd -k start -DSSL nobody8452 0.0 0.2 65712 3340 ?S12:42 0:00 /usr/local/apache/bin/httpd -k start -DSSL nobody8453 0.0 0.2 65712 3260 ?S12:42 0:00 /usr/local/apache/bin/httpd -k start -DSSL nobody8467 0.0 0.1 65712 2356 ?S12:43 0:00 /usr/local/apache/bin/httpd -k start -DSSL nobody8468 0.0 0.1 65712 2344 ?S12:43 0:00 /usr/local/apache/bin/httpd -k start -DSSL nobody8519 0.0 0.1 65712 2344 ?S12:43 0:00 /usr/local/apache/bin/httpd -k start -DSSL nikos 8537 0.0 0.0 6372 684 pts/0R+ 12:44 0:00 grep apache My script were all workign in the previous VPS enviroment, the script is correct is just a few minor thing in the new VPS env that they need to be taken care of thus prohibit my script to run.. please don't give up helping me and tell me please what you want me to try. tahnk you very much. -- http://mail.python.org/mailman/listinfo/python-list
Is there a function that applies list of functions to a value?
Hi, From time to time I have to apply a series of functions to a value in such a way: func4(func3(func2(func1(myval I was wondering if there is a function in standard library that would take a list of functions and a initial value and do the above like this: func_im_looking_for([func1, func2, func3, func4], myval) I looked in itertools but nothing seamed to do the job. This seams like something vary obvious that was needed many times elsewhere so maybe you could help me? -- http://mail.python.org/mailman/listinfo/python-list
My attempts in playing with tail-recursion in python
Hi,
I would like to share some of my recent attempts concerning recursivity in
python, more precisely recursivity with lambda functions.
I know that the title of my thread with the tail-recursion words may wake up
some long and old war; please don't take it as such. I am not claiming anything
about what programming languages should be or not; I enjoy using python for
many purposes and I perfectly know how to handle loops for achieving some tasks,
but sometimes I like rather think with recursivity because I have been using
various dialects of Lisp for a long time. I had a very great time studying the
Y-combinator; then I wrote various pieces of code for remapping recursive calls
to loop iterations.
The following functions are fully usable; I hope someone will enjoy using them.
If you are not interested by the explanations, just jump to the end of the
message and take my functions for using them.
Here is a recursive function:
fac = lambda f: lambda n: 1 if n==0 else n*f(n-1)
The Y-combinator is well known:
Y = lambda f: (lambda x: x(x))(lambda y: f(lambda *args: y(y)(*args)))
Now, you can use the recursive function:
rf = Y(fac)
rf(5)
Now we write fac as a tail-recursive function:
fac = lambda f: lambda a,b: b if a==0 else f(a-1,a*b)
rf = Y(fac)
rf(5,1)
but of course, the recursivity is handled like previously.
In fact, it is very easy to build some effcient wrapper; for instance:
(lambda f: f(lambda *args: (callback,args)))
will act in the following way:
(lambda f: f(lambda *args: (callback,args)))(fac)(5,1)
-- ('callback', (4, 5))
(lambda f: f(lambda *args: (callback,args)))(fac)(4,5)
-- ('callback', (3, 20))
(lambda f: f(lambda *args: (callback,args)))(fac)(3,20))
-- ('callback', (2, 60))
(lambda f: f(lambda *args: (callback,args)))(fac)(2,60)
-- ('callback', (1, 120))
(lambda f: f(lambda *args: (callback,args)))(fac)(1,120)
-- ('callback', (0, 120))
(lambda f: f(lambda *args: (callback,args)))(fac)(0,120)
-- 120
Here, the callback string is arbitrary chosen in order to make the loop know
that a next call is needed.
Now, the recursivity is handled as successive calls, which is what I was looking
for. A first proposal could be:
def with_tail_recursion(func):
x = (lambda f: f(lambda *args: (callback,args)))(func)
def wrapper(*args):
out = (callback,args)
while type(out)==tuple and out[0]==callback:
out = x(*out[1])
return out
return wrapper
Now, the very same function can be used as recursive or inside a loop:
fac = lambda f: lambda a,b: b if a==0 else f(a-1,a*b)
rf = Y(fac)
tr = with_tail_recursion(fac)
rf(5,1)
-- 120
tr(5,1)
-- 120
Of course, if most of your job relies on writing functions returning tuples
with the string callback being the first argument, you should use another
keyword in the previous code ;-)
You can inspect the stack by raising an exception:
f2 = lambda f: lambda n: 1/n if n==0 else f(n-1)
and see the differences between Y(f2)(5) and with_tail_recursion(f2)(5)
But I was not fully happy with the use of a tuple, efficient but a little too
tricky to my eyes. For that reason, I took the Y combinator again and slightly
modified it:
lambda f: (lambda x: x(x))(lambda y: f(lambda *args: lambda: y(y)(*args)))
Now, the function doesn't call itself, but returns a function calling itself
with the relevant arguments.
I like this new function better than the previous one, but it is now more
difficult for the wrapper to detect when it is time to leave the loop.
Right now, I use the following test: checking for the __call__ string in
the dir() list. This means ONE IMPORTANT THING: this second wrapper can't
handle tail-recursive functions returning functions, (which is actually more
likely to happen than tail-recursive functions returning tuples with the
string callback being the first argument ;-) ). But I like it that way:
def B(func):
x = (lambda f: (lambda x: x(x))(lambda y:
f(lambda *args: lambda: y(y)(*args(func)
def wrapper(*args):
out = x(*args)
while '__call__' in dir(out):
out = out()
return out
return wrapper
tr2 = B(fac)
tr2(5,1)
-- 120
Now, you can write functions with a huge depth of recusivity with no
problem :
B(lambda f: lambda n: ok if n==0 else f(n-1))(5000)
(don't try with the Y combinator instead...)
Best regards,
--
Thomas Baruchel
--
http://mail.python.org/mailman/listinfo/python-list
Re: Is there a function that applies list of functions to a value?
On 2013-08-28 05:52, AdamKal wrote: From time to time I have to apply a series of functions to a value in such a way: func4(func3(func2(func1(myval I was wondering if there is a function in standard library that would take a list of functions and a initial value and do the above like this: func_im_looking_for([func1, func2, func3, func4], myval) At least in Py2.x you can use reduce: reduce(lambda value, fn: fn(value), [list_of_functions], myval) I believe it was moved into functools.reduce() in Py3.x meaning you might want to do something like try: reduce # see if it's already in __builtins__ except NameError: # running Py3... from functools import reduce or try: from functools import reduce except ImportError: pass # it should already be in __builtins__ for pre-2.6 at the top to make sure it's in your global namespace. -tkc -- http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
This si what iam tryign now since the function ishish proposed wont help me.
try:
#find the needed counter for the page URL
if os.path.exists( path + page ) or os.path.exists( cgi_path + page ):
cur.execute('''SELECT ID FROM counters WHERE url = %s''', page )
data = cur.fetchone() #URL is unique, so should only be one
except:
print( repr(e) )
[Wed Aug 28 13:08:27 2013] [error] [client 108.162.231.120] Original exception
was:
[Wed Aug 28 13:08:27 2013] [error] [client 108.162.231.120] Traceback (most
recent call last):
[Wed Aug 28 13:08:27 2013] [error] [client 108.162.231.120] File
/home/nikos/public_html/cgi-bin/metrites.py, line 174, in module
[Wed Aug 28 13:08:27 2013] [error] [client 108.162.231.120]
cur.execute('''SELECT ID FROM counters WHERE url = %s''', page )
[Wed Aug 28 13:08:27 2013] [error] [client 108.162.231.120] File
/usr/local/bin/python/lib/python3.3/site-packages/pymysql/cursors.py, line
108, in execute
[Wed Aug 28 13:08:27 2013] [error] [client 108.162.231.120] query = query %
escaped_args
[Wed Aug 28 13:08:27 2013] [error] [client 108.162.231.120] TypeError:
unsupported operand type(s) for %: 'bytes' and 'str'
[Wed Aug 28 13:08:27 2013] [error] [client 108.162.231.120]
[Wed Aug 28 13:08:27 2013] [error] [client 108.162.231.120] During handling of
the above exception, another exception occurred:
[Wed Aug 28 13:08:27 2013] [error] [client 108.162.231.120]
[Wed Aug 28 13:08:27 2013] [error] [client 108.162.231.120] Traceback (most
recent call last):
[Wed Aug 28 13:08:27 2013] [error] [client 108.162.231.120] File
/home/nikos/public_html/cgi-bin/metrites.py, line 177, in module
[Wed Aug 28 13:08:27 2013] [error] [client 108.162.231.120] print( repr(e) )
[Wed Aug 28 13:08:27 2013] [error] [client 108.162.231.120] NameError: name 'e'
is not defined
--
http://mail.python.org/mailman/listinfo/python-list
Re: Is there a function that applies list of functions to a value?
AdamKal writes:
Hi,
From time to time I have to apply a series of functions to a value
in such a way:
func4(func3(func2(func1(myval
I was wondering if there is a function in standard library that
would take a list of functions and a initial value and do the above
like this:
func_im_looking_for([func1, func2, func3, func4], myval)
I looked in itertools but nothing seamed to do the job. This seams
like something vary obvious that was needed many times elsewhere so
maybe you could help me?
If you can have things backwards, or have func_im_looking_for reverse
things first, you can do it this way:
from functools import reduce
def funcall(arg, fun): return fun(arg)
def func1(arg): return 'f1({})'.format(arg)
def func2(arg): return 'f2({})'.format(arg)
def func3(arg): return 'f3({})'.format(arg)
# prints: f1(f2(f3(3.14)))
print(reduce(funcall, (func3, func2, func1), 3.14))
--
http://mail.python.org/mailman/listinfo/python-list
Re: Is there a function that applies list of functions to a value?
Am 28.08.2013 13:52, schrieb AdamKal: Hi, From time to time I have to apply a series of functions to a value in such a way: func4(func3(func2(func1(myval I was wondering if there is a function in standard library that would take a list of functions and a initial value and do the above like this: func_im_looking_for([func1, func2, func3, func4], myval) I looked in itertools but nothing seamed to do the job. This seams like something vary obvious that was needed many times elsewhere so maybe you could help me? You could try somthing like: myval = 'whatever' for i in range(1,4): print eval(func%s(%s) % (i, myval)) -- http://mail.python.org/mailman/listinfo/python-list
Re: Is there a function that applies list of functions to a value?
Tim Chase writes: On 2013-08-28 05:52, AdamKal wrote: From time to time I have to apply a series of functions to a value in such a way: func4(func3(func2(func1(myval I was wondering if there is a function in standard library that would take a list of functions and a initial value and do the above like this: func_im_looking_for([func1, func2, func3, func4], myval) At least in Py2.x you can use reduce: reduce(lambda value, fn: fn(value), [list_of_functions], myval) I notice now that I didn't notice, when I just sent the same solution, that the function list was already backwards to its intended order of application, so yes, this should work as wanted. Sorry. -- http://mail.python.org/mailman/listinfo/python-list
Re: Is there a function that applies list of functions to a value?
Thanks! I guess this is as simple as it gets then. I was just looking for the one obvious way to do it. W dniu środa, 28 sierpnia 2013 15:11:34 UTC+2 użytkownik Tim Chase napisał: On 2013-08-28 05:52, AdamKal wrote: From time to time I have to apply a series of functions to a value in such a way: func4(func3(func2(func1(myval I was wondering if there is a function in standard library that would take a list of functions and a initial value and do the above like this: func_im_looking_for([func1, func2, func3, func4], myval) At least in Py2.x you can use reduce: reduce(lambda value, fn: fn(value), [list_of_functions], myval) I believe it was moved into functools.reduce() in Py3.x meaning you might want to do something like try: reduce # see if it's already in __builtins__ except NameError: # running Py3... from functools import reduce or try: from functools import reduce except ImportError: pass # it should already be in __builtins__ for pre-2.6 at the top to make sure it's in your global namespace. -tkc -- http://mail.python.org/mailman/listinfo/python-list
Re: Is there a function that applies list of functions to a value?
Am 2013-08-28 14:52 schrieb AdamKal: Hi, From time to time I have to apply a series of functions to a value in such a way: func4(func3(func2(func1(myval I was wondering if there is a function in standard library that would take a list of functions and a initial value and do the above like this: func_im_looking_for([func1, func2, func3, func4], myval) I looked in itertools but nothing seamed to do the job. This seams like something vary obvious that was needed many times elsewhere so maybe you could help me? reduce(lambda x, f: f(x), funcs, myval) would do the job. Thomas -- http://mail.python.org/mailman/listinfo/python-list
Re: Is there a function that applies list of functions to a value?
On Wed, Aug 28, 2013 at 11:23 PM, AdamKal adamkalin...@gmail.com wrote: I guess this is as simple as it gets then. I was just looking for the one obvious way to do it. The one obvious way to do some things is to post on python-list and see what comes back :) I love reading over these sorts of threads, they're good fun. ChrisA -- http://mail.python.org/mailman/listinfo/python-list
Re: Is there a function that applies list of functions to a value?
On 2013-08-28 06:23, AdamKal wrote: Thanks! I guess this is as simple as it gets then. I was just looking for the one obvious way to do it. When 3 replies from 3 people all arrive within minutes, each suggesting reduce(), I'd figure it's the one obvious way to do it :-) -tkc -- http://mail.python.org/mailman/listinfo/python-list
Re: Is there a function that applies list of functions to a value?
W dniu środa, 28 sierpnia 2013 15:43:39 UTC+2 użytkownik Tim Chase napisał: When 3 replies from 3 people all arrive within minutes, each suggesting reduce(), I'd figure it's the one obvious way to do it :-) I guess it's at least a good hint ;) Thanks to all! :) -- http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
Am 28.08.2013 13:55, schrieb Ferrous Cranus: Τη Τετάρτη, 28 Αυγούστου 2013 2:32:44 μ.μ. UTC+3, ο χρήστης Dave Angel έγραψε: You really have no directory in which you have write permissions? If so, perhaps you'd better solve that first. of cours ei ahve write permissions. Here: ni...@superhost.gr [~]# ls -ld www/ drwxr-x--- 4 nikos nobody 4096 Jul 13 10:33 www// ni...@superhost.gr [~]# ls -ld www/cgi-bin/ drwxr-xr-x 2 nikos nikos 4096 Aug 28 10:41 www/cgi-bin// whick make it a mysterya s to why with open(../err.out, a) as f: fails to write the file. ...maybe it's because the server is not running as user nikos? Uli -- http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
Τη Τετάρτη, 28 Αυγούστου 2013 4:38:02 μ.μ. UTC+3, ο χρήστης Ulrich Eckhardt έγραψε: Am 28.08.2013 13:55, schrieb Ferrous Cranus: Τη Τετάρτη, 28 Αυγούστου 2013 2:32:44 μ.μ. UTC+3, ο χρήστης Dave Angel έγραψε: You really have no directory in which you have write permissions? If so, perhaps you'd better solve that first. of cours ei ahve write permissions. Here: ni...@superhost.gr [~]# ls -ld www/ drwxr-x--- 4 nikos nobody 4096 Jul 13 10:33 www// ni...@superhost.gr [~]# ls -ld www/cgi-bin/ drwxr-xr-x 2 nikos nikos 4096 Aug 28 10:41 www/cgi-bin// whick make it a mysterya s to why with open(../err.out, a) as f: fails to write the file. ...maybe it's because the server is not running as user nikos? Uli Yes Uli, the script metrits.py is being invoked by Apache Web Server which in turn runs under user Nobody. So, that mean that? user 'nobody' has no write permission to /home/nikos folder? -- http://mail.python.org/mailman/listinfo/python-list
Re: Improving the web page download code.
On 28/08/2013 07:23, mukesh tiwari wrote:
[snip]
Initially I blocked the main using raw_input('') and it was working fine.
u = Downloader()
signal.signal( signal.SIGINT , u.handleexception)
thread.start_new_thread ( u.createurl , () )
for i in xrange ( 5 ) :
thread.start_new_thread ( u.downloadurl , () )
#This is for blocking main
raw_input('')
When I pressed ctrl-c then it's responding fine but now after switching to
threading module, I am not able to kill my program using SIGINT ( ctrl-c ). Any
idea how to signal SIGINT to threads ?
Try making them daemon threads. A daemon thread is one that will be
killed when the main thread terminates.
Now the changed code and I have to catch the SIGINT.
u = Downloader()
signal.signal( signal.SIGINT , u.handleexception)
urlcreator = threading.Thread ( target = u.createurl )
workers = []
for i in xrange ( 5 ):
workers.append ( threading.Thread( target = u.downloadurl ) )
urlcreator.daemon = True
urlcreator.start()
for w in workers:
urlcreator.daemon = True
w.daemon = True
w.start()
urlcreator.join()
for w in workers:
w.join()
--
http://mail.python.org/mailman/listinfo/python-list
python3 integer division debugging
The change in integer division seems to be the most insidious source of silent errors in porting code from python2 - since it changes the behaviour or valid code silently. I wish the interpreter had an instrumented mode to detect and report such problems. -- http://mail.python.org/mailman/listinfo/python-list
Re: python3 integer division debugging
On 28 August 2013 16:15, Neal Becker ndbeck...@gmail.com wrote: The change in integer division seems to be the most insidious source of silent errors in porting code from python2 - since it changes the behaviour or valid code silently. I wish the interpreter had an instrumented mode to detect and report such problems. Is that a joke? Run the code under Python 2.6/2.7 with the -3 flag: $ cat test.py print(10 / 7) $ python -3 test.py test.py:2: DeprecationWarning: classic int division print(10 / 7) 1 Oscar -- http://mail.python.org/mailman/listinfo/python-list
Re: python3 integer division debugging
On Wed, Aug 28, 2013, at 11:15, Neal Becker wrote: The change in integer division seems to be the most insidious source of silent errors in porting code from python2 - since it changes the behaviour or valid code silently. I wish the interpreter had an instrumented mode to detect and report such problems. There is such a mode in python2 from version 2.2 through 2.7: -Q warn. -- http://mail.python.org/mailman/listinfo/python-list
Re: python3 integer division debugging
On Thu, Aug 29, 2013 at 1:21 AM, Oscar Benjamin oscar.j.benja...@gmail.com wrote: On 28 August 2013 16:15, Neal Becker ndbeck...@gmail.com wrote: The change in integer division seems to be the most insidious source of silent errors in porting code from python2 - since it changes the behaviour or valid code silently. I wish the interpreter had an instrumented mode to detect and report such problems. Is that a joke? Run the code under Python 2.6/2.7 with the -3 flag: I wouldn't say that's a joke, it's just another demonstration of Guido's time machine :) ChrisA -- http://mail.python.org/mailman/listinfo/python-list
Re: python3 integer division debugging
Chris Angelico wrote: On Thu, Aug 29, 2013 at 1:21 AM, Oscar Benjamin oscar.j.benja...@gmail.com wrote: On 28 August 2013 16:15, Neal Becker ndbeck...@gmail.com wrote: The change in integer division seems to be the most insidious source of silent errors in porting code from python2 - since it changes the behaviour or valid code silently. I wish the interpreter had an instrumented mode to detect and report such problems. Is that a joke? Run the code under Python 2.6/2.7 with the -3 flag: I wouldn't say that's a joke, it's just another demonstration of Guido's time machine :) ChrisA Ah! I looked for it in python3. Funny it isn't there as well. Thanks! -- http://mail.python.org/mailman/listinfo/python-list
String splitting with exceptions
I have a crufty old DNS provisioning system that I'm rewriting and I hope improving in python. (It's based on tinydns if you know what that is.) The record formats are, in the worst case, like this: foo.[DOM]::[IP6::4361:6368:6574]:600:: What I would like to do is to split this string into a list like this: [ 'foo.[DOM]','','[IP6::4361:6368:6574]','600','' ] Colons are separators except when they're inside square brackets. I have been messing around with re.split() and re.findall() and haven't been able to come up with either a working separator pattern for split() or a working field pattern for findall(). I came pretty close with findall() but can't get it to reliably match the nothing between two adjacent colons not inside brackets. Any suggestions? I realize I could do it in a loop where I pick stuff off the front of the string, but yuck. This is in python 2.7.5. -- Regards, John Levine, jo...@iecc.com, Primary Perpetrator of The Internet for Dummies, Please consider the environment before reading this e-mail. http://jl.ly -- http://mail.python.org/mailman/listinfo/python-list
Re: String splitting with exceptions
The record formats are, in the worst case, like this: foo.[DOM]::[IP6::4361:6368:6574]:600:: Any suggestions? Write a little parser that can handle the record format? Skip -- http://mail.python.org/mailman/listinfo/python-list
Re: String splitting with exceptions
On Wed, Aug 28, 2013, at 12:44, John Levine wrote:
I have a crufty old DNS provisioning system that I'm rewriting and I
hope improving in python. (It's based on tinydns if you know what
that is.)
The record formats are, in the worst case, like this:
foo.[DOM]::[IP6::4361:6368:6574]:600::
What I would like to do is to split this string into a list like this:
[ 'foo.[DOM]','','[IP6::4361:6368:6574]','600','' ]
Colons are separators except when they're inside square brackets. I
have been messing around with re.split() and re.findall() and haven't
been able to come up with either a working separator pattern for
split() or a working field pattern for findall(). I came pretty
close with findall() but can't get it to reliably match the
nothing between two adjacent colons not inside brackets.
Any suggestions? I realize I could do it in a loop where I pick stuff
off the front of the string, but yuck.
This is in python 2.7.5.
Can you have brackets within brackets? If so, this is impossible to deal
with within a regex.
Otherwise:
re.findall('((?:[^[:]|\[[^]]*\])*):?',s)
['foo.[DOM]', '', '[IP6::4361:6368:6574]', '600', '', '']
I'm not sure why _your_ list only has one empty string at the end. Is
the record always terminated by a colon that is not meant to imply an
empty field after it? If so, remove the question mark:
re.findall('((?:[^[:]|\[[^]]*\])*):',s)
['foo.[DOM]', '', '[IP6::4361:6368:6574]', '600', '']
I've done this kind of thing (for validation, not capturing) for email
addresses (there are some obscure bits of email address syntax that need
it) before, so it came to mind immediately.
--
http://mail.python.org/mailman/listinfo/python-list
Re: String splitting with exceptions
On 2013-08-28 13:14, random...@fastmail.us wrote:
On Wed, Aug 28, 2013, at 12:44, John Levine wrote:
I have a crufty old DNS provisioning system that I'm rewriting
and I hope improving in python. (It's based on tinydns if you
know what that is.)
The record formats are, in the worst case, like this:
foo.[DOM]::[IP6::4361:6368:6574]:600::
Otherwise:
re.findall('((?:[^[:]|\[[^]]*\])*):?',s)
['foo.[DOM]', '', '[IP6::4361:6368:6574]', '600', '', '']
I'm not sure why _your_ list only has one empty string at the end.
I wondered that. I also wondered about bracketed quoting that
doesn't start at the beginning of a field:
foo.[one:two]::[IP6::1234:5678:9101]:600::
^
This might be bogus, or one might want to catch this case.
-tkc
--
http://mail.python.org/mailman/listinfo/python-list
Re: can't get utf8 / unicode strings from embedded python
Thank you for your thoughtful and thorough response. I now understand much better what you (and apparently the others) were warning me against and I will certainly consider that moving forward. I very much appreciate your help as I learn about python and embedding and all these crazy encoding problems. What do kids have to do with this? When a person has children, they quickly learn that the best way to deal with some one who seems to be not listening or having a tantrum: show understanding and compassion, restraint and patience, as you, in the most neutral way that you can, gently bit firmly guide said person back on track. You learn that if you instead express your frustration at said person, that it never, ever helps the situation, and only causes more hurt to be spread around to the very people you are ostensibly attempting to help. Are you an adult or a child? Perhaps my comment was lost in translation, but this is rather the question that I was obliquely asking you. *wink right back* In any case I thank you for your help, which has in fact been quite great! My demo script is working, and I know now to properly advise my script writers regarding how to properly encode strings. -- http://mail.python.org/mailman/listinfo/python-list
Re: String splitting with exceptions
On 2013-08-28, John Levine jo...@iecc.com wrote: I have a crufty old DNS provisioning system that I'm rewriting and I hope improving in python. (It's based on tinydns if you know what that is.) The record formats are, in the worst case, like this: foo.[DOM]::[IP6::4361:6368:6574]:600:: What I would like to do is to split this string into a list like this: [ 'foo.[DOM]','','[IP6::4361:6368:6574]','600','' ] Colons are separators except when they're inside square brackets. I have been messing around with re.split() and re.findall() and haven't been able to come up with either a working separator pattern for split() or a working field pattern for findall(). I came pretty close with findall() but can't get it to reliably match the nothing between two adjacent colons not inside brackets. Any suggestions? I realize I could do it in a loop where I pick stuff off the front of the string, but yuck. A little parser, as Skip suggested, is a good way to go. The brackets make your string context-sensitive, a difficult concept to cleanly parse with a regex. I initially hoped a csv module dialect could work, but the quote character is (currently) hard-coded to be a single, simple character, i.e., I can't tell it to treat [xxx] as xxx. What about Skip's suggestion? A little parser. It might seem crass or something, but it really is easier than musceling a regex into a context sensitive grammer. def dns_split(s): in_brackets = False b = 0 # index of beginning of current string for i, c in enumerate(s): if not in_brackets: if c == [: in_brackets = True elif c == ':': yield s[b:i] b = i+1 elif c == ]: in_brackets = False print(list(dns_split(s))) ['foo.[DOM]', '', '[IP6::4361:6368:6574]', '600', ''] It'll gag on nested brackets (fixable with a counter) and has no error handling (requires thought), but it's a start. -- Neil Cerutti -- http://mail.python.org/mailman/listinfo/python-list
Re: String splitting with exceptions
On 2013-08-28, Tim Chase python.l...@tim.thechases.com wrote:
On 2013-08-28 13:14, random...@fastmail.us wrote:
On Wed, Aug 28, 2013, at 12:44, John Levine wrote:
I have a crufty old DNS provisioning system that I'm rewriting
and I hope improving in python. (It's based on tinydns if you
know what that is.)
The record formats are, in the worst case, like this:
foo.[DOM]::[IP6::4361:6368:6574]:600::
Otherwise:
re.findall('((?:[^[:]|\[[^]]*\])*):?',s)
['foo.[DOM]', '', '[IP6::4361:6368:6574]', '600', '', '']
I'm not sure why _your_ list only has one empty string at the end.
I wondered that.
Good point. My little parser fails on that, too. It'll miss *all*
final fields. My parser needs if s: yield s[b:] at the end, to
operate like str.split, where the empty string is special.
--
Neil Cerutti
--
http://mail.python.org/mailman/listinfo/python-list
Re: String splitting with exceptions
Neil Cerutti wrote: On 2013-08-28, John Levine jo...@iecc.com wrote: I have a crufty old DNS provisioning system that I'm rewriting and I hope improving in python. (It's based on tinydns if you know what that is.) The record formats are, in the worst case, like this: foo.[DOM]::[IP6::4361:6368:6574]:600:: What I would like to do is to split this string into a list like this: [ 'foo.[DOM]','','[IP6::4361:6368:6574]','600','' ] Colons are separators except when they're inside square brackets. I have been messing around with re.split() and re.findall() and haven't been able to come up with either a working separator pattern for split() or a working field pattern for findall(). I came pretty close with findall() but can't get it to reliably match the nothing between two adjacent colons not inside brackets. Any suggestions? I realize I could do it in a loop where I pick stuff off the front of the string, but yuck. A little parser, as Skip suggested, is a good way to go. The brackets make your string context-sensitive, a difficult concept to cleanly parse with a regex. I initially hoped a csv module dialect could work, but the quote character is (currently) hard-coded to be a single, simple character, i.e., I can't tell it to treat [xxx] as xxx. What about Skip's suggestion? A little parser. It might seem crass or something, but it really is easier than musceling a regex into a context sensitive grammer. def dns_split(s): in_brackets = False b = 0 # index of beginning of current string for i, c in enumerate(s): if not in_brackets: if c == [: in_brackets = True elif c == ':': yield s[b:i] b = i+1 elif c == ]: in_brackets = False I think you need one more yield outside the loop. print(list(dns_split(s))) ['foo.[DOM]', '', '[IP6::4361:6368:6574]', '600', ''] It'll gag on nested brackets (fixable with a counter) and has no error handling (requires thought), but it's a start. Something similar on top of regex: def split(s): ... start = level = 0 ... for m in re.compile(r[[:\]]).finditer(s): ... if m.group() == [: level += 1 ... elif m.group() == ]: ... assert level ... level -= 1 ... elif level == 0: ... yield s[start:m.start()] ... start = m.end() ... yield s[start:] ... list(split(a[b:c:]:d)) ['a[b:c:]', 'd'] list(split(a[b:c[:]]:d)) ['a[b:c[:]]', 'd'] list(split()) [''] list(split(:)) ['', ''] list(split(:x)) ['', 'x'] list(split([:x])) ['[:x]'] list(split(:[:x])) ['', '[:x]'] list(split(:[:[:]:x])) ['', '[:[:]:x]'] list(split([:::])) ['[:::]'] s = foo.[DOM]::[IP6::4361:6368:6574]:600:: list(split(s)) ['foo.[DOM]', '', '[IP6::4361:6368:6574]', '600', '', ''] Note that there is one more empty string which I believe the OP forgot. -- http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
On 28/8/2013 07:38, Ferrous Cranus wrote: no this is the general error log apache produces for all the server. Is there a way to grep error logging info, pertainign only to my specific nikos account or my superhost.gr domain? I now nothing about Apache logs, but how about grepping the client url ? [client 108.162.231.120] I still don't understand why you don't find or create a directory that nobody has write access to, so you can be more flexible about what information you log. Or strip the problem down to a simple page that displays what print emits in a simple form. -- DaveA -- http://mail.python.org/mailman/listinfo/python-list
RE: [error] [client 178.59.111.223] (2)No such file or directory: exec of
Ferrous Cranus wrote: Yes Uli, the script metrits.py is being invoked by Apache Web Server which in turn runs under user Nobody. So, that mean that? user 'nobody' has no write permission to /home/nikos folder? Yes. You should make it group writable with nobody as the group. Use chmod and chown to change permissions and owners (i.e. groups). As a last resort (for testing purposes only!) you can set the directory world writable, but then *anyone* with access to that host can write/delete/destroy the contents of that directory. This is obviously very insecure and not a good idea. But if you are only trying to get a quick error message then it might work for you. Normally I would have thought you would have a public_html or www directory in your home folder that would be readable/writable to the web server (and where you should write). ~Ramit This email is confidential and subject to important disclaimers and conditions including on offers for the purchase or sale of securities, accuracy and completeness of information, viruses, confidentiality, legal privilege, and legal entity disclaimers, available at http://www.jpmorgan.com/pages/disclosures/email. -- http://mail.python.org/mailman/listinfo/python-list
Re: Is there a function that applies list of functions to a value?
Reduce tricks are nice, but I prefer clarity sometimes:
def double(x):
return x*2
def add3(x):
return x+3
def compose(*funcs):
for func in funcs:
if not callable(func):
raise ValueError('Must pass callable functions')
def inner(value):
for func in funcs:
value = func(value)
return value
return inner
add_then_double = compose(add3, double)
double_then_add = compose(double, add3)
print add_then_double(1) # prints 8
print double_then_add(1) # prints 5
--
http://mail.python.org/mailman/listinfo/python-list
Re: python3 integer division debugging
On 8/28/2013 11:15 AM, Neal Becker wrote: The change in integer division seems to be the most insidious source of silent errors in porting code from python2 - since it changes the behaviour or valid code silently. In Python since 2.??, put 'from __future__ import integer_division' (sp?) at the top of your code -- Terry Jan Reedy -- http://mail.python.org/mailman/listinfo/python-list
Moving to Python for web
So, I have been working in PHP for several years but I want to learn something new. That something new is Python. But since I'm a web developer I want to build stuff for the web. I don't want to use Django because it's too bloated, it seem to do everything for you. I don't like that. I want to do the plumbing. But at the same time I have no idea how I would write something that could handle cookies, sessions, post, get etc etc; so I assume I have to use some kind of web framework. So, can you recommend a minimal web framework that still allows me to write in Python? Furthermore, do I even need one? I am currently running NGINX and I have UWSGI installed. I'm just worried about how I would handle form submissions, get requests and sessions/cookies. Any advice would be greatly appreciated. -- http://mail.python.org/mailman/listinfo/python-list
Re: My attempts in playing with tail-recursion in python
Le 28-08-2013, Thomas Baruchel baruc...@gmx.com a écrit : The following functions are fully usable; I hope someone will enjoy using them. If you are not interested by the explanations, just jump to the end of the message and take my functions for using them. Despite the very short size of my function, I made a module of it as a convenience for my own use. I share here my recursion.py file in which I also added some docstrings. - module recursion.py --- The recursion module provides convenient functions for handling recursion with lambda functions. The famous Y-combinator is provided as a convenience, but the most distinctive function of the module is the B function for handling tail-recursion. Written by Thomas Baruchel Y = lambda f: (lambda x: x(x))(lambda y: f(lambda *args: y(y)(*args))) def B(func): B(lambda) - lambda Return a usable function from a lambda expression written with a tail-recursion style. The new function will be evaluated inside a loop with no recursive calls, allowing high depths of recursion. Since the internal loop evaluates the return of the function as long as it is callable, the function does not work with functions returning functions (at the end of the recursive calls); there is no restriction otherwise. E.g.: fac = lambda f: lambda a,b: b if a==0 else f(a-1,a*b) func = B(fac) func(5,1) -- 120 or more shortly: B(lambda f: lambda a,b: b if a==0 else f(a-1,a*b))(5,1) -- 120 x = (lambda f: (lambda x: x(x))(lambda y: f(lambda *args: lambda: y(y)(*args(func) def wrapper(*args): out = x(*args) while callable(out): out = out() return out return wrapper -- http://mail.python.org/mailman/listinfo/python-list
Re: Moving to Python for web
On Wed, Aug 28, 2013 at 4:14 PM, ecazs@gmail.com wrote: So, I have been working in PHP for several years but I want to learn something new. That something new is Python. But since I'm a web developer I want to build stuff for the web. I don't want to use Django because it's too bloated, it seem to do everything for you. I don't like that. I want to do the plumbing. But at the same time I have no idea how I would write something that could handle cookies, sessions, post, get etc etc; so I assume I have to use some kind of web framework. So, can you recommend a minimal web framework that still allows me to write in Python? Furthermore, do I even need one? I am currently running NGINX and I have UWSGI installed. I'm just worried about how I would handle form submissions, get requests and sessions/cookies. Any advice would be greatly appreciated. I like django, but you may want to google python micro web framework There are a handful with some following so that there are communities, docs, etc available As to get/cookies/sessions check out the requests module (3rd party - well received) http://docs.python-requests.org/en/latest/ -- http://mail.python.org/mailman/listinfo/python-list -- Joel Goldstick http://joelgoldstick.com -- http://mail.python.org/mailman/listinfo/python-list
Interface and duck typing woes
While designing a simple library, I found myself asking a philosophical question: to check or not to check the parameter's interface? I think that, considering it is Python, the usual answer would be no, but here is the situation that got me thinking: class Flock: def __init__(self): self.ducks= [] def do_stuff(self): for duck in self.ducks: duck.quack() class Duck: def quack(self): #quack-quack pass f = Flock() d = Duck() f.ducks.append(d) f.do_stuff() Ok, no big deal there, the problem is if the user forgets to implement the quack() method. The stack trace would complain that duck.quack() is wrong, but that can happen hundreds of lines after the user actually added the object to the Flock, and it can be hard to find out what is happening and which object is wrong. Of course I don't want to check isistance(), I like duck typing, but should I check if hasattr() and callable() before adding to the container? What is the pythonic way to deal with it? Am I worrying too much ;-)? Thanks, Joe -- http://mail.python.org/mailman/listinfo/python-list
Re: Moving to Python for web
On Wednesday, August 28, 2013 11:08:52 PM UTC+2, Joel Goldstick wrote: On Wed, Aug 28, 2013 at 4:14 PM, Ecaz wrote: So, I have been working in PHP for several years but I want to learn something new. That something new is Python. But since I'm a web developer I want to build stuff for the web. I don't want to use Django because it's too bloated, it seem to do everything for you. I don't like that. I want to do the plumbing. But at the same time I have no idea how I would write something that could handle cookies, sessions, post, get etc etc; so I assume I have to use some kind of web framework. So, can you recommend a minimal web framework that still allows me to write in Python? Furthermore, do I even need one? I am currently running NGINX and I have UWSGI installed. I'm just worried about how I would handle form submissions, get requests and sessions/cookies. Any advice would be greatly appreciated. I like django, but you may want to google python micro web framework There are a handful with some following so that there are communities, docs, etc available As to get/cookies/sessions check out the requests module (3rd party - well received) http://docs.python-requests.org/en/latest/ -- http://mail.python.org/mailman/listinfo/python-list -- Joel Goldstick http://joelgoldstick.com I've looked at Flask, Bottle and Web.py. I quite like the look of Bottle. I'll keep looking for some other microframeworks, maybe I can find something else that interests me. Thank you. -- http://mail.python.org/mailman/listinfo/python-list
Re: Moving to Python for web
On Wednesday, August 28, 2013 11:25:44 PM UTC+2, Andreas Ecaz wrote: I've looked at Flask, Bottle and Web.py. I quite like the look of Bottle. I'll keep looking for some other microframeworks, maybe I can find something else that interests me. Thank you. At the moment I'm worried about writing more framework than python (if that makes sense) which seems unlikely with MOST microframeworks. -- http://mail.python.org/mailman/listinfo/python-list
Re: String splitting with exceptions
Can you have brackets within brackets? If so, this is impossible to deal
with within a regex.
Nope. It's a regular language, not a CFL.
Otherwise:
re.findall('((?:[^[:]|\[[^]]*\])*):?',s)
['foo.[DOM]', '', '[IP6::4361:6368:6574]', '600', '', '']
That seems to do it, thanks.
--
Regards,
John Levine, jo...@iecc.com, Primary Perpetrator of The Internet for Dummies,
Please consider the environment before reading this e-mail. http://jl.ly
--
http://mail.python.org/mailman/listinfo/python-list
Re: Interface and duck typing woes
On 8/28/2013 5:09 PM, Joe Junior wrote:
While designing a simple library, I found myself asking a
philosophical question: to check or not to check the parameter's
interface?
I think that, considering it is Python, the usual answer would be
no, but here is the situation that got me thinking:
class Flock:
def __init__(self):
self.ducks= []
def do_stuff(self):
for duck in self.ducks:
duck.quack()
class Duck:
def quack(self):
#quack-quack
pass
f = Flock()
d = Duck()
f.ducks.append(d)
f.do_stuff()
Ok, no big deal there, the problem is if the user forgets to implement
the quack() method. The stack trace would complain that duck.quack()
is wrong, but that can happen hundreds of lines after the user
actually added the object to the Flock, and it can be hard to find out
what is happening and which object is wrong.
Of course I don't want to check isistance(), I like duck typing, but
should I check if hasattr() and callable() before adding to the
container? What is the pythonic way to deal with it? Am I worrying too
much ;-)?
You could underscore '_ducks' and add a .add_duck method with the checks
you suggest. Or wrap 'duck.quack()' in try-except and log or warn (or
even raise) on AttributeError or TypeError (not callable) with an
informative message. Grepping for 'ducks.append(' will find all
locations where a non-duck might have been added.
Depending on who the users will be, I might just not worry about it
until an exception is raised. If you try to protect against everything
that you might do wrong, you are on the road to madness, as the
protection code might also be buggy. (Too much testing has the same
problem ;-).
--
Terry Jan Reedy
--
http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
On Wed, 28 Aug 2013 18:44:28 +, Prasad, Ramit wrote: Normally I would have thought you would have a public_html or www directory in your home folder that would be readable/writable to the web server (and where you should write). I expect that he does. But Nikos has tried writing to the Nikos home directory, and to .. (the parent directory). I don't believe he has tried writing to . (the current directory), or to /tmp. I'm not an expert, but I expect that Apache should be able to write to one of those. And if not, he has root on his system, he can simply create a writable directory and write to that. I expect that there are security implications of having a directories writable to the webserver user, but temporarily creating one for a quick debugging aid should be okay. -- Steven -- http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
On Thu, Aug 29, 2013 at 4:44 AM, Prasad, Ramit ramit.pra...@jpmorgan.com.dmarc.invalid wrote: Normally I would have thought you would have a public_html or www directory in your home folder that would be readable/writable to the web server (and where you should write). No, a normal setup would have that world-readable but not writable. That way, even if an exploit is found in your web site that lets an attacker write files, s/he can't upload more files to the web server's directory and start running them. A directory writable by the web server might be /tmp. ChrisA -- http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
On Wed, Aug 28, 2013 at 6:49 PM, Steven D'Aprano steve+comp.lang.pyt...@pearwood.info wrote: On Wed, 28 Aug 2013 18:44:28 +, Prasad, Ramit wrote: Normally I would have thought you would have a public_html or www directory in your home folder that would be readable/writable to the web server (and where you should write). I expect that he does. But Nikos has tried writing to the Nikos home directory, and to .. (the parent directory). I don't believe he has tried writing to . (the current directory), or to /tmp. I'm not an expert, but I expect that Apache should be able to write to one of those. And if not, he has root on his system, he can simply create a writable directory and write to that. I expect that there are security implications of having a directories writable to the webserver user, but temporarily creating one for a quick debugging aid should be okay. -- Steven -- http://mail.python.org/mailman/listinfo/python-list This thread follows well travelled grounds from several of the previous Nikos appearances here. He seems to have problems grasping permissions as they relate to apache. He seems to demand cook book answers as compared to understanding the issues. At any rate, isn't this stuff really something that the Web Server company should be helping him with? Its their server, they know how it is configured, and they can quickly look in his directories to figure out permissions related issues. -- Joel Goldstick http://joelgoldstick.com -- http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
On Wed, 28 Aug 2013 06:11:13 -0700, Ferrous Cranus wrote: This si what iam tryign now since the function ishish proposed wont help me. I see that your apology for careless writing didn't last very long. [...] except: print( repr(e) ) What is the value of e here, and where is it defined? Let's look at the error in your log file: [Wed Aug 28 13:08:27 2013] [error] [client 108.162.231.120] print( repr(e) ) [Wed Aug 28 13:08:27 2013] [error] [client 108.162.231.120] NameError: name 'e' is not defined Did you bother to read the error before asking for help? Variable 'e' is not defined. Perhaps you should define it? -- Steven -- http://mail.python.org/mailman/listinfo/python-list
Re: Interface and duck typing woes
On Thu, Aug 29, 2013 at 7:54 AM, Terry Reedy tjre...@udel.edu wrote: Depending on who the users will be, I might just not worry about it until an exception is raised. If you try to protect against everything that you might do wrong, you are on the road to madness, as the protection code might also be buggy. (Too much testing has the same problem ;-). I'd go further. Do you believe that you can write code to catch every bug you might make? If so, you are naive and probably haven't spent much time programming yet :) And if not, then you must acknowledge that bugs WILL happen; therefore you will need to cope with them after the event. So rather than trying to prevent them all, just improve your means of coping, and you'll accomplish the same end with much less trouble. At this point I could go off into a lengthy discussion of philosophy and original sin (not original SYN, which is a different thing altogether), but anyone who's ever written bug-handling code will understand what I mean already :) ChrisA -- http://mail.python.org/mailman/listinfo/python-list
Re: Interface and duck typing woes
On Wed, 28 Aug 2013 18:09:22 -0300, Joe Junior wrote: While designing a simple library, I found myself asking a philosophical question: to check or not to check the parameter's interface? The only correct answer to that is, Yes no maybe. :-) I think that, considering it is Python, the usual answer would be no, but here is the situation that got me thinking: class Flock: def __init__(self): self.ducks= [] def do_stuff(self): for duck in self.ducks: duck.quack() class Duck: def quack(self): #quack-quack pass f = Flock() d = Duck() f.ducks.append(d) f.do_stuff() Ok, no big deal there, the problem is if the user forgets to implement the quack() method. The stack trace would complain that duck.quack() is wrong, but that can happen hundreds of lines after the user actually added the object to the Flock, and it can be hard to find out what is happening and which object is wrong. True, but that's a good case for improving the error message, or using a debugger. Here is Flock.do_stuff re-written to give a more verbose/useful error message: def do_stuff(self): for i, duck in enumerate(self.ducks): try: duck.quack() except AttributeError: raise DuckError( 'object %r at index %d has no quack' % (duck, i) ) Okay, seeing the index is useful. But we would have got nearly as much information from the AttributeError traceback, minus the index: py (42).quack() Traceback (most recent call last): File stdin, line 1, in module AttributeError: 'int' object has no attribute 'quack' So how much extra work are you prepared to put in to make a rare occurrence (passing a magpie instead of a duck) easier to debug? Since errors are presumably rare, maybe the answer is not a lot of extra work. But if the consequence of an error is catastrophic (for want of a duck quacking, the nuclear reactor explodes, making the northern hemisphere uninhabitable), maybe the answer is as much as it takes. Other questions: what happens if duck.quack is buggy and raises AttributeError? A good question, but just how far should we go in worrying about things like this? What happens if duck.quack is buggy and raises StopIteration? Sometimes the right reaction is to deal with it if and when it actually occurs. In other words, wait for the bug report before trying to fix it. (Fix it may mean telling people don't do that!.) Of course I don't want to check isistance(), I like duck typing, but should I check if hasattr() and callable() before adding to the container? What is the pythonic way to deal with it? Am I worrying too much ;-)? Yes :-) Except in the (rare?) case that you aren't worrying enough, in which case you can check hasattr and callable up front, or do whatever other tests you feel the need to check. It depends on the specific code you are writing. -- Steven -- http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
On Wed, 28 Aug 2013 18:56:56 -0400, Joel Goldstick wrote: At any rate, isn't this stuff really something that the Web Server company should be helping him with? Its their server, they know how it is configured, and they can quickly look in his directories to figure out permissions related issues. Perhaps. But Nikos is reporting that his log file shows entries from all the other websites on the server, which doesn't sound good to me. Surely any decent, competent web server company would be able to ensure that each customer sees only their own log entries? -- Steven -- http://mail.python.org/mailman/listinfo/python-list
semicolon at end of python's statements
Dear all, I'm C++ programmer and unfortunately put semicolon at end of my statements in python. Quesion: What's really defferences between putting semicolon and don't put? Yours, Mohsen -- http://mail.python.org/mailman/listinfo/python-list
Re: semicolon at end of python's statements
On Thu, Aug 29, 2013 at 10:18 AM, Mohsen Pahlevanzadeh moh...@pahlevanzadeh.org wrote: Dear all, I'm C++ programmer and unfortunately put semicolon at end of my statements in python. Quesion: What's really defferences between putting semicolon and don't put? Very little. Putting the semicolon makes you look like a C programmer who's new to Python; omitting it makes you look like you actually understand Python :) As a C and C++ programmer myself, I know where you're coming from, but putting semicolons at the ends of Python statements is as useless as putting lots of (((irritating (((superfluous (((parentheses) in your C++ code. The parser won't mind, but subsequent programmers will wonder what these unnecessary syntactic elements are for. ChrisA -- http://mail.python.org/mailman/listinfo/python-list
Re: semicolon at end of python's statements
On 2013-08-29 04:48, Mohsen Pahlevanzadeh wrote: I'm C++ programmer and unfortunately put semicolon at end of my statements in python. Quesion: What's really defferences between putting semicolon and don't put? From a technical standpoint, nothing (see below). From a readability on the part of other programmers standpoint, it's bad practice. So if you're coding for yourself, do whichever makes you happy. If you want to interact with other Python developers and don't want to make them grumpy, remove them. -tkc def with_semis(): ... print 1; ... print 2; ... print 3; ... def without_semis(): ... print 1 ... print 2 ... print 3 ... import dis dis.dis(with_semis) 2 0 LOAD_CONST 1 (1) 3 PRINT_ITEM 4 PRINT_NEWLINE 3 5 LOAD_CONST 2 (2) 8 PRINT_ITEM 9 PRINT_NEWLINE 4 10 LOAD_CONST 3 (3) 13 PRINT_ITEM 14 PRINT_NEWLINE 15 LOAD_CONST 0 (None) 18 RETURN_VALUE dis.dis(without_semis) 2 0 LOAD_CONST 1 (1) 3 PRINT_ITEM 4 PRINT_NEWLINE 3 5 LOAD_CONST 2 (2) 8 PRINT_ITEM 9 PRINT_NEWLINE 4 10 LOAD_CONST 3 (3) 13 PRINT_ITEM 14 PRINT_NEWLINE 15 LOAD_CONST 0 (None) 18 RETURN_VALUE -- http://mail.python.org/mailman/listinfo/python-list
Re: semicolon at end of python's statements
On 2013-08-29 10:31, Chris Angelico wrote: but putting semicolons at the ends of Python statements is as useless as putting lots of (((irritating (((superfluous (((parentheses) in your C++ code. The parser won't mind, but subsequent programmers will wonder what these unnecessary syntactic elements are for. That would would be a lisp programmer writing C++ code? :-) -tkc -- http://mail.python.org/mailman/listinfo/python-list
Re: semicolon at end of python's statements
In article mailman.332.1377735563.19984.python-l...@python.org, Mohsen Pahlevanzadeh moh...@pahlevanzadeh.org wrote: Dear all, I'm C++ programmer and unfortunately put semicolon at end of my statements in python. Quesion: What's really defferences between putting semicolon and don't put? In theory, nothing. In practice, all the real Python programmers will make fun of you. Somewhat more seriously, every language has its own way of doing things. There's the set of things the language allows you to do, and the somewhat smaller set of things that have become accepted as the proper way to do things in that language. For Python, putting semicolons at the ends of statements falls into the first set but not the second. -- http://mail.python.org/mailman/listinfo/python-list
Re: semicolon at end of python's statements
On 8/28/13 8:18 PM, Mohsen Pahlevanzadeh wrote: Dear all, I'm C++ programmer and unfortunately put semicolon at end of my statements in python. Quesion: What's really defferences between putting semicolon and don't put? There is no difference. The semicolon is unnecessary in Python. If you include them, people will know that you are still thinking in another language. Full disclosure: you can separate statements on a line with semicolons, but this practice is strongly discouraged. --Ned. Yours, Mohsen -- http://mail.python.org/mailman/listinfo/python-list
Re: semicolon at end of python's statements
On Thu, Aug 29, 2013 at 10:37 AM, Tim Chase python.l...@tim.thechases.com wrote: On 2013-08-29 10:31, Chris Angelico wrote: but putting semicolons at the ends of Python statements is as useless as putting lots of (((irritating (((superfluous (((parentheses) in your C++ code. The parser won't mind, but subsequent programmers will wonder what these unnecessary syntactic elements are for. That would would be a lisp programmer writing C++ code? :-) Isn't that what LISP stands for? Lots of Irritating Superfluous Parentheses? :) I shouldn't talk, though. Never used LISP for anything serious - nearest I've done is to use Scheme to tinker with GNU Lilypond. ChrisA -- http://mail.python.org/mailman/listinfo/python-list
Re: semicolon at end of python's statements
On Thu, Aug 29, 2013 at 10:33 AM, Roy Smith r...@panix.com wrote: In article mailman.332.1377735563.19984.python-l...@python.org, Mohsen Pahlevanzadeh moh...@pahlevanzadeh.org wrote: Dear all, I'm C++ programmer and unfortunately put semicolon at end of my statements in python. Quesion: What's really defferences between putting semicolon and don't put? In theory, nothing. In practice, all the real Python programmers will make fun of you. Somewhat more seriously, every language has its own way of doing things. There's the set of things the language allows you to do, and the somewhat smaller set of things that have become accepted as the proper way to do things in that language. For Python, putting semicolons at the ends of statements falls into the first set but not the second. This is about Perl, but may be of interest. http://www.perl.com/pub/2007/12/06/soto-11.html One of his main points is that languages differ primarily in what they force you to say - not what you're able to express. C forces you to declare the ends of statements with semicolons. Python forces you to be consistent with indentation. Smalltalk (if I have this correct) forces you to put parentheses in expressions like a+b*c to declare order of operations. German forces you to match das/die/der to the noun it's referring to. Doing what a completely different programming language forces you to do is like speaking with the wrong grammar (Murdered in the bed we will be! One day we will in bed find ourselves stone dead![1]); native speakers will understand you, but it doesn't sound fluent. ChrisA [1] Mit der knife in der chess! Sun on the Stubble. Great book. -- http://mail.python.org/mailman/listinfo/python-list
Re: semicolon at end of python's statements
In article mailman.338.1377737268.19984.python-l...@python.org, Chris Angelico ros...@gmail.com wrote: This is about Perl, but may be of interest. http://www.perl.com/pub/2007/12/06/soto-11.html I got about halfway through, then raised an uncaught TLDNR Exception. But I did like what he had to say about Tcl. Tcl is under-appreciated. A few gigs back, I did a lot of work in Tcl. We were writing a network management tool (long since subsumed into IBM Tivoli via multiple corporate mergers and put out to pasture: http://tinyurl.com/qxd4kw9). The dev team consisted mostly of people who were networking subject matter experts and not real programmers. Tcl turned out to be an excellent tool to let the SME's express their networking knowledge in executable form without having to learn C++, Java, or even Python. Tcl is also ridiculously easy to embed. It's literally one line of C code and you've got an embedded Tcl interpreter running. -- http://mail.python.org/mailman/listinfo/python-list
Re: Interface and duck typing woes
On 29Aug2013 09:17, Chris Angelico ros...@gmail.com wrote: | On Thu, Aug 29, 2013 at 7:54 AM, Terry Reedy tjre...@udel.edu wrote: | Depending on who the users will be, I might just not worry about it until an | exception is raised. If you try to protect against everything that you might | do wrong, you are on the road to madness, as the protection code might also | be buggy. (Too much testing has the same problem ;-). | | I'd go further. | | Do you believe that you can write code to catch every bug you might | make? If so, you are naive and probably haven't spent much time | programming yet :) And if not, then you must acknowledge that bugs | WILL happen; therefore you will need to cope with them after the | event. So rather than trying to prevent them all, just improve your | means of coping, and you'll accomplish the same end with much less | trouble. I'm not so extreme. Yes, of course certain things will only show at runtime and you should be prepared to have to deal with that. However, when working in Java its type strictness caught a great many simple brainfart logic errors by checking function signatures; typically calling the wrong function/method or mangling arguments. Getting this stuff up front was handy. Of course there's a price there in terms of flexibility and all that wordy stuff defining the functions in the first place. As an aside, you can also get a lot of this checking in C with aggressive linting and making a bunch of macros like: #define CNULL ((char *)NULL) #define CPNULL ((char **)NULL) and so forth as needed - lint can then catch a lot of otherwise unchecked comparisons. Anyway, I digress. My point is that there are plusses to having signature/type checking at coding time. It is not the Python Way, but I surely cannot be alone in sometimes being frustrated chasing a deeply nested runtime error that static type checking might have found up front. Cheers, -- Cameron Simpson c...@zip.com.au waste cycles drawing trendy 3D junk - Mac Eudora v3 config option -- http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
On 28Aug2013 05:48, Nikos nikos.gr...@gmail.com wrote: | Hi steven , sorry for the typos. | you are write my script is invoked by apache web server application which it runs under account 'nobody' [...] | nobody8449 0.0 0.2 65712 3228 ?S12:42 0:00 /usr/local/apache/bin/httpd -k start -DSSL [...] | My script were all workign in the previous VPS enviroment, the script is correct is just a few minor thing in the new VPS env that they need to be taken care of thus prohibit my script to run.. Your previous VPS used suexec in the Apache. This one does not. Cheers, -- Cameron Simpson c...@zip.com.au Think positively, act positively, and never leave fingerprints. - Robert Sneddon -- http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
On 28Aug2013 18:44, Prasad, Ramit ramit.pra...@jpmorgan.com.dmarc.invalid wrote: | Ferrous Cranus wrote: | Yes Uli, the script metrits.py is being invoked by Apache Web Server which in turn runs under user | Nobody. | So, that mean that? user 'nobody' has no write permission to /home/nikos folder? As Ramit says, yes. Your own directory listing earlier showed r-x for the group nobody; that says no write. The file was the same: r--. | Yes. You should make it group writable with nobody as the group. Use chmod and chown | to change permissions and owners (i.e. groups). To be explicit: chgrp nobody the-file chmod g+w the-file | Normally I would have thought you would have a public_html or www directory in your | home folder that would be readable/writable to the web server (and where you should | write). Readable, yes. Writable? Generally mad. Apaches are often configured to run as nobody or nofiles specificly to ensure that it cannot write to stuff. The last thing you want is to have the website's files writable by the apache; it is asking for defacements and other hacks. Nikos should make a specific directory for these files and give ONLY THAT write permission for nobody. And then use a full pathname to the directory in his CGI script - a relative path makes ill founded assumptions about the current working directory of the script. Cheers, -- Cameron Simpson c...@zip.com.au A gentleman does not go motoring about after dark. - J. Lucas -- http://mail.python.org/mailman/listinfo/python-list
Re: [error] [client 178.59.111.223] (2)No such file or directory: exec of
On 28Aug2013 12:11, Steven D'Aprano steve+comp.lang.pyt...@pearwood.info wrote: | On Wed, 28 Aug 2013 01:46:01 -0700, Ferrous Cranus wrote: | Also many times when i try to view the error_log by | tail -F /usr/local/apache/logs/error_log | | i get realtime scrolling of other joomla webistes pho errors and i have | hard time trackign my own webistes erros. | | is ther a work around for that? | | That's an apache logging issue, not Python, and I don't know enough about | apache to do more than guess that there probably is a solution but I have | no idea what it is. Normal practice is to specify vhost specific log paths inside each website's VirtualHost clause, thus splitting the log for each website out into separate files. http://httpd.apache.org/docs/2.2/mod/core.html#virtualhost Notice the ErrorLog directive inside the clause. Cheers, -- Cameron Simpson c...@zip.com.au What the hell are we supposed to use, man -- harsh language? Flame units only. - _Aliens_ -- http://mail.python.org/mailman/listinfo/python-list
