Re: Reading structured text file (non-CSV) into Pandas Dataframe

[breamoreboy]

On Thursday, April 13, 2017 at 11:09:23 AM UTC+1, David Shi wrote:
> http://www.ebi.ac.uk/ena/data/warehouse/search?query=%22geo_circ(-0.587,-90.5713,170)%22=sequence_release=text
> The above is a web link to a structured text file.  It is not a CSV.
> How can this text file be read into a Pandas Dataframe, so that further 
> processing can be made?
> Looking forward to hearing from you.
> Regards.
> David

http://pandas.pydata.org/pandas-docs/stable/io.html
-- 
https://mail.python.org/mailman/listinfo/python-list

Re: reading a text file

[Paul Rubin]

superpollo u...@example.net writes:
 while True:
  try:
  sys.stdout.write(sys.stdin.next().upper())
  except StopIteration:
  break

Maybe there is some subtle difference, but it looks like you really mean

   for line in sys.stdin:
   sys.stdout.write(line.upper())
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: reading a text file

[Peter Otten]

superpollo wrote:

 hi clp
 
 what's the difference between:
 
 while True:
  input_line = sys.stdin.readline()
  if input_line:
  sys.stdout.write(input_line.upper())
  else:
  break
 
 and:
 
 
 while True:
  try:
  sys.stdout.write(sys.stdin.next().upper())
  except StopIteration:
  break

You should write the latter as

for line in sys.stdin:
sys.stdout.write(line.upper())

or 

sys.stdout.writelines(line.upper() for line in sys.stdin)

You seem to know already that next() and readline() use different ways to 
signal I'm done with the file. Also, after the first StopIteration 
subsequent next() calls are guaranteed to raise a StopIteration. But the 
main difference is that file.next() uses an internal buffer, file.readline() 
doesn't. That means you would lose data if you tried to replace the 
readline() call below with next()

first_line = f.readline()
read_of_the_file = f.read()

In newer Python versions you will get a ValueError when mixing next() and 
read()/readline() but in older Pythons (before 2.5 I think) you are in for a 
surprise.

As 

for line in file: ...

is both the fastest and most readable approach if you want to access a file 
one line at a time I recommend that you use it unless there is a specific 
reason not to.

Peter

-- 
http://mail.python.org/mailman/listinfo/python-list

Re: reading a text file

[Tino Wildenhain]

superpollo wrote:

hi clp

what's the difference between:

while True:
input_line = sys.stdin.readline()
if input_line:
sys.stdout.write(input_line.upper())
else:
break

and:


while True:
try:
sys.stdout.write(sys.stdin.next().upper())
except StopIteration:
break



More useless code, under the hood its working similar.
But why not use it in the way intended?

for input_line in sys.stdin:
sys.stdout.write(input_line.upper())

?

Regards
Tino


smime.p7s
Description: S/MIME Cryptographic Signature
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Reading from text file

[Fredrik Lundh]

A. Joseph wrote:


I want to read from text file, 25 lines each time i press enter key,
just like the python documentation.


you can use pydoc's pager from your program:

import pydoc

text = open(filename).read()
pydoc.pager(text)

/F

--
http://mail.python.org/mailman/listinfo/python-list

Re: reading hebrew text file

[hagai26]

realy thanks

hagai

-- 
http://mail.python.org/mailman/listinfo/python-list

Re: reading hebrew text file

[Alex Martelli]

[EMAIL PROTECTED] wrote:

 I have a hebrew text file, which I want to read in python
 I don't know which encoding I need to use  how I do that

As for the how, look to the codecs module -- but if you don't know
what codec the textfile is written in, I know of no ways to guess from
here!-)


Alex
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: reading hebrew text file

[jepler]

I looked for VAV in the files in the encodings directory
(/usr/lib/python2.4/encodings/*.py on my machine).  I found that the following
character encodings seem to include hebrew characters:
cp1255
cp424
cp856
cp862
iso8859-8
A file containing hebrew text might be in any one of these encodings, or
any unicode-based encoding.

To open an encoded file for reading, use
f = codecs.open(file, 'r', encoding='...')
Now, calls like 'f.readline()' will return unicode strings.

Here's an example, using a file in UTF-8 I have laying around:
 f = codecs.open(/users/jepler/txt/UTF-8-demo.txt, r, utf-8)
 for i in range(5): print repr(f.readline())
... 
u'UTF-8 encoded sample plain-text file\n'
u'\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\u203e\n'
u'\n'
u'Markus Kuhn [\u02c8ma\u02b3k\u028as ku\u02d0n] [EMAIL PROTECTED] \u2014 
1999-08-20\n'
u'\n'

Jeff


pgpIIx2zTStwL.pgp
Description: PGP signature
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: reading hebrew text file

[Fredrik Lundh]

[EMAIL PROTECTED] wrote:

 I have a hebrew text file, which I want to read in python
 I don't know which encoding I need to use

that's not a good start.  but maybe it's one of these:

http://sites.huji.ac.il/tex/hebtex_fontsrep.html

?

 how I do that

f = open(myfile)
text = f.readline()

followed by one of

text = text.decode(iso-8859-8)
text = text.decode(cp1255)
text = text.decode(cp862)

alternatively, use:

f = codecs.open(myfile, r, encoding)

to get a stream that decodes things on the fly.

/F



-- 
http://mail.python.org/mailman/listinfo/python-list