Re: export .csv file from database
Two things:
First, Ms Excel sucks. From that attached screenshot it's obvious that it
thought it was a space separated file. When actually using MS Office, I
recommend that you add `quoting=csv.QUOTE_ALL` to all csv writers.
Second, the HttpResponse object is file-like. You don't need to jump through
all the hoops. And MS Office is going to ignore your encoding anyway, so
there's no point in trying to fix it.
On Jun 17, 2013, at 9:44 AM, roopasingh...@gmail.com wrote:
> views.py
>
> @login_required
> def export_csv(request):
> user = request.user
> # heading columns
> headerrow = ['Filename', 'Description','Notes other','Reporter Name']
> allrows = []
> today = datetime.datetime.today() # default to show today
> reports = Report.objects.filter(user=user)
> reports = reports.filter(created_date_time__year=today.year)
> for report in reports:
> row = []
> row.append(report.report_number);
> row.append(report.report_description);
> row.append(report.notes_other);
> row.append(report.reporter_name);
> allrows.append(row)
> # setup CSV export
> response = HttpResponse(mimetype='text/csv')
> filename = "%s-%s.csv" % ('Daily-reports',
> datetime.datetime.now().strftime('%Y-%m-%d'))
> response['Content-Disposition'] = 'attachment; filename=%s' % filename
> writer = UnicodeWriter(response, encoding='utf-8')
> writer.writerow(headerrow)
> for writerow in allrows:
> writer.writerow(writerow)
> return response
>
> csv_unicode.py
>
> import csv, codecs, cStringIO
> class UnicodeWriter:
>def __init__(self, f, dialect=csv.excel, encoding="utf-8", **kwds):
> # Redirect output to a queue
> self.queue = cStringIO.StringIO()
> self.writer = csv.writer(self.queue, dialect=dialect, **kwds)
> self.stream = f
> self.encoder = codecs.getincrementalencoder(encoding)()
>
> def writerow(self, row):
> self.writer.writerow([unicode(s).encode("utf-8") for s in row])
> # Fetch UTF-8 output from the queue ...
> data = self.queue.getvalue()
> data = data.decode("utf-8")
> # ... and reencode it into the target encoding
> data = self.encoder.encode(data)
> # write to the target stream
> self.stream.write(data)
> # empty queue
> self.queue.truncate(0)
>
> def writerows(self, rows):
> for row in rows:
> self.writerow(row)
>
> The above code is exporting the database data into .csv file.
>
> Problem i am facing is,the exported data like Filename,Description,Notes
> Others,Reporter Name are exported in separate cell.Will show the output
> i am getting and required output.
>
> You can see my existing and required format.
>
> I had attached two format,file name existing_csv is the output file i ma
> getting,required_csv is the .csv file i am expecting.
>
> Need some ones help.
Peter of the Norse
rahmc...@radio1190.org
--
You received this message because you are subscribed to the Google Groups
"Django users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to django-users+unsubscr...@googlegroups.com.
To post to this group, send email to django-users@googlegroups.com.
Visit this group at http://groups.google.com/group/django-users.
For more options, visit https://groups.google.com/groups/opt_out.
Re: export .csv file from database
>
> this might come of use, it exports any query set to csv. I use it a lot:
>
>
def queryset_export_csv(qs):
import csv
#from django.db.models.loading import get_model
response = HttpResponse(mimetype='text/csv')
# force download.
response['Content-Disposition'] =
'attachment;filename="service_export.csv"'
# the csv writer
writer = csv.writer(response)
qs_model = qs.model
headers = []
for field in qs_model._meta.fields:
headers.append(field.name)
writer.writerow(headers)
for obj in qs:
row = []
for field in headers:
val = getattr(obj, field)
if callable(val):
val = val()
if type(val) == unicode:
val = val.encode("utf-8")
row.append(val)
writer.writerow(row)
return response
--
You received this message because you are subscribed to the Google Groups
"Django users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to django-users+unsubscr...@googlegroups.com.
To post to this group, send email to django-users@googlegroups.com.
Visit this group at http://groups.google.com/group/django-users.
For more options, visit https://groups.google.com/groups/opt_out.
Re: export .csv file from database
I am guessing that your csv writer is outputting something that your
spreadsheet is reading incorrectly. Try opening the csv with a text editer
(a good one, like Notepad++) so that you can really see what is going on.
Embedded commas or quotes inside a field are invitations for disaster, and
you have both. You may need to change the settings on the csv writer -- it
has lots of them, and different spreadsheet programs interpret different
csv files differently. The default settings are usually good for Excel,
but you don't mention which spreadsheet you are trying to do the reading
with, nor what settings you are using at import time. You must find a
combination that works for your situation (and it will not be easy.) It
may actually be easier to re-design the target system than to meet its
existing requirements.
Another option would be to use a tool like xlwt and send out a real
spreadsheet rather than a .csv. That way, all interpretation is under your
control.
On Monday, June 17, 2013 4:44:39 PM UTC+1, roopas...@gmail.com wrote:
>
> views.py
>
> @login_requireddef export_csv(request):
> user = request.user
> # heading columns
> headerrow = ['Filename', 'Description','Notes other','Reporter Name']
> allrows = []
> today = datetime.datetime.today() # default to show today
> reports = Report.objects.filter(user=user)
> reports = reports.filter(created_date_time__year=today.year)
> for report in reports:
> row = []
> row.append(report.report_number);
> row.append(report.report_description);
> row.append(report.notes_other);
> row.append(report.reporter_name);
> allrows.append(row)
> # setup CSV export
> response = HttpResponse(mimetype='text/csv')
> filename = "%s-%s.csv" % ('Daily-reports',
> datetime.datetime.now().strftime('%Y-%m-%d'))
> response['Content-Disposition'] = 'attachment; filename=%s' % filename
> writer = UnicodeWriter(response, encoding='utf-8')
> writer.writerow(headerrow)
> for writerow in allrows:
> writer.writerow(writerow)
> return response
>
> csv_unicode.py
>
> import csv, codecs, cStringIOclass UnicodeWriter:
>def __init__(self, f, dialect=csv.excel, encoding="utf-8", **kwds):
> # Redirect output to a queue
> self.queue = cStringIO.StringIO()
> self.writer = csv.writer(self.queue, dialect=dialect, **kwds)
> self.stream = f
> self.encoder = codecs.getincrementalencoder(encoding)()
>
> def writerow(self, row):
> self.writer.writerow([unicode(s).encode("utf-8") for s in row])
> # Fetch UTF-8 output from the queue ...
> data = self.queue.getvalue()
> data = data.decode("utf-8")
> # ... and reencode it into the target encoding
> data = self.encoder.encode(data)
> # write to the target stream
> self.stream.write(data)
> # empty queue
> self.queue.truncate(0)
>
> def writerows(self, rows):
> for row in rows:
> self.writerow(row)
>
> The above code is exporting the database data into .csv file.
>
> Problem i am facing is,the exported data like Filename,Description,Notes
> Others,Reporter Name are exported in separate cell.Will show the output
> i am getting and required output.
>
> You can see my existing and required format.
>
> I had attached two format,file name existing_csv is the output file i ma
> getting,required_csv is the .csv file i am expecting.
>
> Need some ones help.
>
>
>
>
--
You received this message because you are subscribed to the Google Groups
"Django users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to django-users+unsubscr...@googlegroups.com.
To post to this group, send email to django-users@googlegroups.com.
Visit this group at http://groups.google.com/group/django-users.
For more options, visit https://groups.google.com/groups/opt_out.
Re: export .csv file from database
>From just a quick glance, I have probably missed complex here - but one
option to try is changing the delimiter from a comma to another character
(e.g. a semi-colon) - see:
http://docs.python.org/2/library/csv.html#dialects-and-formatting-parameters
(But its also possible that in all the encoding/decoding that is going on,
that something else is going wrong!)
On Monday, 17 June 2013 17:44:39 UTC+2, roopas...@gmail.com wrote:
>
> views.py
>
> @login_requireddef export_csv(request):
> user = request.user
> # heading columns
> headerrow = ['Filename', 'Description','Notes other','Reporter Name']
> allrows = []
> today = datetime.datetime.today() # default to show today
> reports = Report.objects.filter(user=user)
> reports = reports.filter(created_date_time__year=today.year)
> for report in reports:
> row = []
> row.append(report.report_number);
> row.append(report.report_description);
> row.append(report.notes_other);
> row.append(report.reporter_name);
> allrows.append(row)
> # setup CSV export
> response = HttpResponse(mimetype='text/csv')
> filename = "%s-%s.csv" % ('Daily-reports',
> datetime.datetime.now().strftime('%Y-%m-%d'))
> response['Content-Disposition'] = 'attachment; filename=%s' % filename
> writer = UnicodeWriter(response, encoding='utf-8')
> writer.writerow(headerrow)
> for writerow in allrows:
> writer.writerow(writerow)
> return response
>
> csv_unicode.py
>
> import csv, codecs, cStringIOclass UnicodeWriter:
>def __init__(self, f, dialect=csv.excel, encoding="utf-8", **kwds):
> # Redirect output to a queue
> self.queue = cStringIO.StringIO()
> self.writer = csv.writer(self.queue, dialect=dialect, **kwds)
> self.stream = f
> self.encoder = codecs.getincrementalencoder(encoding)()
>
> def writerow(self, row):
> self.writer.writerow([unicode(s).encode("utf-8") for s in row])
> # Fetch UTF-8 output from the queue ...
> data = self.queue.getvalue()
> data = data.decode("utf-8")
> # ... and reencode it into the target encoding
> data = self.encoder.encode(data)
> # write to the target stream
> self.stream.write(data)
> # empty queue
> self.queue.truncate(0)
>
> def writerows(self, rows):
> for row in rows:
> self.writerow(row)
>
> The above code is exporting the database data into .csv file.
>
> Problem i am facing is,the exported data like Filename,Description,Notes
> Others,Reporter Name are exported in separate cell.Will show the output
> i am getting and required output.
>
> You can see my existing and required format.
>
> I had attached two format,file name existing_csv is the output file i ma
> getting,required_csv is the .csv file i am expecting.
>
> Need some ones help.
>
>
>
>
--
You received this message because you are subscribed to the Google Groups
"Django users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to django-users+unsubscr...@googlegroups.com.
To post to this group, send email to django-users@googlegroups.com.
Visit this group at http://groups.google.com/group/django-users.
For more options, visit https://groups.google.com/groups/opt_out.
export .csv file from database
views.py
@login_requireddef export_csv(request):
user = request.user
# heading columns
headerrow = ['Filename', 'Description','Notes other','Reporter Name']
allrows = []
today = datetime.datetime.today() # default to show today
reports = Report.objects.filter(user=user)
reports = reports.filter(created_date_time__year=today.year)
for report in reports:
row = []
row.append(report.report_number);
row.append(report.report_description);
row.append(report.notes_other);
row.append(report.reporter_name);
allrows.append(row)
# setup CSV export
response = HttpResponse(mimetype='text/csv')
filename = "%s-%s.csv" % ('Daily-reports',
datetime.datetime.now().strftime('%Y-%m-%d'))
response['Content-Disposition'] = 'attachment; filename=%s' % filename
writer = UnicodeWriter(response, encoding='utf-8')
writer.writerow(headerrow)
for writerow in allrows:
writer.writerow(writerow)
return response
csv_unicode.py
import csv, codecs, cStringIOclass UnicodeWriter:
def __init__(self, f, dialect=csv.excel, encoding="utf-8", **kwds):
# Redirect output to a queue
self.queue = cStringIO.StringIO()
self.writer = csv.writer(self.queue, dialect=dialect, **kwds)
self.stream = f
self.encoder = codecs.getincrementalencoder(encoding)()
def writerow(self, row):
self.writer.writerow([unicode(s).encode("utf-8") for s in row])
# Fetch UTF-8 output from the queue ...
data = self.queue.getvalue()
data = data.decode("utf-8")
# ... and reencode it into the target encoding
data = self.encoder.encode(data)
# write to the target stream
self.stream.write(data)
# empty queue
self.queue.truncate(0)
def writerows(self, rows):
for row in rows:
self.writerow(row)
The above code is exporting the database data into .csv file.
Problem i am facing is,the exported data like Filename,Description,Notes
Others,Reporter Name are exported in separate cell.Will show the output
i am getting and required output.
You can see my existing and required format.
I had attached two format,file name existing_csv is the output file i ma
getting,required_csv is the .csv file i am expecting.
Need some ones help.
--
You received this message because you are subscribed to the Google Groups
"Django users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to django-users+unsubscr...@googlegroups.com.
To post to this group, send email to django-users@googlegroups.com.
Visit this group at http://groups.google.com/group/django-users.
For more options, visit https://groups.google.com/groups/opt_out.
<><>
