hello again!
I have some tables with blob data in them, such as PDF and DOC files. I
download the tables from MS SQL server and convert them into CSV files, at
this step blob data go crazy.
Here is my bulkloader.yaml, in case you offer me to use export_transform
property. And probably I used it wrong (lack of examples about GAE) it does
no thing.
- kind: AppendixBlobData
connector: csv
connector_options: encoding: iso-8859-9
property_map:
- property: __key__
external_name: key
export_transform: transform.key_id_or_name_as_string
- property: ObjectID
external_name: ObjectID
- property: FileData
external_name: FileData
export_transform: transform.blob_to_file('Filename',
'AttachmentBlobs')
I want to fetch that file form CSV file then be able yo upload it to
datastore. And yes, when I try to upload the CSV with blob data I get this
error:
10:24 AM Uploading data records.
[INFO ] Logging to bulkloader-log-20130905.102454
[INFO ] Throttling transfers:
[INFO ] Bandwidth: 250000 bytes/second
[INFO ] HTTP connections: 8/second
[INFO ] Entities inserted/fetched/modified: 20/second
[INFO ] Batch Size: 10
[INFO ] Opening database: bulkloader-progress-20130905.102454.sql3
[INFO ] Connecting to banamsgbirak.appspot.com/_ah/remote_api
[INFO ] Starting import; maximum 10 entities per post
[ERROR ] [Thread-12] DataSourceThread:
Traceback (most recent call last):
File "C:\Program Files
(x86)\Google\google_appengine\google\appengine\tools\bulkloader.py", line
1601, in run self.PerformWork()
File "C:\Program Files
(x86)\Google\google_appengine\google\appengine\tools\bulkloader.py", line
1720, in PerformWork for item in content_gen.Batches():
File "C:\Program Files
(x86)\Google\google_appengine\google\appengine\tools\bulkloader.py", line
556, in Batches self._ReadRows(key_start, key_end)
File "C:\Program Files
(x86)\Google\google_appengine\google\appengine\tools\bulkloader.py", line
466, in _ReadRows row = self.reader.next()
File "C:\Program Files
(x86)\Google\google_appengine\google\appengine\ext\bulkload\csv_connector.py",
line 218, in generate_import_record for input_dict in self.dict_generator:
File "C:\Python27\lib\csv.py", line 104, in next row = self.reader.next()
Error: line contains NULL byte
[INFO ] An error occurred. Shutting down...
[ERROR ] Error in data source thread: line contains NULL byte
[INFO ] 0 entities total, 0 previously transferred
[INFO ] 0 entities (2590 bytes) transferred in 2.1 seconds
[INFO ] Some entities not successfully transferred
Continue...
What can I do about this Null nyte error and, exporting blob data, I would
buy you a beer If you'd help me with this! Thanks.
--
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.
