Hi,
I'm getting a TaskTooLarge Error when starting a pipeline, but I've
logged the arguments passed in, and the size of the parameters are all
well within the size limit.
I feel like maybe the pipeline api stores all child tasks within some
larger task, but can't find anything in the documentation related to
his.
I've attached the pipeline that is causing problems and the
traceback. Does anyone know what is causing my problem?
Code:
class QueueDateContentReportPulls(pipeline.Pipeline):
def run(self, userkey, dates, organic, no_results,
*pipeline_values):
date = dates[0]
batch_size = 100
this_date_tasks = []
index = 1
while index+batch_size<=no_results:
this_date_tasks += [ (yield
PullContentReportPipelineItem(userkey,[date],index,organic)) ]
index += batch_size
this_date_tasks += [ (yield Blocker(*this_date_tasks)) ]
return
Traceback:
Running
logic.ga.QueueDateContentReportPulls(*(u'ahF3b3JkZmluLXN0YWdpbmcxMnINCxIFVXNlcnMYqcACDA',
[1303834299], True, 11125, 1), **{})#902f0f9c710a11e0b76a739846fa16a4
E 2011-04-27 13:14:30.839
Task size must be less than 10240; found 13203
Traceback (most recent call last):
File "/base/python_runtime/python_lib/versions/1/google/appengine/
ext/webapp/__init__.py", line 636, in __call__
handler.post(*groups)
File "/base/data/home/apps/wordfin-staging12/1.350022175603504352/
pipeline/pipeline.py", line 2242, in post
attempt=int(self.request.get('attempt', '0')))
File "/base/data/home/apps/wordfin-staging12/1.350022175603504352/
pipeline/pipeline.py", line 1985, in evaluate
pipelines_to_run=pipelines_to_run)
File "/base/data/home/apps/wordfin-staging12/1.350022175603504352/
pipeline/pipeline.py", line 2095, in transition_run
db.run_in_transaction(txn)
File "/base/python_runtime/python_lib/versions/1/google/appengine/
api/datastore.py", line 2148, in RunInTransaction
DEFAULT_TRANSACTION_RETRIES, function, *args, **kwargs)
File "/base/python_runtime/python_lib/versions/1/google/appengine/
api/datastore.py", line 2247, in RunInTransactionCustomRetries
ok, result = _DoOneTry(new_connection, function, args, kwargs)
File "/base/python_runtime/python_lib/versions/1/google/appengine/
api/datastore.py", line 2269, in _DoOneTry
result = function(*args, **kwargs)
File "/base/data/home/apps/wordfin-staging12/1.350022175603504352/
pipeline/pipeline.py", line 2072, in txn
params=dict(pipeline_key=[str(key) for key in pipelines_to_run]))
File "/base/python_runtime/python_lib/versions/1/google/appengine/
api/labs/taskqueue/taskqueue.py", line 532, in __init__
(MAX_TASK_SIZE_BYTES, self.size))
TaskTooLargeError: Task size must be less than 10240; found 13203
--
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to
[email protected].
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
