Just a note that this issue was addressed in the pipeline group: http://groups.google.com/group/app-engine-pipeline-api/browse_thread/thread/d5cc08c369bf6232
On Wed, Apr 27, 2011 at 16:50, Aaron <[email protected]> wrote: > Hi, > > I'm getting a TaskTooLarge Error when starting a pipeline, but I've > logged the arguments passed in, and the size of the parameters are all > well within the size limit. > > I feel like maybe the pipeline api stores all child tasks within some > larger task, but can't find anything in the documentation related to > his. > > I've attached the pipeline that is causing problems and the > traceback. Does anyone know what is causing my problem? > > Code: > class QueueDateContentReportPulls(pipeline.Pipeline): > def run(self, userkey, dates, organic, no_results, > *pipeline_values): > date = dates[0] > batch_size = 100 > this_date_tasks = [] > index = 1 > while index+batch_size<=no_results: > this_date_tasks += [ (yield > PullContentReportPipelineItem(userkey,[date],index,organic)) ] > index += batch_size > this_date_tasks += [ (yield Blocker(*this_date_tasks)) ] > return > > > Traceback: > Running > logic.ga.QueueDateContentReportPulls(*(u'ahF3b3JkZmluLXN0YWdpbmcxMnINCxIFVXNlcnMYqcACDA', > [1303834299], True, 11125, 1), **{})#902f0f9c710a11e0b76a739846fa16a4 > E 2011-04-27 13:14:30.839 > Task size must be less than 10240; found 13203 > Traceback (most recent call last): > File "/base/python_runtime/python_lib/versions/1/google/appengine/ > ext/webapp/__init__.py", line 636, in __call__ > handler.post(*groups) > File "/base/data/home/apps/wordfin-staging12/1.350022175603504352/ > pipeline/pipeline.py", line 2242, in post > attempt=int(self.request.get('attempt', '0'))) > File "/base/data/home/apps/wordfin-staging12/1.350022175603504352/ > pipeline/pipeline.py", line 1985, in evaluate > pipelines_to_run=pipelines_to_run) > File "/base/data/home/apps/wordfin-staging12/1.350022175603504352/ > pipeline/pipeline.py", line 2095, in transition_run > db.run_in_transaction(txn) > File "/base/python_runtime/python_lib/versions/1/google/appengine/ > api/datastore.py", line 2148, in RunInTransaction > DEFAULT_TRANSACTION_RETRIES, function, *args, **kwargs) > File "/base/python_runtime/python_lib/versions/1/google/appengine/ > api/datastore.py", line 2247, in RunInTransactionCustomRetries > ok, result = _DoOneTry(new_connection, function, args, kwargs) > File "/base/python_runtime/python_lib/versions/1/google/appengine/ > api/datastore.py", line 2269, in _DoOneTry > result = function(*args, **kwargs) > File "/base/data/home/apps/wordfin-staging12/1.350022175603504352/ > pipeline/pipeline.py", line 2072, in txn > params=dict(pipeline_key=[str(key) for key in pipelines_to_run])) > File "/base/python_runtime/python_lib/versions/1/google/appengine/ > api/labs/taskqueue/taskqueue.py", line 532, in __init__ > (MAX_TASK_SIZE_BYTES, self.size)) > TaskTooLargeError: Task size must be less than 10240; found 13203 > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
