Re: [google-appengine] data Join using MapReduce/pipeline api

2011-05-25 Thread Robert Kluin
On Wed, May 25, 2011 at 01:07, Bing Wei blackice@gmail.com wrote: Thanks, Brett. I am still confused about the join process. I append the results of two maps together, but get exceptions when I run the Shuffler. The result of a map is a list. But the two map results have different length.

Re: [google-appengine] data Join using MapReduce/pipeline api

2011-05-24 Thread Brett Slatkin
On Mon, May 23, 2011 at 2:06 PM, Bing blackice@gmail.com wrote: In the google io talk, data join is implemented by Append method. But it seems the Append method is only to append lists together. Is that Append method just a high-level concept or is there an implementation? Also, join can

Re: [google-appengine] data Join using MapReduce/pipeline api

2011-05-24 Thread Bing Wei
Thanks, Brett. I am still confused about the join process. I append the results of two maps together, but get exceptions when I run the Shuffler. The result of a map is a list. But the two map results have different length. Let's say the length of the first map result is 3, the length of the

[google-appengine] data Join using MapReduce/pipeline api

2011-05-23 Thread Bing
In the google io talk, data join is implemented by Append method. But it seems the Append method is only to append lists together. Is that Append method just a high-level concept or is there an implementation? Also, join can be implemented by using referenceProperty. It is not necessary to do the