Re: multiple reads from a Map - optimization question

2010-06-23 Thread Raghava Mutharaju
>>> So this is a Scan or a Get? I am using Scan with a filter. It would check for rows which satisfy the condition, say, B>> What's D? Or you meant C? And to find all those values, is it another scan/get on a third table that gives you your D that you insert in a fourth table? I meant C :). Yes, I

Re: multiple reads from a Map - optimization question

2010-06-23 Thread Jean-Daniel Cryans
Inline. J-D On Wed, Jun 23, 2010 at 10:16 AM, Raghava Mutharaju wrote: > Hello JD, > > Thank you for the response. > Are the Gets done on the same row that is mapped? Or on the same table? > Or another table? >    By row that is mapped, does it mean the row that is given to the map() > meth

Re: multiple reads from a Map - optimization question

2010-06-23 Thread Raghava Mutharaju
Hello JD, Thank you for the response. >>> Are the Gets done on the same row that is mapped? Or on the same table? Or another table? By row that is mapped, does it mean the row that is given to the map() method as a pair? Then no, the data from this row is used to construct a filter which is

Re: multiple reads from a Map - optimization question

2010-06-23 Thread Jean-Daniel Cryans
I'm still confused by 2 things: - Are the Gets done on the same row that is mapped? Or on the same table? Or another table? - Can you give a real example of what you are trying to achieve? (with fake data) Thx J-D On Tue, Jun 22, 2010 at 10:51 AM, Raghava Mutharaju wrote: This is not su

Re: multiple reads from a Map - optimization question

2010-06-23 Thread Raghava Mutharaju
any advice on this one? Raghava. On Tue, Jun 22, 2010 at 1:51 PM, Raghava Mutharaju < m.vijayaragh...@gmail.com> wrote: > >>> This is not super clear, some comments inline. > I will try & explain better this time. > > The overall objective -- from the complete dataset, obtain a subset of it > to

Re: multiple reads from a Map - optimization question

2010-06-22 Thread Raghava Mutharaju
>>> This is not super clear, some comments inline. I will try & explain better this time. The overall objective -- from the complete dataset, obtain a subset of it to work on. Now this subset would be obtained by making use of the 2-3 conditions (filters). The setting up of one filter depends on t

Re: multiple reads from a Map - optimization question

2010-06-22 Thread Jean-Daniel Cryans
This is not super clear, some comments inline. J-D On Tue, Jun 22, 2010 at 12:49 AM, Raghava Mutharaju wrote: > Hello all, > >      In the data, I have to check for multiple conditions and then work > with the data that satisfies all the conditions. I am doing this as an MR > job with no reduce

multiple reads from a Map - optimization question

2010-06-22 Thread Raghava Mutharaju
Hello all, In the data, I have to check for multiple conditions and then work with the data that satisfies all the conditions. I am doing this as an MR job with no reduce and the conditions are translated to a set of filters. Among the multiple conditions (2 or 3 max), data that satisfies on