Yeah, anything that reproduces the error would be great. Thanks! D
On Thu, Jun 7, 2012 at 10:35 AM, Steve Bernstein <[email protected]> wrote: > Thanks Dmitriy. The full script is probably more than you want (and more > than I think I'd want to send), but let me create a "subset" of it, run it to > check that it's otherwise sound and that the error replicates, then send > that. Would that be okay? > > -----Original Message----- > From: Dmitriy Ryaboy [mailto:[email protected]] > Sent: Wednesday, June 06, 2012 11:56 AM > To: [email protected] > Subject: Re: this nested foreach worked in 0.8.1, no longer works in 0.10 > > Any chance you can send the full script? > > On Jun 6, 2012, at 11:44 AM, Steve Bernstein <[email protected]> wrote: > >> Meanwhile, I'm moving forward running this script on 0.8.1 with no issues. >> Probably going to back off on using 0.10 for now and wait for a more stable >> release. >> >> -----Original Message----- >> From: Steve Bernstein [mailto:[email protected]] >> Sent: Sunday, June 03, 2012 9:25 AM >> To: [email protected] >> Subject: RE: this nested foreach worked in 0.8.1, no longer works in >> 0.10 >> >> Since this seems to do with project, before I wrote to the list, I'd already >> tried actionBag.sent and actionBagGrouped::actionBag.sent. No joy. Is this >> a bug? Seems like others would have stumbled across it already. >> SB >> ________________________________________ >> From: Subir S [[email protected]] >> Sent: Saturday, June 02, 2012 4:04 AM >> To: [email protected] >> Subject: Re: this nested foreach worked in 0.8.1, no longer works in >> 0.10 >> >> Can you try sent = FILTER actionBag BY actionBag.action=='sent'; >> >> Although not sure why it does not work. I also use pig 0.8.1 and similar >> constructs work for me. >> >> On Fri, Jun 1, 2012 at 10:55 PM, Steve Bernstein >> <[email protected]>wrote: >> >>> No, all those relations embedded in the nested foreach are unique to >>> it, not used elsewhere. >>> SB >>> >>> -----Original Message----- >>> From: Dmitriy Ryaboy [mailto:[email protected]] >>> Sent: Friday, June 01, 2012 2:03 AM >>> To: [email protected] >>> Cc: [email protected] >>> Subject: Re: this nested foreach worked in 0.8.1, no longer works in >>> 0.10 >>> >>> Do you have relations ned sent, opened, etc, elsewhere in the script? >>> >>> On May 31, 2012, at 12:09 PM, Steve Bernstein >>> <[email protected]> >>> wrote: >>> >>>> We upgraded from Pig 0.8.1 to 0.10 and the following nested foreach >>>> no >>> longer works: >>>> >>>> actionBagGrouped = GROUP actionBag BY (deal_id,month); dealCounts = >>>> FOREACH actionBagGrouped { >>>> sent = FILTER actionBag BY action=='sent'; >>>> opened = FILTER actionBag BY action=='opened'; >>>> clicked = FILTER actionBag BY action=='clicked'; >>>> purchased = FILTER actionBag BY action=='purchased'; >>>> >>>> GENERATE >>>> FLATTEN(group), >>>> COUNT(sent) AS sentCount, >>>> COUNT(opened) AS openedCount, >>>> COUNT(clicked) AS clickedCount, >>>> COUNT(purchased) AS purchasedCount; }; >>>> I get: >>>> "Invalid scalar projection: action : A column needs to be projected >>>> from >>> a relation for it to be used as a scalar" >>>> Banging my head against a wall-the problem is with the nest op sent >>>> = >>> Filter... >>>> >>>> Help! >>>> Thanks- >>>> Steve >>>
