RE: How to clone a logical plan ?

2009-11-05 Thread RichardGUO Fei
Hi, I am also doing a cost-based optimizer. So I am interested in knowing some of the specs that you are after. Thanks, Richard _ 上Windows Live 中国首页,下载Messenger2009安全版! http://www.windowsl

RE: RequiredFields contents

2009-11-05 Thread RichardGUO Fei
Hi, I am also curious. I studied this and I guess that it could be the input index. For example, foreach A generate Here A's index is 0 in the inputs of the operator foreach. Let me know if I am wrong. Thanks, Richard > Date: Fri, 6 Nov 2009 00:04:36 -0500 > Subject: RequiredFields cont

RE: How to clone a logical plan ?

2009-11-05 Thread RichardGUO Fei
o for > a given join type. Once we have join type selection working, other > optimizations can be added -- the tricky part is making sure the > costing functions can't produce drastically wrong results. > > All the work is happening at the logical layer, between the rule-based >

TPC-H benchmark

2009-11-22 Thread RichardGUO Fei
Hi, Apart from Pig Performance and Pig Mix, do you know any TPC-H benchmark rewritten for Pig? Thanks, Richard _ MSN十周年庆典,查看MSN注册时间,赢取神秘大奖 http://10.msn.com.cn

Custom Loadfunc problem!

2009-10-25 Thread RichardGUO Fei
Hi, I implemented a custom loadfunc class to read data from a database. This class implements both Slicer and LoadFunc. It also generates the slices properly. The problem is that when I perform this query: A = LOAD 'table_name' USING CustomStorage; DUMP A; The PIG gives the followin

RE: Custom Loadfunc problem!

2009-10-26 Thread RichardGUO Fei
To: pig-dev@hadoop.apache.org > > Hi Richard, > > I am not sure what's your problem, but I suggest you can debug your program > in pig's local mode. > > And you can even debug it in pig's mapreduce mode locally > > > > Jeff zhang > > > 2009/10/25

RE: Custom Loadfunc problem!

2009-10-26 Thread RichardGUO Fei
To: pig-dev@hadoop.apache.org > > Hi Richard, > > I am not sure what's your problem, but I suggest you can debug your program > in pig's local mode. > > And you can even debug it in pig's mapreduce mode locally > > > > Jeff zhang > > > 2009/10/25

RE: Custom Loadfunc problem!

2009-10-26 Thread RichardGUO Fei
gt; -Original Message- > From: "zjffdu" > To: pig-dev@hadoop.apache.org > Sent: 10/27/2009 1:45 AM > Subject: RE: Custom Loadfunc problem! > > Illustrate will not execute the job, while dump and store will execute it. > So I think there must be something wro

RE: Custom Loadfunc problem!

2009-10-26 Thread RichardGUO Fei
6 Oct 2009 16:15:53 -0400 > Subject: Re: Custom Loadfunc problem! > From: dvrya...@gmail.com > To: pig-dev@hadoop.apache.org > > Do you get any of your Log messages to come out, or none at all? > > -D > > 2009/10/26 RichardGUO Fei : > > > > Hi, > > > >

RE: Custom Loadfunc problem!

2009-10-28 Thread RichardGUO Fei
dev@hadoop.apache.org > Sent: 10/27/2009 1:45 AM > Subject: RE: Custom Loadfunc problem! > > Illustrate will not execute the job, while dump and store will execute it. > So I think there must be something wrong with your custom slicer. I suggest > you set breakpoint in your sl

RE: Custom Loadfunc problem!

2009-10-28 Thread RichardGUO Fei
d LoadFuncs > easier to write, but it also means that you have to specify a scheme > if you are doing something that's not file-based. Try changing your > code to expect the location string to start with some scheme, such as > abcd:/ (or perhaps something more meaningful) and things