Hi, Dremel is high performance system. I think building something generic "inter-languages" will hurt performance. Having generic executor service we can add several different paradigms of the local computation (and even not local). But I think SQL like query language should be done in most efficient way. David
On Mon, Aug 27, 2012 at 3:20 AM, Hyunsik Choi <[email protected]> wrote: > Hi, > > How about having a generic logical plan described as a DAG, where each > vertex indicates a logical operator including various annotations and each > edge represents a data flow. A DAG has much expressive power. Many > literatures have shown that most logical plans of various data manipulation > languages can be described as such a DAG. > > Additional languages have different ASTs, and they can be transformed into > the generic logical plan. In this case, we can reuse logical plan, logical > plan optimization, and physical execution plan. Besides, Drill may consider > a global plan that represents the distributed execution plan. Since the > global plan generally depends on the logical plan, we can also reuse all > code related to the global plan. > > -- > Hyunsik Choi > > > On Mon, Aug 27, 2012 at 6:22 AM, Ted Dunning <[email protected]> > wrote: > > > Camuel, > > > > Do you have a grammar test suite that demonstrates the range of > > expressions? > > > > Also, I believe that some have a goal to use additional languages besides > > SQL like languages. A limited version of pig, for instance, would be > very > > interesting. To do this, it will be important to have a logical plan > > structure that is common for different syntaxes and is not limited to the > > idiosyncracies of any particular syntax. > > > > How do you think that should be handled? Do you have an idea for a > logical > > plan structure? > > > > On Sun, Aug 26, 2012 at 4:11 PM, Camuel Gilyadov <[email protected]> > wrote: > > > > > I've written and attached ANTLR grammar for DrQL which I assume is same > > as > > > BigQuery language described in Query Reference on BigQuery website. > This > > > grammar includes AST production rules. > > > > > > > > > > > >
