Awesome! Thanks guys. Your contributions will improve tajo more powerful. :)
2014/1/23 Hyunsik Choi <[email protected]> > Hi Yu, > > Thank you for your contribution. I have been looking forward to seeing > this work. Could you submit a patch to proper issues or create a jira? > We will create a new branch for that after review. > > Hi folks, > > Some of us know Yu in offline. After the discussion early this year, > he has mostly worked on Tajo C++ worker. I also contributed a small > part about JIT code generation via LLVM, and participated in the > design. Another contributor, Hyoung Jun, also contributed some module. > Its main objective is to build a high performance query engine to > maximize hardware utilization by using SIMD and cache conscious > algorithm. It is under heavy development. As he mentioned, it would be > a long journey for the future. > > - hyunsik > > On Wed, Jan 22, 2014 at 8:19 PM, Yu Dongmin <[email protected]> wrote: > > Hello, > > > > I'm very glad to hear that Tajo is getting stable and production ready. > > > > Here's another news. Some of us might have have seen some Hyunsik's > presentations commenting about an experimental project, c++ tajo worker. > > > > > > Recently, I've been working on the c++ worker, even though it is a > little bit far from behind schedule than what I expected, > > it is able to communicate with Tajo Master and Query Master successfully. > > > > This is never a replacement of Java worker, but an exchangeable worker. > We could use Java workers as is, C++ workers only, or mixed workers. > > > > It is designed as a vectorized execution engine hoping to process > certain types of data structures very efficiently. > > > > These are the supported features right now. > > > > - Reading and parsing csv files in the hadoop data node. > > - Filtering rows within LLVM code generated evaluation > > - Simple scalar functions > > - Simple group by aggregation functions > > > > Now I'm working on 'order by' clause and doing profiling to get expected > performance. > > > > Working on these stuffs, I hope community to allow creating a new git > branch, say native_worker, cplus_worker or a nicer name, to make this > project together. > > > > > > There's still a long way to go on this project, but it could be improved > with help of the Tajo community. > > > > > > Thanks > > Min > -- Thanks, Jaehwa Jung Bigdata Platform Team Gruter
