Great work! This documentation would be a good starting point for users who want to run benchmarks on Apache Tajo.
2015-03-09 15:36 GMT+09:00 Hyunsik Choi <[email protected]>: > Thank you for your comment. Sounds nice to me. Please go head! > > On Sun, Mar 8, 2015 at 11:31 PM, Dongjoon Hyun <[email protected]> > wrote: > > Thank you, Hyunsik and Jihoon. > > > > For your suggestion, I totally agree with you. Tajo must handle the > > original queries of TPC-DS. > > Fortunately, I generated those queries from TPC-DS by myself. > > (I studied and referred Cloudera and Hortonworks, but I do not use their > > modified queries) > > > > I used the following commands with official TPC-DS tools in > > "TPCDSVersion1.3.1/dbgen2" folder, > > > > for i in {1..99}; do ./dsqgen -template query$i.tpl -directory > > ../query_templates -dialect netezza -scale 1 -verbose; mv query_0.sql > > query$i.sql; done; > > > > I used 'netezza' dialect for 'limit' clause. It has no other side > effects. > > Sorry for missing the above details. > > > > If I missed anything else, please talk to me anytime. I welcome any > > feedback. > > > > Regards, > > Dongjoon. > > > > > > On Mon, Mar 9, 2015 at 2:55 PM, Hyunsik Choi <[email protected]> > wrote: > > > >> It's a great start for TPC-DS benchmark. > >> > >> I have one suggestion. Your seem to refer impala's TPC-DS queries. > >> But, some of them are modified too much. Later, we need to > >> investigate how many original queries work in Tajo, and we need to > >> reflect the original queries rather than modified ones to the wiki > >> page. > >> > >> Warm regards, > >> Hyunsik > >> > >> On Sun, Mar 8, 2015 at 10:47 PM, Jihoon Son <[email protected]> > wrote: > >> > Looks great! > >> > Thanks Dongjoon > >> > > >> > Best, > >> > Jihoon > >> > 2015년 3월 9일 (월) 오후 2:38, Dongjoon Hyun <[email protected]>님이 작성: > >> > > >> >> I created and filled the following page according to my file. > >> >> > >> >> > https://cwiki.apache.org/confluence/display/TAJO/TPC-DS+Benchmark+Set > >> >> > >> >> Thank you, Hyunsik. > >> >> > >> >> Best regards, > >> >> Dongjoon. > >> >> > >> >> On Mon, Mar 9, 2015 at 1:51 PM, Hyunsik Choi <[email protected] > >> >> <javascript:_e(%7B%7D,'cvml','[email protected]');>> wrote: > >> >> > >> >> > I just gave your account the privileges. You can create or edit > wiki > >> >> pages > >> >> > now. > >> >> > > >> >> > Best regards, > >> >> > Hyunsik > >> >> > > >> >> > On Sun, Mar 8, 2015 at 9:49 PM, Dongjoon Hyun <[email protected] > >> >> > <javascript:_e(%7B%7D,'cvml','[email protected]');>> wrote: > >> >> > > Thanks, Jihoon. :) > >> >> > > > >> >> > > Regards, > >> >> > > Dongjoon. > >> >> > > > >> >> > > 2015년 3월 9일 월요일, Jihoon Son<[email protected] > >> >> > <javascript:_e(%7B%7D,'cvml','[email protected]');>>님이 작성한 메시지: > >> >> > > > >> >> > >> Thanks Hyunsik. > >> >> > >> That's the best way I think. > >> >> > >> > >> >> > >> Dongjoon, > >> >> > >> I read your document carefully, and looks good. > >> >> > >> Currently, I don't have any comments. > >> >> > >> Please go ahead! > >> >> > >> > >> >> > >> Regards, > >> >> > >> Jihoon > >> >> > >> > >> >> > >> On Mon, Mar 9, 2015 at 1:30 PM Dongjoon Hyun < > [email protected] > >> >> > <javascript:_e(%7B%7D,'cvml','[email protected]');> > >> >> > >> <javascript:;>> wrote: > >> >> > >> > >> >> > >> > Hi, Hyunsik. > >> >> > >> > > >> >> > >> > Thank you. If you do so, I will create and update TPC-DS page. > >> My id > >> >> > is > >> >> > >> > dongjoon. > >> >> > >> > > >> >> > >> > Regards, > >> >> > >> > Dongjoon. > >> >> > >> > > >> >> > >> > On Mon, Mar 9, 2015 at 1:18 PM, Hyunsik Choi < > [email protected] > >> >> > <javascript:_e(%7B%7D,'cvml','[email protected]');> > >> >> > >> <javascript:;> > >> >> > >> > <javascript:_e(%7B%7D,'cvml','[email protected] > >> >> > <javascript:_e(%7B%7D,'cvml','[email protected]');> > >> <javascript:;>');>> > >> >> > >> wrote: > >> >> > >> > > >> >> > >> > > Hi Dongjoon, > >> >> > >> > > > >> >> > >> > > Thank you for your work. The work looks nice. Do you have a > >> wiki > >> >> > >> > > account? If so, please let me know your account. I'll give > >> proper > >> >> > >> > > privileges to your account, allowing you to edit the wiki > >> pages. > >> >> It > >> >> > >> > > would be great if you continue to update the TPC-DS pages. > >> >> > >> > > > >> >> > >> > > If you don't have a wiki account, you can easily create the > >> >> account > >> >> > at > >> >> > >> > > https://cwiki.apache.org/confluence/signup.action > >> >> > >> > > > >> >> > >> > > Best regards, > >> >> > >> > > Hyunsik > >> >> > >> > > > >> >> > >> > > On Sun, Mar 8, 2015 at 5:54 PM, Jihoon Son < > >> [email protected] > >> >> > <javascript:_e(%7B%7D,'cvml','[email protected]');> > >> >> > >> <javascript:;> > >> >> > >> > > <javascript:_e(%7B%7D,'cvml','[email protected] > >> >> > <javascript:_e(%7B%7D,'cvml','[email protected]');> > >> >> <javascript:;>');>> > >> >> > >> wrote: > >> >> > >> > > > Thanks for sharing. > >> >> > >> > > > It doesn't matter via whatever sharing tools you use. > >> >> > >> > > > I just think that Jira can be a good candidate for > sharing. > >> >> > >> > > > > >> >> > >> > > > Anyway, it looks good in overall. I'll left some comments. > >> >> > >> > > > > >> >> > >> > > > Regards, > >> >> > >> > > > Jihoon > >> >> > >> > > > > >> >> > >> > > > 2015년 3월 9일 (월) 오전 9:16, Dongjoon Hyun > >> >> > >> > > > [email protected] > >> >> > <javascript:_e(%7B%7D,'cvml','[email protected]');> > <javascript:;> > >> >> > >> > > <javascript:_e(%7B%7D,'cvml','[email protected] > >> >> > <javascript:_e(%7B%7D,'cvml','[email protected]');> > >> >> > <javascript:;>');>>님이 > >> >> > >> 작성: > >> >> > >> > > > > >> >> > >> > > > Thank you, Jihoon. > >> >> > >> > > >> > >> >> > >> > > >> By the way, Tajo wiki is not managed by Git. I thought > this > >> is > >> >> > not a > >> >> > >> > > patch. > >> >> > >> > > >> Here is the file. > >> >> > >> > > >> > >> >> > >> > > >> Google Drive > >> >> > >> > > >> > >> >> > >> > > >> tpcds.rst > >> >> > >> > > >> < > >> https://docs.google.com/file/d/0B6ZxA8hLu4UIUVAtbE5maTVjWFk/ > >> >> > >> > > >> edit?usp=drivesdk> > >> >> > >> > > >> > >> >> > >> > > >> > >> >> > >> > > >> Box (tpcds.txt, the same file with the above) > >> >> > >> > > >> > >> >> > >> > > >> https://app.box.com/s/g0w051zgh09wsa982klp6nqgow709ssk > >> >> > >> > > >> > >> >> > >> > > >> TPC-DS is very heavy benchmark including updating the DW > >> tables > >> >> > from > >> >> > >> > > >> original source tables. This file does not cover that > kind > >> >> > updating > >> >> > >> > > part. > >> >> > >> > > >> It's a beginning of Tajo for official supporting TPC-DS. > >> >> > >> > > >> > >> >> > >> > > >> I have a plan to focus TPC-DS with Tajo for a while. I > >> >> appreciate > >> >> > >> any > >> >> > >> > > >> comments. > >> >> > >> > > >> > >> >> > >> > > >> Thank you again, Jihoon. > >> >> > >> > > >> > >> >> > >> > > >> Regards, > >> >> > >> > > >> Dongjoon. > >> >> > >> > > >> > >> >> > >> > > >> 2015년 3월 9일 월요일, > >> >> > >> > > >> Jihoon Son<[email protected] > >> >> > <javascript:_e(%7B%7D,'cvml','[email protected]');> > <javascript:;> > >> >> > >> > > <javascript:_e(%7B%7D,'cvml','[email protected] > >> >> > <javascript:_e(%7B%7D,'cvml','[email protected]');> > >> >> > <javascript:;>');>>님이 > >> >> > >> 작성한 메시지: > >> >> > >> > > >> > >> >> > >> > > >> > Good idea. > >> >> > >> > > >> > I can help you to reflect your patch. > >> >> > >> > > >> > Would you share it with us? > >> >> > >> > > >> > I think Jira is good for sharing. > >> >> > >> > > >> > > >> >> > >> > > >> > Best regards, > >> >> > >> > > >> > Jihoon > >> >> > >> > > >> > 2015년 3월 9일 (월) 오전 8:05, Dongjoon Hyun < > >> [email protected] > >> >> > <javascript:_e(%7B%7D,'cvml','[email protected]');> > >> >> > >> <javascript:;> > >> >> > >> > > <javascript:_e(%7B%7D,'cvml','[email protected] > >> >> > <javascript:_e(%7B%7D,'cvml','[email protected]');> > >> <javascript:;>');> > >> >> > >> > > >> <javascript:;>>님이 > >> >> > >> > > >> > 작성: > >> >> > >> > > >> > > >> >> > >> > > >> > > Hi, > >> >> > >> > > >> > > > >> >> > >> > > >> > > TPC-DS is becoming more popular. It is in the Tajo > >> Roadmap > >> >> > also > >> >> > >> > and > >> >> > >> > > >> > > several related issues are already created and > closed in > >> >> Tajo > >> >> > >> > Jira. > >> >> > >> > > >> So, I > >> >> > >> > > >> > > made TPC-DS rst file for Tajo wiki during last > weekend. > >> I > >> >> > think > >> >> > >> it > >> >> > >> > > will > >> >> > >> > > >> > be > >> >> > >> > > >> > > helpful for other Tajo users preparing TPC-DS in the > >> >> future. > >> >> > >> > > >> > > > >> >> > >> > > >> > > Could anyone review this and update Tajo wiki (maybe, > >> >> > benchmark > >> >> > >> > > >> section)? > >> >> > >> > > >> > > I prepared this file in the same style with TPC-H in > >> Tajo > >> >> > wiki. > >> >> > >> > > >> > > > >> >> > >> > > >> > > Warmly, > >> >> > >> > > >> > > Dongjoon. > >> >> > >> > > >> > > > >> >> > >> > > >> > > >> >> > >> > > >> > >> >> > >> > > > >> >> > >> > > >> >> > >> > >> >> > > >> >> > >> >
