Re: SQL analysis

2012-05-10 Thread Shi Yu
ge- From: Shi Yu [mailto:sh...@uchicago.edu] Sent: 10 May 2012 18:58 To: common-user@hadoop.apache.org Subject: RE: SQL analysis Flume might be suitable for your case. https://cwiki.apache.org/FLUME/ Shi This e-mail and any attachments are confidential and intended solely for the addressee and ma

RE: SQL analysis

2012-05-10 Thread karanveer.singh
I am more worried about the analysis assuming this data is in HDFS. -Original Message- From: Shi Yu [mailto:sh...@uchicago.edu] Sent: 10 May 2012 18:58 To: common-user@hadoop.apache.org Subject: RE: SQL analysis Flume might be suitable for your case. https://cwiki.apache.org/FLUME

RE: SQL analysis

2012-05-10 Thread Shi Yu
Flume might be suitable for your case. https://cwiki.apache.org/FLUME/ Shi

RE: SQL analysis

2012-05-10 Thread karanveer.singh
Our focus as of now is on batch queries. And keen to explore on the approach to get to the path analysis. Regards, Karanveer -Original Message- From: Shi Yu [mailto:sh...@uchicago.edu] Sent: 10 May 2012 17:02 To: common-user@hadoop.apache.org Subject: Re: SQL analysis It depends on

Re: SQL analysis

2012-05-10 Thread Shi Yu
It depends on your use case, for example, query only or you have requirement of real time insert and update. The solutions can be different. You might need consider HBase, Cassandra or tools like Flume.

SQL analysis

2012-05-10 Thread karanveer.singh
We are looking at doing some initial analysis on SQL text info within the query runs to come up with some kind of path output to depict how various tables are linked to each other. For example. A 'view' might be a join from two table's top of the hierarchy and in turn might be creating some new