Hi Sangeetha, sry, was on road and the answer tooks a while.
As Mark wrote, SerDe will be a good start. If its usefull for you take a look at http://code.google.com/p/hive-json-serde/wiki/GettingStarted. - alex On Tue, Dec 6, 2011 at 10:26 AM, sangeetha k <[email protected]> wrote: > Hi, > > Thanks for the response. > Yes, You got my question. > > An example of my log message line will be as below: > > [2011-10-17 16:30:57,281] [ INFO] [33157362@qtp-28456974-0] > [net.hp.tr.webservice.referenceimplcustomer.resource.CustomersResource] > [Organization: Travelocity] [Client: AA] [Location of device: DFW] [User: > 550393] [user_role: ] [CorelationId: 248] [Component: Crossplane] [Server: > server01] [Request: seats=5] [Response: yes] [Status: pass] - Entering > Method = getKey() > > How to specify the delimiter, while describing the table? > > Thanks, > Sangeetha > > *From:* alo alt <[email protected]> > *To:* [email protected]; sangeetha k <[email protected]> > *Sent:* Tuesday, December 6, 2011 2:01 PM > *Subject:* Re: log4j format logs in Hive table > > Hi, > > I hope I understood your question correct - did you describe your table? > Like > "create TABLE YOURTABLE (row1 STRING, row2 STRING, row3 STRING) ROW FORMAT > DELIMITED FIELDS TERMINATED BY 'YOUR TERMINATOR' STORED AS TEXTFILE;" > > row* = a name of your descision, Datatype look @documentation. > > After import via "insert (overwrite) table YOURTABLE" > > - alex > > > On Tue, Dec 6, 2011 at 8:56 AM, sangeetha k <[email protected]> wrote: > > Hi, > > I am new to Hive. > > I am using Flume agent to collect log4j logs and sending to HDFS. > Now i wanted to load the log4j format logs from HDFS to Hive tables. > Each of the attributes in log statements like timestamp, level, classname > etc... should be loaded in seperate columns in the Hive tables. > > I tried creating table in Hive and loaded the entire log in one column, > but dont know how to load the above mentioned data in seperate columns. > > Please send me your suggestions, any links, tutorials on this. > > Thanks, > Sangeetha > > > > > -- > Alexander Lorenz > http://mapredit.blogspot.com > > *P **Think of the environment: please don't print this email unless you > really need to.* > > > > > -- Alexander Lorenz http://mapredit.blogspot.com *P **Think of the environment: please don't print this email unless you really need to.*
