Hivers,
I have a web log which i need to load into single table. But one column
has complete string of important data. However i want to extract
complete information from 1 column and do further analysis.
Issue here is that after giving ';' as a delimiter i was expecting Map
for all occurrence of ';'. But it is considering only first
delimiter(;) and rest of the string is coming in value pair.
This is how 1 column data is looks like
ASP.NET_SessionId=bzqgdenuhxxyqmc2vv5tvrdw;+Rviewd=;+UserId=%
7bb5cecc61-cd09-4aa6-bc92-cae367f1753b%7d;+UserType=G;
+LastLogin=9/11/2012+12:00:01+AM
It is getting stored as below.
{"ASP.NET_SessionId":"bzqgdenuhxxyqmc2vv5tvrdw;+Rviewd=;+UserId=%
7bb5cecc61-cd09-4aa6-bc92-cae367f1753b%7d;+UserType=G;
+LastLogin=9/11/2012+12:00:01+AM"}
Below is the DDL.
CREATE external TABLE page_view_tmp_2
(
C_0 STRING,
C_1 MAP<STRING,STRING>,
C_2 STRING,
C_3 STRING,
C_41 STRING)
COMMENT 'Page View'
ROW FORMAT DELIMITED FIELDS TERMINATED BY ' ' MAP KEYS TERMINATED BY
';'
STORED AS TEXTFILE