Spark Thrift Server - Skip header when load data from local file

2017-02-14 Thread kumar r
Hi,

I want to load data from csv file to Spark table using Spark thrift server.
When i load, header(first line) should be ignored.

I have used tblproperties("skip.header.line.count"="1") option. But its not
working and first line also included.

Below is spark sql query i have tried.

create table tabname(id string,name string) row format delimited fields
terminated by ',' tblproperties("skip.header.line.count"="1");
load data local inpath 'tabname.csv' overwrite into table tabname;

How can i achieve this? Is there any other solution or workaround.


Cached table details

2017-01-24 Thread kumar r
Hi,

I have cached some table in Spark Thrift Server. I want to get all cached
table information. I can see it in 4040 web ui port.

Is there any command or other way to get the cached table details
programmatically?

Thanks,
Kumar