Hi all, I am using S3 location to store data in ORC table and I am not seeing any data from it any help here? Even I used default location which is HDFS it results the same in ORC 'no data'.
hive> *create* *table* test_S3_*text*(cell_id int, run_date string, init_hour double, pet array<double>, rainfall array<double>, rhmax array<double>,rhmin array<double>, solar array<double>, tmax array<double>, tmin array<double>, windspeedmax array<double>, windspeedmean array<double>) clustered by (cell_id) into 10 buckets row format delimited fields terminated by ',' collection items terminated by '$' stored as textfile location 's3://agrible-weather/monolith/test_S3_text'; OK Time taken: 3.313 seconds hive> *load* data local inpath '/tmp/sowjanya_files/asperitas/gfshourly/gfstest.csv' overwrite into table test_S3_text; Loading data to table monolith.test_s3_text OK Time taken: 2.704 seconds hive> select * from *test_s3_text*; OK 1 2018-04-05 0.0 [0.03,0.04,0.05,0.07] [0.03,0.04,0.05,0.07] [0.03,0.04,0.05,0.07] [0.03,0.04,0.05,0.07] [0.03,0.04,0.05,0.07] [0.03,0.04,0.05,0.07] [0.03,0.04,0.05,0.07] [0.03,0.04,0.05,0.07] [0.03,0.04,0.05,0.07] Time taken: 0.187 seconds, Fetched: 1 row(s) hive>* create table test_S3_orc*(cell_id int, run_date string, init_hour double, pet array<double>, rainfall array<double>, rhmax array<double>,rhmin array<double>, solar array<double>, tmax array<double>, tmin array<double>, windspeedmax array<double>, windspeedmean array<double>) clustered by (cell_id) into 10 buckets row format delimited fields terminated by ',' collection items terminated by '$' stored as orc location 's3://agrible-weather/monolith/test_S3_orc' TBLPROPERTIES ('transactional'='true'); OK Time taken: 3.209 seconds hive> *insert into* table test_S3_orc select * from test_S3_text; Query ID = hadoop_20180430154640_71a46667-9f8f-41d3-93a6-c9360d0fbabb Total jobs = 1 Launching Job 1 out of 1 Status: Running (Executing on YARN cluster with App id application_1524689752360_0094) ---------------------------------------------------------------------------------------------- * VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED * ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 1 1 0 0 0 0 ---------------------------------------------------------------------------------------------- *VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 11.09 s * ---------------------------------------------------------------------------------------------- Loading data to table monolith.test_s3_orc OK Time taken: 24.364 seconds *hive> select * from test_S3_orc;* *OK* *Time taken: 0.219 seconds* Any suggestions what todo?