Re: how to append data to IGFS so that data gets saved to Hive partitioned table?

2017-08-02 Thread csumi
Ignite-hadoop accelerator is configured as https://apacheignite.readme.io/v1.0/docs/hadoop-accelerator#section-secondary-file-system. Idea is to run hive queries on IGFS but looks like its not working that way. Not sure how to confirm if hive is connecting to HDFS or IGFS. Also, I think creating

Re: how to append data to IGFS so that data gets saved to Hive partitioned table?

2017-08-03 Thread csumi
Hi Mikhail, Thanks for your response. I changed hdfs://localhost:9000 to igfs://localhost:9000 in the core-site.xml of hive home directory but core-site.xml of Hadoop home was still pointing to hdfs://localhost:9000. Issue persists. If I create partition using the insert command on hive I am

Re: how to append data to IGFS so that data gets saved to Hive partitioned table?

2017-08-03 Thread csumi
Thank you for the response. If I insert data from hive directly using below query, select query works fine. insert into table stocks PARTITION (years=2004,months=12,days=3) values('AAPL',1501236980,120.34); I think the issue here is that when we insert data using IGFS api (append method),

Re: how to append data to IGFS so that data gets saved to Hive partitioned table?

2017-08-04 Thread csumi
Let me try to clear here with the sequence of steps performed. - Created table with partition through hive using below query. It creates a directory in hdfs. create table stocks3 (stock string, time timestamp, price float) PARTITIONED BY (years bigint, months bigint, days bigint)

Re: how to append data to IGFS so that data gets saved to Hive partitioned table?

2017-08-16 Thread csumi
Hi Mikhail, Your last reply is showing as blank. Any luck with reproduce? Thanks! -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/how-to-append-data-to-IGFS-so-that-data-gets-saved-to-Hive-partitioned-table-tp15725p16217.html Sent from the Apache Ignite Users

how to append data to IGFS so that data gets saved to Hive partitioned table?

2017-07-27 Thread csumi
I have a Hive partitioned table as below: create table stocks (stock string, time timestamp, price float) PARTITIONED BY (years bigint, months bigint, days bigint) ROW FORMAT DELIMITED FIELDS TERMINATED BY ','; Data is getting saved in HDFS through IGFS when I pass comma separated string to the