Ignite-hadoop accelerator is configured as
https://apacheignite.readme.io/v1.0/docs/hadoop-accelerator#section-secondary-file-system.
Idea is to run hive queries on IGFS but looks like its not working that way.
Not sure how to confirm if hive is connecting to HDFS or IGFS. Also, I think
creating
Hi Mikhail,
Thanks for your response.
I changed hdfs://localhost:9000 to igfs://localhost:9000 in the
core-site.xml of hive home directory but core-site.xml of Hadoop home was
still pointing to hdfs://localhost:9000. Issue persists.
If I create partition using the insert command on hive I am
Thank you for the response.
If I insert data from hive directly using below query, select query works
fine.
insert into table stocks PARTITION (years=2004,months=12,days=3)
values('AAPL',1501236980,120.34);
I think the issue here is that when we insert data using IGFS api (append
method),
Let me try to clear here with the sequence of steps performed.
- Created table with partition through hive using below query. It creates
a
directory in hdfs.
create table stocks3 (stock string, time timestamp, price float)
PARTITIONED BY (years bigint, months bigint, days bigint)
Hi Mikhail,
Your last reply is showing as blank. Any luck with reproduce?
Thanks!
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/how-to-append-data-to-IGFS-so-that-data-gets-saved-to-Hive-partitioned-table-tp15725p16217.html
Sent from the Apache Ignite Users
I have a Hive partitioned table as below:
create table stocks (stock string, time timestamp, price float) PARTITIONED
BY (years bigint, months bigint, days bigint) ROW FORMAT DELIMITED FIELDS
TERMINATED BY ',';
Data is getting saved in HDFS through IGFS when I pass comma separated
string to the