[GitHub] [carbondata] chetandb commented on a change in pull request #3296: [CARBONDATA-3443] Update hive guide with Read from hive
chetandb commented on a change in pull request #3296: [CARBONDATA-3443] Update hive guide with Read from hive URL: https://github.com/apache/carbondata/pull/3296#discussion_r295263694 ## File path: docs/hive-guide.md ## @@ -99,4 +99,16 @@ select count(*) from hive_carbon; select * from hive_carbon order by id; ``` +### Query data from hive table in Spark-2.1 + +``` +set hive.mapred.supports.subdirectories=true; +set mapreduce.input.fileinputformat.input.dir.recursive=true; + +create table hive_carbon_1(id int, name string, scale decimal, country string, salary double) ROW FORMAT SERDE 'org.apache.carbondata.hive.CarbonHiveSerDe' WITH SERDEPROPERTIES ('mapreduce.input.carboninputformat.databaseName'='default', 'mapreduce.input.carboninputformat.tableName'='HIVE_CARBON_EXAMPLE') STORED AS INPUTFORMAT 'org.apache.carbondata.hive.MapredCarbonInputFormat' OUTPUTFORMAT 'org.apache.carbondata.hive.MapredCarbonOutputFormat' LOCATION 'location_to_the_carbon_table'; +select * from hive_carbon_1; +select count(*) from hive_carbon_1; +select * from hive_carbon_1 order by id; +``` + Review comment: 1. query on hive table created using Carbon table with standard hive partition is not supported. This can be mentioned as a note. 2. Reading data with Map datatype is not supported. This can be mentioned as a note. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] chetandb commented on a change in pull request #3296: [CARBONDATA-3443] Update hive guide with Read from hive
chetandb commented on a change in pull request #3296: [CARBONDATA-3443] Update hive guide with Read from hive URL: https://github.com/apache/carbondata/pull/3296#discussion_r295263694 ## File path: docs/hive-guide.md ## @@ -99,4 +99,16 @@ select count(*) from hive_carbon; select * from hive_carbon order by id; ``` +### Query data from hive table in Spark-2.1 + +``` +set hive.mapred.supports.subdirectories=true; +set mapreduce.input.fileinputformat.input.dir.recursive=true; + +create table hive_carbon_1(id int, name string, scale decimal, country string, salary double) ROW FORMAT SERDE 'org.apache.carbondata.hive.CarbonHiveSerDe' WITH SERDEPROPERTIES ('mapreduce.input.carboninputformat.databaseName'='default', 'mapreduce.input.carboninputformat.tableName'='HIVE_CARBON_EXAMPLE') STORED AS INPUTFORMAT 'org.apache.carbondata.hive.MapredCarbonInputFormat' OUTPUTFORMAT 'org.apache.carbondata.hive.MapredCarbonOutputFormat' LOCATION 'location_to_the_carbon_table'; +select * from hive_carbon_1; +select count(*) from hive_carbon_1; +select * from hive_carbon_1 order by id; +``` + Review comment: query on hive table created using Carbon table with standard hive partition is not supported. This can be mentioned as a note. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] chetandb commented on a change in pull request #3296: [CARBONDATA-3443] Update hive guide with Read from hive
chetandb commented on a change in pull request #3296: [CARBONDATA-3443] Update hive guide with Read from hive URL: https://github.com/apache/carbondata/pull/3296#discussion_r295259308 ## File path: docs/hive-guide.md ## @@ -99,4 +99,16 @@ select count(*) from hive_carbon; select * from hive_carbon order by id; ``` +### Query data from hive table in Spark-2.1 + +``` +set hive.mapred.supports.subdirectories=true; +set mapreduce.input.fileinputformat.input.dir.recursive=true; + +create table hive_carbon_1(id int, name string, scale decimal, country string, salary double) ROW FORMAT SERDE 'org.apache.carbondata.hive.CarbonHiveSerDe' WITH SERDEPROPERTIES ('mapreduce.input.carboninputformat.databaseName'='default', 'mapreduce.input.carboninputformat.tableName'='HIVE_CARBON_EXAMPLE') STORED AS INPUTFORMAT 'org.apache.carbondata.hive.MapredCarbonInputFormat' OUTPUTFORMAT 'org.apache.carbondata.hive.MapredCarbonOutputFormat' LOCATION 'location_to_the_carbon_table'; Review comment: "Example" can be the heading for this query sequence This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] chetandb commented on a change in pull request #3296: [CARBONDATA-3443] Update hive guide with Read from hive
chetandb commented on a change in pull request #3296: [CARBONDATA-3443] Update hive guide with Read from hive URL: https://github.com/apache/carbondata/pull/3296#discussion_r295196357 ## File path: docs/hive-guide.md ## @@ -99,4 +99,16 @@ select count(*) from hive_carbon; select * from hive_carbon order by id; ``` +### Query data from hive table in Spark-2.1 Review comment: 1. Some basic info(1 or 2 lines) can be mentioned on what this feature does. 2. what interface the user can use to query from hive table can be mentioned. 3. It needs to be mentioned that carbon jars need to be placed in hive/lib folder and yarn/lib folders for this feature to work. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] chetandb commented on a change in pull request #3296: [CARBONDATA-3443] Update hive guide with Read from hive
chetandb commented on a change in pull request #3296: [CARBONDATA-3443] Update hive guide with Read from hive URL: https://github.com/apache/carbondata/pull/3296#discussion_r295191608 ## File path: docs/hive-guide.md ## @@ -99,4 +99,16 @@ select count(*) from hive_carbon; select * from hive_carbon order by id; ``` +### Query data from hive table in Spark-2.1 + +``` +set hive.mapred.supports.subdirectories=true; Review comment: Why are these parameters required can be mentioned in 1 or 2 lines. Also where these parameters need to be configured need to be mentioned. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services