Prasanna Ravichandran created CARBONDATA-3915:
-------------------------------------------------
Summary: Correction in the documentation for spark-shell
Key: CARBONDATA-3915
URL: https://issues.apache.org/jira/browse/CARBONDATA-3915
Project: CarbonData
Issue Type: Bug
Components: hive-integration
Affects Versions: 2.0.0
Environment: 3 node ANT cluster one track.
Reporter: Prasanna Ravichandran
Spark-Shell program is not working, which is given in the
[https://github.com/apache/carbondata/blob/master/docs/hive-guide.md]
Working program is given as below:
import org.apache.spark.sql.SparkSession
import org.apache.spark.sql.CarbonSession._
val newSpark =
SparkSession.builder().config(sc.getConf).enableHiveSupport.config("spark.sql.extensions","org.apache.spark.sql.CarbonExtensions").getOrCreate()
newSpark.sql("drop table if exists hive_carbon").show
newSpark.sql("create table hive_carbon(id int, name string, scale decimal,
country string, salary double) STORED AS carbondata").show
newSpark.sql("LOAD DATA INPATH 'hdfs://hacluster/user/prasanna/samplehive.csv'
INTO TABLE hive_carbon").show
newSpark.sql("SELECT * FROM hive_carbon").show()
so could update the above working program in the
[https://github.com/apache/carbondata/blob/master/docs/hive-guide.md] page,
under the "Start Spark shell by running the following command in the Spark
directory" section.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
