Re: Unable to run simple spark-sql

2019-06-21 Thread Raymond Honderdors
n HDFS > i.e.hdfs://xxx:8020/apps/hive/warehouse/ > For this the code ran fine. > > Thanks for the help, > -Nirmal > > From: Nirmal Kumar > Sent: 19 June 2019 11:51 > To: Raymond Honderdors > Cc: user > Subject: RE: Unable to run simple spark-sql > > Hi Raymo

RE: Unable to run simple spark-sql

2019-06-21 Thread Nirmal Kumar
local filesystem. I created a new database and confirmed that the location was in HDFS i.e.hdfs://xxx:8020/apps/hive/warehouse/ For this the code ran fine. Thanks for the help, -Nirmal From: Nirmal Kumar Sent: 19 June 2019 11:51 To: Raymond Honderdors Cc: user Subject: RE: Unable to run simple spar

RE: Unable to run simple spark-sql

2019-06-18 Thread Nirmal Kumar
directory of hive user (/home/hive/). Why is it referring the local file system and from where? Thanks, Nirmal From: Raymond Honderdors Sent: 19 June 2019 11:18 To: Nirmal Kumar Cc: user Subject: Re: Unable to run simple spark-sql Hi Nirmal, i came across the following article "

Re: Unable to run simple spark-sql

2019-06-18 Thread Raymond Honderdors
June 18, 2019 5:56:06 PM > To: Raymond Honderdors; Nirmal Kumar > Cc: user > Subject: RE: Unable to run simple spark-sql > > Hi Raymond, > > Permission on hdfs is 777 > drwxrwxrwx - impadmin hdfs 0 2019-06-13 16:09 > /home/hive/spark-warehouse > > &g

Re: Unable to run simple spark-sql

2019-06-18 Thread Nirmal Kumar
utlook for Android<https://aka.ms/ghei36> From: Nirmal Kumar Sent: Tuesday, June 18, 2019 5:56:06 PM To: Raymond Honderdors; Nirmal Kumar Cc: user Subject: RE: Unable to run simple spark-sql Hi Raymond, Permission on hdfs is 777 drwxrwxrwx - impadmin hdfs

RE: Unable to run simple spark-sql

2019-06-18 Thread Nirmal Kumar
spark-warehouse/testdb.db/employee_orc/.hive-staging_hive_2019-06-18_16-08-21_448_1691186175028734135-1' Thanks, -Nirmal From: Raymond Honderdors Sent: 18 June 2019 17:52 To: Nirmal Kumar Cc: user Subject: Re: Unable to run simple spark-sql Hi Can you check the permission of the user runni

Re: Unable to run simple spark-sql

2019-06-18 Thread Raymond Honderdors
Hi Can you check the permission of the user running spark On the hdfs folder where it tries to create the table On Tue, Jun 18, 2019, 15:05 Nirmal Kumar wrote: > Hi List, > > I tried running the following sample Java code using Spark2 version 2.0.0 > on YARN (HDP-2.5.0.0) > > public class SparkS