Re: Hive on Spark NPE at org.apache.hadoop.hive.ql.io.HiveInputFormat

2015-11-03 Thread Xuefu Zhang
Yeah. it seems that the NPE is a result of the warning msg, missing map.xml file. Not sure why, but I believe that Hortonworks doesn't support Hive on Spark. You can try get a build from the master branch or try other distributions. Thanks, Xuefu On Mon, Nov 2, 2015 at 10:18 PM, Jagat Singh

Re: Hive on Spark NPE at org.apache.hadoop.hive.ql.io.HiveInputFormat

2015-11-02 Thread Jagat Singh
This is the virtual machine from Hortonworks. The query is this select count(*) from sample_07; It should run fine with MR. I am trying to run on Spark. On Tue, Nov 3, 2015 at 4:39 PM, Xuefu Zhang wrote: > That msg could be just noise. On the other hand, there is

Re: Hive on Spark NPE at org.apache.hadoop.hive.ql.io.HiveInputFormat

2015-11-02 Thread Xuefu Zhang
That msg could be just noise. On the other hand, there is NPE, which might be the problem you're having. Have you tried your query with MapReduce? On Sun, Nov 1, 2015 at 5:32 PM, Jagat Singh wrote: > One interesting message here , *No plan file found: * > > 15/11/01

Re: Hive on Spark NPE at org.apache.hadoop.hive.ql.io.HiveInputFormat

2015-11-01 Thread Jagat Singh
One interesting message here , *No plan file found: * 15/11/01 23:55:36 INFO exec.Utilities: No plan file found: hdfs://

Re: Hive on Spark NPE at org.apache.hadoop.hive.ql.io.HiveInputFormat

2015-11-01 Thread Jone Zhang
pls check and attach the application master log. 2015-11-02 8:03 GMT+08:00 Jagat Singh : > Hi, > > I am trying to run Hive on Spark on HDP Virtual machine 2.3 > > Following wiki > https://cwiki.apache.org/confluence/display/Hive/Hive+on+Spark%3A+Getting+Started > > I have

Hive on Spark NPE at org.apache.hadoop.hive.ql.io.HiveInputFormat

2015-11-01 Thread Jagat Singh
Hi, I am trying to run Hive on Spark on HDP Virtual machine 2.3 Following wiki https://cwiki.apache.org/confluence/display/Hive/Hive+on+Spark%3A+Getting+Started I have replaced all the occurrences of hdp.version with 2.3.0.0-2557 I start hive with following set hive.execution.engine=spark;