Re: Format dillema

2017-06-19 Thread Sruthi Kumar Annamneedu
Try using Parquet with Snappy compression and Impala will work with this
combination.

On Sun, Jun 18, 2017 at 3:35 AM, rakesh sharma 
wrote:

> We are facing an issue of format. We would like to do bi style queries
> from hive using impala and that supports parquet but we would like the data
> to be compressed to the best ratio like orc. But impala cannot query orc
> formats. What can be a design consideration for this. Any help
>
> Thanks
> Rakesh
>
> Get Outlook for Android 
>
>


any hive release imminent?

2017-06-19 Thread Stephen Sprague
Hey guys,
Is there any word out on the street about a timeframe for the next 2.x hive
release? Looks like Dec 2016 was the last one.

The natives are getting restless i think. :)

thanks,
Stephen.


Re: debug on hive

2017-06-19 Thread Ying Chen
What is not working... ?
Ying

On Wed, Jun 14, 2017 at 8:55 PM, vergil  wrote:

> Hi,
> Because I am going to rewrite and change some source code  based on our
> demands,I need to debug on hive in eclipse.But it do not works refer to
> https://cwiki.apache.org/confluence/display/Hive/DeveloperGuide and
> https://cwiki.apache.org/confluence/display/Hive/HiveDeveloperFAQ.
> Anyone could give me some suggestion?
>
> --
> The harder, more fortunate
>
>


Re: setup spark engine to hive ,the hive version and spark build problem

2017-06-19 Thread Mich Talebzadeh
just to clarify you mean:

Hive 2.1.1 works with Spark engine 2.X

Thanks

Dr Mich Talebzadeh



LinkedIn * 
https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
*



http://talebzadehmich.wordpress.com


*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.



On 19 June 2017 at 06:53, vergil  wrote:

> Hi,dear friend
> 1.After I try it and read the source code,I find that hive on spark2.X do
> works on hive 2.2.0 2.2.1 version and 2.4.x version which includes this
> commit history https://github.com/apache/hive/commit/
> ac977cc88757b49fbbd5c3bb236adcedcaae396c.I use the 2.2.0 version now.
> 2.Hive on spark,according to hive source code,you can just build the spark
> without hive profile and  add the essential spark jars and scala'library
> into your hive's lib folder.So you have no need to deploy the whole
> spark.This can meet your demands.
> 3.Spark sql,deploying another standard version whith hive can meet your
> sparksql demand.
> I hope it can help you.
>
> --
> The harder, more fortunate
>
>