Re: For Apache Hive HS2 , what is the largest heap size setting that works well?

Hi Sharanya, Can you share your current GC settings and Java version. Are you using Java 8/9 w/ G1 already? Regards, Johannes Sent from my iPhone > On Nov 28, 2017, at 12:57 PM, Sharanya Santhanam > wrote: > > Hello , > > I am currently trying to upgrade hive version on our prod clusters

Re: For Apache Hive HS2 , what is the largest heap size setting that works well?

FreeRatio=30 -XX:MinHeapFreeRatio=10 > -XX:+UseParNewGC -XX:-UseGCOverheadLimit -XX:PermSize=256m > > > Thanks , > Sharanya > >> On Tue, Nov 28, 2017 at 2:19 PM, Johannes Alberti >> wrote: >> Hi Sharanya, >> >> Can you share your cur

Re: Hive beeline and ACID tables.

Hi Collin, you need to set the table property “transactional” to true, this will mark the table as ACID. See also the example all the way at the bottom of this link. https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions For your error, the SELECT, maybe it is simply a copy-n-paste

Re: Proposal: File based metastore

Have you looked at https://cwiki.apache.org/confluence/display/Hive/LanguageManual+ImportExport? Why does this not suit your use case? Regards, Johannes Sent from my iPhone > On Feb 23, 2018, at 3:40 PM, Alexander Kolbasov wrote: > > Would it be useful to have a tool that can save database(

Re: error when beeline connecting to hiveserver2

You should connect by default to 1, the webui port is not the port beeline connects with. Regards, Johannes Sent from my iPhone > On Apr 23, 2018, at 6:38 AM, 侯宗田 wrote: > > Hi, > > I have started hiveserver2 and try to connect it with beeline using the > following command: > >!connect j

Re: Hive remote databases/tables proposal

Did you guys look at https://github.com/qubole/Hive-JDBC-Storage-Handler and discussed the pros/cons/similarities of the qubole approach On Thu, Apr 26, 2018 at 4:01 AM, Elliot West wrote: > Hello, > > At the 2018 DataWorks conference in Berlin, Hotels.com presented Waggle > Dance

Re: How to extract data from hive effectively

sqoop 1.x ...sqoop export -connect ... Sent from my iPhone > On Apr 28, 2018, at 4:29 AM, 侯宗田 wrote: > > Does anyone know how to extract data from hive to other databases > effectively, like hawq etc. > > 发自我的 iPhone

Re: HiveServer2 requests distribution

You should be able to see this when enabling metrics, these are to my knowledge per instance metrics. See also https://cwiki.apache.org/confluence/display/Hive/Hive+Metrics Sent from my iPhone > On May 21, 2018, at 2:53 AM, Greenhorn Techie > wrote: > > Hi, > > Any thoughts on this please?

Re: Clustering and Large-scale analysis of Hive Queries

Did you guys already look at Dr Elephant? https://engineering.linkedin.com/blog/2016/04/dr-elephant-open-source-self-serve-performance-tuning-hadoop-spark Not sure if there is anything you might find useful, but I would be interested in hearing about good and bad about Dr Elephant w/ Hive. Sent

Re: Identify no. of mappers and reducers allocated to a query in beeline

This might give you some hints https://issues.apache.org/jira/browse/HIVE-14183 On Fri, Sep 21, 2018 at 5:04 PM Tharun M wrote: > How can we see no. of mappers and reducers allocated to a query in > beeline? > I enabled debug log but doesn’t work. > > /t > >