requesting write access to hive confluence wiki

Hi, I would like to update/fix some sections in the hive confluence wiki. Please grant write access. My user name is thejas. Thanks, Thejas

Re: [ANNOUNCE] Apache Hive 0.11.0 Released

Thanks to all the contributors who helped create this new release! And special thanks to the release managers Ashutosh Chauhan and Owen O'Malley - for driving this release. On Thu, May 16, 2013 at 2:19 PM, Owen O'Malley omal...@apache.org wrote: The Apache Hive team is proud to announce the

Re: regarding Hive Thrift Metastore Server

Without a metastore server, you would need to make access to the mysql db possible from all hive clients. This is inherently less secure, because anybody who can run hive cli can modify the mysql db, and there is not metastore server doing the authorization checks. If you don't care about

Re: [ANNOUNCE] New Hive Committer - Thejas Nair

, Aug 20, 2013 at 03:31:48AM -0700, Carl Steinbach wrote: The Apache Hive PMC has voted to make Thejas Nair a committer on the Apache Hive project. Please join me in congratulating Thejas! -- *Note that I'm no longer using my Yahoo! email address. Please email me at billgra

Re: ODBC driver for Excel

You can use the hortonworks odbc driver for free, it is available as an add-on - http://hortonworks.com/download/download-archives/ -Thejas On Thu, Aug 22, 2013 at 4:30 PM, Chad Dotzenrod cdotzen...@gmail.comwrote: Trying to find an ODBC driver to use with Excel against my cluster that I

Re: [ANNOUNCE] New Hive Committer - Yin Huai

Congrats Yin! Well deserved! Looking forward to many more contributions from you! On Tue, Sep 3, 2013 at 11:45 PM, Hari Subramaniyan hsubramani...@hortonworks.com wrote: Congrats !! On Tue, Sep 3, 2013 at 11:43 PM, Vaibhav Gumashta vgumas...@hortonworks.com wrote: Congrats Yin! On

Re: User accounts to execute hive queries

You might find my slides on this topic useful - http://www.slideshare.net/thejasmn/hive-authorization-models Also linked from last slide - https://cwiki.apache.org/confluence/display/HCATALOG/Storage+Based+Authorization On Tue, Sep 17, 2013 at 11:46 PM, Nitin Pawar nitinpawar...@gmail.com

Re: Why doesn't work?

Can you shares some examples of what does not work ? On Thu, Sep 26, 2013 at 11:34 AM, Gary Zhao garyz...@gmail.com wrote: Hello I found something strange. I tried a few queries, in WHERE 1. works, returns expected results 2. and doesn't work, returns 0 result 3. doesn't work, return

[RESULT] Apache Hive 0.12.0 Release Candidate 1

With 3 binding +1's and 2 non-binding +1s and no -1s this vote passes. Thanks to everybody who voted and gave feedback. I will start working on publishing the release. Thanks, Thejas On Sun, Oct 13, 2013 at 4:37 PM, Carl Steinbach c...@apache.org wrote: +1 (binding) Regarding the 3 day

Re: Use hive on hadoop 3.0.0

If you are using HIVE-TEZ branch, you also need tez (git clone g...@github.com:apache/tez.git). Publish the tez artifacts locally (mvn clean install -DskipTests). In hive, change build.properties to have hadoop-0.23.version=Hadoop-3.0.0-SNAPSHOT. Specifying that using -Dhadoop-0.23.version in

Fwd: [ANNOUNCE] Apache Hive 0.12.0 Released

The Apache Hive team is proud to announce the the release of Apache Hive version 0.12.0. The Apache Hive (TM) data warehouse software facilitates querying and managing large datasets residing in distributed storage. Built on top of Apache Hadoop (TM), it provides: * Tools to enable easy data

Re: HS2 ODBC incompatibility

Yes, the current odbc driver source in hive is not compatible with hive server2. I am not aware of any body working on it. But you can download odbc driver add on for hive server2, for free from the hortonworks website - http://hortonworks.com/download/download-archives/ On Mon, Oct 21, 2013 at

Re: In Beeline what is the syntax for ALTER TABLE ?

beeline does not have any query syntax of its own, it just sends the query to hive server2, which uses same code as hive-cli to run the query. ie query syntax is same as hive cli On Mon, Oct 21, 2013 at 11:41 AM, Sanjay Subramanian sanjay.subraman...@wizecommerce.com wrote: Hi guys

Re: Hive 12 with Hadoop 2.x with ORC

protobuf 2.5 upgrade did not get included in hive 0.12 (HIVE-5112). You might want to apply the protobuf update patch on top of 0.12 to use it with recent versions of hadoop 2.x . (but i am certain if this is a protobuf version issue). On Tue, Oct 22, 2013 at 6:53 AM, Rajesh Balamohan

Re: [ANNOUNCE] New Hive Committer - Xuefu Zhang

Congrats Xuefu! On Sun, Nov 3, 2013 at 11:11 PM, Mohammad Islam misla...@yahoo.com wrote: Congrats Xuefu! --Mohammad On Sunday, November 3, 2013 9:07 PM, hsubramani...@hortonworks.com hsubramani...@hortonworks.com wrote: Congrats Xuefu! Thanks, Hari On Nov 3, 2013, at 8:28 PM,

Re: UnitTest did not pass during compile the latest hive code

from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: fcitx-socket-:0) I'm trying to fix it. Best Regards 金杰 (Jay Jin) On Wed, Nov 6, 2013 at 4:58 AM, Thejas Nair

Re: [ANNOUNCE] New Hive Committer - Prasad Mujumdar

Congrats Prasad! On Sun, Nov 10, 2013 at 6:46 PM, Jarek Jarcec Cecho jar...@apache.org wrote: Congratulations Prasad, good job! Jarcec On Sun, Nov 10, 2013 at 06:42:45PM -0800, Carl Steinbach wrote: The Apache Hive PMC has voted to make Prasad Mujumdar a committer on the Apache Hive

Re: [ANNOUNCE] New Hive PMC Member - Harish Butani

Congrats Harish! On Fri, Nov 15, 2013 at 1:08 AM, Gunther Hagleitner ghagleit...@hortonworks.com wrote: Congratulations Harish! Very cool. On Thu, Nov 14, 2013 at 10:01 PM, Prasad Mujumdar pras...@cloudera.comwrote: Congratulations !! thanks Prasad On Thu, Nov 14, 2013 at 5:17

Re: Running Hive 0.12.0 with Hadoop 2.2

It is better to first upgrade hive 0.12 to protocol buffer 2.5 first - https://issues.apache.org/jira/browse/HIVE-5112. This will make it into hive 0.13 release. If you want a pre-built hive 0.12 that works with hadoop 2.2.x , you can download one from hortonworks website -

Re: [ANNOUNCE] New Hive Committer and PMC Member - Lefty Leverenz

Congrats Lefty! On Sat, Nov 16, 2013 at 9:20 PM, Carl Steinbach c...@apache.org wrote: The Apache Hive PMC has voted to make Lefty Leverenz a committer and PMC member on the Apache Hive Project. Please join me in congratulating Lefty! Thanks. Carl -- CONFIDENTIALITY NOTICE NOTICE: This

Re: [ANNOUNCE] New Hive Committers - Jitendra Nath Pandey and Eric Hanson

Congrats! On Thu, Nov 21, 2013 at 3:46 PM, Shreepadma Venugopalan shreepa...@cloudera.com wrote: Congrats guys! On Thu, Nov 21, 2013 at 3:37 PM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Congratulations to both! Great job and keep up the good work! Thanks, +Vinod On Nov 21,

Re: Difference in number of row observstions from distinct and group by

You probably have 400 rows where col1, col2 and col3 have null values. count(distinct col1,col2,col3) will not count those rows. On Thu, Nov 21, 2013 at 7:13 AM, Mayank Bansal mayank.ban...@mu-sigma.com wrote: Hi, I have a table which has 3 columns combined together to form a primary key.

Re: Using Hive with WebHCat

Can you try setting templeton.storage.root in webhcat-site.xml to a directory that exists ? On Mon, Dec 2, 2013 at 6:21 AM, Jonathan Hodges hodg...@gmail.com wrote: Hi, I have setup WebHCat that is bundled with Hive 0.11.0. I am able to kick of map reduce jobs with the REST API

Re: [DISCUSS] Proposed Changes to the Apache Hive Project Bylaws

The changes look good to me. Only concern I have is with the 7 days for release candidate voting. Based on my experience with releases, it often takes few cycles to get the candidate out, and people tend to vote closer to the end of the voting period. This can mean that it takes several weeks to

Re: [DISCUSS] Proposed Changes to the Apache Hive Project Bylaws

, Ashutosh On Fri, Dec 27, 2013 at 9:33 AM, Thejas Nair the...@hortonworks.com wrote: The changes look good to me. Only concern I have is with the 7 days for release candidate voting. Based on my experience with releases, it often takes few cycles to get the candidate out, and people tend to vote

Re: [DISCUSS] Proposed Changes to the Apache Hive Project Bylaws

On Sun, Dec 29, 2013 at 12:06 AM, Lefty Leverenz leftylever...@gmail.com wrote: Let's discuss annual rotation of the PMC chair a bit more. Although I agree with the points made in favor, I wonder about frequent loss of expertise and needing to establish new relationships. What's the ramp-up

Re: [ANNOUNCE] New Hive Committer - Vikram Dixit

Congrats Vikram! On Mon, Jan 6, 2014 at 9:01 AM, Jarek Jarcec Cecho jar...@apache.org wrote: Congratulations Vikram! Jarcec On Mon, Jan 06, 2014 at 08:58:06AM -0800, Carl Steinbach wrote: The Apache Hive PMC has voted to make Vikram Dixit a committer on the Apache Hive Project. Please

Re: [DISCUSS] Proposed Changes to the Apache Hive Project Bylaws

other changes are in. On Fri, Dec 27, 2013 at 1:03 PM, Thejas Nair the...@hortonworks.com wrote: I agree with Ashutosh that the 24 hour waiting period after +1 is cumbersome, I have also forgotten to commit patches after +1, resulting in patches going stale. But I think 24 hours wait between

Re: [DISCUSS] Proposed Changes to the Apache Hive Project Bylaws

'd. With the change the clock starts ticking when patch is available (ie, controlled by contributor). I think this 'small' change will improver things for better in a bigger way. On Tue, Jan 7, 2014 at 7:01 PM, Thejas Nair the...@hortonworks.com wrote: After thinking some more about it, I am

Re: [DISCUSS] Proposed Changes to the Apache Hive Project Bylaws

wrote: This wording seems fine. You could add a here: Committers should wait for [a] reasonable time The guidance is good. +1 -- Lefty On Tue, Jan 14, 2014 at 7:53 PM, Thejas Nair the...@hortonworks.com wrote: I guess the silence from others on the changing the '24 hours from +1

Re: [ANNOUNCE] New Hive Committers - Sergey Shelukhin and Jason Dere

Congrats Jason and Sergey! Well deserved! Looking forward to your help in getting the patch available counts down (its at 225 now)! On Mon, Jan 27, 2014 at 10:55 AM, Vaibhav Gumashta vgumas...@hortonworks.com wrote: Congrats Sergey and Jason! --Vaibhav On Mon, Jan 27, 2014 at 10:47 AM,

Re: HIVE+MAPREDUCE

You can use hcatalog to write into hive tables from mapreduce. See https://cwiki.apache.org/confluence/display/Hive/HCatalog+InputOutput . Another example is in https://gist.github.com/thejasmn/7607406 On Tue, Jan 21, 2014 at 12:21 AM, Ranjini Rathinam ranjinibe...@gmail.com wrote: Hi, Need

Re: [ANNOUNCE] New Hive Committer - Remus Rusanu

Congrats Remus! On Wed, Feb 26, 2014 at 9:08 AM, Clay McDonald stuart.mcdon...@bateswhite.com wrote: Congratulations Remus! Clay -Original Message- From: Jarek Jarcec Cecho [mailto:jar...@apache.org] Sent: Wednesday, February 26, 2014 12:06 PM To: user@hive.apache.org Cc:

Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

Congrats Xuefu! On Fri, Feb 28, 2014 at 3:20 AM, Clark Yang (杨卓荦) yangzhuo...@gmail.comwrote: Congrats, Xuefu! Thanks, Zhuoluo (Clark) Yang 2014-02-28 19:19 GMT+08:00 Lianhui Wang lianhuiwan...@gmail.com: Congrats Xuefu! 2014-02-28 17:49 GMT+08:00 Jason Dere jd...@hortonworks.com:

Re: Hive jdbc access to HiveServer2. How to debug?

This hanging issue has been seen when there is a mismatch between the auth modes of HS2 server and client (usually SASL vs NOSASL). On Sun, Apr 6, 2014 at 5:40 AM, Jay Vyas jayunit...@gmail.com wrote: Hi hive. I cant run JDBC queries against HiveServer2. It appears the client is connecting

Re: [ANNOUNCE] New Hive Committers - Alan Gates, Daniel Dai, and Sushanth Sowmyan

Congrats Alan, Daniel, Sushanth! On Mon, Apr 14, 2014 at 11:29 AM, Szehon Ho sze...@cloudera.com wrote: Congratulations, guys! On Mon, Apr 14, 2014 at 11:14 AM, Hari Subramaniyan hsubramani...@hortonworks.com wrote: Congrats! On Mon, Apr 14, 2014 at 11:09 AM, Tao Li

Re: [ANNOUNCE] Apache Hive 0.13.0 Released

Thanks to Harish for all the hard work managing and getting the release out! This is great news! This is a significant release in hive! This has more than twice the number of jiras included (see release note link), compared to 0.12, and earlier releases which were also out after a similar gap of

Re: What is the minimal required version of Hadoop for Hive 0.13.0?

There is a jira for the hadoop 1.0.x compatibility issue. https://issues.apache.org/jira/browse/HIVE-6962 I have suggested a possible workaround there. There is no patch for it yet. I am planning to propose a 0.13.1 release, primarily for the issues around use of Oracle as metastore database, and

Re: MapReduce with HCatalog hangs

HcatInputFormat does not run any initial mapreduce jobs. It seems to me that the MapReduce job actually ran. You might want to do a jstack on your java program client side, to see what it is waiting on. On Fri, May 2, 2014 at 7:28 AM, Fabian Reinartz fab.ek...@googlemail.com wrote: I

Re: Hive Vs Pig: Master's thesis

The primary difference between hive and pig is the language. There are implementation differences that will result in performance differences, but it will be hard to figure out what aspect of implementation responsible for what improvement. I think a more interesting project would be to compare

Re: OrcOutputFormat

I am not familiar with https://github.com/mayanhui/hive-orc-mr/. But is there any reason why you are not using hcatalog input/output format for this ? https://cwiki.apache.org/confluence/display/Hive/HCatalog+InputOutput. On Wed, Apr 30, 2014 at 4:25 AM, Seema Datar sda...@yahoo-inc.com wrote:

Re: Metastore 0.13 is not starting up.

Have you tried using schematool to upgrade the metastore schema ? https://cwiki.apache.org/confluence/display/Hive/Hive+Schema+Tool On Wed, May 21, 2014 at 4:29 AM, Biswajit Nayak biswajit.na...@inmobi.com wrote: Hi All, I had metastore(0.12) running previously. But after upgrading to 0.13 it

CVE-2014-0228: Apache Hive Authorization vulnerability

that data into his table. This is possible if the user HiveServer2 runs as has permissions for that directory and its contents. Mitigation: Users who use SQL standards based authorization should upgrade to 0.13.1. Credit: This issue was discovered by Thejas Nair of Hortonworks. -BEGIN PGP

Re: Questions about hive authorization under hdfs permissions.

I hope you don't mind me cc'ing user-group so that this qa is available for others as well. The grant/revoke based authorization models (including the new sql-standards based authorization in hive 0.13) does not automatically ensure that the user has necessary privileges on hdfs dirs and files.

Re: Getting Started with Hive 0.13.1 ClassNotFound

hcat_server is essentially same has hive metastore, it is there for historical reasons (time to remove it, in my opinion). As metastore command is more commonly used, hcat_server command might have new bugs that have gone unnoticed because of its disuse. You can start hive-metastore by using

Re: hive 0.13.0 guava issues

guava jar is there as part of hadoop, and hadoop uses guava 0.11 jar. As the guava versions are not fully compatible with each other, hive can't upgrade unless hadoop also upgrades or we use a good way to isolate the jar usage. See discussion in hadoop about upgrading the guava version -

Re: hive 0.13.0 guava issues

it as a library dependency that can be easily removed if needed. Previously I had a hack to let the ClassLoader load guava that my user code cares about the most i.e. the latest one. Never seen Hadoop break because of that. Thanks, Viral On Mon, Sep 29, 2014 at 11:45 AM, Thejas Nair

Re: [ANNOUNCE] New Hive PMC Member - Alan Gates

Congrats Alan! On Mon, Oct 27, 2014 at 10:11 PM, Sergio Pena sergio.p...@cloudera.com wrote: Congratulations Alan!! On Mon, Oct 27, 2014 at 5:38 PM, Carl Steinbach c...@apache.org wrote: I am pleased to announce that Alan Gates has been elected to the Hive Project Management Committee.

Re: hcatalog table permissions error

Nathan, Can you check if you have hive.metastore.execute.setugi=true in conf object used by HCatClient.create(conf) ? Thanks, Thejas On Wed, Oct 22, 2014 at 12:55 PM, Nathan Bamford nathan.bamf...@redpoint.net wrote: Whoops, I pasted the wrong line in for the hcat table records. Should have

Re: [ANNOUNCE] Apache Hive 0.14.0 Released

The link to the download page is now - https://hive.apache.org/downloads.html (I have also corrected the email template in how-to-release wiki with new url). On Mon, Nov 17, 2014 at 1:59 PM, Roshan Naik ros...@hortonworks.com wrote: 1) fyi.. this link is broken:

Re: [ANNOUNCE] New Hive PMC Member - Prasad Mujumdar

Congrats Prasad! On Tue, Dec 9, 2014 at 5:03 PM, Navis류승우 navis@nexr.com wrote: Congratulations! 2014-12-10 8:35 GMT+09:00 Jason Dere jd...@hortonworks.com: Congrats! On Dec 9, 2014, at 3:02 PM, Venkat V venka...@gmail.com wrote: Congrats Prasad! On Tue, Dec 9, 2014 at 2:32 PM,

Re: [ANNOUNCE] New Hive PMC Members - Szehon Ho, Vikram Dixit, Jason Dere, Owen O'Malley and Prasanth Jayachandran

Congrats! On Wed, Jan 28, 2015 at 2:08 PM, Prasanth Jayachandran pjayachand...@hortonworks.com wrote: Thanks Shezon and everyone! Congraturlations Vikram, Jason, Shezon and Owen! On Jan 28, 2015, at 1:51 PM, Szehon Ho sze...@cloudera.commailto:sze...@cloudera.com wrote: Thanks and congrats

Re: show databases doesn't return all databases with Kerberos/Sentry enabled

Hi Liping, As Szehon said, the sentry mailing list is likely to be able to help you with this. Please note that the secur...@hive.apache.org is meant to be used to report security vulnerabilities, it is not the right place for questions on features . Thanks, Thejas On Wed, May 13, 2015 at

Re: [ANNOUNCE] Apache Hive 2.1.0 Released

Thanks for your hard work and patience in driving the release Jesus! :) On Tue, Jun 21, 2016 at 10:18 AM, Jesus Camachorodriguez wrote: > The Apache Hive team is proud to announce the release of Apache Hive > version 2.1.0. > > The Apache Hive (TM) data warehouse software

Re: Issue with Star schema

As suggested, looking at the explain plan should tell you if map-join is getting used. Using a recent version with hive-on-tez would also give you further speedup as map-joins are optimized further in it. On Tue, Mar 15, 2016 at 9:32 AM, sreebalineni . wrote: > You can

Re: Hive 2 database Entity-Relationship Diagram

The pdf is not upside for me, in chrome browser. However, there seems to be many tables that are not related to (or rather used by) hive, specifically DMRV_* and DMRS_* ones. Thanks, Thejas From: Mich Talebzadeh Sent: Thursday,

Re: use jdbc connect to hive2.0

The property should be named hadoop.proxyuser.dcos.groups and hadoop.proxyuser.dcos.groups if you are running HS2 as user dcos. Also, user dcos should belong to the group dcos if that setting is to work. I assume you are trying to have hive.server2.enable.doAs=true. I am not sure why you are

Re: [VOTE] Bylaws change to allow some commits without review

?+1 From: Wei Zheng Sent: Monday, April 18, 2016 10:51 AM To: user@hive.apache.org Subject: Re: [VOTE] Bylaws change to allow some commits without review +1 Thanks, Wei From: Siddharth Seth >

Re: javax.jdo.JDODataStoreException: Required table missing : "VERSION" in Catalog "" Schema "". DataNucleus requires this table to perform its persistence operations. Either your MetaData is incorrec

As the error message indicated, please use "schematool -initSchema -dbType.. " command to create the proper metadata schema in metastore. On Fri, Aug 19, 2016 at 4:53 AM, شجاع الرحمن بیگ wrote: > Hey, > > Could you please help me resolving this error? > version= hive

Re: why need set hive.server2.enable.doAs=false in SQL-Standard Based Authorization

1 - if it set to true, you need to manager permissions in two places for users, using grant/revoke on tables, and file system permissions as well, and keep them in sync. That will be a headache. Moreover, the main intent for sql std auth is to be able to provide fine grained access control using

Re: SQL Standard Based Hive Authorization with CDH 5.X

You can also set them via hiveserver2-site.xml instead of passing them as commandline params. Let me make that more clear in the doc. On Thu, May 11, 2017 at 9:36 AM, Rob Anderson wrote: > You add the options to HiveServer2 Environment Advanced Configuration >

Re: CVE-2016-3083: Apache Hive SSL vulnerability bug disclosure

It went in under guise of the jira - HIVE-13390. Commit - https://github.com/apache/hive/commit/3b2ea248078bdf3a8372958cf51a989dc3883bcc On Tue, May 30, 2017 at 12:35 PM, Ying Chen wrote: > Hello - > Was there a particular JIRA(s) that went into Hive 1.2.2 that fixed this

Re: Proposal: Apply SQL based authorization functions in the metastore.

Hi Elliot, One scenario where Storage based authorization doesn't work is the case of object stores such as S3. In those scenarios, the tool/platform that is accessing the data won't have any restrictions on data access either. I am not sure how the data access would be secured in such cases,

Re: [SECURITY] CVE-2018-1314: Hive explain query not being authorized

Terry, Yes this is seen with SQL stardard authorization, Ranger and I suppose Sentry based authorization as well. Hive was not passing the table objects to the authorization plugin implementations during authorization api calls. On Wed, Nov 7, 2018 at 1:49 PM Terry wrote: > > Daniel - Is this

Re: HIVE-20420 Provide a fallback authorizer when no other authorizer is in use

This was for CVE-2018-11777. You can find more details in description of CVE-2018-11777 On Wed, Nov 14, 2018 at 3:40 AM Oleksiy S wrote: > > Guys, could you help with this new feature? HIVE-20420 > > I see no docs, no use cases, just nothing. Thanks. > > -- > Oleksiy