Re: [VOTE] hive 0.6.0 release candidate 0

2010-10-21 Thread Edward Capriolo
On Wed, Oct 20, 2010 at 6:38 PM, John Sichi jsi...@facebook.com wrote: The tarballs are at http://people.apache.org/~jvs/hive-0.6.0-candidate-0 Carl did some sanity testing on it already, but any additional testing you can do before voting helps to ensure a quality release. JVS I am

Re: [ANNOUNCE] New Committer - Carl Steinbach

2010-11-02 Thread Edward Capriolo
On Tue, Nov 2, 2010 at 2:23 PM, Ashish Thusoo athu...@facebook.com wrote: Hi Folks, The Hive PMC has passed the vote to make Carl Steinbach a new committer on the Apache Hive project. Carl has made a lot of contributions to Hive with the latest being him serving as the release manager for

Re: [ANNOUNCE] New Hive Committer - Amareshwari Sriramadasu

2010-11-09 Thread Edward Capriolo
Welcome! On Tue, Nov 9, 2010 at 3:28 AM, Yongqiang He heyongqiang...@gmail.com wrote: Congrats amareshwari! Yongqiang On Nov 8, 2010, at 6:00 PM, Namit Jain nj...@facebook.com wrote: Hi Folks, The Hive PMC has passed the vote to make Amareshwari Sriramadasu a new committer on the Apache

Re: jmx metrics for metastore server

2010-11-09 Thread Edward Capriolo
On Tue, Nov 9, 2010 at 5:38 PM, Sushanth Sowmyan khorg...@gmail.com wrote: Hi all, We were looking at monitoring requirements from within Howl, which essentially translates to monitoring requirements for the Metastore server and would like to add in volume and latency jmx counters to

Review Request: Hive Variables

2010-11-29 Thread Edward Capriolo
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/124/ --- Review request for hive. Summary --- This patch adds hive variables Diffs

Re: Review Request: HIVE-1096 Hive Variables

2010-11-29 Thread Edward Capriolo
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/124/ --- (Updated 2010-11-29 10:27:46.947077) Review request for hive. Summary

RoadMap vs Jira

2010-12-11 Thread Edward Capriolo
In jira we have ~ 600 scheduled issues. These issues range from unconfirmed bugs, general wish list items, very complex additions such as new syntax or new expanding the scope of hive. Almost everything is marked as a MAJOR - BUG, when many things are minor wishes. I believe we should encourage

Re: Review Request: HIVE-1262

2010-12-24 Thread Edward Capriolo
On 2010-12-23 16:04:03, John Sichi wrote: http://svn.apache.org/repos/asf/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFAesDecrypt.java, line 37 https://reviews.apache.org/r/192/diff/1/?file=9231#file9231line37 Shouldn't this be deterministic=true? The

Re: Regarding Hive History File(s).

2011-01-04 Thread Edward Capriolo
On Tue, Jan 4, 2011 at 7:03 AM, Mohit mohitsi...@huawei.com wrote: Hello All, What is the purpose of maintaining hive history files which contain session information like session start, query start, query end, task start, task end etc.? Are they being used later (say by a tool) for some

Re: Regarding Hive History File(s).

2011-01-05 Thread Edward Capriolo
. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it! -Original Message- From: Edward Capriolo [mailto:edlinuxg...@gmail.com] Sent: Tuesday, January 04, 2011 8:03 PM To: mohitsi...@huawei.com Cc: hive-...@hadoop.apache.org; c

Re: patch review process

2011-01-20 Thread Edward Capriolo
On Thu, Jan 20, 2011 at 5:56 PM, Namit Jain nj...@fb.com wrote: I agree on the problem of comments. For a new reviewer, it makes the process more painful. But, I think, the issues are not major, and we should decide one approach or another. Even for option 2., we can make it mandatory for

Re: Scheduling the Hive 0.7.0 Release

2011-01-24 Thread Edward Capriolo
On Mon, Jan 24, 2011 at 4:11 PM, Carl Steinbach c...@cloudera.com wrote: Hi, There's been a lot of talk recently about Hive 0.7.0, so in the interest of getting the process moving I'd like to propose that we create the release branch this Friday (1/28), and aim to have the release out the

Re: Scheduling the Hive 0.7.0 Release

2011-01-24 Thread Edward Capriolo
On Mon, Jan 24, 2011 at 5:03 PM, Carl Steinbach c...@cloudera.com wrote: Hi Ed, This seems aggressive. We have 4 open blockers and 68 other issues slated for 0.7.0. Three of the four open blockers involve writing metastore upgrade scripts. I'm willing to assume responsibility for this and

Re: Run CliDriver in Eclipse

2011-01-24 Thread Edward Capriolo
On Mon, Jan 24, 2011 at 4:19 PM, Pei HE pei...@gmail.com wrote: Hi, I am trying to debug Hive in Eclipse. My problem is Hive doesn't work with Hadoop, when the command line is invoked in Eclipse. The version of Hadoop is 0.19.2. There is no problem when I run Hive by

Re: hadoop core 0.20.2 not found

2011-02-07 Thread Edward Capriolo
You do not need to compile against a specific minor (it is a bug in the build process) Try: ant -Dhadoop.version=0.20.0 package The resulting binary will be compatible with 0.20.2 Edward On Mon, Feb 7, 2011 at 3:27 AM, abhinav narain abhinavnarai...@gmail.com wrote: hi,  I have mailed my

Re: hadoop core 0.20.2 not found

2011-02-07 Thread Edward Capriolo
On Mon, Feb 7, 2011 at 10:23 AM, abhinav narain abhinavnarai...@gmail.com wrote: I get the following error about hbase, then ? this is the code recently checked out from svn    Host repository.apache.org not found. url=

Re: hadoop core 0.20.2 not found

2011-02-08 Thread Edward Capriolo
On Tue, Feb 8, 2011 at 5:40 AM, abhinav narain abhinavnarai...@gmail.com wrote: On Mon, Feb 7, 2011 at 11:29 PM, Carl Steinbach c...@cloudera.com wrote: Hi Abhinav, I am using a proxy. I am using cntlm for authentication. I have added localhost:1234 in ANT_OPTS ... as above before

Re: Question about Transform and M/R scripts

2011-02-16 Thread Edward Capriolo
On Wed, Feb 16, 2011 at 5:07 PM, Vijay tec...@gmail.com wrote: Hi, I'm trying this use case: do a simple select from an existing table and pass the results through a reduce script to do some analysis. The table has web logs so the select uses a pseudo user ID as the key and the rest of the

Trying to make sense of build/ql/tmp/hive.log

2011-02-18 Thread Edward Capriolo
It seems that each time the test argument is run hive makes tens hundreds of... 011-02-18 07:46:50,243 WARN zookeeper.ClientCnxn (ClientCnxn.java:run(1120)) - Session 0x12e39732268 for server null, unexpected error, closing socket con nection and attempting reconnect

Re: how to load hive table schema programatically?

2011-03-14 Thread Edward Capriolo
On Mon, Mar 14, 2011 at 3:01 PM, Carl Steinbach c...@cloudera.com wrote: Hi Ed, I'm pretty sure HiveMetaStoreClient is intended to be a public API. On Mon, Mar 14, 2011 at 11:49 AM, Edward Capriolo edlinuxg...@gmail.com wrote: On Mon, Mar 14, 2011 at 2:44 PM, Jae Lee jlee...@gmail.com wrote

Re: skew join optimization

2011-03-20 Thread Edward Capriolo
On Sun, Mar 20, 2011 at 10:30 AM, Ted Yu yuzhih...@gmail.com wrote: Can someone re-attach the missing figures for that wiki ? Thanks On Sun, Mar 20, 2011 at 7:15 AM, bharath vissapragada bharathvissapragada1...@gmail.com wrote: Hi Igor, See

Re: skew join optimization

2011-03-20 Thread Edward Capriolo
On Sun, Mar 20, 2011 at 11:20 AM, Ted Yu yuzhih...@gmail.com wrote: How about link to http://imageshack.us/ or TinyPic ? Thanks On Sun, Mar 20, 2011 at 7:56 AM, Edward Capriolo edlinuxg...@gmail.com wrote: On Sun, Mar 20, 2011 at 10:30 AM, Ted Yu yuzhih...@gmail.com wrote: Can someone re

Re: [VOTE] Hive 0.7.0 Release Candidate 1

2011-03-24 Thread Edward Capriolo
Release looks great many great new features +1. Good work all. On Sun, Mar 20, 2011 at 5:32 AM, Carl Steinbach c...@cloudera.com wrote: Hive 0.7.0 Release Candidate 1 is available here: http://people.apache.org/~cws/hive-0.7.0-candidate-1 We need 3 +1 votes from Hive PMC members in order to

Re: Jira issues

2011-03-30 Thread Edward Capriolo
On Wed, Mar 30, 2011 at 11:59 AM, Lars Francke lars.fran...@gmail.com wrote: HIVE-2085 Document GenericUD(A|T)F. This is the second ticket I have seen calling for more documentation. All tickets like these should be closed instantly unless 1) User wants to write an xdoc or java doc and get

Re: [ANNOUNCE] New Hive Committer - Siying Dong

2011-04-14 Thread Edward Capriolo
Congrats Siying. Great work so far. On Thu, Apr 14, 2011 at 2:30 AM, Namit Jain nj...@fb.com wrote: Hi Folks, The Hive PMC has passed the vote to make Siying Dong a new committer on the Apache Hive project. Following is a list of the contributions that Siying has made to the project:

Re: [REMINDER] Hive Contrib Meeting Today + Preliminary Agenda

2011-04-25 Thread Edward Capriolo
On Mon, Apr 25, 2011 at 2:38 PM, Carl Steinbach c...@cloudera.com wrote: Hi, The April Hive Contributors meeting is convening later today at Facebook. See the Meetup page for more details: http://www.meetup.com/Hive-Contributors-Group/ Here's the preliminary agenda for the meeting: 1)

Re: purging old releases

2011-06-08 Thread Edward Capriolo
I am ok we should keep one pre 20 version around for a while. On Tuesday, June 7, 2011, John Sichi jsi...@fb.com wrote: Apache Infra has asked us to delete from our dist area releases which are no longer under active development: http://www.apache.org/dist/hive/ They suggested deleting

Re: HCatalog-Hive StorageHandler compatibility

2012-03-02 Thread Edward Capriolo
Of the handlers that exist Cassandra outside of tree Hypertable outside of tree Mongo github outside of tree From the way I look at it is if you change the handler interface your patch should fix the only in hive tree hbase handler. As long as the tests keep passing I d not see it as an issue.

Re: Hive 0.8.1 build errors using IBM JAVA

2012-03-05 Thread Edward Capriolo
I am sure you are going to love hearing this since you are from IBM, but there have been a few outstanding issues with Hive and the IBM jvm. I just searched to find one as an example. https://issues.apache.org/jira/browse/HIVE-1686 I am not sure how many users in the wild are running Hive with

Re: Hive projects for Google Summer of code 2012 ?

2012-03-07 Thread Edward Capriolo
For the record we are 0-2 in gsoc. On Wed, Mar 7, 2012 at 1:42 AM, Namit Jain nj...@fb.com wrote: Done On 3/6/12 10:32 PM, bharath vissapragada bharathvissapragada1...@gmail.com wrote: Hi Namit, Is it possible to add Hive-1362 [1] to the list? I am interested in working on that and I've

Re: HWI Interface

2012-03-27 Thread Edward Capriolo
Awesome. Read the hive wiki about adding contributing. Open a jira issue and mark me as a watcher and I will take a look at your patch. On Tue, Mar 27, 2012 at 10:43 AM, Hugo h...@trippaers.nl wrote: Heya all, Completely new to this list, but i've been working with hive for some time now.

Re: Is HiveMetastoreClient a public interface?

2012-03-29 Thread Edward Capriolo
Ideally you want to do everything through the hiveQL language. Calling the read only methods are safe and would be easier/better then Calling 'show tables' and attempting to parse. But I would consider the rest of the interface for experts only. Also this interface can change slightly between

Looking at the columns table

2012-04-11 Thread Edward Capriolo
Hey all. Our metastore in mysql is fairly large over 12GB. All the storage here is the columns table. It seems that each column is stored for each partition/storage descriptor as a one-many relationship. In our case all the partitions have the same column definition. My thinking. Should the

Re: Problems with Arc/Phabricator

2012-04-11 Thread Edward Capriolo
If we are going to switch from fabricator we just might as well go back to not using anything. Review board was really clunky and confusing. Edward On Tue, Apr 10, 2012 at 9:27 PM, Kevin Wilfong kevinwilf...@fb.com wrote: +John Sichi as he did a lot of the work on getting Hive to use

Re: Problems with Arc/Phabricator

2012-04-11 Thread Edward Capriolo
I have arc working on linux. Fedora core 12 I think. On Wed, Apr 11, 2012 at 8:45 PM, Ashutosh Chauhan ashutosh.chau...@gmail.com wrote: Is mac only supported OS ? Arc doesn't work for me on linux, which is unfortunate since thats where I do all my testing. Thanks, Ashutosh On Wed, Apr 11,

Re: Problems with Arc/Phabricator

2012-04-11 Thread Edward Capriolo
. Ashutosh On Wed, Apr 11, 2012 at 11:57, Owen O'Malley omal...@apache.org wrote: On Wed, Apr 11, 2012 at 11:48 AM, Edward Capriolo edlinuxg...@gmail.com wrote: If we are going to switch from fabricator we just might as well go back to not using anything. Review board was really

Re: Problems with Arc/Phabricator

2012-04-19 Thread Edward Capriolo
/ashutosh/work/hive/arcanist/scripts/arcanist.php(266): ArcanistDiffWo in /Users/ashutosh/work/hive/libphutil/src/conduit/client/ConduitFuture.php on line 48 Any ideas how to solve this? Thanks, Ashutosh On Wed, Apr 11, 2012 at 18:37, Edward Capriolo edlinuxg...@gmail.comwrote: I think

Re: [VOTE] Apache Hive 0.9.0 Release Candidate 2

2012-04-25 Thread Edward Capriolo
+1 great work all. On Wed, Apr 25, 2012 at 7:30 PM, John Sichi jsi...@gmail.com wrote: +1 -- Forwarded message -- From: Carl Steinbach c...@cloudera.com Date: Wed, Apr 25, 2012 at 1:00 PM Subject: Re: [VOTE] Apache Hive 0.9.0 Release Candidate 2 To: dev@hive.apache.org

Re: Getting Started with Hive

2012-05-01 Thread Edward Capriolo
I think there is some bug with hive-builtins. It does not get generated until package, but you can not test without it. so you need to do ant package ant test On Mon, Apr 30, 2012 at 10:14 PM, Radhika Malik radhika1...@hotmail.com wrote: A group of us is trying to write some code on Hive as a

Re: Hive projects for Google Summer of code 2012 ?

2012-05-02 Thread Edward Capriolo
I meant 0-2 over the past few years. I was wrong in any case. My bad. On Wed, May 2, 2012 at 2:49 AM, Carl Steinbach c...@cloudera.com wrote: Ed, Did you see this? http://google-melange.appspot.com/gsoc/project/google/gsoc2012/bharathv/29002 On Wed, Mar 7, 2012 at 12:15 PM, Edward Capriolo

Re: Want to give a short talk at the next Hive User Group meetup?

2012-05-23 Thread Edward Capriolo
I can give you a PPT on the upcoming programming hive book that someone else can run thought. but I wont be able to present unless you want to fly me out :) Edward On Tue, May 22, 2012 at 9:28 PM, Carl Steinbach c...@cloudera.com wrote: Hi, I just wanted to remind everyone that the next Hive

Re: [jira] [Commented] (HIVE-2372) java.io.IOException: error=7, Argument list too long

2012-05-26 Thread Edward Capriolo
[junit] Error during job, obtaining debugging information... [junit] diff -a /home/edward/hive/trunk/build/ql/test/logs/clientnegative/script_broken_pipe1.q.out /home/edward/hive/trunk/ql/src/test/results/clientnegative/script_broken_pipe1.q.out [junit] Done query:

Re: perl code generated from thrift

2012-05-29 Thread Edward Capriolo
Hive uses thrift in two places 1) HiveServer 2)Metastore . Search in the metastore directory for the thrift interface file and compile that. Then you should get a class generated for hive_metastore.Schema Edward On Tue, May 29, 2012 at 11:46 AM, Stephen Sprague sprag...@gmail.com wrote: Hi

Re: perl code generated from thrift

2012-05-29 Thread Edward Capriolo
but no subclasses. :( thoughts, ideas, ruminations? Thanks again Ed. Cheers, Stephen On Tue, May 29, 2012 at 9:00 AM, Edward Capriolo edlinuxg...@gmail.comwrote: Hive uses thrift in two places 1) HiveServer 2)Metastore . Search in the metastore directory for the thrift interface file

Re: Behavior of Hive 2837: insert into external tables should not be allowed

2012-06-01 Thread Edward Capriolo
I am a bit confused by this feature too especialyl since hive now has a lock table function. Changing existing semantics would be bad. Different storage handlers actually treat external differently as well. On 6/1/12, Mark Grover grover.markgro...@gmail.com wrote: Hi folks, I have a question

Re: Behavior of Hive 2837: insert into external tables should not be allowed

2012-06-01 Thread Edward Capriolo
(one being the hive access/authorization framework) Edward On 6/1/12, Edward Capriolo edlinuxg...@gmail.com wrote: I am a bit confused by this feature too especialyl since hive now has a lock table function. Changing existing semantics would be bad. Different storage handlers actually treat

distinctlike is documented nowhere at all.

2012-06-02 Thread Edward Capriolo
Yo guys I noticed UDTFType ads a distinctlike. I am trying to document it for programming hive. This was added by hive-1003 http://svn.apache.org/viewvc/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/UDFType.java?view=log

Turn around on patches that do not need full unit testing

2012-06-10 Thread Edward Capriolo
Hive's unit tests take a long time. There are many simple patches we can get into hive earlier if we drop the notion of running the full test suite to QA every patch. For example: https://issues.apache.org/jira/browse/HIVE-3081 -- spelling mistakes that involved types

Re: Turn around on patches that do not need full unit testing

2012-06-11 Thread Edward Capriolo
. Target to make unit test fast. Btw we can run test in parallel a hive wiki has details Thanks Sent from my iPhone On Jun 10, 2012, at 7:29 PM, Edward Capriolo edlinuxg...@gmail.com wrote: Hive's unit tests take a long time. There are many simple patches we can get into hive earlier if we drop

Re: Hive Unit Tests: Read-Only Table

2012-06-12 Thread Edward Capriolo
It seems like your are running unit tests in a non-standard way. It sounds like your are trying to write stand along j-unit tests. Hive uses velocity to turn .q scripts into test and the testing framework diffs the output. You should look at the .q files inside

Re: Hive Unit Tests: Read-Only Table

2012-06-12 Thread Edward Capriolo
QTestUtil.java, however I'm getting the read-only error I described earlier. Do you know how to solve this problem? Thank you! Shefali -Original Message- From: Edward Capriolo [mailto:edlinuxg...@gmail.com] Sent: Tuesday, June 12, 2012 12:01 PM To: dev@hive.apache.org Subject: Re: Hive

Re: Question about documentation for Hive in general

2012-06-12 Thread Edward Capriolo
Lars, Great work. What is it with people named Lars that are into writing documentation? As you may have heard myself and some others (Dean, Jason) are working on the programming hive book. I recently stumbed onto the really amazing thrift raw bytes serde. Who knew that hive table can be

Re: Question about documentation for Hive in general

2012-06-14 Thread Edward Capriolo
The indexes would not make sense on storage handler tables. They attempt to make an index of data-dfs block. Then that information is used to prune blocks from the job, this would not make sense for storage handlers because the data is not directly backed by blocks. Edward On Thu, Jun 14, 2012

Re: Hive List Bucketing - Feature Review

2012-06-14 Thread Edward Capriolo
I am of the opinion this feature is too specialized to be generally helpful. --- The cardinality of 'x' is in 1000's per partition of T. Moreover, there is a skew for the values of 'x'. In general, there are ~10 values of 'x' which have a very large skew, and the

Re: Hive List Bucketing - Feature Review

2012-06-14 Thread Edward Capriolo
instruments skewed key and displays them to user Thanks Tim On 6/14/12 9:34 AM, Edward Capriolo edlinuxg...@gmail.com wrote: I am of the opinion this feature is too specialized to be generally helpful. --- The cardinality of 'x' is in 1000's per partition of T. Moreover

Re: Running unit tests on Windows - Need some suggestions/help to fix exim archive related issues

2012-06-14 Thread Edward Capriolo
ARge windows :) Well '!' is just a shortcut for a process builder. I guess if we were clever enough we could make the escapes more cross platform. It might be better to build udfs that could do this things SELECT RM(/path/to/file) from src limit 1; It would not be pretty but it would be cross

Re: hive.merge properties with RCFile

2012-06-18 Thread Edward Capriolo
This will not work. set hive.merge.size.per.task=28*1024*1024; It has to be a number. On Mon, Jun 18, 2012 at 2:46 PM, Benyi Wang bewang.t...@gmail.com wrote: I try to use Hive merge options to merge the smallfiles into a large files using the following query. It is working well except that I

Re: Test failures : Running HIVE unit test with Hadoop - 1.x

2012-06-21 Thread Edward Capriolo
All indications are most of the things work fine, but we seem to have a steady trickle of compatibility issues slightly after things are released. I can bet your issue is unescaped - in uris On Thu, Jun 21, 2012 at 5:36 PM, Zhenxiao Luo zhenx...@cloudera.com wrote: Hi, I think Carl has a fix

Re: Test failures : Running HIVE unit test with Hadoop - 1.x

2012-06-21 Thread Edward Capriolo
as it is blocking my windows porting work. Thanks, Kanna -Original Message- From: Edward Capriolo [mailto:edlinuxg...@gmail.com] Sent: Thursday, June 21, 2012 2:39 PM To: dev@hive.apache.org Cc: hive-...@hadoop.apache.org Subject: Re: Test failures : Running HIVE unit test with Hadoop

Re: Concurrency in hive

2012-06-22 Thread Edward Capriolo
Almost all operations in hive can exploit map reduce for parallelism. (isnt not really done on the thread level) essentially if you run a hive job and there is multiple mappers or reducers it was parallelism. On Fri, Jun 22, 2012 at 5:14 AM, Jayanth Muthya jayanthmut...@gmail.com wrote: Thanks

Re: Hive CLI wikidoc review

2012-07-24 Thread Edward Capriolo
The xdoc should be removed its dead and out of sync. On Tue, Jul 24, 2012 at 7:21 PM, Lefty Leverenz le...@hortonworks.com wrote: The Hive CLIhttps://cwiki.apache.org/confluence/display/Hive/LanguageManual+Cli wikidoc differs slightly from the xdocs

Re: Custom UDF can not handle constant string parameter

2012-07-25 Thread Edward Capriolo
It depends on how you wrote the UDF. One trick you can do trick hive into thinking it is non-constant: select a column of 0 length and then concat it. SELECT concat(substring(colx),0,0), myUDF(constant string) ) from Now its not constant! On Wed, Jul 25, 2012 at 4:52 PM, Ablimit Aji

Re: Custom UDF can not handle constant string parameter

2012-07-25 Thread Edward Capriolo
markup LIMIT 5; How can I write the correct UDF to achieve original simplicity ? On Wed, Jul 25, 2012 at 5:02 PM, Edward Capriolo edlinuxg...@gmail.comwrote: It depends on how you wrote the UDF. One trick you can do trick hive into thinking it is non-constant: select a column of 0 length

Re: non map-reduce for simple queries

2012-07-28 Thread Edward Capriolo
If where condition is too complex , selecting specific columns seems simple enough and useful. On Saturday, July 28, 2012, Namit Jain nj...@fb.com wrote: Currently, hive does not launch map-reduce jobs for the following queries: select * from T where condition on partition columns (limit n)?

Re: Is HiveMetastoreClient threadsafe?

2012-07-30 Thread Edward Capriolo
From my understand thrift clients are never thread safe as they manipulate the underlying protocol. This is true with Cassandra's thrift client for sure. On Mon, Jul 30, 2012 at 2:25 PM, Francis Liu tof...@apache.org wrote: Hi, We are trying to implement caching of HiveMetastoreClient in

Re: [ANNOUNCE] New Hive Committer - Navis Ryu

2012-08-10 Thread Edward Capriolo
Keep up the good work Navis! Congratulations. Come hang out on #hive irc. Edward On Fri, Aug 10, 2012 at 5:58 AM, John Sichi jsi...@gmail.com wrote: The Apache Hive PMC has passed a vote to make Navis Ryu a new committer on the project. JIRA is currently down, so I can't send out a link with

Re: [VOTE] Apache Hive 0.11.0 Release Candidate 2

2013-05-15 Thread Edward Capriolo
+1 On Wed, May 15, 2013 at 10:44 PM, Ashutosh Chauhan hashut...@apache.orgwrote: +1 Built from sources, ran few unit tests and some simple queries against 1-node cluster. Thanks, Ashutosh On Wed, May 15, 2013 at 5:30 PM, Navis류승우 navis@nexr.com wrote: +1 - built from

Re: admin rights for Hive jira

2013-05-16 Thread Edward Capriolo
While you guys are on the topic, I am on the pmc and I do not think I can edit my own comments. On Thu, May 16, 2013 at 9:50 AM, Xuefu Zhang xzh...@cloudera.com wrote: Hi Carl, As a side question, though not a committer, I expect to be able to assign a JIRA to myself, especially for those

Re: admin rights for Hive jira

2013-05-16 Thread Edward Capriolo
Thanks. I will only use it to correct my typo's. I tend to make many of them. :) On Thu, May 16, 2013 at 11:56 AM, Owen O'Malley omal...@apache.org wrote: On Thu, May 16, 2013 at 7:58 AM, Edward Capriolo edlinuxg...@gmail.com wrote: While you guys are on the topic, I am on the pmc and I do

Supporting an independent build farm

2013-06-16 Thread Edward Capriolo
Hive's unit test suite has gotten larger as we have added more features and thus it takes longer to run. For a single machine duel core with solid state disks I have to start a test run at night, and then check the next morning to see if the run has finished. (I have been running tests for maybe 2

Re: call it Hive-SQL instead of HiveQL ?

2013-07-02 Thread Edward Capriolo
I see that the hive community intends to make hive SQL compliant and is on that path. . I was not under the general impression that we are on that path. Someone once told me that supporting full SQL will result in roughly 4 times the parser and planner code. For me that is not a huge win. Also

Re: call it Hive-SQL instead of HiveQL ?

2013-07-02 Thread Edward Capriolo
types supported (and details of data type support) - If all your friends jumped off a bridge would you do it? If I had to suggest another name for HiveQL. I might call it Almost-SQL++. On Tue, Jul 2, 2013 at 10:19 PM, Thejas Nair the...@hortonworks.com wrote: On Tue, Jul 2, 2013 at 6:52 PM, Edward

Re: call it Hive-SQL instead of HiveQL ?

2013-07-03 Thread Edward Capriolo
motivation and that dictates what they do. That is not our motivation. On Wed, Jul 3, 2013 at 3:26 AM, Thejas Nair the...@hortonworks.com wrote: On Tue, Jul 2, 2013 at 8:39 PM, Edward Capriolo edlinuxg...@gmail.com wrote: What is in a name? :) Which SQL feature you are talking about here

What is CommandNeedRetryException

2013-07-08 Thread Edward Capriolo
No documentation here. Why should one throw it, and what does it mean to the caller?

Tez branch and tez based patches

2013-07-13 Thread Edward Capriolo
I have started to see several re factoring patches around tez. https://issues.apache.org/jira/browse/HIVE-4843 This is the only mention on the hive list I can find with tez: Makes sense. I will create the branch soon. Thanks, Ashutosh On Tue, Jun 11, 2013 at 7:44 PM, Gunther Hagleitner

Re: Tez branch and tez based patches

2013-07-15 Thread Edward Capriolo
at the moment. On Mon, Jul 15, 2013 at 8:37 PM, Alan Gates ga...@hortonworks.com wrote: On Jul 13, 2013, at 9:48 AM, Edward Capriolo wrote: I have started to see several re factoring patches around tez. https://issues.apache.org/jira/browse/HIVE-4843 This is the only mention

Re: Tez branch and tez based patches

2013-07-16 Thread Edward Capriolo
the rest of the community. But assuming the community accepts that Tez is a reasonable direction and there are volunteers who want to do the work, then you can't argue they should work on something else instead. Alan. On Jul 15, 2013, at 6:51 PM, Edward Capriolo wrote: The Hive bylaws, https

Re: Tez branch and tez based patches

2013-07-16 Thread Edward Capriolo
are answered to the satisfaction of the hive developers. On Mon, Jul 15, 2013 at 9:51 PM, Edward Capriolo edlinuxg...@gmail.comwrote: The Hive bylaws, https://cwiki.apache.org/confluence/display/Hive/Bylaws , lay out what votes are needed for what. I don't see anything there about needing 3 +1s

Re: Tez branch and tez based patches

2013-07-17 Thread Edward Capriolo
application, does this mean that Tez will be the first hive feature that will require YARN? (It seems like the answer is yes) On Wed, Jul 17, 2013 at 3:35 PM, Alan Gates ga...@hortonworks.com wrote: Answers to some of your questions inlined. Alan. On Jul 16, 2013, at 10:20 PM, Edward Capriolo

Re: [DISCUSS] moving website to Apache CMS

2013-07-18 Thread Edward Capriolo
I like the idea. markdown is easy to learn. The correct system uses forest which is a big PITA.

Re: [jira] [Commented] (HIVE-2906) Support providing some table properties by user via SQL

2013-07-19 Thread Edward Capriolo
I will be looking at this soon. On Friday, July 19, 2013, Hive QA (JIRA) j...@apache.org wrote: [ https://issues.apache.org/jira/browse/HIVE-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13713621#comment-13713621] Hive QA commented on

Re: Tez branch and tez based patches

2013-07-20 Thread Edward Capriolo
the video you posted and study the material myself as well. On Wed, Jul 17, 2013 at 8:43 PM, Ashutosh Chauhan hashut...@apache.orgwrote: On Wed, Jul 17, 2013 at 1:41 PM, Edward Capriolo edlinuxg...@gmail.com wrote: In my opinion we should limit the amount of tez related optimizations

Re: [DISCUSS] moving website to Apache CMS

2013-07-20 Thread Edward Capriolo
18, 2013 at 7:39 AM, Alexander Alten-Lorenz wget.n...@gmail.com wrote: +1 (non - binding) :) Agree with Ed. Thanks to bringing this to attention, Brock. On Jul 18, 2013, at 7:37 AM, Edward Capriolo edlinuxg...@gmail.com wrote: I like the idea. markdown is easy to learn. The correct

VOTE: moving hive from forest to Apache CMS

2013-07-21 Thread Edward Capriolo
http://hive.apache.org is generated by forest, a rather cumbersome and confusing way to run a website. Forest is difficult to maintain and publish updates with. As a nail in the coffin forest does not even work well with recent versions of java. This vote is to move the site to: Apache

Re: VOTE: moving hive from forest to Apache CMS

2013-07-21 Thread Edward Capriolo
+1 On Sun, Jul 21, 2013 at 1:53 PM, Edward Capriolo edlinuxg...@gmail.comwrote: http://hive.apache.org is generated by forest, a rather cumbersome and confusing way to run a website. Forest is difficult to maintain and publish updates with. As a nail in the coffin forest does not even work

Re: [ANNOUNCE] New Hive Committer - Gunther Hagleitner

2013-07-21 Thread Edward Capriolo
Nice work Gunther on many issues BTW. On Sun, Jul 21, 2013 at 2:25 PM, Mark Grover grover.markgro...@gmail.comwrote: Many congratulations, Gunther! On Sun, Jul 21, 2013 at 10:55 AM, Shreepadma Venugopalan shreepa...@cloudera.com wrote: Congratulations, Gunther! On Sun, Jul 21, 2013

Great progress with the hive pre-commit hive build farm

2013-07-21 Thread Edward Capriolo
We now have a system automatically building and testing patches. Thanks much to Brock and Cloudera for driving this through. https://builds.apache.org/user/brock/my-views/view/hive/job/PreCommit-HIVE-Build/ I can already see by the 30 day summary that this has greatly accelerate the

Re: [DISCUSS] moving website to Apache CMS

2013-07-25 Thread Edward Capriolo
This vote has passed. Carl can you send the request to asf-infrastructure, or is that something anyone can do? On Sat, Jul 20, 2013 at 11:33 AM, Edward Capriolo edlinuxg...@gmail.comwrote: The hive site is not very big how long do you think it will take to move? Does anyone want to take point

[Discuss] project chop up

2013-07-25 Thread Edward Capriolo
I have been developing my laptop on a duel core 2 GB Ram laptop for years now. With the addition of hcatalog, hive-thrift2, and some other growth trying to develop hive in a eclipse on this machine craws, especially if 'build automatically' is turned on. As we look to add on more things this is

Re: [Discuss] project chop up

2013-07-25 Thread Edward Capriolo
I prefer option 3 as well. On Fri, Jul 26, 2013 at 12:52 AM, Brock Noland br...@cloudera.com wrote: On Thu, Jul 25, 2013 at 9:48 PM, Edward Capriolo edlinuxg...@gmail.com wrote: I have been developing my laptop on a duel core 2 GB Ram laptop for years now. With the addition of hcatalog

Re: [Discuss] project chop up

2013-07-26 Thread Edward Capriolo
it in. On Friday, July 26, 2013, Edward Capriolo edlinuxg...@gmail.com wrote: I prefer option 3 as well. On Fri, Jul 26, 2013 at 12:52 AM, Brock Noland br...@cloudera.com wrote: On Thu, Jul 25, 2013 at 9:48 PM, Edward Capriolo edlinuxg...@gmail.com wrote: I have been developing my laptop

Re: Extending Explode

2013-07-26 Thread Edward Capriolo
So the explode output should be in the order of the array or the map you are exploding. I think you could use rank or row-sequence to give the exploded attay a number. If that does not wok adding a new udf might make more sence then extwnding in this case.: On Friday, July 26, 2013,

Re: [Discuss] project chop up

2013-07-26 Thread Edward Capriolo
-metastore, it makes sense to have them in same project. On Fri, Jul 26, 2013 at 6:33 AM, Edward Capriolo edlinuxg...@gmail.com wrote: Also i believe hcatalog web can fall into the same designation. Question , hcatalog was initily a big hive-metastore fork. I was under the impression that Hcat

Re: [Discuss] project chop up

2013-07-27 Thread Edward Capriolo
Hive's jars to compile, so it's one of the last things in the compile step. Would moving the other modules you note to be in the same category be enough? Did you want to also make it so that the default ant target doesn't compile those? Alan. On Jul 26, 2013, at 4:09 PM, Edward Capriolo

hive windowing should not have been committed in it's current state

2013-07-27 Thread Edward Capriolo
I was looking through the function registery today and I noticed this: UDAFS_IMPLY_ORDER.add(rank); UDAFS_IMPLY_ORDER.add(dense_rank); UDAFS_IMPLY_ORDER.add(percent_rank); UDAFS_IMPLY_ORDER.add(cume_dist); UDAFS_IMPLY_ORDER.add(LEAD_FUNC_NAME);

Re: Tez branch and tez based patches

2013-07-29 Thread Edward Capriolo
, at 10:20 PM, Edward Capriolo wrote: There are some points I want to bring up. First, I am on the PMC. Here is something I find relevant: http://www.apache.org/foundation/how-it-works.html -- The role of the PMC from a Foundation perspective is oversight

Re: Tez branch and tez based patches

2013-07-29 Thread Edward Capriolo
night thoughts over, Ed On Tue, Jul 30, 2013 at 12:02 AM, Edward Capriolo edlinuxg...@gmail.comwrote: At ~25:00 There is a working prototype of hive which is using tez as the targeted runtime Can I get a look at that code? Is it on github? Edward On Wed, Jul 17, 2013 at 3:35 PM, Alan

Re: [jira] [Created] (HIVE-4954) PTFTranslator hardcodes ranking functions

2013-07-30 Thread Edward Capriolo
Project: Hive Issue Type: Improvement Reporter: Edward Capriolo Assignee: Edward Capriolo Attachments: HIVE-4879.2.patch.txt, HIVE-4954.1.patch.txt protected static final ArrayListString RANKING_FUNCS = new ArrayListString(); static

Re: [jira] [Created] (HIVE-4844) Add char/varchar data types

2013-07-30 Thread Edward Capriolo
As for the param types. How do we enforce these? If we have a lazy simple serde and a varchar 10 and we are reading a column with 11 chars, what do we do? Maybe we say that char is an alias and we do not actually enforce anything. On Tuesday, July 30, 2013, Xuefu Zhang (JIRA) j...@apache.org

If you change the version of a jar file remember to update eclipse templates

2013-07-30 Thread Edward Capriolo
Remember that you also need to make changes so that eclipse can generate the project correctly. See: Fix eclipse template broken by HIVE-3256 I know its something that you can forget not be aware of, but it just a reminder that it can really screw up someone's work flow if eclipse stops working.

  1   2   3   4   5   6   7   8   9   10   >