RE: [ANNOUNCE] New Committer - Carl Steinbach

2010-11-03 Thread Namit Jain
congrats Carl From: Zheng Shao [zsh...@gmail.com] Sent: Tuesday, November 02, 2010 11:34 PM To: dev@hive.apache.org Subject: Re: [ANNOUNCE] New Committer - Carl Steinbach Congratulations Carl! Zheng On Tue, Nov 2, 2010 at 11:23 AM, Ashish Thusoo

[ANNOUNCE] New Hive Committer - Amareshwari Sriramadasu

2010-11-08 Thread Namit Jain
Hi Folks, The Hive PMC has passed the vote to make Amareshwari Sriramadasu a new committer on the Apache Hive project. Following is a list of the contributions that Amareshwari has made to the project: http://bit.ly/c3z0ty Congratulations Amareshwari. Please send over your CLA to Apache.

RE: Confusing in hive-default.xml

2010-11-09 Thread Namit Jain
It is a typo. Can you file a jira and fix it ? Thanks, -namit -Original Message- From: 김영우 [mailto:warwit...@gmail.com] Sent: Tuesday, November 09, 2010 3:12 AM To: dev@hive.apache.org Subject: Confusing in hive-default.xml Hi, Myabe it is a typo but i'm not sure. Excerpt from

hive roadmap

2010-11-23 Thread Namit Jain
For the interest of the community, we have updated the following page: http://wiki.apache.org/hadoop/Hive/Roadmap If you are planning to work on a task, please add it to the appropriate section. This helps to track the major new features, and also help new contributors to pick up a project.

Re: Issue with map join

2010-12-23 Thread Namit Jain
Can you send the exact query along with the schema of the tables ? On 12/23/10 1:48 AM, jaydeep vishwakarma jaydeep.vishwaka...@mkhoj.com wrote: Hi, I am trying to running some MAPJOIN queries. When I am placing single table in MAP JOIN it works fine,But when I run same query with two tables

Re: patch review process

2011-01-20 Thread Namit Jain
-yongqiang On Wed, Jan 19, 2011 at 6:37 PM, Namit Jain nj...@fb.com wrote: It would be good to have a policy for submitting a new patch for review. If the patch is small, usually it is pretty easy to review.But, if it large, a GUI like reviewboard (https://reviews.apache.org) makes

Re: patch review process

2011-01-20 Thread Namit Jain
and contribution focused environment would be better to encourage people to do more contributions of different kinds. thanks -yongqiang On Wed, Jan 19, 2011 at 6:37 PM, Namit Jain nj...@fb.com wrote: It would be good to have a policy for submitting a new patch for review

Re: The control flow of hive

2011-01-24 Thread Namit Jain
Do you want to do it offline - I mean, insert in a hive table - that will be done parallely using map-reduce. This is a jira on export-import for hive being worked on. It might be simpler to just export the data and import it into another db table. It might take some work to get the format

Re: Scheduling the Hive 0.7.0 Release

2011-01-24 Thread Namit Jain
Before finalizing on the date, let us go over the 68 issues. Based on that, let us come up with a release date. There is no point in having a release with lots of bugs or mostly working features. Don¹t get me wrong - I am very interested in 0.7 release, but don¹t want to hurry up something - a

Re: Query Optimization in Hive

2011-02-01 Thread Namit Jain
Absolutely, that is one direction we are looking into, and none of us has actively started on that. Bharath is planning to start on join-reordering https://issues.apache.org/jira/browse/HIVE-1938. Similar to the above jira, can you file one and we can discuss in more detail in the jira ?

Re: Query regarding Metastore(Derby) SDS table data

2011-02-03 Thread Namit Jain
Different partitions can have different paths - A partition's path need not be a sub-direcotry of the table's path. In facebook, we use this regularly, specially for external tables. So, it simplifies things if the full path is stored for the partition in the metastore. Thanks, -namit On

Re: Review Request: HIVE-2049. Push down partition pruning to JDO filtering for a subset of partition predicates

2011-03-21 Thread namit jain
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/489/#review341 --- trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java

Re: Review Request: HIVE-2049. Push down partition pruning to JDO filtering for a subset of partition predicates

2011-03-21 Thread namit jain
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/489/#review342 --- It would be very useful to have the JDO expression for the table under

Re: Review Request: HIVE-2049. Push down partition pruning to JDO filtering for a subset of partition predicates

2011-03-21 Thread namit jain
On 2011-03-21 13:45:49, namit jain wrote: It would be very useful to have the JDO expression for the table under consideration in the explain plan (extended). The client side logs are very difficult to debug with. - namit

Re: [VOTE] Hive 0.7.0 Release Candidate 1

2011-03-25 Thread Namit Jain
+1 - go ahead On 3/25/11 12:53 PM, John Sichi jsi...@fb.com wrote: +1, ship it! JVS On Mar 20, 2011, at 2:32 AM, Carl Steinbach wrote: Hive 0.7.0 Release Candidate 1 is available here: http://people.apache.org/~cws/hive-0.7.0-candidate-1 We need 3 +1 votes from Hive PMC members in

Re: Review Request: HIVE-2050. batch processing partition pruning process

2011-03-28 Thread namit jain
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/522/#review355 --- mostly minor issues - can you update the patch, and I will try to get

Re: Review Request: HIVE-2082. Reduce memory consumption in preparing MapReduce job

2011-04-06 Thread namit jain
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/556/#review396 --- Also, why should the test outputs be different.

Re: Review Request: HIVE-2107. Log4J initialization info should not be printed out if -S is specified

2011-04-11 Thread namit jain
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/580/#review427 --- Ship it! - namit On 2011-04-11 22:36:06, Ning Zhang wrote:

[ANNOUNCE] New Hive Committer - Siying Dong

2011-04-14 Thread Namit Jain
Hi Folks, The Hive PMC has passed the vote to make Siying Dong a new committer on the Apache Hive project. Following is a list of the contributions that Siying has made to the project: http://bit.ly/goFnzw http://bit.ly/goFnzw Congratulations Siying. Please send over your CLA to Apache.

Re: Review Request: HIVE-2127. Improve stats gathering reliability by retries on failures

2011-04-26 Thread namit jain
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/664/#review570 --- One minor comment: In both statspublisher and statsaggregator, you are

Re: Review Request: Input Sampling Splits

2011-04-28 Thread namit jain
:17) Review request for hive, Ning Zhang and namit jain. Summary --- We need a better input sampling to serve at least two purposes: 1. test their queries against a smaller data set 2. understand more about how the data look like without scanning the whole table. A simple

Re: Review Request: HIVE-2056

2011-05-09 Thread namit jain
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/700/#review651 --- Change hive-default.xml with the new parameter. Add the new parameter

multi cluster suppoort in hive

2012-02-01 Thread Namit Jain
I added a new document: https://cwiki.apache.org/confluence/display/Hive/Hive+across+Multiple+Data+Centers+(Physical+Clusters) for https://issues.apache.org/jira/browse/HIVE-2612 Please comment. Thanks, -namit

Re: Hive projects for Google Summer of code 2012 ?

2012-02-05 Thread Namit Jain
Hi Alexis/Bharath, Great to see your interests. If you looking for ideas, some things that will be very useful are: 1. Removing the map-join hint completely. Moving all processing to runtime. Currently, bucketed map joins and sort merge joins are completely driven off hints. It would be

Re: Thrift build

2012-02-08 Thread Namit Jain
Check out svn+ssh://tubbs/svnhive/hadoop/external/thrift-0.7.0 And set your thrift.home to the above On 2/8/12 12:32 PM, Aniket Mokashi aniket...@gmail.com wrote: Hi, I made some changes to hive_metastore.thrift to add a few new apis. I am trying to generate code with thrift, but I am hitting

partitioned views

2012-02-09 Thread Namit Jain
We found a bug recently, that partitioned views do not have storage descriptors. https://issues.apache.org/jira/browse/HIVE-2795 We will fix this bug, but the existing data needs to be upgraded (if you really care about the describe output of a view partition). It seems fairly difficult to come

Re: Changing defaults for dynamic partitioning and enforced bucketing?

2012-03-02 Thread Namit Jain
I agree with changing the hive.exec.dynamic.partitions. I am not sure about enforcing hive.enforcing.bucketing. It can have a additional cost, which may or may not be needed. If we change this, we should trust the metastore completelely and also change hive.optimize.bucketmapjoin and

Re: Hive projects for Google Summer of code 2012 ?

2012-03-06 Thread Namit Jain
I filed a couple of gsoc 2012 jiras. Please submit your proposal if you are interested. https://issues.apache.org/jira/secure/IssueNavigator.jspa?requestId=1231927 0 Thanks, -namit On 2/7/12 6:32 PM, Alexis De La Cruz Toledo alexis...@gmail.com wrote: Hi Namit Jain, I'm Alexis, I'm

Re: Hive projects for Google Summer of code 2012 ?

2012-03-06 Thread Namit Jain
https://issues.apache.org/jira/secure/IssueNavigator.jspa?requestId=1231927 0 0 was in the next line by mistake Look for HIVE jiras. On 3/6/12 7:37 PM, Alexis De La Cruz Toledo alexis...@gmail.com wrote: Sorry Mr. Namit Jain I can't see the jiras. Thanks El 6 de marzo de 2012 19:41, Namit

Re: Hive projects for Google Summer of code 2012 ?

2012-03-06 Thread Namit Jain
/HIVE-1362 On Wed, Mar 7, 2012 at 6:46 AM, Namit Jain nj...@fb.com wrote: https://issues.apache.org/jira/secure/IssueNavigator.jspa?requestId=12319 27 0 0 was in the next line by mistake Look for HIVE jiras. On 3/6/12 7:37 PM, Alexis De La Cruz Toledo alexis...@gmail.com wrote: Sorry Mr

Re: Automatic/parallel patch testing

2012-03-08 Thread Namit Jain
I won't be able to work on this right now. John, do you have some cycles ? On 3/7/12 9:30 PM, Amareshwari Sri Ramadasu amar...@yahoo-inc.com wrote: +1 for HIVE-1175 -Amareshwari On 3/8/12 3:21 AM, Ashutosh Chauhan hashut...@apache.org wrote: I am very much in favor of

Re: GSOC project for Hive

2012-03-21 Thread Namit Jain
Hi Nitika, I have proposed a few Hive projects on the GSOC. Do you want to add more projects ? What are you exactly looking for - new project ideas, or proposals for existing projects. Thanks, -namit On 3/21/12 3:37 PM, nitika gupta nitika71...@gmail.com wrote: Hi Hive Devs, I am a student

Re: Make hive support various charsets

2012-03-28 Thread Namit Jain
Kai, That would be great. Please file a jura, and submit a patch. We would definitely like to get it for the whole community Thanks, -namit On 3/28/12 8:46 PM, Zhang Kai zhangk1...@gmail.com wrote: Hi all I've been working with hive for some time. In my company, we use hive for querying

Re: ant test fails

2012-04-22 Thread Namit Jain
When you run ant test -Dtestcase=TestCliDriver Which test fails ? Also, can you try running the tests in non-debug mode. I.e Do ant package (Instead of ant -Djavac.debug=on package) -namit On 4/22/12 9:59 PM, Srinivasan Rajivelu srinivasanrajiv...@gmail.com wrote: Hi All, After

new feature in hive: links

2012-05-21 Thread Namit Jain
There is a requirement for a new feature, for which Sambavi has written a detailed overview https://cwiki.apache.org/confluence/display/Hive/Links. We would like to get some core concepts out of it, and implement them in open source hive, so that the whole community gets it. There are new

non-string partition columns

2012-05-24 Thread Namit Jain
http://svn.apache.org/viewvc?view=revisionrevision=1308427 The patch above broke drop partitions if the partition happens to be non-string. This is due to a JDO issue with non-string columns. Is anyone using non-string partition columns ? Should be force the partition columns to be only of type

Re: non-string partition columns

2012-05-25 Thread Namit Jain
Should we disallow non-string partition columns completely ? Does anyone depend on that ? On 5/24/12 6:49 PM, Namit Jain nj...@fb.com wrote: http://svn.apache.org/viewvc?view=revisionrevision=1308427 The patch above broke drop partitions if the partition happens to be non-string. This is due

Re: non-string partition columns

2012-05-25 Thread Namit Jain
://issues.apache.org/jira/browse/HIVE-2702 Is the underlying problem same as the one which I described on that jira ? Thanks, Ashutosh On Thu, May 24, 2012 at 10:59 PM, Namit Jain nj...@fb.com wrote: Should we disallow non-string partition columns completely ? Does anyone depend on that ? On 5/24/12 6:49 PM

Re: non-string partition columns

2012-05-25 Thread Namit Jain
Should I go ahead and file a jira to disallow non-string partition columns ? Or, someone depends on that functionality. On 5/25/12 10:01 AM, Namit Jain nj...@fb.com wrote: Yes, but the meta-question is: Is anyone dependent on non-string partition columns ? Should we drop the support for non

Re: non-string partition columns

2012-05-29 Thread Namit Jain
are a good thing to have - it allows you to do all sorts of date range calculations etc. AFAIK, MySQL's partition columns can be of any type. Phil. On May 26, 2012 7:55 AM, Namit Jain nj...@fb.com wrote: Should I go ahead and file a jira to disallow non-string partition columns

not able to commit

2012-06-01 Thread Namit Jain
There seems to be some problems with my apache account. When I try to reset my password from http://people.apache.org/~joes/jira-hacked.txt And visit https://issues.apache.org/jira/secure/ForgotPassword!default.jspa, I am getting a bad page. Is anyone else running into the same issue ?

test errors

2012-06-11 Thread Namit Jain
I am seeing the following errors on a fresh hive trunk ? [junit] Running org.apache.hadoop.hive.thrift.TestZooKeeperTokenStore [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec [junit] Test org.apache.hadoop.hive.thrift.TestZooKeeperTokenStore FAILED (crashed) Is

Re: Hive Unit Tests: Read-Only Table

2012-06-12 Thread Namit Jain
You cannot change tables which are created by QTestUtil (like src). On 6/12/12 12:34 PM, Shefali Vohra t-sh...@microsoft.com wrote: Fair enough. So (just to make sure) if I need to create a table to run a test, I should do so within the .q file itself? Thanks so much for your help!! Shefali

Re: Lisk Bucketing DDL Patch

2012-07-26 Thread Namit Jain
Note that, we are also planning to use the same syntax for specifying the syntax for skew for optimizing joins. https://cwiki.apache.org/Hive/skewed-join-optimization.html Thanks, -namit On 7/25/12 1:01 PM, Gang Tim Liu g...@fb.com wrote: Dear all hive developers, Please review the

Re: Lisk Bucketing DDL Patch

2012-07-27 Thread Namit Jain
Yes, that patch will become quiet big to be done a single shot. Moreover, the skew information can be used by a variety of use-cases. 1. List Bucketing 2. Skew Joins: https://cwiki.apache.org/Hive/skewed-join-optimization.html 3. Another variant of skew joins:

non map-reduce for simple queries

2012-07-28 Thread Namit Jain
Currently, hive does not launch map-reduce jobs for the following queries: select * from T where condition on partition columns (limit n)? This behavior is not configurable, and cannot be altered. HIVE-2925 wants to extend this behavior. The goal is not to spawn map-reduce jobs for the

Re: non map-reduce for simple queries

2012-07-29 Thread Namit Jain
specific columns seems simple enough and useful. On Saturday, July 28, 2012, Namit Jain nj...@fb.com wrote: Currently, hive does not launch map-reduce jobs for the following queries: select * from T where condition on partition columns (limit n)? This behavior is not configurable

Re: non map-reduce for simple queries

2012-07-29 Thread Namit Jain
This can be a follow-up to HIVE-2925. Navis, if you want, I can work on it. On 7/29/12 7:58 PM, Namit Jain nj...@fb.com wrote: I like Navis's idea. The timeout can be configurable. On 7/29/12 6:47 AM, Navis류승우 navis@nexr.com wrote: I was thinking of timeout for fetching, 2000msec

Re: non map-reduce for simple queries

2012-07-30 Thread Namit Jain
The total number of bytes of the input will be used to determine whether to not launch a map-reduce job for this query. That was in my original mail. However, given any complex where condition and the lack of column statistics in hive, we cannot determine the number of bytes that would be needed

Re: non map-reduce for simple queries

2012-07-31 Thread Namit Jain
On 7/31/12 12:01 PM, Owen O'Malley omal...@apache.org wrote: On Mon, Jul 30, 2012 at 9:12 PM, Namit Jain nj...@fb.com wrote: The total number of bytes of the input will be used to determine whether to not launch a map-reduce job for this query. That was in my original mail. However

Re: non map-reduce for simple queries

2012-07-31 Thread Namit Jain
On 7/31/12 9:23 PM, Owen O'Malley omal...@apache.org wrote: On Mon, Jul 30, 2012 at 11:38 PM, Namit Jain nj...@fb.com wrote: That would be difficult. The % done can be estimated from the data already read. I'm confused. Wouldn't the maximum size of the data remaining over the maximum size

compiling hive on hadoop 23

2012-08-07 Thread Namit Jain
I was trying to add a test case which only works for hadoop 23. However, I got some errors when I tried to compile: I tried the following: ant -Dhadoop.version=0.23.0 -Dhadoop.security.version=0.23.0 -Dhadoop.security.version.prefix=0.23 package ant -Dhadoop.version=0.23.0 package looking

Re: compiling hive on hadoop 23

2012-08-08 Thread Namit Jain
for me. But I don't know exact meaning of it. -navis 2012/8/8 Namit Jain nj...@fb.commailto:nj...@fb.com I was trying to add a test case which only works for hadoop 23. However, I got some errors when I tried to compile: I tried the following: ant -Dhadoop.version=0.23.0 -Dhadoop.security.version

Re: compiling hive on hadoop 23

2012-08-08 Thread Namit Jain
Thanks Navis, with your new ivy.xml - I was able to compile On 8/8/12 12:22 PM, Namit Jain nj...@fb.com wrote: Navis, org.apache.hadoop#hadoop-core;0-23.1 Do you know where is the corresponding jar stored ? I didn't find it in mvn. For now, I can try hardcoding ivy.xml and proceed. -namit

Re: [ANNOUNCE] New Hive Committer - Navis Ryu

2012-08-12 Thread Namit Jain
Congrats Navis On 8/11/12 3:17 AM, Ashutosh Chauhan hashut...@apache.org wrote: Congrats, Navis! Well deserved. Welcome, aboard! Ashutosh On Fri, Aug 10, 2012 at 11:10 AM, Carl Steinbach c...@cloudera.com wrote: Congratulations Navis! This is very well deserved. Looking forward to many more

Re: Review Request: HIVE-3056: Ability to bulk update location field in Db/Table/Partition records

2012-08-22 Thread namit jain
/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java https://reviews.apache.org/r/6650/#comment22717 System.out.println() in hive code seems like a bad idea - namit jain On Aug. 22, 2012, 2:48 a.m., Shreepadma Venugopalan wrote

reduced unit test timings

2013-01-30 Thread Namit Jain
I have noticed that the time taken to run the unit tests has reduced considerably (it has become nearly half) from the last week or so. Just wondering, if anyone else has noticed this too. If yes, does anyone know the root cause of this speedup ? Thanks, -namit

Re: reduced unit test timings

2013-01-30 Thread Namit Jain
MiniMRCliDriver and NegativeMiniMRCliDriver used to remain in hung state for ~10 minutes after all tests have run and minicluster is tearing down. That patch has saved atleast ~15 mins for test runs in my environment. Thanks to Navis for that! Ashutosh On Wed, Jan 30, 2013 at 8:23 PM, Namit Jain nj

Re: [VOTE] Amend Hive Bylaws + Add HCatalog Submodule

2013-01-31 Thread Namit Jain
+1 and +1 On 1/30/13 6:53 AM, Gunther Hagleitner ghagleit...@hortonworks.com wrote: +1 and +1 Thanks, Gunther. On Tue, Jan 29, 2013 at 5:18 PM, Edward Capriolo edlinuxg...@gmail.comwrote: Measure 1: +1 Measure 2: +1 On Mon, Jan 28, 2013 at 2:47 PM, Carl Steinbach c...@apache.org wrote:

Re: branch for ptf and windowing fuction

2013-02-03 Thread Namit Jain
+1 On 2/2/13 11:01 AM, Clark Yang (杨卓荦) yangzhuo...@gmail.com wrote: +1 Cheers, Zhuoluo (Clark) Yang 2013/2/2 Jarek Jarcec Cecho jar...@apache.org +1. Jarcec On Fri, Feb 01, 2013 at 10:11:32AM -0800, Ashutosh Chauhan wrote: Hi all, Harish and Prajkta are doing some cool work over

Re: [VOTE] Graduate HCatalog from the incubator and become part of Hive

2013-02-06 Thread Namit Jain
+1 On 2/5/13 2:54 PM, Alexander Alten-Lorenz wget.n...@gmail.com wrote: +1, non-binding - Alex On Feb 5, 2013, at 10:06 AM, Sushanth Sowmyan khorg...@gmail.com wrote: And my axe! Erm... I mean, my +1. On Mon, Feb 4, 2013 at 10:18 PM, Alan Gates ga...@hortonworks.com wrote: FYI.

ant clean package failing

2013-03-30 Thread Namit Jain
BUILD FAILED /Users/njain/hive/hive_commit3/build.xml:270: The following error occurred while executing this line: /Users/njain/hive/hive_commit3/build.xml:109: The following error occurred while executing this line: /Users/njain/hive/hive_commit3/build.xml:111: The following error occurred

ant clean package failing

2013-03-30 Thread Namit Jain
BUILD FAILED /Users/njain/hive/hive_commit3/build.xml:270: The following error occurred while executing this line: /Users/njain/hive/hive_commit3/build.xml:109: The following error occurred while executing this line: /Users/njain/hive/hive_commit3/build.xml:111: The following error occurred

Re: ant clean package failing

2013-03-30 Thread Namit Jain
, 2013 at 3:22 AM, Namit Jain nj...@fb.com wrote: BUILD FAILED /Users/njain/hive/hive_commit3/build.xml:270: The following error occurred while executing this line: /Users/njain/hive/hive_commit3/build.xml:109: The following error occurred while executing this line: /Users/njain/hive/hive_commit3

Re: Branch for HIVE-4160

2013-04-02 Thread Namit Jain
It will be difficult to merge back the branch. Can you stage your changes incrementally ? I mean, start with the making the operators vectorized - it can be a for loop to start with ? I think it will be very difficult to merge it back if we diverge on this. I would recommend starting with simple

Re: Branch for HIVE-4160

2013-04-03 Thread Namit Jain
, 2013 at 8:37 PM, Namit Jain nj...@fb.com wrote: It will be difficult to merge back the branch. Can you stage your changes incrementally ? I mean, start with the making the operators vectorized - it can be a for loop to start with ? I think it will be very difficult to merge it back if we

Re: Branch for HIVE-4160

2013-04-08 Thread Namit Jain
at that point. We will limit the scope of the work on the branch to just a few operators and primitive datatypes. Does that sound reasonable? regards jitendra On Wed, Apr 3, 2013 at 9:03 PM, Namit Jain nj...@fb.com wrote: There is no right answer, but I feel if you go this path a long way

lots of tests failing

2013-04-09 Thread Namit Jain
It seems that the comments have been removed from the output files, and so a lot of tests are failing. I have not debugged, but https://issues.apache.org/jira/browse/HIVE-1953 looks like the culprit. Navis, is that so ? Are you updating the log files ?

Re: lots of tests failing

2013-04-09 Thread Namit Jain
before doing things. 2013/4/10 Namit Jain nj...@fb.com: It seems that the comments have been removed from the output files, and so a lot of tests are failing. I have not debugged, but https://issues.apache.org/jira/browse/HIVE-1953 looks like the culprit. Navis, is that so ? Are you

hi

2013-04-18 Thread Namit Jain
Hi, Since we are developing at a very fast pace, it would be really useful to think about maintainability and testing of the large codebase. Historically, we have not focussed on a few things, and they might soon bite us. I wanted to propose the following for all checkins: 1. Javadoc for

Re: hi

2013-04-18 Thread Namit Jain
(possibly incompatible) changes. Please note that I'm not suggesting to abandon the *.q file tests, just to also include unit tests for complex methods. Jarcec On Thu, Apr 18, 2013 at 12:31:10PM +, Namit Jain wrote: Hi, Since we are developing at a very fast pace, it would be really useful

Re: hi

2013-04-18 Thread Namit Jain
Having said that, it might be difficult to write unit tests for operator trees. Might take more time initially - so, making it a constraint might slow us down. On 4/18/13 9:41 PM, Brock Noland br...@cloudera.com wrote: Hi, I like the proposal as well! On Thu, Apr 18, 2013 at 10:49 AM, Jarek

Re: Review Request: Support archiving for multiple partitions if the table is partitioned by multiple columns

2011-10-28 Thread namit jain
: https://reviews.apache.org/r/2595/ --- (Updated 2011-10-28 18:28:45) Review request for hive and namit jain. Summary --- Support archiving for multiple partitions if the table is partitioned by multiple columns

Re: Review Request: Use sorted nature of compact indexes

2011-11-01 Thread namit jain
: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/2605/ --- (Updated 2011-10-29 01:39:50) Review request for hive, Yongqiang He, Ning Zhang, and namit jain. Summary --- The CompactIndexHandler determines

Re: Review Request: Use sorted nature of compact indexes

2011-11-01 Thread namit jain
-mail. To reply, visit: https://reviews.apache.org/r/2605/ --- (Updated 2011-10-29 01:39:50) Review request for hive, Yongqiang He, Ning Zhang, and namit jain. Summary --- The CompactIndexHandler determines if the reentrant

Re: Review Request: HIVE-3392 - Review request

2012-09-10 Thread namit jain
no tabs - namit jain On Sept. 11, 2012, 5:10 a.m., Ajesh kumar wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/7004

Re: Review Request: HIVE-3392 - Review request

2012-09-11 Thread namit jain
not sure if it removes the jars also. Can you confirm ? ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java https://reviews.apache.org/r/7004/#comment24425 space after if - namit jain On Sept. 12, 2012, 3:20 a.m., Ajesh kumar wrote

Re: Review Request: HIVE-3495: For UDAFs, when generating a plan without map-side-aggregation, constant agg parameters will be replaced by ExprNodeColumnDesc

2012-09-30 Thread namit jain
are trying - namit jain On Sept. 30, 2012, 8:55 p.m., Yin Huai wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/7221/ --- (Updated

Re: Review Request: HIVE-3495: For UDAFs, when generating a plan without map-side-aggregation, constant agg parameters will be replaced by ExprNodeColumnDesc

2012-10-01 Thread namit jain
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/7221/#review12070 --- Ship it! Ship It! - namit jain On Oct. 1, 2012, 2:35 p.m., Yin

Re: Review Request: HIVE-1362: Support for column statistics in Hive

2012-10-03 Thread namit jain
instead of Rwt ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFComputeStats.java https://reviews.apache.org/r/6878/#comment25820 LHS should not be an arraylist Please fix all such occurences - namit jain On Oct. 3, 2012, 3:10 a.m., Shreepadma Venugopalan wrote

Re: number of buckets in bucket map join

2012-10-31 Thread Namit Jain
The number of mappers is the greater common factor for all the tables. So, it it is not a multiple, a single mapper will be assigned. On 11/1/12 5:20 AM, Mahsa Mofidpoor mofidp...@gmail.com wrote: Hi, Hive summit 2011 says for performing a bucket join the number of buckets of all tables has to

Re: [DISCUSS] HCatalog becoming a subproject of Hive

2012-11-04 Thread Namit Jain
I like the idea of Hcatalog becoming a Hive sub-project. The enhancements/bugs in the serde/metastore areas can indirectly benefit the hive community, and it will be easier for the fix to be in one place. Having said that, I don't see serde/metastore moving out of hive into a separate component.

Re: [DISCUSS] HCatalog becoming a subproject of Hive

2012-11-06 Thread Namit Jain
Alan, that would not be a good idea. Metastore code is part of hive code, and it would be safer if only Hive committers had commit access to that. On 11/6/12 11:25 PM, Alan Gates ga...@hortonworks.com wrote: On Nov 4, 2012, at 8:35 PM, Namit Jain wrote: I like the idea of Hcatalog becoming

Re: hive 0.10 release

2012-11-07 Thread Namit Jain
+1 to the idea On 11/8/12 6:33 AM, Edward Capriolo edlinuxg...@gmail.com wrote: That sounds good. I think this issue needs to be solved as well as anything else that produces a bugus query result. https://issues.apache.org/jira/browse/HIVE-3083 Edward On Wed, Nov 7, 2012 at 7:50 PM, Ashutosh

Re: [DISCUSS] HCatalog becoming a subproject of Hive

2012-11-14 Thread Namit Jain
with access to the metastore. And the Hive PMC is there to assure this does not happen. If there are issues I am sure they can deal with them. Alan. On Nov 6, 2012, at 8:06 PM, Namit Jain wrote: Alan, that would not be a good idea. Metastore code is part of hive code, and it would be safer

Re: Top-K optimization

2012-11-19 Thread Namit Jain
Hi Siva, Take a look at https://issues.apache.org/jira/browse/HIVE-3562. It is in my todo list, but I have not been able to review this. I think, this addresses a very similar problem. If yes, can you also review the above patch ? Thanks, -namit On 11/19/12 3:10 PM, Sivaramakrishnan

Re: Transform.java Vs. PhysicalPlanResolver.java

2012-11-27 Thread Namit Jain
Optimizations in the Transform take the operator tree and transform that into a new operator tree. Then the operator tree is broken into various tasks. Physical optimizer takes a task and optimizes/changes the task. Both these optimizations are done at compile time. There is nothing like a

Re: [DISCUSS] HCatalog becoming a subproject of Hive

2012-12-19 Thread Namit Jain
earlier, I think this would also help to assuage the concerns of many Hive committers who don't want to see the MetaStore split out into a separate project. Thanks. Carl On Thu, Dec 13, 2012 at 7:59 PM, Namit Jain nj...@fb.com wrote: I am fine with this. Any hive committers who wants

Re: write access to the Hive wiki?

2013-01-02 Thread Namit Jain
What is your id ? On 1/3/13 1:18 AM, Sean Busbey bus...@cloudera.com wrote: Hi All! Could I have write access to the Hive wiki? I'd like to fix some documentation errors. The most immediate is the Avro SerDe page, which contains incorrect table creation statements. -- Sean

running apache jenkins build on hadoop 23

2013-01-06 Thread Namit Jain
I forgot who had setup apache jenkins build for all hive checkins. These tests are Currently running on hadoop 20. It would be really useful if these tests can also be run on hadoop 23 – we have added a lot of tests recently, which only work on hadoop 23.

Re: running apache jenkins build on hadoop 23

2013-01-08 Thread Namit Jain
://builds.apache.org/job/hive-trunk-hadoop1/ Enjoy, Ashutosh On Sun, Jan 6, 2013 at 10:56 PM, Namit Jain nj...@fb.com wrote: I forgot who had setup apache jenkins build for all hive checkins. These tests are Currently running on hadoop 20. It would be really useful if these tests can also

Re: [VOTE] Apache Hive 0.10.0 Release Candidate 0

2013-01-08 Thread Namit Jain
+1 Build from src. Ran some sanity tests both from bin and compiled src - they looked good On 12/27/12 3:08 AM, Ashutosh Chauhan ashutosh.chau...@gmail.com wrote: +1 Built from sources. Ran unit tests. All looked good. Thanks, Ashutosh On Fri, Dec 21, 2012 at 2:25 PM, Alan Gates

Re: running apache jenkins build on hadoop 23

2013-01-09 Thread Namit Jain
://builds.apache.org/job/hive-trunk-hadoop1/ Enjoy, Ashutosh On Sun, Jan 6, 2013 at 10:56 PM, Namit Jain nj...@fb.com wrote: I forgot who had setup apache jenkins build for all hive checkins. These tests are Currently running on hadoop 20. It would be really useful if these tests can also be run on hadoop 23

[jira] Commented: (HIVE-1667) Store the group of the owner of the table in metastore

2010-10-08 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12919351#action_12919351 ] Namit Jain commented on HIVE-1667: -- Not in CREATE TABLE, but Hive should let the user

[jira] Commented: (HIVE-1641) add map joined table to distributed cache

2010-10-08 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12919408#action_12919408 ] Namit Jain commented on HIVE-1641: -- As discussed offline, need to move the task from local

[jira] Commented: (HIVE-307) LOAD DATA LOCAL INPATH fails when the table already contains a file of the same name

2010-10-08 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12919410#action_12919410 ] Namit Jain commented on HIVE-307: - Looks good - I will start the tests LOAD DATA LOCAL

[jira] Commented: (HIVE-1699) incorrect partition pruning ANALYZE TABLE

2010-10-12 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12920343#action_12920343 ] Namit Jain commented on HIVE-1699: -- @Paul, are you working on optimizing

[jira] Assigned: (HIVE-1709) Provide Postgres metastore schema migration scripts (0.5 - 0.6)

2010-10-13 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain reassigned HIVE-1709: Assignee: Yuanjun Li Provide Postgres metastore schema migration scripts (0.5 - 0.6

[jira] Updated: (HIVE-1709) Provide Postgres metastore schema migration scripts (0.5 - 0.6)

2010-10-13 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-1709: - Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available

[jira] Commented: (HIVE-1711) CREATE TABLE LIKE should not set stats in the new table

2010-10-15 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12921549#action_12921549 ] Namit Jain commented on HIVE-1711: -- The code changes look good CREATE TABLE LIKE should

  1   2   3   4   5   6   7   8   9   10   >