[jira] Updated: (HIVE-307) "LOAD DATA LOCAL INPATH" fails when the table already contains a file of the same name

2010-09-17 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo updated HIVE-307: --- Status: Open (was: Patch Available) Assignee: Kirk True Cancelling the patch because of a

[jira] Commented: (HIVE-307) "LOAD DATA LOCAL INPATH" fails when the table already contains a file of the same name

2010-09-17 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12910799#action_12910799 ] Ashish Thusoo commented on HIVE-307: Hi Kirk, Thanks for the contribution. Can you

RE: [VOTE] Hive as a TLP

2010-08-30 Thread Ashish Thusoo
26, 2010 at 1:01 PM, Ashish Thusoo wrote: > The Hive development community voted and passed the following > resolution. The details of the vote is at > > http://www.bit.ly/aJogyU > > The PMC will comprise of the current committers on Hive (as of 8/24/2010) > with Namit

RE: [VOTE] Draft Resolution to make Hive a TLP

2010-08-26 Thread Ashish Thusoo
;>>> >>>> >>>> From: Ning Zhang [nzh...@facebook.com] >>>> Sent: Tuesday, August 24, 2010 9:18 PM >>>> To: >>>> Subject: Re: [VOTE] Draft Resolution to make Hive a TLP >>>> &

[VOTE] Draft Resolution to make Hive a TLP

2010-08-24 Thread Ashish Thusoo
* Prasad Chakka (pras...@apache.org) * Joydeep Sen Sarma (jsensa...@apache.org) * Ashish Thusoo (athu...@apache.org) NOW, THEREFORE, BE IT FURTHER RESOLVED, that Namit Jain be appointed to the office of Vice President, Apache Hive, to ser

[DISCUSS] Hive as TLP

2010-08-20 Thread Ashish Thusoo
The Hive subproject has voted to become a TLP http://bit.ly/9nb4nN Does the Hadoop community have any questions or concerns on this? I will be calling a more formal vote after this discussion. The Hive dev community is still dominated by Facebook but the community is working hard to diversify

RE: [DISCUSSION] Move to become a TLP

2010-08-20 Thread Ashish Thusoo
; On Aug 14, 2010, at 4:42 PM, Jeff Hammerbacher wrote: > >> > >>> Yes, I think Hive is ready to become a TLP. > >>> > >>> On Fri, Aug 13, 2010 at 1:36 PM, Ashish Thusoo > >>> > wrote: > >>> > >>>> Ni

RE: [DISCUSSION] Move to become a TLP

2010-08-13 Thread Ashish Thusoo
, August 12, 2010 8:05 AM To: hive-dev@hadoop.apache.org Subject: Re: [DISCUSSION] Move to become a TLP On Wed, Aug 11, 2010 at 9:15 PM, Ashish Thusoo wrote: > Folks, > > This question has come up in the PMC once again and would be great to hear > once more on this topic. What do people t

[DISCUSSION] Move to become a TLP

2010-08-11 Thread Ashish Thusoo
Folks, This question has come up in the PMC once again and would be great to hear once more on this topic. What do people think? Are we ready to become a TLP? Thanks, Ashish

RE: Hive Web Interface Broken YET AGAIN!

2010-07-29 Thread Ashish Thusoo
Can you point to the JIRA that introduced this problem? Ashish -Original Message- From: Edward Capriolo [mailto:edlinuxg...@gmail.com] Sent: Thursday, July 29, 2010 7:38 AM To: Subject: Hive Web Interface Broken YET AGAIN! All, While the web interface is not as widely used as the cli

RE: [howldev] Initial thoughts on authorization in howl

2010-07-29 Thread Ashish Thusoo
Hi Pradeep, I get from this note that the authorization that you are talking about here are basically the management of the permissions on the hdfs directories corresponding to the tables and the partitions. So from that angle this sounds good to me. There is a whole set of permissions/authoriz

RE: Hive should start moving to the new hadoop mapreduce api.

2010-07-29 Thread Ashish Thusoo
api. Maybe we should decide hive-0.7 as the last branch to support hadoop pre-0.20 API and later branches of Hive will be switched to the new hadoop API? On Jul 29, 2010, at 11:53 AM, Ashish Thusoo wrote: > Yes these are mutually exclusive. > > Ashish > > -Original Mess

RE: Hive should start moving to the new hadoop mapreduce api.

2010-07-29 Thread Ashish Thusoo
ually exclusive? The new Map Reduce API appeared in 20. Deprecating 17 seems reasonable, but we still have to support the old api for 18 and 19 correct? On Thu, Jul 29, 2010 at 2:11 PM, Ashish Thusoo wrote: > +1 to this > > Ashish > > -Original Message- > From: yongqiang

RE: Hive should start moving to the new hadoop mapreduce api.

2010-07-29 Thread Ashish Thusoo
+1 to this Ashish -Original Message- From: yongqiang he [mailto:heyongqiang...@gmail.com] Sent: Thursday, July 29, 2010 10:54 AM To: hive-dev@hadoop.apache.org Subject: Hive should start moving to the new hadoop mapreduce api. Hi all, In offline discussions when we fixing HIVE-1492, we

[jira] Commented: (HIVE-417) Implement Indexing in Hive

2010-07-27 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12892939#action_12892939 ] Ashish Thusoo commented on HIVE-417: Also, how is the file name populated? That is

[jira] Commented: (HIVE-417) Implement Indexing in Hive

2010-07-27 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12892932#action_12892932 ] Ashish Thusoo commented on HIVE-417: Started looking at this. One initial question I

[jira] Commented: (HIVE-1264) Make Hive work with Hadoop security

2010-07-26 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12892517#action_12892517 ] Ashish Thusoo commented on HIVE-1264: - Can these changes be packed in the shims l

[jira] Assigned: (HIVE-1264) Make Hive work with Hadoop security

2010-07-26 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo reassigned HIVE-1264: --- Assignee: Venkatesh S > Make Hive work with Hadoop secur

[jira] Created: (HIVE-1449) Table aliases in order by clause lead to semantic analysis failure

2010-07-02 Thread Ashish Thusoo (JIRA)
Components: Query Processor Reporter: Ashish Thusoo Assignee: Ashish Thusoo Fix For: 0.7.0 A simple statement of the form select a.account_id, count(1) from tmp_ash_test2 a group by a.account_id order by a.account_id; throws a sematic analysis

[jira] Commented: (HIVE-287) count distinct on multiple columns does not work

2010-07-02 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12884699#action_12884699 ] Ashish Thusoo commented on HIVE-287: @John Another disadvantage for doing C that I

[jira] Commented: (HIVE-417) Implement Indexing in Hive

2010-07-02 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12884685#action_12884685 ] Ashish Thusoo commented on HIVE-417: Looked at the code and have some questions...

[jira] Commented: (HIVE-1428) ALTER TABLE ADD PARTITION fails with a remote Thirft metastore

2010-07-01 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12884401#action_12884401 ] Ashish Thusoo commented on HIVE-1428: - Is your question the fact that build.dir i

RE: predicate pushdown, HIVE-1395, and HIVE-1342

2010-06-28 Thread Ashish Thusoo
I will look into those. Ashish -Original Message- From: John Sichi [mailto:jsi...@facebook.com] Sent: Monday, June 28, 2010 4:54 PM To: hive-dev@hadoop.apache.org Subject: predicate pushdown, HIVE-1395, and HIVE-1342 Could the person who originally developed predicate pushdown take a lo

[jira] Updated: (HIVE-1271) Case sensitiveness of type information specified when using custom reducer causes type mismatch

2010-06-25 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo updated HIVE-1271: Status: Resolved (was: Patch Available) Resolution: Fixed Committed. Thanks Arvind

[jira] Commented: (HIVE-1271) Case sensitiveness of type information specified when using custom reducer causes type mismatch

2010-06-23 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12881998#action_12881998 ] Ashish Thusoo commented on HIVE-1271: - I have committed this to trunk and will co

RE: 6.0 and trunk look broken to me

2010-06-23 Thread Ashish Thusoo
Not sure if this is just my env but on 0.6.0 when I run the unit tests I get a bunch of errors of the following form: [junit] Begin query: alter3.q [junit] java.lang.NoSuchFieldError: HIVESESSIONSILENT [junit] at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:1052

[jira] Commented: (HIVE-1271) Case sensitiveness of type information specified when using custom reducer causes type mismatch

2010-06-23 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12881767#action_12881767 ] Ashish Thusoo commented on HIVE-1271: - sounds good to me. Thanks for the explanat

[jira] Commented: (HIVE-1364) Increase the maximum length of SERDEPROPERTIES values (currently 767 characters)

2010-06-22 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12881324#action_12881324 ] Ashish Thusoo commented on HIVE-1364: - Also why do we make everything 4000 bytes

[jira] Commented: (HIVE-1271) Case sensitiveness of type information specified when using custom reducer causes type mismatch

2010-06-22 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12881319#action_12881319 ] Ashish Thusoo commented on HIVE-1271: - Looks good to me. However, why remove the c

[jira] Commented: (HIVE-1271) Case sensitiveness of type information specified when using custom reducer causes type mismatch

2010-06-22 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12881306#action_12881306 ] Ashish Thusoo commented on HIVE-1271: - I am looking at this. > Case sensitive

RE: Vertical partitioning

2010-06-17 Thread Ashish Thusoo
If you are querying this data again and again you could just create another table which has only those 10 columns (more like a materialized view approach - though that is not there in Hive yet.) This ofcourse uses up some space as compared to vertical partitioning but if the rcfile performance i

Release Management for 0.6.0

2010-06-15 Thread Ashish Thusoo
Hi Folks, In order to be able to release Hive more often, we are going to have a formal release manager for upcoming releases. Our goal would be to release Hive more often than once in 6 months so that we can get more and more features pushed out with a greater frequency to a stable and well te

RE: how to set the debut parameters of hive?

2010-06-11 Thread Ashish Thusoo
I think if you just pass the java parameters on the command line it should just work. So bin/hive And your parameters. I have not tried it though, mostly I am just able to debug using eclipse (you can create the related eclipse files by doing cd metastore ant model-jar cd .. ant eclipse-fi

[jira] Commented: (HIVE-417) Implement Indexing in Hive

2010-06-09 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12877236#action_12877236 ] Ashish Thusoo commented on HIVE-417: A couple of comments on this: A complication

[jira] Created: (HIVE-1398) Support union all without an outer select *

2010-06-09 Thread Ashish Thusoo (JIRA)
Reporter: Ashish Thusoo Assignee: Ashish Thusoo In hive for union alls the query has to be wrapped in an sub query as shown below: select * from (select c1 from t1 union all select c2 from t2); This JIRA proposes to fix that to support select c1 from t1 union all

[jira] Commented: (HIVE-1139) GroupByOperator sometimes throws OutOfMemory error when there are too many distinct keys

2010-06-09 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12877232#action_12877232 ] Ashish Thusoo commented on HIVE-1139: - Arvind, I thought the whole point of this

[jira] Commented: (HIVE-1397) histogram() UDAF for a numerical column

2010-06-09 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12877233#action_12877233 ] Ashish Thusoo commented on HIVE-1397: - +1. This would be a cool contribu

[jira] Updated: (HIVE-1373) Missing connection pool plugin in Eclipse classpath

2010-06-09 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo updated HIVE-1373: Status: Resolved (was: Patch Available) Hadoop Flags: [Reviewed] Fix Version/s

[jira] Commented: (HIVE-1369) LazySimpleSerDe should be able to read classes that support some form of toString()

2010-05-28 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12872997#action_12872997 ] Ashish Thusoo commented on HIVE-1369: - I I do not see any drawbacks here. I t

[jira] Commented: (HIVE-1371) remove blank in rcfilecat

2010-05-28 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12872995#action_12872995 ] Ashish Thusoo commented on HIVE-1371: - +1. Will commit. > remove blank in rc

[jira] Updated: (HIVE-1371) remove blank in rcfilecat

2010-05-28 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo updated HIVE-1371: Status: Patch Available (was: Open) Hi Yongqiang, Please do a submit patch when putting up a

[jira] Commented: (HIVE-1265) Function Registry should should auto-detect UDFs from UDF Description

2010-05-28 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12872993#action_12872993 ] Ashish Thusoo commented on HIVE-1265: - Can you explain more what you mean by i

[jira] Commented: (HIVE-1359) Unit test should be shim-aware

2010-05-28 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12872990#action_12872990 ] Ashish Thusoo commented on HIVE-1359: - +1 to all the great suggestions in

[jira] Assigned: (HIVE-1372) New algorithm for variance() UDAF

2010-05-28 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo reassigned HIVE-1372: --- Assignee: Mayank Lahiri Also I have added you as a contributor, so you should be able to

[jira] Updated: (HIVE-1372) New algorithm for variance() UDAF

2010-05-28 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo updated HIVE-1372: Status: Patch Available (was: Open) Hi Mayank, Thanks for the contribution. Please do a submit

[jira] Commented: (HIVE-1374) Query compile-only option

2010-05-28 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12872981#action_12872981 ] Ashish Thusoo commented on HIVE-1374: - Is doing explain on the query enough? If

[jira] Commented: (HIVE-1375) dynamic partitions should not create some of the partitions if the query fails

2010-05-28 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12872976#action_12872976 ] Ashish Thusoo commented on HIVE-1375: - An example would be great to help explain

[jira] Commented: (HIVE-1346) Table column name changed to _col1,_col2 ..._coln when where clause used in the select quert statement

2010-05-28 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12872975#action_12872975 ] Ashish Thusoo commented on HIVE-1346: - @Namit, in what cases would colAlias eve

[jira] Commented: (HIVE-1346) Table column name changed to _col1,_col2 ..._coln when where clause used in the select quert statement

2010-05-28 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12872968#action_12872968 ] Ashish Thusoo commented on HIVE-1346: - Hi Sunil, Have you created this patch on 0

[jira] Assigned: (HIVE-1346) Table column name changed to _col1,_col2 ..._coln when where clause used in the select quert statement

2010-05-28 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo reassigned HIVE-1346: --- Assignee: Sunil Kumar > Table column name changed to _col1,_col2 ..._coln when where cla

[jira] Commented: (HIVE-1368) Hive JDBC Integration with SQuirrel SQL Client support Enhanced

2010-05-28 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12872965#action_12872965 ] Ashish Thusoo commented on HIVE-1368: - In my opinion best would be to load this p

[jira] Assigned: (HIVE-1368) Hive JDBC Integration with SQuirrel SQL Client support Enhanced

2010-05-28 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo reassigned HIVE-1368: --- Assignee: Sunil Kumar Sunil, I have added you as a contributor so you can assign JIRAs to

[jira] Commented: (HIVE-1373) Missing connection pool plugin in Eclipse classpath

2010-05-28 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12872962#action_12872962 ] Ashish Thusoo commented on HIVE-1373: - 1 copy is anyway done from lib to dist/lib

[jira] Commented: (HIVE-80) Allow Hive Server to run multiple queries simulteneously

2010-05-27 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-80?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12872240#action_12872240 ] Ashish Thusoo commented on HIVE-80: --- yes I think what Ning is saying is correct. We sh

[jira] Commented: (HIVE-802) Bug in DataNucleus prevents Hive from building if inside a dir with '+' in it

2010-05-27 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12872238#action_12872238 ] Ashish Thusoo commented on HIVE-802: Should we just mark this as a duplicate of 117

[jira] Commented: (HIVE-1373) Missing connection pool plugin in Eclipse classpath

2010-05-27 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12872237#action_12872237 ] Ashish Thusoo commented on HIVE-1373: - +1. Looks good to me. I think in futur

[jira] Assigned: (HIVE-1373) Missing connection pool plugin in Eclipse classpath

2010-05-27 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo reassigned HIVE-1373: --- Assignee: Vinithra Varadharajan Have added you to the contributors so you should be able to

[jira] Updated: (HIVE-1347) Create Pre Task hooks for Hive

2010-05-18 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo updated HIVE-1347: Attachment: HIVE-1347.patch A prelimnary patch for this. Take a look at the PreTask.java interface

[jira] Created: (HIVE-1347) Create Pre Task hooks for Hive

2010-05-17 Thread Ashish Thusoo (JIRA)
: Ashish Thusoo Assignee: Ashish Thusoo Create pre task hooks for hive which can modify configuration parameters or task plans. This is very useful for implementing a number of different execution policies such as 1. Sending jobs that work on small data sets to a different cluster. 2

[jira] Updated: (HIVE-1320) NPE with lineage in a query of union alls on joins.

2010-04-22 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo updated HIVE-1320: Status: Patch Available (was: Open) Affects Version/s: 0.6.0 Fix Version/s

[jira] Updated: (HIVE-1320) NPE with lineage in a query of union alls on joins.

2010-04-22 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo updated HIVE-1320: Attachment: HIVE-1320.patch Fixed the NPE. The cause was that we were not checking for inp_dep to

[jira] Created: (HIVE-1320) NPE with lineage in a query of union alls on joins.

2010-04-22 Thread Ashish Thusoo (JIRA)
Processor Reporter: Ashish Thusoo Assignee: Ashish Thusoo The following query generates a NPE in the lineage ctx code EXPLAIN INSERT OVERWRITE TABLE dest_l1 SELECT j.* FROM (SELECT t1.key, p1.value FROM src1 t1 LEFT OUTER JOIN src p1 ON (t1.key = p1.key

[jira] Commented: (HIVE-987) Hive CLI Omnibus Improvement ticket

2010-04-22 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12859956#action_12859956 ] Ashish Thusoo commented on HIVE-987: I am +1 on this. I think this can open up

RE: [DISCUSSION] To be (or not to be) a TLP - that is the question

2010-04-22 Thread Ashish Thusoo
a TLP and nowhere have a seen how this would benefit Hive. Any thoughts on that? Ashish From: Jeff Hammerbacher [mailto:ham...@cloudera.com] Sent: Wednesday, April 21, 2010 7:35 PM To: hive-dev@hadoop.apache.org Cc: Ashish Thusoo Subject: Re: [DISCUSSION] To be

[DISCUSSION] To be (or not to be) a TLP - that is the question

2010-04-19 Thread Ashish Thusoo
Hi Folks, Recently Apache Board asked the Hadoop PMC if some sub projects can become top level projects. In the opinion of the board, big umbrella projects make it difficult to monitor the health of the communities within the sub projects. If Hive does become a TLP, then we would have to elect

[jira] Commented: (HIVE-1293) Concurreny Model for Hive

2010-04-14 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857110#action_12857110 ] Ashish Thusoo commented on HIVE-1293: - I would vote for versioning. Since we do

[jira] Updated: (HIVE-1131) Add column lineage information to the pre execution hooks

2010-04-05 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo updated HIVE-1131: Attachment: HIVE-1131_8.patch Another one with test fixes. > Add column lineage information

[jira] Updated: (HIVE-1131) Add column lineage information to the pre execution hooks

2010-04-02 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo updated HIVE-1131: Release Note: This changes the signature of PostExecute.java Hadoop Flags: [Incompatible change

[jira] Updated: (HIVE-1131) Add column lineage information to the pre execution hooks

2010-04-02 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo updated HIVE-1131: Attachment: HIVE-1131_7.patch Another patch which fixes the QueryPlan to have LinkedHashMaps as

[jira] Updated: (HIVE-1131) Add column lineage information to the pre execution hooks

2010-04-02 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo updated HIVE-1131: Attachment: HIVE-1131_6.patch With fixes to tests and with null dropped. > Add column line

[jira] Updated: (HIVE-1131) Add column lineage information to the pre execution hooks

2010-03-31 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo updated HIVE-1131: Attachment: HIVE-1131_5.patch Added a more centralized function to decide what is the dependency

[jira] Commented: (HIVE-1131) Add column lineage information to the pre execution hooks

2010-03-31 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12852013#action_12852013 ] Ashish Thusoo commented on HIVE-1131: - I looked at the ExecutionCtx stuff. There

[jira] Commented: (HIVE-1131) Add column lineage information to the pre execution hooks

2010-03-30 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12851674#action_12851674 ] Ashish Thusoo commented on HIVE-1131: - Look at the DataContainer class. That h

RE: [ANNOUNCEMENT] Contributor Workshop at Yahoo!

2010-03-25 Thread Ashish Thusoo
Sounds like a good idea to me. If anyone @FB wants to join, maybe they could do it with you. Ashish -Original Message- From: Carl Steinbach [mailto:c...@cloudera.com] Sent: Thursday, March 25, 2010 2:09 PM To: hive-dev@hadoop.apache.org Subject: Re: [ANNOUNCEMENT] Contributor Workshop

[jira] Updated: (HIVE-1131) Add column lineage information to the pre execution hooks

2010-03-25 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo updated HIVE-1131: Attachment: HIVE-1131_4.patch This patch has all the tests updated as well. > Add column line

[jira] Commented: (HIVE-1131) Add column lineage information to the pre execution hooks

2010-03-25 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12849633#action_12849633 ] Ashish Thusoo commented on HIVE-1131: - Also I did not find any instance of S3 in

[jira] Updated: (HIVE-1131) Add column lineage information to the pre execution hooks

2010-03-25 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo updated HIVE-1131: Attachment: HIVE-1131_3.patch This fixes all the review comments. Will post the patch with tests

[jira] Commented: (HIVE-1131) Add column lineage information to the pre execution hooks

2010-03-25 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12849624#action_12849624 ] Ashish Thusoo commented on HIVE-1131: - Comment 3 from Raghu and comment S2-S4

[jira] Updated: (HIVE-1131) Add column lineage information to the pre execution hooks

2010-03-25 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo updated HIVE-1131: Attachment: HIVE-1131_2.patch Patch with all the review comments incorporated. This is just the

[jira] Commented: (HIVE-1176) 'create if not exists' fails for a table name with 'select' in it

2010-02-18 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12835324#action_12835324 ] Ashish Thusoo commented on HIVE-1176: - my bad. There is already a test

[jira] Commented: (HIVE-1176) 'create if not exists' fails for a table name with 'select' in it

2010-02-18 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12835323#action_12835323 ] Ashish Thusoo commented on HIVE-1176: - Can you provide a reproducible test case

[jira] Commented: (HIVE-1117) Make QueryPlan serializable

2010-02-12 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12833117#action_12833117 ] Ashish Thusoo commented on HIVE-1117: - What would be the advantage to use Avro here

[jira] Commented: (HIVE-1123) Checkstyle fixes

2010-02-04 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12829816#action_12829816 ] Ashish Thusoo commented on HIVE-1123: - Apart from the indentation of throws claus

[jira] Updated: (HIVE-1131) Add column lineage information to the pre execution hooks

2010-02-04 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo updated HIVE-1131: Attachment: HIVE-1131.patch This is just the source patch. Will publish the test patch soon. >

[jira] Created: (HIVE-1131) Add column lineage information to the pre execution hooks

2010-02-03 Thread Ashish Thusoo (JIRA)
Components: Query Processor Reporter: Ashish Thusoo Assignee: Ashish Thusoo We need a mechanism to pass the lineage information of the various columns of a table to a pre execution hook so that applications can use that for: - auditing - dependency checking and many other

RE: HIVE-49 and other forms of CLI niceness

2010-01-27 Thread Ashish Thusoo
Looks like a good suggestion. Ideally the driver code should just return a structure that encodes the columns separately as opposed to a single serialized string today and the formatting logic should all be in the CliDriver Ashish -Original Message- From: Edward Capriolo [mailto:edlinu

RE: Hive in maven

2010-01-22 Thread Ashish Thusoo
Yes you should open a JIRA for this. Ashish -Original Message- From: Gerrit [mailto:gvanvuu...@specificmedia.com] Sent: Friday, January 22, 2010 7:33 AM To: hive-dev@hadoop.apache.org Subject: Re: Hive in maven Hi, Yes I'll start on creating the pom.xml The fastest and recommended wa

RE: Unit test result depends on platform.

2010-01-19 Thread Ashish Thusoo
Can you file a JIRA and give us the unit tests that fail. That would be very helpful. I suspect some of the test queries may be missing a sort by predicate so they could have different sort orders as compared to the expected output. Ashish -Original Message- From: Mafish Liu [mailto:ma

RE: New Hive committer Ning Zhang

2010-01-11 Thread Ashish Thusoo
Congrats!! Ashish -Original Message- From: Zheng Shao [mailto:zsh...@gmail.com] Sent: Monday, January 11, 2010 11:51 AM To: hive-dev@hadoop.apache.org Subject: New Hive committer Ning Zhang Ning has done a lot of work on Hive. Hadoop PMC recently approved Ning Zhang as a new committer t

[jira] Commented: (HIVE-972) support views

2009-12-22 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12793711#action_12793711 ] Ashish Thusoo commented on HIVE-972: Pretty comprehensive writeup :) Here ar

RE: [VOTE] hive release candidate 0.4.1-rc3

2009-11-30 Thread Ashish Thusoo
gt; >> Tarball: >> http://people.apache.org/~zshao/hive-0.4.1-dev.tar.gz >> >> >> Please vote. >> >> Zheng >> >> On Sun, Nov 15, 2009 at 1:14 AM, Ashish Thusoo wrote: >>> Zheng, >>> >>> I cannot find the tar ball.

[jira] Created: (HIVE-939) Extend hive streaming to support counter updates similar to hadoop streaming.

2009-11-17 Thread Ashish Thusoo (JIRA)
Issue Type: Improvement Components: Query Processor Reporter: Ashish Thusoo Assignee: Ashish Thusoo The code to update hadoop counters needs to be ported from hadoop streaming to the streaming code in Hive. -- This message is automatically generated by JIRA

RE: [VOTE] hive release candidate 0.4.1-rc2

2009-11-14 Thread Ashish Thusoo
Zheng, I cannot find the tar ball. What is the location? Ashish From: Zheng Shao [zsh...@gmail.com] Sent: Thursday, November 12, 2009 4:14 PM To: hive-dev@hadoop.apache.org Subject: Re: [VOTE] hive release candidate 0.4.1-rc2 Please vote. We would like re

RE: Hive Performance

2009-11-09 Thread Ashish Thusoo
There are a bunch of optimizations that deal with skewed data in Hive as well. The optimizer is rule based and the user has to hint the query - similar to what is done in RDBMS. We have mostly done our performance work on the benchmark published in the SIGMOD paper. Ashish -Original Messag

RE: Make me as a member of hive developer

2009-11-02 Thread Ashish Thusoo
Hi Mohan, The instructions to subscribe to the mailing list is here... http://hadoop.apache.org/hive/mailing_lists.html#Developers Ashish -Original Message- From: Mohan Agarwal [mailto:mohan.agarwa...@gmail.com] Sent: Monday, November 02, 2009 8:45 AM To: hive-dev@hadoop.apache.org Su

[jira] Commented: (HIVE-885) Better error messages for debugging serde problem at reducer input

2009-10-17 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12766983#action_12766983 ] Ashish Thusoo commented on HIVE-885: Will values.next() always return a BytesWrit

[jira] Commented: (HIVE-884) Metastore Server should exit if error happens

2009-10-17 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12766966#action_12766966 ] Ashish Thusoo commented on HIVE-884: Can we add a test case? Otherwise changes

[ANNOUNCE] Hive 0.4.0 released

2009-10-14 Thread Ashish Thusoo
Hi Folks, We have release the rc2 candidate that Namit had generated as Hive 0.4.0. You can find download it from the download page. http://hadoop.apache.org/hive/releases.html#Download Thanks, Ashish

RE: Hive and MapReduce

2009-10-12 Thread Ashish Thusoo
adding hive-user and hive-dev lists. And removing the common mailing list.. Can you elaborate a bit on the datasize. By default Hive should just be relying on hadoop to give you the number of mappers depending on the number of splits you have in your data. Ashish -Original Message- Fro

[jira] Updated: (HIVE-805) Session level metastore

2009-10-07 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo updated HIVE-805: --- Attachment: HIVE-805-1.patch Incorporated Prasad's review comments. I have not yet disabled thi

  1   2   3   4   5   6   7   8   9   10   >