[jira] Commented: (HIVE-1701) drop support for pre-0.20 Hadoop versions

[ https://issues.apache.org/jira/browse/HIVE-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920439#action_12920439 ] Ning Zhang commented on HIVE-1701: -- +1. Will commit if tests pass. > drop support for pre-

[jira] Resolved: (HIVE-1669) non-deterministic display of storage parameter in test

[ https://issues.apache.org/jira/browse/HIVE-1669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang resolved HIVE-1669. -- Resolution: Duplicate This task is fixed as part of HIVE-1658. Closing. > non-deterministic display of

[jira] Resolved: (HIVE-1658) Fix describe [extended] column formatting

[ https://issues.apache.org/jira/browse/HIVE-1658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang resolved HIVE-1658. -- Resolution: Fixed Committed. Thanks Thiruvel! > Fix describe [extended] column formatting > ---

[jira] Commented: (HIVE-1705) remove pre-0.20 Hadoop tweaks

[ https://issues.apache.org/jira/browse/HIVE-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920421#action_12920421 ] John Sichi commented on HIVE-1705: -- We can also remove the version-specific logic in comman

[jira] Resolved: (HIVE-1617) ScriptOperator's AutoProgressor can lead to an infinite loop

[ https://issues.apache.org/jira/browse/HIVE-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Yang resolved HIVE-1617. - Resolution: Fixed > ScriptOperator's AutoProgressor can lead to an infinite loop > ---

[jira] Created: (HIVE-1706) Support BLOB data type

Support BLOB data type -- Key: HIVE-1706 URL: https://issues.apache.org/jira/browse/HIVE-1706 Project: Hadoop Hive Issue Type: Improvement Components: Serializers/Deserializers Affects Versions: 0.7.0

Re: blob handling in hive

Yes. tentatively that is what I have to do. another way is to convert the data to base64 encoded string. after client received the data, it needs to decode the data back to binary. this is a hack, but works. If hive supports byte array as native data type, then the solution is much more elegan

[jira] Commented: (HIVE-1658) Fix describe [extended] column formatting

[ https://issues.apache.org/jira/browse/HIVE-1658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920406#action_12920406 ] Ning Zhang commented on HIVE-1658: -- +1. Will commit if tests pass. > Fix describe [extend

Re: blob handling in hive

How about utf-8 encode your blob and store in Hive as String ? On Tue, Oct 12, 2010 at 4:20 PM, Jinsong Hu wrote: > I thought about that too. but then I need to write an bytes inspector and > stick that into hive inspector factory. we also need to create a new > datatype , such as blob , in hiv

Re: blob handling in hive

I thought about that too. but then I need to write an bytes inspector and stick that into hive inspector factory. we also need to create a new datatype , such as blob , in hive's supported data types. Adding a new supported data type to hive is a non-trivial task, as more code will need to be t

Re: blob handling in hive

How about creating org.apache.hadoop.hive.serde2.io.BytesWritable which wraps byte[] ? On Tue, Oct 12, 2010 at 3:49 PM, Jinsong Hu wrote: > storing the blob in hbase is too costly. hbase compaction costs lots of > cpu. All I want to do is to be able to read the byte array out of a sequence > fil

Re: blob handling in hive

storing the blob in hbase is too costly. hbase compaction costs lots of cpu. All I want to do is to be able to read the byte array out of a sequence file, and map that byte array to an hive column. I can write a SerDe for this purpose. I tried to define the data to be array. I then tried to wri

[jira] Created: (HIVE-1705) remove pre-0.20 Hadoop tweaks

remove pre-0.20 Hadoop tweaks - Key: HIVE-1705 URL: https://issues.apache.org/jira/browse/HIVE-1705 Project: Hadoop Hive Issue Type: Improvement Components: Configuration Affects Versions: 0.7.0

[jira] Commented: (HIVE-1701) drop support for pre-0.20 Hadoop versions

[ https://issues.apache.org/jira/browse/HIVE-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920389#action_12920389 ] John Sichi commented on HIVE-1701: -- Created HIVE-1704 as a followup for getting rid of the

[jira] Commented: (HIVE-1658) Fix describe [extended] column formatting

[ https://issues.apache.org/jira/browse/HIVE-1658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920385#action_12920385 ] Thiruvel Thirumoolan commented on HIVE-1658: @ Ning: Yes, HIVE-1658_3.patch incl

[jira] Updated: (HIVE-1658) Fix describe [extended] column formatting

[ https://issues.apache.org/jira/browse/HIVE-1658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thiruvel Thirumoolan updated HIVE-1658: --- Attachment: HIVE-1658_3.patch Changelog: 1. Updated code changes attached. Fixed a bu

[jira] Created: (HIVE-1704) remove Hadoop 0.17 specific test reference logs

remove Hadoop 0.17 specific test reference logs --- Key: HIVE-1704 URL: https://issues.apache.org/jira/browse/HIVE-1704 Project: Hadoop Hive Issue Type: Improvement Components: Testing In

[jira] Updated: (HIVE-1701) drop support for pre-0.20 Hadoop versions

[ https://issues.apache.org/jira/browse/HIVE-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Sichi updated HIVE-1701: - Status: Patch Available (was: Open) > drop support for pre-0.20 Hadoop versions > ---

[jira] Updated: (HIVE-1701) drop support for pre-0.20 Hadoop versions

[ https://issues.apache.org/jira/browse/HIVE-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Sichi updated HIVE-1701: - Attachment: HIVE-1701.1.patch Note that this patch deletes a lot of files; the committer needs to do the

[jira] Commented: (HIVE-1699) incorrect partition pruning ANALYZE TABLE

[ https://issues.apache.org/jira/browse/HIVE-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920360#action_12920360 ] Namit Jain commented on HIVE-1699: -- +1 > incorrect partition pruning ANALYZE TABLE > -

Re: blob handling in hive

One way is to store blob in HBase and use HBaseHandler to access your blob. On Tue, Oct 12, 2010 at 2:14 PM, Jinsong Hu wrote: > Hi, > I am using sqoop to export data from mysql to hive. I noticed that hive > don't have blob data type yet. is there anyway I can do so hive can store > blob ? > >

blob handling in hive

Hi, I am using sqoop to export data from mysql to hive. I noticed that hive don't have blob data type yet. is there anyway I can do so hive can store blob ? Jimmy

[jira] Commented: (HIVE-1658) Fix describe [extended] column formatting

[ https://issues.apache.org/jira/browse/HIVE-1658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920346#action_12920346 ] Ning Zhang commented on HIVE-1658: -- Thanks Thiruvel! I will take a look. Does this patch su

[jira] Created: (HIVE-1703) BOOL types should implicitly cast to INT

BOOL types should implicitly cast to INT Key: HIVE-1703 URL: https://issues.apache.org/jira/browse/HIVE-1703 Project: Hadoop Hive Issue Type: Improvement Components: Query Processor

[jira] Commented: (HIVE-1699) incorrect partition pruning ANALYZE TABLE

[ https://issues.apache.org/jira/browse/HIVE-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920343#action_12920343 ] Namit Jain commented on HIVE-1699: -- @Paul, are you working on optimizing Hive.getPartitions

[jira] Updated: (HIVE-1699) incorrect partition pruning ANALYZE TABLE

[ https://issues.apache.org/jira/browse/HIVE-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1699: - Status: Patch Available (was: Open) > incorrect partition pruning ANALYZE TABLE > ---

[jira] Updated: (HIVE-1699) incorrect partition pruning ANALYZE TABLE

[ https://issues.apache.org/jira/browse/HIVE-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1699: - Attachment: HIVE-1699.patch This patch includes the following changes: 1) correctly pruning partitions

[jira] Created: (HIVE-1702) optimize JDBM to make mapjoin faster

optimize JDBM to make mapjoin faster Key: HIVE-1702 URL: https://issues.apache.org/jira/browse/HIVE-1702 Project: Hadoop Hive Issue Type: Improvement Components: Query Processor Repo

[jira] Commented: (HIVE-1700) Optimiza JDBM to make mapjoin faster

[ https://issues.apache.org/jira/browse/HIVE-1700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920339#action_12920339 ] Namit Jain commented on HIVE-1700: -- Let us break into 2 separate jiras: 1. HTree.get() wil

Build failed in Hudson: Hive-trunk-h0.20 #390

See Changes: [jvs] HIVE-1264. Make Hive work with Hadoop security (Todd Lipcon via jvs) -- [...truncated 14300 lines...] [junit] POSTHOOK: Output: defa...@srcbucket2 [junit] OK

[jira] Commented: (HIVE-1681) ObjectStore.commitTransaction() does not properly handle transactions that have already been rolled back

[ https://issues.apache.org/jira/browse/HIVE-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920318#action_12920318 ] Paul Yang commented on HIVE-1681: - Somewhat related - can you make a change to add_partition

HIVE-1701

I'm going to start working on a patch for dropping pre-0.20 Hadoop. JVS

[jira] Created: (HIVE-1701) drop support for pre-0.20 Hadoop versions

drop support for pre-0.20 Hadoop versions - Key: HIVE-1701 URL: https://issues.apache.org/jira/browse/HIVE-1701 Project: Hadoop Hive Issue Type: Improvement Components: Build Infrastructure

[jira] Updated: (HIVE-1612) Cannot build hive for hadoop 0.21.0

[ https://issues.apache.org/jira/browse/HIVE-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daisuke Fujiwara updated HIVE-1612: --- Attachment: HIVE-1612.patch Hi, I have managed to build Hive (trunk -r 1000628) against Hadoo

Re: hive svn is up and hive.apache.org is up

Thanks for kicking this off. I propose we set the svn cutover date as Oct 25 (the next contributor meetup at Facebook), after the meetup wraps up. I think we'll need to update the Hudson configuration as well. (We should drop the pre-0.20 Hudson configurations too.) If it's possible to take

[jira] Created: (HIVE-1700) Optimiza JDBM to make mapjoin faster

Optimiza JDBM to make mapjoin faster Key: HIVE-1700 URL: https://issues.apache.org/jira/browse/HIVE-1700 Project: Hadoop Hive Issue Type: Improvement Reporter: He Yongqiang copied from email

Build failed in Hudson: Hive-trunk-h0.19 #567

See Changes: [jvs] HIVE-1264. Make Hive work with Hadoop security (Todd Lipcon via jvs) -- [...truncated 12289 lines...] [junit] POSTHOOK: Output: defa...@srcbucket2 [junit] OK

[jira] Commented: (HIVE-1681) ObjectStore.commitTransaction() does not properly handle transactions that have already been rolled back

[ https://issues.apache.org/jira/browse/HIVE-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920266#action_12920266 ] Ning Zhang commented on HIVE-1681: -- @venkatesh, could you reproduce the error without the p

Build failed in Hudson: Hive-trunk-h0.18 #567

See Changes: [jvs] HIVE-1264. Make Hive work with Hadoop security (Todd Lipcon via jvs) -- [...truncated 31063 lines...] [junit] POSTHOOK: Output: defa...@srcbucket2 [junit] OK

[jira] Commented: (HIVE-1658) Fix describe [extended] column formatting

[ https://issues.apache.org/jira/browse/HIVE-1658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920189#action_12920189 ] Thiruvel Thirumoolan commented on HIVE-1658: The patch is ready and tests are ru

[jira] Updated: (HIVE-1583) Hive should not override Hadoop specific system properties

[ https://issues.apache.org/jira/browse/HIVE-1583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thiruvel Thirumoolan updated HIVE-1583: --- Attachment: HIVE-1583_2.patch Have removed the changes for CLASSPATH. > Hive should n