[jira] [Created] (HIVE-4121) ORC should have optional dictionaries for both strings and numeric types

2013-03-05 Thread Owen O'Malley (JIRA)
Owen O'Malley created HIVE-4121: --- Summary: ORC should have optional dictionaries for both strings and numeric types Key: HIVE-4121 URL: https://issues.apache.org/jira/browse/HIVE-4121 Project: Hive

[jira] [Created] (HIVE-4120) Implement decimal encoding for ORC

2013-03-05 Thread Owen O'Malley (JIRA)
Owen O'Malley created HIVE-4120: --- Summary: Implement decimal encoding for ORC Key: HIVE-4120 URL: https://issues.apache.org/jira/browse/HIVE-4120 Project: Hive Issue Type: New Feature

[jira] [Updated] (HIVE-4121) ORC should have optional dictionaries for both strings and numeric types

2013-03-05 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-4121: Description: Currently string columns always have dictionaries and numerics are always directly

[jira] [Created] (HIVE-4123) The RLE encoding for ORC can be improved

2013-03-05 Thread Owen O'Malley (JIRA)
Owen O'Malley created HIVE-4123: --- Summary: The RLE encoding for ORC can be improved Key: HIVE-4123 URL: https://issues.apache.org/jira/browse/HIVE-4123 Project: Hive Issue Type: New Feature

[jira] [Resolved] (HIVE-2899) Remove dependency on sun's jdk.

2013-03-05 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HIVE-2899. - Resolution: Invalid I'm closing this. Remove dependency on sun's jdk

[jira] [Created] (HIVE-4127) Testing with Hadoop 2.x causes test failure for ORC's TestFileDump

2013-03-05 Thread Owen O'Malley (JIRA)
Owen O'Malley created HIVE-4127: --- Summary: Testing with Hadoop 2.x causes test failure for ORC's TestFileDump Key: HIVE-4127 URL: https://issues.apache.org/jira/browse/HIVE-4127 Project: Hive

[jira] [Commented] (HIVE-4015) Add ORC file to the grammar as a file format

2013-03-05 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13593987#comment-13593987 ] Owen O'Malley commented on HIVE-4015: - +1 looks good to me. Add ORC

[jira] [Updated] (HIVE-4127) Testing with Hadoop 2.x causes test failure for ORC's TestFileDump

2013-03-05 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-4127: Status: Patch Available (was: Open) Testing with Hadoop 2.x causes test failure for ORC's

[jira] [Commented] (HIVE-4113) select count(1) reads all columns with RCFile

2013-03-04 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13592751#comment-13592751 ] Owen O'Malley commented on HIVE-4113: - There are a couple of context where Hive assumes

[jira] [Updated] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

2013-03-01 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-3874: Status: Patch Available (was: Open) Pamela, Yeah, that probably makes sense. I'll file

[jira] [Created] (HIVE-4097) ORC file doesn't properly interpret empty hive.io.file.readcolumn.ids

2013-03-01 Thread Owen O'Malley (JIRA)
Owen O'Malley created HIVE-4097: --- Summary: ORC file doesn't properly interpret empty hive.io.file.readcolumn.ids Key: HIVE-4097 URL: https://issues.apache.org/jira/browse/HIVE-4097 Project: Hive

[jira] [Created] (HIVE-4098) OrcInputFormat assumes Hive always calls createValue

2013-03-01 Thread Owen O'Malley (JIRA)
Owen O'Malley created HIVE-4098: --- Summary: OrcInputFormat assumes Hive always calls createValue Key: HIVE-4098 URL: https://issues.apache.org/jira/browse/HIVE-4098 Project: Hive Issue Type

[jira] [Commented] (HIVE-4015) Add ORC file to the grammar as a file format

2013-03-01 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590722#comment-13590722 ] Owen O'Malley commented on HIVE-4015: - Gunther, this looks good. I'd suggest removing

[jira] [Updated] (HIVE-4097) ORC file doesn't properly interpret empty hive.io.file.readcolumn.ids

2013-03-01 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-4097: Status: Patch Available (was: Open) This patch fixes the problem and adds a test case to ensure

[jira] [Updated] (HIVE-4098) OrcInputFormat assumes Hive always calls createValue

2013-03-01 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-4098: Status: Patch Available (was: Open) The patch removes the assumption of a dedicated row for each

[jira] [Commented] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

2013-02-25 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13586018#comment-13586018 ] Owen O'Malley commented on HIVE-3874: - Ok, I added some additional comments

[jira] [Updated] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

2013-02-25 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-3874: Status: Patch Available (was: Open) Create a new Optimized Row Columnar file format for Hive

[jira] [Commented] (HIVE-4058) make ORC versioned

2013-02-25 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13586021#comment-13586021 ] Owen O'Malley commented on HIVE-4058: - The metadata is versioned, it just doesn't have

[jira] [Assigned] (HIVE-4059) Make Column statistics for ORC optional

2013-02-25 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley reassigned HIVE-4059: --- Assignee: Owen O'Malley Make Column statistics for ORC optional

[jira] [Commented] (HIVE-4058) make ORC versioned

2013-02-25 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13586398#comment-13586398 ] Owen O'Malley commented on HIVE-4058: - I should also note that if it is required

[jira] [Resolved] (HIVE-4061) skip columns which are not accessed in the query for ORC

2013-02-25 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HIVE-4061. - Resolution: Cannot Reproduce This is already done. skip columns which

[jira] [Resolved] (HIVE-4058) make ORC versioned

2013-02-25 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HIVE-4058. - Resolution: Won't Fix make ORC versioned -- Key: HIVE

[jira] [Updated] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

2013-02-13 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-3874: Status: Patch Available (was: Open) Create a new Optimized Row Columnar file format for Hive

[jira] [Commented] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

2013-02-12 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13576691#comment-13576691 ] Owen O'Malley commented on HIVE-3874: - Kevin, I had some distractions at work, but I

[jira] [Created] (HIVE-4015) Add ORC file to the grammar as a file format

2013-02-12 Thread Owen O'Malley (JIRA)
Owen O'Malley created HIVE-4015: --- Summary: Add ORC file to the grammar as a file format Key: HIVE-4015 URL: https://issues.apache.org/jira/browse/HIVE-4015 Project: Hive Issue Type

[jira] [Assigned] (HIVE-4015) Add ORC file to the grammar as a file format

2013-02-12 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley reassigned HIVE-4015: --- Assignee: Owen O'Malley Add ORC file to the grammar as a file format

[jira] [Updated] (HIVE-4000) Hive client goes into infinite loop at 100% cpu

2013-02-11 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-4000: Status: Patch Available (was: Open) Replace the sets/maps with concurrent versions that protect

[jira] [Created] (HIVE-4000) Hive client goes into infinite loop at 100% cpu

2013-02-07 Thread Owen O'Malley (JIRA)
Owen O'Malley created HIVE-4000: --- Summary: Hive client goes into infinite loop at 100% cpu Key: HIVE-4000 URL: https://issues.apache.org/jira/browse/HIVE-4000 Project: Hive Issue Type: Bug

[jira] [Commented] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

2013-02-06 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13572623#comment-13572623 ] Owen O'Malley commented on HIVE-3874: - I've pushed the current version up to [github

[jira] [Commented] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

2013-02-05 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13571510#comment-13571510 ] Owen O'Malley commented on HIVE-3874: - [~kevinwilfong] Thanks for the bug fixes, Kevin

Re: [VOTE] Amend Hive Bylaws + Add HCatalog Submodule

2013-01-28 Thread Owen O'Malley
+1 and +1 On Mon, Jan 28, 2013 at 1:56 PM, Ashish Thusoo athu...@qubole.com wrote: Measure 1: +1 Measure 2: +1 Ashish On Mon, Jan 28, 2013 at 1:11 PM, Ashutosh Chauhan hashut...@apache.org wrote: Measure 1: +1 Measure 2: +1 Ashutosh On Mon, Jan 28, 2013 at 11:48 AM, Carl

[jira] [Updated] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

2013-01-22 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-3874: Attachment: (was: orc.tgz) Create a new Optimized Row Columnar file format for Hive

[jira] [Updated] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

2013-01-22 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-3874: Attachment: (was: orc.tgz) Create a new Optimized Row Columnar file format for Hive

[jira] [Updated] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

2013-01-22 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-3874: Attachment: orc.tgz I've fixed some bugs. Create a new Optimized Row Columnar

[jira] [Commented] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

2013-01-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13557341#comment-13557341 ] Owen O'Malley commented on HIVE-3874: - Joydeep, I've used a two level strategy

[jira] [Commented] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

2013-01-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13557353#comment-13557353 ] Owen O'Malley commented on HIVE-3874: - Yin, large stripes (and I'm defaulting to 250MB

[jira] [Updated] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

2013-01-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-3874: Attachment: orc.tgz Here's the current version of the code. The seek to row isn't implemented

[jira] [Updated] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

2013-01-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-3874: Attachment: orc.tgz I've updated the patch with the index suppression option that Nammit asked

[jira] [Created] (HIVE-3889) Add floating point compression to ORC file

2013-01-11 Thread Owen O'Malley (JIRA)
Owen O'Malley created HIVE-3889: --- Summary: Add floating point compression to ORC file Key: HIVE-3889 URL: https://issues.apache.org/jira/browse/HIVE-3889 Project: Hive Issue Type: New Feature

[jira] [Updated] (HIVE-3889) Add floating point compression to ORC file

2013-01-11 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-3889: Attachment: fpc-impl.tar This is the file that Karol emailed to me for me to submit to Apache

[jira] [Commented] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

2013-01-11 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551231#comment-13551231 ] Owen O'Malley commented on HIVE-3874: - Namit, I'm using the table properties to manage

[jira] [Commented] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

2013-01-11 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551248#comment-13551248 ] Owen O'Malley commented on HIVE-3874: - Doug, of course Trevni could be modified

[jira] [Commented] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

2013-01-11 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551286#comment-13551286 ] Owen O'Malley commented on HIVE-3874: - Sambavi, I should have a patch ready next week

[jira] [Commented] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

2013-01-10 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13549774#comment-13549774 ] Owen O'Malley commented on HIVE-3874: - He Yongqiang, the APIs to the two formats

[jira] [Commented] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

2013-01-10 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13549784#comment-13549784 ] Owen O'Malley commented on HIVE-3874: - Namit, I obviously did consider Trevni

[jira] [Commented] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

2013-01-10 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13549839#comment-13549839 ] Owen O'Malley commented on HIVE-3874: - Namit, for pure hive users there aren't any

[jira] [Created] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

2013-01-09 Thread Owen O'Malley (JIRA)
Owen O'Malley created HIVE-3874: --- Summary: Create a new Optimized Row Columnar file format for Hive Key: HIVE-3874 URL: https://issues.apache.org/jira/browse/HIVE-3874 Project: Hive Issue Type

[jira] [Commented] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

2013-01-09 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13548750#comment-13548750 ] Owen O'Malley commented on HIVE-3874: - Namit, Yes, it has dictionary encoding

[jira] [Updated] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

2013-01-09 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-3874: Attachment: OrcFileIntro.pptx Create a new Optimized Row Columnar file format for Hive

[jira] [Updated] (HIVE-3234) getting the reporter in the recordwriter

2012-11-13 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-3234: Status: Patch Available (was: Open) This patch passes in the real mapreduce reporter

Re: hive 0.10 release

2012-11-08 Thread Owen O'Malley
+1 On Thu, Nov 8, 2012 at 3:18 PM, Carl Steinbach c...@cloudera.com wrote: +1 On Wed, Nov 7, 2012 at 11:23 PM, Alexander Lorenz wget.n...@gmail.com wrote: +1, good karma On Nov 8, 2012, at 4:58 AM, Namit Jain nj...@fb.com wrote: +1 to the idea On 11/8/12 6:33 AM, Edward

[jira] [Created] (HIVE-3660) Improve OutputFormat for Hive

2012-11-02 Thread Owen O'Malley (JIRA)
Owen O'Malley created HIVE-3660: --- Summary: Improve OutputFormat for Hive Key: HIVE-3660 URL: https://issues.apache.org/jira/browse/HIVE-3660 Project: Hive Issue Type: Improvement

[jira] [Created] (HIVE-3599) missing return of compression codec to pool

2012-10-18 Thread Owen O'Malley (JIRA)
Owen O'Malley created HIVE-3599: --- Summary: missing return of compression codec to pool Key: HIVE-3599 URL: https://issues.apache.org/jira/browse/HIVE-3599 Project: Hive Issue Type: Bug

[jira] [Assigned] (HIVE-3599) missing return of compression codec to pool

2012-10-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley reassigned HIVE-3599: --- Assignee: Owen O'Malley missing return of compression codec to pool

[jira] [Updated] (HIVE-3599) missing return of compression codec to pool

2012-10-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-3599: Attachment: hive-3599.patch Here's the obvious fix. There aren't any functional difference

[jira] [Updated] (HIVE-3599) missing return of compression codec to pool

2012-10-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-3599: Status: Patch Available (was: Open) missing return of compression codec to pool

Re: non map-reduce for simple queries

2012-07-31 Thread Owen O'Malley
On Mon, Jul 30, 2012 at 9:12 PM, Namit Jain nj...@fb.com wrote: The total number of bytes of the input will be used to determine whether to not launch a map-reduce job for this query. That was in my original mail. However, given any complex where condition and the lack of column statistics

Re: non map-reduce for simple queries

2012-07-31 Thread Owen O'Malley
On Mon, Jul 30, 2012 at 11:38 PM, Namit Jain nj...@fb.com wrote: That would be difficult. The % done can be estimated from the data already read. I'm confused. Wouldn't the maximum size of the data remaining over the maximum size of the original query give a reasonable approximation of the

Re: non map-reduce for simple queries

2012-07-30 Thread Owen O'Malley
On Sat, Jul 28, 2012 at 6:17 PM, Navis류승우 navis@nexr.com wrote: I was thinking of timeout for fetching, 2000msec for example. How about that? Instead of time, which requires launching the query and letting it timeout, how about determining the number of bytes that would need to be fetched

[jira] [Commented] (HIVE-3153) Release codecs and output streams between flushes of RCFile

2012-07-23 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13421023#comment-13421023 ] Owen O'Malley commented on HIVE-3153: - I just posted this as https

[jira] [Assigned] (HIVE-3234) getting the reporter in the recordwriter

2012-07-05 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley reassigned HIVE-3234: --- Assignee: Owen O'Malley getting the reporter in the recordwriter

[jira] [Commented] (HIVE-3098) Memory leak from large number of FileSystem instances in FileSystem.CACHE. (Must cache UGIs.)

2012-06-28 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13403579#comment-13403579 ] Owen O'Malley commented on HIVE-3098: - Alejandro, Daryn is absolutely right that we

[jira] [Updated] (HIVE-3153) Release codecs and output streams between flushes of RCFile

2012-06-25 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-3153: Attachment: hive-3153.patch This patch: * Fixes some javadoc * Suppresses some unused warnings

[jira] [Updated] (HIVE-3153) Release codecs and output streams between flushes of RCFile

2012-06-25 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-3153: Status: Patch Available (was: Open) Release codecs and output streams between flushes

[jira] [Updated] (HIVE-3153) Release codecs and output streams between flushes of RCFile

2012-06-22 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-3153: Attachment: (was: giraph-pom.patch) Release codecs and output streams between flushes

[jira] [Updated] (HIVE-3153) Release codecs and output streams between flushes of RCFile

2012-06-22 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-3153: Attachment: giraph-pom.patch Release codecs and output streams between flushes of RCFile

[jira] [Created] (HIVE-3153) Release codecs and output streams between flushes of RCFile

2012-06-18 Thread Owen O'Malley (JIRA)
Owen O'Malley created HIVE-3153: --- Summary: Release codecs and output streams between flushes of RCFile Key: HIVE-3153 URL: https://issues.apache.org/jira/browse/HIVE-3153 Project: Hive Issue

[jira] [Created] (HIVE-3028) Fix javadoc again

2012-05-15 Thread Owen O'Malley (JIRA)
Owen O'Malley created HIVE-3028: --- Summary: Fix javadoc again Key: HIVE-3028 URL: https://issues.apache.org/jira/browse/HIVE-3028 Project: Hive Issue Type: Bug Components: Build

[jira] [Updated] (HIVE-3028) Fix javadoc again

2012-05-15 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-3028: Status: Patch Available (was: Open) Fix javadoc again

[jira] [Updated] (HIVE-3028) Fix javadoc again

2012-05-15 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-3028: Attachment: hive-3028.patch This patch fixes the problem, although it leaves undone the other

[jira] [Commented] (HIVE-2911) Move global .hiverc file

2012-05-10 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13272697#comment-13272697 ] Owen O'Malley commented on HIVE-2911: - Namit, How is it backward incompatible

Re: [VOTE] Apache Hive 0.9.0 Release Candidate 0

2012-04-18 Thread Owen O'Malley
I'm -1 (nonbinding) on rc0 so that we can incorporate HIVE-2930, which fixes the Apache headers on the source files. (Thanks for committing that!) -- Owen

[jira] [Updated] (HIVE-2930) Add license to the Hive files

2012-04-17 Thread Owen O'Malley (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2930: Status: Patch Available (was: Open) This doesn't fix the sql files, but fixes the rest of them

Re: Problems with Arc/Phabricator

2012-04-11 Thread Owen O'Malley
On Wed, Apr 11, 2012 at 11:48 AM, Edward Capriolo edlinuxg...@gmail.com wrote: If we are going to switch from fabricator we just might as well go back to not using anything. Review board was really clunky and confusing. I'm mostly +1 to that. If no one is supporting phabricator, then it won't

[jira] [Assigned] (HIVE-2924) Clean up warnings in RCFile

2012-04-06 Thread Owen O'Malley (Assigned) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley reassigned HIVE-2924: --- Assignee: Owen O'Malley Clean up warnings in RCFile

[jira] [Created] (HIVE-2930) Add license to the

2012-04-06 Thread Owen O'Malley (Created) (JIRA)
Add license to the --- Key: HIVE-2930 URL: https://issues.apache.org/jira/browse/HIVE-2930 Project: Hive Issue Type: Improvement Reporter: Owen O'Malley Assignee: Owen O'Malley Priority

[jira] [Updated] (HIVE-2930) Add license to the Hive files

2012-04-06 Thread Owen O'Malley (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2930: Summary: Add license to the Hive files (was: Add license to the ) Add license to the Hive

[jira] [Commented] (HIVE-2930) Add license to the Hive files

2012-04-06 Thread Owen O'Malley (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13248586#comment-13248586 ] Owen O'Malley commented on HIVE-2930: - The files that are copyright by Facebook

[jira] [Commented] (HIVE-2930) Add license to the Hive files

2012-04-06 Thread Owen O'Malley (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13248891#comment-13248891 ] Owen O'Malley commented on HIVE-2930: - I ran through the files without headers

Re: Hive 0.9 release

2012-04-06 Thread Owen O'Malley
I think we also need to get the RAT report cleaned up. Apache projects aren't supposed to release while they have files without the Apache header. I've filed HIVE-2930 to fix all of the issues. While working on it, I found that one of the files was added by HIVE-2246. HIVE-2246 was contributed by

[jira] [Updated] (HIVE-2711) Make the header of RCFile unique

2012-04-05 Thread Owen O'Malley (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2711: Attachment: rc-file-v0.rc Here's the binary file that arc didn't include in the patch

[jira] [Updated] (HIVE-2711) Make the header of RCFile unique

2012-04-04 Thread Owen O'Malley (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2711: Status: Patch Available (was: Open) Sorry, I didn't re-run the test cases after removing

[jira] [Created] (HIVE-2924) Clean up warnings in RCFile

2012-04-03 Thread Owen O'Malley (Created) (JIRA)
Clean up warnings in RCFile --- Key: HIVE-2924 URL: https://issues.apache.org/jira/browse/HIVE-2924 Project: Hive Issue Type: Improvement Reporter: Owen O'Malley Currently we get a couple of warnings

[jira] [Updated] (HIVE-2911) Move global .hiverc file

2012-03-29 Thread Owen O'Malley (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2911: Status: Patch Available (was: Open) I tested this on a cluster and it worked as expected

[jira] [Created] (HIVE-2911) Move global .hiverc file

2012-03-28 Thread Owen O'Malley (Created) (JIRA)
Move global .hiverc file Key: HIVE-2911 URL: https://issues.apache.org/jira/browse/HIVE-2911 Project: Hive Issue Type: Improvement Components: CLI Reporter: Owen O'Malley Assignee

[jira] [Updated] (HIVE-2898) Add nicer helper functions for adding and reading metadata from RCFiles

2012-03-26 Thread Owen O'Malley (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2898: Attachment: (was: HIVE-2898.D2439.1.patch) Add nicer helper functions for adding

[jira] [Updated] (HIVE-2898) Add nicer helper functions for adding and reading metadata from RCFiles

2012-03-26 Thread Owen O'Malley (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2898: Status: Patch Available (was: Open) I ran the unit tests and they passed. Add

[jira] [Updated] (HIVE-2879) Add rat target to build to look for missing license headers

2012-03-23 Thread Owen O'Malley (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2879: Status: Patch Available (was: Open) Unsurprisingly, tests pass. Add rat target

[jira] [Created] (HIVE-2898) Add nicer helper functions for adding and reading metadata from RCFiles

2012-03-23 Thread Owen O'Malley (Created) (JIRA)
: New Feature Components: Serializers/Deserializers Reporter: Owen O'Malley Assignee: Owen O'Malley Currently, to use the metadata in RCFile, you need to manipulate it using SequenceFile.Metadata. I'd like to add two helper functions that make it more convenient

[jira] [Moved] (HIVE-2899) Remove dependency on sun's jdk.

2012-03-23 Thread Owen O'Malley (Moved) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley moved HADOOP-8203 to HIVE-2899: - Key: HIVE-2899 (was: HADOOP-8203) Project: Hive (was: Hadoop

[jira] [Created] (HIVE-2894) RCFile Reader doesn't provide access to Metadata

2012-03-22 Thread Owen O'Malley (Created) (JIRA)
RCFile Reader doesn't provide access to Metadata Key: HIVE-2894 URL: https://issues.apache.org/jira/browse/HIVE-2894 Project: Hive Issue Type: New Feature Reporter: Owen O'Malley

[jira] [Updated] (HIVE-2894) RCFile Reader doesn't provide access to Metadata

2012-03-22 Thread Owen O'Malley (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2894: Status: Patch Available (was: Open) I ran the test cases and they pass. RCFile

[jira] [Updated] (HIVE-2879) Add rat target to build to look for missing license headers

2012-03-19 Thread Owen O'Malley (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2879: Component/s: Build Infrastructure Add rat target to build to look for missing license headers

[jira] [Created] (HIVE-2879) Add rat target to build to look for missing license headers

2012-03-19 Thread Owen O'Malley (Created) (JIRA)
Reporter: Owen O'Malley Assignee: Owen O'Malley We should have a rat target that can generate an Apache RAT report. RAT is used for finding missing license headers. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA

[jira] [Commented] (HIVE-2879) Add rat target to build to look for missing license headers

2012-03-19 Thread Owen O'Malley (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13233026#comment-13233026 ] Owen O'Malley commented on HIVE-2879: - I got the exclude patterns so

[jira] [Updated] (HIVE-2850) Remove zero length files

2012-03-16 Thread Owen O'Malley (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2850: Status: Patch Available (was: Open) Tests pass with files removed. Remove zero

Re: Sorting algorithm

2012-03-16 Thread Owen O'Malley
On Fri, Mar 16, 2012 at 6:05 PM, indrani gorti indrani.go...@gmail.comwrote: Hi Which is the sorting algorith used in map-reduce to sort the data set in the shuffling stage i.e after the mapped for each split up of the entire dataset. Take a look at Chris Douglas' presentation on the sort.

[jira] [Commented] (HIVE-2835) Change default configuration for hive.exec.dynamic.partition

2012-03-09 Thread Owen O'Malley (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13226300#comment-13226300 ] Owen O'Malley commented on HIVE-2835: - Thanks for catching the problem, Ed. I uploaded

[jira] [Commented] (HIVE-2841) Fix javadoc warnings

2012-03-07 Thread Owen O'Malley (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13224734#comment-13224734 ] Owen O'Malley commented on HIVE-2841: - Sure, but because I've filed an ICLA anything I

[jira] [Updated] (HIVE-2841) Fix javadoc warnings

2012-03-07 Thread Owen O'Malley (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2841: Attachment: h-2841.patch Fix javadoc warnings Key

<    4   5   6   7   8   9   10   >