[jira] [Commented] (HIVE-8915) Log file explosion due to non-existence of COMPACTION_QUEUE table

2015-03-31 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390009#comment-14390009 ] Owen O'Malley commented on HIVE-8915: - Yeah, I hit this too. What is the fix,

[jira] [Updated] (HIVE-10407) separate out the timestamp ranges for testing purposes

2015-04-20 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-10407: - Attachment: HIVE-10407.patch Fixed the cases of year = that Prasanth found. separate out

[jira] [Assigned] (HIVE-9451) Add max size of column dictionaries to ORC metadata

2015-04-23 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley reassigned HIVE-9451: --- Assignee: Owen O'Malley Add max size of column dictionaries to ORC metadata

[jira] [Resolved] (HIVE-8521) Document the ORC format

2015-04-23 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HIVE-8521. - Resolution: Fixed This was added to the wiki. Document the ORC format ---

[jira] [Updated] (HIVE-9451) Add max size of column dictionaries to ORC metadata

2015-04-23 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-9451: Attachment: HIVE-9451.patch This patch adds the maxDictionarySize and configured stripe size to the

[jira] [Commented] (HIVE-10036) Writing ORC format big table causes OOM - too many fixed sized stream buffers

2015-04-23 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510096#comment-14510096 ] Owen O'Malley commented on HIVE-10036: -- I understand the problem, but this patch

[jira] [Commented] (HIVE-4227) Add column level encryption to ORC files

2015-04-22 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14507225#comment-14507225 ] Owen O'Malley commented on HIVE-4227: - I've started working on this. I'll post a patch

[jira] [Updated] (HIVE-4227) Add column level encryption to ORC files

2015-04-22 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-4227: Labels: (was: gsoc gsoc2013) Add column level encryption to ORC files

[jira] [Assigned] (HIVE-4227) Add column level encryption to ORC files

2015-04-22 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley reassigned HIVE-4227: --- Assignee: Owen O'Malley Add column level encryption to ORC files

[jira] [Commented] (HIVE-10303) HIVE-9471 broke forward compatibility of ORC files

2015-04-20 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503376#comment-14503376 ] Owen O'Malley commented on HIVE-10303: -- +1 LGTM HIVE-9471 broke forward

[jira] [Commented] (HIVE-10165) Improve hive-hcatalog-streaming extensibility and support updates and deletes.

2015-05-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14548439#comment-14548439 ] Owen O'Malley commented on HIVE-10165: -- Sorry for coming in so late on this. This is

[jira] [Updated] (HIVE-10305) TestOrcFile has a mistake that makes metadata test ineffective

2015-04-10 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-10305: - Attachment: HIVE-10305.patch This patch does a flip so that the buffer doesn't look empty.

[jira] [Updated] (HIVE-10795) Remove use of PerfLogger from Orc

2015-06-23 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-10795: - Attachment: HIVE-10795.patch Thanks for the catch, Damien. I removed both of the now unused

[jira] [Updated] (HIVE-10553) Remove hardcoded Parquet references from SearchArgumentImpl

2015-06-23 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-10553: - Attachment: HIVE-10553.patch My patch had gone a little stale, so I updated it. I also manually

[jira] [Updated] (HIVE-11115) Remove dependence from ORC's WriterImpl to OrcInputFormat

2015-06-25 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-5: - Attachment: HIVE-5.patch Have WriterImpl get its own copy of the shims. Remove dependence

[jira] [Updated] (HIVE-11124) Move OrcRecordUpdater.getAcidEventFields to RecordReaderFactory

2015-06-25 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11124: - Attachment: HIVE-11124.patch Move the method over. Move OrcRecordUpdater.getAcidEventFields to

[jira] [Resolved] (HIVE-8644) ORC rle v2 writer should round when converting from floats to integers

2015-06-24 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HIVE-8644. - Resolution: Won't Fix I suspect changing this isn't worth it at this point. ORC rle v2 writer

[jira] [Updated] (HIVE-11080) Modify VectorizedRowBatch.toString() to not depend on VectorExpressionWriter

2015-06-24 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11080: - Attachment: HIVE-11080.patch This changes the vectorized row batch to use the physical types of

[jira] [Updated] (HIVE-11086) Remove use of ErrorMsg in Orc's RunLengthIntegerReaderV2

2015-06-24 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11086: - Attachment: HIVE-11086.patch Since ORC wasn't using the error code, I just moved the string back

[jira] [Updated] (HIVE-10795) Remove use of PerfLogger from Orc

2015-05-22 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-10795: - Attachment: HIVE-10795.patch Remove use of PerfLogger from Orc

[jira] [Updated] (HIVE-10553) Remove hardcoded Parquet references from SearchArgumentImpl

2015-05-22 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-10553: - Attachment: HIVE-10553.patch This patch fixes the test case that I missed in the previous

[jira] [Updated] (HIVE-10796) Remove dependencies on NumericHistogram and NumDistinctValueEstimator from JavaDataModel

2015-05-22 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-10796: - Attachment: HIVE-10796.patch This patch moves the memory estimation from JavaDataModel to the

[jira] [Updated] (HIVE-10794) Remove the dependence from ErrorMsg to HiveUtils

2015-05-21 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-10794: - Attachment: HIVE-10794.patch Remove the dependence from ErrorMsg to HiveUtils

[jira] [Commented] (HIVE-10794) Remove the dependence from ErrorMsg to HiveUtils

2015-05-21 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1470#comment-1470 ] Owen O'Malley commented on HIVE-10794: -- The recursive set of dependencies for

[jira] [Assigned] (HIVE-10553) Remove hardcoded Parquet references from SearchArgumentImpl

2015-05-22 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley reassigned HIVE-10553: Assignee: Owen O'Malley Remove hardcoded Parquet references from SearchArgumentImpl

[jira] [Updated] (HIVE-10553) Remove hardcoded Parquet references from SearchArgumentImpl

2015-05-22 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-10553: - Attachment: HIVE-10553.patch This patch exposes the ExpressionTree for SearchArguments, which

[jira] [Commented] (HIVE-11504) Predicate pushing down doesn't work for float type for Parquet

2015-08-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14701763#comment-14701763 ] Owen O'Malley commented on HIVE-11504: -- This patch seems problematic. The SARGs

[jira] [Commented] (HIVE-11504) Predicate pushing down doesn't work for float type for Parquet

2015-08-21 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14706981#comment-14706981 ] Owen O'Malley commented on HIVE-11504: -- The goal is simplicity. For the types that

[jira] [Commented] (HIVE-11504) Predicate pushing down doesn't work for float type for Parquet

2015-08-21 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14706990#comment-14706990 ] Owen O'Malley commented on HIVE-11504: -- If you need to differentiate the types for

[jira] [Assigned] (HIVE-11618) Correct the SARG api to reunify the PredicateLeaf.Type INTEGER and LONG

2015-08-21 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley reassigned HIVE-11618: Assignee: Owen O'Malley Correct the SARG api to reunify the PredicateLeaf.Type INTEGER

[jira] [Updated] (HIVE-11618) Correct the SARG api to reunify the PredicateLeaf.Type INTEGER and LONG

2015-08-21 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11618: - Attachment: HIVE-11618.patch Ok, here is a patch that fixes the problem. The major change was in

[jira] [Commented] (HIVE-11504) Predicate pushing down doesn't work for float type for Parquet

2015-08-24 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14709482#comment-14709482 ] Owen O'Malley commented on HIVE-11504: -- Ok, I wrote the patch that addresses

[jira] [Updated] (HIVE-11253) Move SearchArgument and VectorizedRowBatch classes to storage-api.

2015-07-28 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11253: - Attachment: HIVE-11253.patch The patch will apply for jenkins now that the previous jiras have

[jira] [Commented] (HIVE-11209) Clean up dependencies in HiveDecimalWritable

2015-07-22 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637099#comment-14637099 ] Owen O'Malley commented on HIVE-11209: -- For most types, it would be a problem. With

[jira] [Commented] (HIVE-11259) LLAP: clean up ORC dependencies part 1

2015-07-23 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639451#comment-14639451 ] Owen O'Malley commented on HIVE-11259: -- Right, we can put the orc-llap as a module in

[jira] [Updated] (HIVE-10799) Refactor the SearchArgumentFactory to remove the dependence on ExprNodeGenericFuncDesc

2015-07-24 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-10799: - Attachment: HIVE-10799.patch This patch adds tests for calls into the sarg builder with the wrong

[jira] [Commented] (HIVE-10799) Refactor the SearchArgumentFactory to remove the dependence on ExprNodeGenericFuncDesc

2015-07-24 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14641130#comment-14641130 ] Owen O'Malley commented on HIVE-10799: -- I've created HIVE-11370 for adding the binary

[jira] [Commented] (HIVE-11259) LLAP: clean up ORC dependencies part 1

2015-07-22 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637649#comment-14637649 ] Owen O'Malley commented on HIVE-11259: -- You need to remove the dependence between

[jira] [Commented] (HIVE-10799) Refactor the SearchArgumentFactory to remove the dependence on ExprNodeGenericFuncDesc

2015-07-22 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637657#comment-14637657 ] Owen O'Malley commented on HIVE-10799: -- Given that ORC files currently have the value

[jira] [Commented] (HIVE-11259) LLAP: clean up ORC dependencies part 1

2015-07-22 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637749#comment-14637749 ] Owen O'Malley commented on HIVE-11259: -- I can't see any other application for

[jira] [Resolved] (HIVE-11318) Move ORC table properties from OrcFile to OrcOutputFormat

2015-07-21 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HIVE-11318. -- Resolution: Duplicate Move ORC table properties from OrcFile to OrcOutputFormat

[jira] [Commented] (HIVE-11321) Move OrcFile.OrcTableProperties from OrcFile into OrcConf.

2015-07-21 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635988#comment-14635988 ] Owen O'Malley commented on HIVE-11321: -- So the path looks like: * table properties

[jira] [Updated] (HIVE-11321) Move OrcFile.OrcTableProperties from OrcFile into OrcConf.

2015-07-21 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11321: - Attachment: HIVE-11321.patch This patch pulls all of the configuration knobs into OrcConf

[jira] [Updated] (HIVE-11321) Move OrcFile.OrcTableProperties from OrcFile into OrcConf.

2015-07-21 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11321: - Attachment: (was: HIVE-11321.patch) Move OrcFile.OrcTableProperties from OrcFile into

[jira] [Updated] (HIVE-11321) Move OrcFile.OrcTableProperties from OrcFile into OrcConf.

2015-07-21 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11321: - Attachment: HIVE-11321.patch Sorry, I uploaded the wrong version of the patch. Move

[jira] [Updated] (HIVE-11245) LLAP: Fix the LLAP to ORC APIs

2015-07-13 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11245: - Summary: LLAP: Fix the LLAP to ORC APIs (was: Fix the LLAP to ORC APIs) LLAP: Fix the LLAP to

[jira] [Commented] (HIVE-11253) Move SearchArgument and VectorizedRowBatch classes to storage-api.

2015-07-14 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626455#comment-14626455 ] Owen O'Malley commented on HIVE-11253: -- Move the following classes over: {code}

[jira] [Updated] (HIVE-11209) Clean up dependencies in HiveDecimalWritable

2015-07-13 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11209: - Attachment: HIVE-11209.patch rebased patch to trunk. Clean up dependencies in

[jira] [Updated] (HIVE-10799) Refactor the SearchArgumentFactory to remove the dependence on ExprNodeGenericFuncDesc

2015-07-15 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-10799: - Attachment: HIVE-10799.patch Fix the TestRecordReaderImpl test case to match the new code.

[jira] [Updated] (HIVE-11210) Remove dependency on HiveConf from Orc reader writer

2015-07-15 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11210: - Attachment: HIVE-11210.patch retrying jenkins. Remove dependency on HiveConf from Orc reader

[jira] [Commented] (HIVE-11080) Modify VectorizedRowBatch.toString() to not depend on VectorExpressionWriter

2015-07-15 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628795#comment-14628795 ] Owen O'Malley commented on HIVE-11080: -- The unit test passes locally, can I get a

[jira] [Assigned] (HIVE-11253) Move SearchArgument and VectorizedRowBatch classes to storage-api.

2015-07-17 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley reassigned HIVE-11253: Assignee: Owen O'Malley Move SearchArgument and VectorizedRowBatch classes to

[jira] [Updated] (HIVE-10171) Create a storage-api module

2015-07-17 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-10171: - Fix Version/s: 2.0.0 Create a storage-api module ---

[jira] [Updated] (HIVE-11210) Remove dependency on HiveConf from Orc reader writer

2015-07-17 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11210: - Attachment: HIVE-11210.patch Removed the use of Configuration.getDouble, which messes up the

[jira] [Updated] (HIVE-11210) Remove dependency on HiveConf from Orc reader writer

2015-07-17 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11210: - Attachment: (was: HIVE-11210.patch) Remove dependency on HiveConf from Orc reader writer

[jira] [Updated] (HIVE-11210) Remove dependency on HiveConf from Orc reader writer

2015-07-17 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11210: - Attachment: HIVE-11210.patch Sorry, I managed to get the wrong version of the patch. Remove

[jira] [Updated] (HIVE-11210) Remove dependency on HiveConf from Orc reader writer

2015-07-17 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11210: - Attachment: (was: HIVE-11210.patch) Remove dependency on HiveConf from Orc reader writer

[jira] [Updated] (HIVE-11307) Remove getWritableObject from ColumnVectorBatch

2015-07-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11307: - Attachment: HIVE-11307.patch This patch removes the method and replaces the test code with

[jira] [Updated] (HIVE-11209) Clean up dependencies in HiveDecimalWritable

2015-07-17 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11209: - Attachment: HIVE-11209.patch Found and fixed a screwup in the code that I moved over. I also

[jira] [Updated] (HIVE-10799) Refactor the SearchArgumentFactory to remove the dependence on ExprNodeGenericFuncDesc

2015-07-17 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-10799: - Attachment: HIVE-10799.patch Fixed a couple of problems. Refactor the SearchArgumentFactory to

[jira] [Updated] (HIVE-11253) Move SearchArgument and VectorizedRowBatch classes to storage-api.

2015-07-19 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11253: - Attachment: HIVE-11253.patch Remove MapReduce from the storage api's pom dependencies. Move

[jira] [Updated] (HIVE-10799) Refactor the SearchArgumentFactory to remove the dependence on ExprNodeGenericFuncDesc

2015-07-19 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-10799: - Attachment: HIVE-10799.patch Reverted a spurious LOG.warn call that slipped into the previous

[jira] [Commented] (HIVE-11210) Remove dependency on HiveConf from Orc reader writer

2015-07-20 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14633899#comment-14633899 ] Owen O'Malley commented on HIVE-11210: -- They are actually used by HCatalog to set the

[jira] [Commented] (HIVE-11210) Remove dependency on HiveConf from Orc reader writer

2015-07-20 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14634209#comment-14634209 ] Owen O'Malley commented on HIVE-11210: -- Ok [~prasanth_j], I created HIVE-11321 to do

[jira] [Assigned] (HIVE-12286) Add option to ORC vectorized reader to not trim spaces from char columns.

2015-10-28 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley reassigned HIVE-12286: Assignee: Owen O'Malley > Add option to ORC vectorized reader to not trim spaces from char

[jira] [Updated] (HIVE-12054) Create vectorized write method

2015-11-10 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-12054: - Attachment: HIVE-12054.patch This updates two of the test cases that were extending MemoryManager

[jira] [Updated] (HIVE-12055) Create row-by-row shims for the write path

2015-11-16 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-12055: - Attachment: HIVE-12055.patch This depends on: * HIVE-11890 * HIVE-12054 > Create row-by-row

[jira] [Commented] (HIVE-11981) ORC Schema Evolution Issues (Vectorized, ACID, and Non-Vectorized)

2015-11-09 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997738#comment-14997738 ] Owen O'Malley commented on HIVE-11981: -- You should create a wiki page with the supported schema

[jira] [Commented] (HIVE-11981) ORC Schema Evolution Issues (Vectorized, ACID, and Non-Vectorized)

2015-11-09 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997767#comment-14997767 ] Owen O'Malley commented on HIVE-11981: -- Ok, we need to do some work to avoid tying ORC back into

[jira] [Updated] (HIVE-12054) Create vectorized write method

2015-10-30 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-12054: - Attachment: HIVE-12054.patch This patch: * Updates the murmur3 code to take offsets as well as

[jira] [Issue Comment Deleted] (HIVE-11890) Create ORC module

2015-11-06 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11890: - Comment: was deleted (was: GitHub user omalley opened a pull request:

[jira] [Updated] (HIVE-11890) Create ORC module

2015-11-05 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11890: - Attachment: HIVE-11890.patch This patch moves a lot of the files into the new module. > Create

[jira] [Updated] (HIVE-12054) Create vectorized write method

2015-11-05 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-12054: - Attachment: HIVE-12054.patch Re-upload patch to kick jenkins. > Create vectorized write method >

[jira] [Updated] (HIVE-11890) Create ORC module

2015-11-05 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11890: - Issue Type: Sub-task (was: Bug) Parent: HIVE-10171 > Create ORC module >

[jira] [Updated] (HIVE-11212) Create vectorized types for complex types

2015-10-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11212: - Attachment: HIVE-11212.patch Added the extra null check that Matthew asked for. > Create

[jira] [Updated] (HIVE-11417) Create shims for the row by row read path that is backed by VectorizedRowBatch

2015-10-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11417: - Description: I'd like to make the default path for reading and writing ORC files to be

[jira] [Updated] (HIVE-11212) Create vectorized types for complex types

2015-10-06 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11212: - Attachment: HIVE-11212.patch I needed protection against null in one of the factories. > Create

[jira] [Updated] (HIVE-11212) Create vectorized types for complex types

2015-10-06 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11212: - Attachment: HIVE-11212.patch I found a few more places where Hive is creating ColumnVectors. >

[jira] [Updated] (HIVE-11212) Create vectorized types for complex types

2015-10-05 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11212: - Attachment: HIVE-11212.patch Create the new vectorization columns. > Create vectorized types for

[jira] [Updated] (HIVE-10553) Remove hardcoded Parquet references from SearchArgumentImpl

2015-07-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-10553: - Attachment: HIVE-10553.patch Rebased to current trunk. Remove hardcoded Parquet references from

[jira] [Updated] (HIVE-11209) Clean up dependencies in HiveDecimalWritable

2015-07-08 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11209: - Attachment: HIVE-11209.patch This patch moves the needed enforcePrecisionScale down into

[jira] [Updated] (HIVE-11144) Remove row by row reader.

2015-07-08 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11144: - Description: The core ORC reader will be better served if the vectorized read path is the primary

[jira] [Updated] (HIVE-11144) Remove row by row reader.

2015-07-08 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11144: - Summary: Remove row by row reader. (was: Replace row by row reader and writer with shims to

[jira] [Updated] (HIVE-11210) Remove dependency on HiveConf from Orc reader writer

2015-07-08 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11210: - Attachment: HIVE-11210.patch This patch: * create OrcConf with an enumeration of the config

[jira] [Resolved] (HIVE-10797) Simplify the test for vectorized input

2015-07-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HIVE-10797. -- Resolution: Won't Fix I think we can ignore the acid stuff for now. Simplify the test for

[jira] [Resolved] (HIVE-10798) Remove dependence on VectorizedBatchUtil from VectorizedOrcAcidRowReader

2015-07-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HIVE-10798. -- Resolution: Won't Fix Release Note: Since the InputFormat stuff will stay in Hive, I think

[jira] [Commented] (HIVE-11137) In DateWritable remove the use of LazyBinaryUtils

2015-07-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617592#comment-14617592 ] Owen O'Malley commented on HIVE-11137: -- I'm confused. Do you have a patch for this?

[jira] [Updated] (HIVE-11137) In DateWritable remove the use of LazyBinaryUtils

2015-07-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11137: - Attachment: HIVE-11137.patch Here is my approach. In DateWritable remove the use of

[jira] [Updated] (HIVE-10799) Refactor the SearchArgumentFactory to remove the dependence on ExprNodeGenericFuncDesc

2015-07-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-10799: - Attachment: HIVE-10799.patch This patch: * splits SearchArgumentFactory into

[jira] [Commented] (HIVE-11080) Modify VectorizedRowBatch.toString() to not depend on VectorExpressionWriter

2015-07-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617360#comment-14617360 ] Owen O'Malley commented on HIVE-11080: -- Since this is only used for error messages,

[jira] [Updated] (HIVE-10795) Remove use of PerfLogger from Orc

2015-07-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-10795: - Attachment: HIVE-10795.patch Rebased to current trunk. Remove use of PerfLogger from Orc

[jira] [Updated] (HIVE-10799) Refactor the SearchArgumentFactory to remove the dependence on ExprNodeGenericFuncDesc

2015-07-10 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-10799: - Attachment: HIVE-10799.patch Resubmit for jenkins. Refactor the SearchArgumentFactory to remove

[jira] [Updated] (HIVE-11137) In DateWritable remove the use of LazyBinaryUtils

2015-07-10 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11137: - Attachment: HIVE-11137.patch rebased patch for jenkins. In DateWritable remove the use of

[jira] [Updated] (HIVE-11210) Remove dependency on HiveConf from Orc reader writer

2015-07-10 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11210: - Attachment: HIVE-11210.patch reload for jenkins. Remove dependency on HiveConf from Orc reader

[jira] [Updated] (HIVE-11124) Move OrcRecordUpdater.getAcidEventFields to RecordReaderFactory

2015-07-10 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11124: - Attachment: HIVE-11124.patch Reupload patch for jenkins. Move

[jira] [Resolved] (HIVE-11144) Remove row by row reader.

2015-11-17 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HIVE-11144. -- Resolution: Won't Fix > Remove row by row reader. > - > >

[jira] [Updated] (HIVE-11890) Create ORC module

2015-11-17 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11890: - Attachment: HIVE-11890.patch I made some more compatibility tweaks so that clients don't need to

[jira] [Updated] (HIVE-12055) Create row-by-row shims for the write path

2015-11-17 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-12055: - Attachment: HIVE-12055.patch Updated to match the new version of HIVE-11890. > Create row-by-row

[jira] [Commented] (HIVE-11618) Correct the SARG api to reunify the PredicateLeaf.Type INTEGER and LONG

2015-08-31 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723676#comment-14723676 ] Owen O'Malley commented on HIVE-11618: -- [~spena] Thanks for reviewing and committing this. You're

[jira] [Updated] (HIVE-11704) Create errata.txt file

2015-08-31 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11704: - Attachment: HIVE-11704.patch Here's a proposed file. > Create errata.txt file >

  1   2   3   4   5   6   >