Add export/import facilities to the hive system
---
Key: HIVE-1918
URL: https://issues.apache.org/jira/browse/HIVE-1918
Project: Hive
Issue Type: New Feature
Components: Query Processor
[
https://issues.apache.org/jira/browse/HIVE-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-1918:
Status: Patch Available (was: Open)
Patch for adding export/import.
Add export/import facilities
[
https://issues.apache.org/jira/browse/HIVE-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-1918:
Attachment: HIVE-1918.patch.txt
Add export/import facilities to the hive system
[
https://issues.apache.org/jira/browse/HIVE-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12983532#action_12983532
]
Krishna Kumar commented on HIVE-1918:
-
Design notes:
- Export/Import modeled on
[
https://issues.apache.org/jira/browse/HIVE-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12984128#action_12984128
]
Krishna Kumar commented on HIVE-1918:
-
Ok. Will take of this via a delegating ctor.
A
[
https://issues.apache.org/jira/browse/HIVE-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12984563#action_12984563
]
Krishna Kumar commented on HIVE-1918:
-
Why export/import needs this change: It is not
[
https://issues.apache.org/jira/browse/HIVE-1924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-1924:
Status: Patch Available (was: Open)
Not sure how to test this automatically, since the readers are
[
https://issues.apache.org/jira/browse/HIVE-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12985556#action_12985556
]
Krishna Kumar commented on HIVE-1918:
-
@Edward: Both the existing data model (prettified
[
https://issues.apache.org/jira/browse/HIVE-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-1918:
Attachment: hive-metastore-er.pdf
Prettified ER diagram of the existing data model
Add
[
https://issues.apache.org/jira/browse/HIVE-1924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-1924:
Status: Open (was: Patch Available)
Hmm, The patch is not correct. Setting hive.checkformat=false
[
https://issues.apache.org/jira/browse/HIVE-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992373#comment-12992373
]
Krishna Kumar commented on HIVE-1918:
-
Importing into existing tables is now supported,
[
https://issues.apache.org/jira/browse/HIVE-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992606#comment-12992606
]
Krishna Kumar commented on HIVE-1918:
-
Hmm. LoadSemanticAnalyzer (which knows the
[
https://issues.apache.org/jira/browse/HIVE-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-1918:
Status: Patch Available (was: Open)
Please review. Will try and see if I can update the
[
https://issues.apache.org/jira/browse/HIVE-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12995767#comment-12995767
]
Krishna Kumar commented on HIVE-1918:
-
https://reviews.apache.org/r/430/ added (with
[
https://issues.apache.org/jira/browse/HIVE-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12997296#comment-12997296
]
Krishna Kumar commented on HIVE-1918:
-
There are a few reasons why I took this approach
LOAD compilation does not set the outputs during semantic analysis resulting in
no authorization checks being done for it.
--
Key: HIVE-2003
[
https://issues.apache.org/jira/browse/HIVE-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12998276#comment-12998276
]
Krishna Kumar commented on HIVE-2003:
-
6. Loading a partitioned table without
[
https://issues.apache.org/jira/browse/HIVE-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-2003:
Attachment: (was: HIVE-2003.patch.txt)
LOAD compilation does not set the outputs during
[
https://issues.apache.org/jira/browse/HIVE-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-1918:
Attachment: HIVE-1918.patch.5.txt
- Nested ternaries expanded
- thrift-based serialization for
[
https://issues.apache.org/jira/browse/HIVE-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-1918:
Attachment: (was: HIVE-1918.patch.5.txt)
Add export/import facilities to the hive system
RCFile issues
-
Key: HIVE-2065
URL: https://issues.apache.org/jira/browse/HIVE-2065
Project: Hive
Issue Type: Bug
Reporter: Krishna Kumar
Priority: Minor
Some potential issues with RCFile
1. Remove
[
https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-2065:
Attachment: Slide1.png
Compressed RCFile Layout
RCFile issues
-
[
https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar reassigned HIVE-2065:
---
Assignee: Krishna Kumar
RCFile issues
-
Key: HIVE-2065
[
https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008741#comment-13008741
]
Krishna Kumar commented on HIVE-2065:
-
So should I go ahead and fix #2 and #3 as well?
[
https://issues.apache.org/jira/browse/HIVE-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-2003:
Attachment: HIVE-2003.patch.1.txt
Regenerated the patch.
LOAD compilation does not set the
[
https://issues.apache.org/jira/browse/HIVE-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13009202#comment-13009202
]
Krishna Kumar commented on HIVE-2003:
-
Added to review board:
[
https://issues.apache.org/jira/browse/HIVE-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13009203#comment-13009203
]
Krishna Kumar commented on HIVE-2003:
-
For #4 above, I have taken now the same approach
[
https://issues.apache.org/jira/browse/HIVE-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-2003:
Status: Patch Available (was: Open)
Please review asap as there are lots of changes to q.out files
[
https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13009981#comment-13009981
]
Krishna Kumar commented on HIVE-2065:
-
Hmm. #3 is taking me a bit too far than I
[
https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-2065:
Attachment: proposal.png
The layout as implemented in the attached patch
RCFile issues
[
https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-2065:
Attachment: HIVE.2065.patch.0.txt
Patch. Since it contains binary files, it was generated with
[
https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13012125#comment-13012125
]
Krishna Kumar commented on HIVE-2065:
-
Review Board Entry at
[
https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13014065#comment-13014065
]
Krishna Kumar commented on HIVE-2065:
-
The RCFile layout seems to have been designed
[
https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13014351#comment-13014351
]
Krishna Kumar commented on HIVE-2065:
-
As I indicated, the reason I made changes for
[
https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-2065:
Attachment: HIVE.2065.patch.1.txt
Updated patch where sequence file compliance is not addressed but
Explore mechanisms for better compression with RC Files
---
Key: HIVE-2097
URL: https://issues.apache.org/jira/browse/HIVE-2097
Project: Hive
Issue Type: Improvement
Components:
[
https://issues.apache.org/jira/browse/HIVE-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar reassigned HIVE-2097:
---
Assignee: Krishna Kumar
Explore mechanisms for better compression with RC Files
[
https://issues.apache.org/jira/browse/HIVE-2071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-2071:
Attachment: HIVE.2071.patch.0.txt
Tentative patch to show the implementation for the sessionstate
Make couple of convenience methods in EximUtil public
-
Key: HIVE-2098
URL: https://issues.apache.org/jira/browse/HIVE-2098
Project: Hive
Issue Type: Bug
Reporter: Krishna
[
https://issues.apache.org/jira/browse/HIVE-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar reassigned HIVE-2098:
---
Assignee: Krishna Kumar
Make couple of convenience methods in EximUtil public
[
https://issues.apache.org/jira/browse/HIVE-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-2098:
Attachment: HIVE.2098.patch.0.txt
Couple of methods made public for use outside of the package.
[
https://issues.apache.org/jira/browse/HIVE-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-2098:
Status: Patch Available (was: Open)
Make couple of convenience methods in EximUtil public
[
https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-956:
---
Attachment: HIVE.956.patch.0
Initial patch for lazy binary columnar serde. Reuses elements of columnar
[
https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13041502#comment-13041502
]
Krishna Kumar commented on HIVE-956:
Initial patch for lazy binary columnar serde.
[
https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-956:
---
Status: Patch Available (was: Open)
Add support of columnar binary serde
[
https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-956:
---
Attachment: HIVE.956.patch.1
Patch with a change on how null vs empty strings are handled. This patch
[
https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13046043#comment-13046043
]
Krishna Kumar commented on HIVE-956:
Re-ordering my responses;
bq. can
[
https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-956:
---
Attachment: HIVE.956.patch.2
Re-ordering my responses;
bq. can LazyBinaryColumnarSerDe share some
[
https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13046362#comment-13046362
]
Krishna Kumar commented on HIVE-956:
bq. can warnedOnceNullMapKey be removed?
It is
Provide a way by which ObjectInspectorUtils.compare can be extended by the
caller for comparing maps which are part of the object
-
Key: HIVE-2209
[
https://issues.apache.org/jira/browse/HIVE-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-2209:
Issue Type: Improvement (was: Sub-task)
Parent: (was: HIVE-956)
Provide a way by
[
https://issues.apache.org/jira/browse/HIVE-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-2209:
Attachment: HIVE-2209v0.patch
Patch, with tests, added.
Provide a way by which
[
https://issues.apache.org/jira/browse/HIVE-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-2209:
Status: Patch Available (was: Open)
For review by He Yongqiang
Provide a way by which
[
https://issues.apache.org/jira/browse/HIVE-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13049297#comment-13049297
]
Krishna Kumar commented on HIVE-2209:
-
He Yongqiang,
Can you take a look at this one?
[
https://issues.apache.org/jira/browse/HIVE-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-2209:
Attachment: HIVE2209v1.patch
Added another implementation with sorting of the keys
Provide a way
[
https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-956:
---
Attachment: HIVE-956v3.patch
After separating mapcomparer changes to its own jira/patch - HIVE-2209
[
https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-956:
---
Status: Patch Available (was: Open)
I have tested the setting of rawDataSize with a ANALYZE TABLE
[
https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13438434#comment-13438434
]
Krishna Kumar commented on HIVE-2623:
-
Hi Rao,
I have not been able to do much
[
https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-956:
---
Attachment: HIVE-956v4.patch
Please note that HIVE-2209 is a pre-requisite for this patch.
Add
[
https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13067588#comment-13067588
]
Krishna Kumar commented on HIVE-956:
Common code moved to a base class to that
import of multiple partitions from a partitioned table with external location
overwrites files
--
Key: HIVE-2384
URL: https://issues.apache.org/jira/browse/HIVE-2384
[
https://issues.apache.org/jira/browse/HIVE-2384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-2384:
Assignee: Krishna Kumar
Status: Patch Available (was: Open)
import of multiple partitions
[
https://issues.apache.org/jira/browse/HIVE-2384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-2384:
Attachment: HIVE-2384.v0.patch
Patch with tests
import of multiple partitions from a partitioned
BlockMergeTask ignores client-specified jars
Key: HIVE-2413
URL: https://issues.apache.org/jira/browse/HIVE-2413
Project: Hive
Issue Type: Bug
Components: Query Processor
[
https://issues.apache.org/jira/browse/HIVE-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-2413:
Attachment: HIVE-2413.v0.patch
Here is a simple fix which works for me, though there may be better
Merging of compressed rcfiles fails to write the valuebuffer part correctly
---
Key: HIVE-2417
URL: https://issues.apache.org/jira/browse/HIVE-2417
Project: Hive
Issue
[
https://issues.apache.org/jira/browse/HIVE-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-2417:
Attachment: HIVE-2417.v0.patch
Test added
Merging of compressed rcfiles fails to write the
[
https://issues.apache.org/jira/browse/HIVE-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-2417:
Status: Patch Available (was: Open)
Merging of compressed rcfiles fails to write the valuebuffer
[
https://issues.apache.org/jira/browse/HIVE-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-2413:
Assignee: Krishna Kumar
Status: Patch Available (was: Open)
BlockMergeTask ignores
[
https://issues.apache.org/jira/browse/HIVE-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13094294#comment-13094294
]
Krishna Kumar commented on HIVE-2417:
-
Yes, the test is designed to produce the error
[
https://issues.apache.org/jira/browse/HIVE-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-2417:
Attachment: HIVE-2417.v1.patch
Test changed after review comments
- default codec instead of bzip2
[
https://issues.apache.org/jira/browse/HIVE-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar updated HIVE-2413:
Attachment: HIVE-2413.v1.patch
Empty string not handled correctly in JC so handling it here...
72 matches
Mail list logo