[
https://issues.apache.org/jira/browse/HIVE-506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-506:
--
Attachment: patch-506-2009-05-29.patch
An update against trunk.
MoveTask was not reporting errors
[
https://issues.apache.org/jira/browse/HIVE-460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-460:
--
Attachment: hive-460-2009-05-29-noaliasallowed.patch
hive-460-2009-05-29-noaliasallowed.patch is not a
[
https://issues.apache.org/jira/browse/HIVE-451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-451:
--
Attachment: HIVE-451-2009-05-27.patch
A quick fix, only changes a few lines in Hive.g, and lets order by
[
https://issues.apache.org/jira/browse/HIVE-451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-451:
--
Attachment: HIVE-451-2009-05-28.patch
Added a testcase in orderby.q, and updated several .out files.
[
https://issues.apache.org/jira/browse/HIVE-461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-461:
--
Attachment: hive-461-2009-05-26.patch
A first try. The main modifications lie in ColumnPruner,
[
https://issues.apache.org/jira/browse/HIVE-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12713003#action_12713003
]
He Yongqiang commented on HIVE-417:
---
Checked how Mysql does with index and found mysql
[
https://issues.apache.org/jira/browse/HIVE-490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-490:
--
Attachment: hive-490-2009-05-26.patch
Checked the code and found what i suspected in previous comment is
[
https://issues.apache.org/jira/browse/HIVE-506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-506:
--
Attachment: patch-506-2009-05-23.patch
MoveTask was not reporting errors
[
https://issues.apache.org/jira/browse/HIVE-490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-490:
--
Attachment: hive-490-2009-05-23.patch
set mapred.reduce.tasks to -1 in hive-default.xml
[
https://issues.apache.org/jira/browse/HIVE-490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-490:
--
Attachment: hive-490-2009-05-23-2.patch
Added a comment to explain that hive will automatically find out
[
https://issues.apache.org/jira/browse/HIVE-490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-490:
--
Attachment: hive-490-2009-05-23-3.patch
hive-490-2009-05-23-3.patch includes parameters added in
[
https://issues.apache.org/jira/browse/HIVE-490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12712403#action_12712403
]
He Yongqiang commented on HIVE-490:
---
It seems there are some misunderstanding on the
[
https://issues.apache.org/jira/browse/HIVE-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12712352#action_12712352
]
He Yongqiang commented on HIVE-417:
---
Thanks a lot, Prasad. I will put questions on the
[
https://issues.apache.org/jira/browse/HIVE-500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-500:
--
Attachment: hive-500-2009-05-23.patch
Namit did a patch for HIVE-507, which includes the codes for
[
https://issues.apache.org/jira/browse/HIVE-500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12712359#action_12712359
]
He Yongqiang commented on HIVE-500:
---
Namit, I think HIVE-507 does not resolve this issue.
Optimize RCFile's performance by removeing all synchronized modifiers
-
Key: HIVE-502
URL: https://issues.apache.org/jira/browse/HIVE-502
Project: Hadoop Hive
Issue Type:
[
https://issues.apache.org/jira/browse/HIVE-502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-502:
--
Attachment: hive-502-2009-05-21.patch
Optimize RCFile's performance by removeing all synchronized
[
https://issues.apache.org/jira/browse/HIVE-502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-502:
--
Attachment: hive-502-2009-05-22.patch
Fix a typo in class HiveDataInputBuffer's comment. Thanks, Zheng.
[
https://issues.apache.org/jira/browse/HIVE-497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12711033#action_12711033
]
He Yongqiang commented on HIVE-497:
---
+1. Looks good, and it passed my example.
predicate
[
https://issues.apache.org/jira/browse/HIVE-497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12711254#action_12711254
]
He Yongqiang commented on HIVE-497:
---
Got it. Thanks for the explanation, Prasad. The parse
[
https://issues.apache.org/jira/browse/HIVE-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12710591#action_12710591
]
He Yongqiang commented on HIVE-417:
---
that is not the case if the index is on a non-primary
[
https://issues.apache.org/jira/browse/HIVE-477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12708796#action_12708796
]
He Yongqiang commented on HIVE-477:
---
One Comment for 1):
Avoiding byte copy when init
[
https://issues.apache.org/jira/browse/HIVE-477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12708732#action_12708732
]
He Yongqiang commented on HIVE-477:
---
I did the same test without compression.
It turns out
[
https://issues.apache.org/jira/browse/HIVE-477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12708056#action_12708056
]
He Yongqiang commented on HIVE-477:
---
Using hadoop-streaming.jar
RCFile:
[
https://issues.apache.org/jira/browse/HIVE-477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12708056#action_12708056
]
He Yongqiang edited comment on HIVE-477 at 5/11/09 10:06 PM:
-
Change RCFileOutputFormat's generic signatute to be WritableComparable, ..
Key: HIVE-479
URL: https://issues.apache.org/jira/browse/HIVE-479
Project: Hadoop Hive
[
https://issues.apache.org/jira/browse/HIVE-479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-479:
--
Description:
In one test for hive-477, i found that the below command can not sucessfully
pass:
[
https://issues.apache.org/jira/browse/HIVE-479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-479:
--
Attachment: hive-479-2009-5-12.patch
Change RCFileOutputFormat's generic signatute to be
[
https://issues.apache.org/jira/browse/HIVE-477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12707872#action_12707872
]
He Yongqiang commented on HIVE-477:
---
I did a test to see how much time is used in the
Some optimization thoughts for Hive
---
Key: HIVE-477
URL: https://issues.apache.org/jira/browse/HIVE-477
Project: Hadoop Hive
Issue Type: Improvement
Reporter: He Yongqiang
Before we can start
[
https://issues.apache.org/jira/browse/HIVE-477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-477:
--
Description:
Before we can start working on Hive-461. I am doing some profiling for hive.
And here are
[
https://issues.apache.org/jira/browse/HIVE-472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12707192#action_12707192
]
He Yongqiang commented on HIVE-472:
---
Thanks, Ashish.
This bug will cause insert overwrite
[
https://issues.apache.org/jira/browse/HIVE-477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12707194#action_12707194
]
He Yongqiang commented on HIVE-477:
---
one refrence for 4):
Breaking the Memory Wall in
HiveFileFormatUtils's checkInputFormat does not include RCFile
--
Key: HIVE-472
URL: https://issues.apache.org/jira/browse/HIVE-472
Project: Hadoop Hive
Issue Type: Bug
[
https://issues.apache.org/jira/browse/HIVE-472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-472:
--
Attachment: hive.472.1.patch
hive.472.1.patch adds the check of RCFile.
If we get more and more
[
https://issues.apache.org/jira/browse/HIVE-472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-472:
--
Status: Patch Available (was: Open)
HiveFileFormatUtils's checkInputFormat does not include RCFile
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-352:
--
Attachment: hive-352-2009-4-30-4.patch
hive-352-2009-4-30-4.patch does some refactor work to
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-352:
--
Attachment: hive-352-2009-5-1.patch
Thanks for the detailed review and the improvement instructions,
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-352:
--
Attachment: hive-352-2009-5-1-3.patch
Fixes a small mistake in previous file, and adds in a boolean
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-352:
--
Attachment: hive-352-2009-4-30-2.patch
hive-352-2009-4-30-2.patch changs all lists to java arrays,
1),
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-352:
--
Attachment: Hadoop-5596-2009-04-30-2.patch
compiled with hadoop-0.17
Make Hive support column based
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-352:
--
Attachment: (was: Hadoop-5596-2009-04-30-2.patch)
Make Hive support column based storage
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-352:
--
Attachment: hive-352-2009-4-30-3.patch
Sorry for the wrong file attached earlier.
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12703980#action_12703980
]
He Yongqiang commented on HIVE-352:
---
Zheng, can you post your profiling results?
I did a
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-352:
--
Attachment: hive-352-2009-4-27.patch
hive-352-2009-4-27.patch changed back to bulk compression and now
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12701837#action_12701837
]
He Yongqiang commented on HIVE-352:
---
Thanks, Zheng.
0. Did you try that with hadoop 0.17.0?
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12701843#action_12701843
]
He Yongqiang commented on HIVE-352:
---
More explaination for the fomular used:
{noformat}
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12702146#action_12702146
]
He Yongqiang commented on HIVE-352:
---
Can we also get some numbers on the amount of memory
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-352:
--
Attachment: 4-22 performance.txt
4-22 progress.txt
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12700764#action_12700764
]
He Yongqiang commented on HIVE-352:
---
When I am testing RCFile's read performance, I notice
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12700765#action_12700765
]
He Yongqiang commented on HIVE-352:
---
More explaination to the read sharp decrease problem:
[
https://issues.apache.org/jira/browse/HIVE-428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang resolved HIVE-428.
---
Resolution: Duplicate
Release Note: Duplicate of hive-195
Close this issue, duplicate of
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-352:
--
Attachment: hive-352-2009-4-17.patch
Fixed the select problem.
And refatored the TestRCFile class.
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-352:
--
Attachment: hive-352-2009-4-16.patch
against the latest truck.
1) added a simple rcfile_columar.q file
[
https://issues.apache.org/jira/browse/HIVE-428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12699987#action_12699987
]
He Yongqiang commented on HIVE-428:
---
ohh, sorry.
i am ok to close this for a duplicate or
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-352:
--
Attachment: hive-352-2009-4-15.patch
This is the latest work on this issue.
1) added new columnar serde
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12699046#action_12699046
]
He Yongqiang commented on HIVE-352:
---
more tests are needed, especaill on HiveOutputFormat.
[
https://issues.apache.org/jira/browse/HIVE-360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-360:
--
Attachment: hive-360-2009-04-09.patch
1) modified the .out files using -Doverwrite=true
2) removed
[
https://issues.apache.org/jira/browse/HIVE-360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-360:
--
Attachment: hive-360-2009-04-07-5.patch
1)
HiveOutputFileFormat by adding a new Method? Like
[
https://issues.apache.org/jira/browse/HIVE-360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-360:
--
Attachment: qfile.tar
Generalize the FileFormat Interface in Hive
[
https://issues.apache.org/jira/browse/HIVE-360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-360:
--
Attachment: hive-360-2009-04-08.patch
Generalize the FileFormat Interface in Hive
[
https://issues.apache.org/jira/browse/HIVE-360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-360:
--
Attachment: hive-360-2009-04-04-4.patch
1) change tableDesc in the getHiveRecordWriter method to
[
https://issues.apache.org/jira/browse/HIVE-360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-360:
--
Attachment: hive-360-2009-04-01.patch
hive-360-2009-04-01.patch is a refactored version of
[
https://issues.apache.org/jira/browse/HIVE-360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-360:
--
Status: Patch Available (was: Open)
Generalize the FileFormat Interface in Hive
[
https://issues.apache.org/jira/browse/HIVE-360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-360:
--
Attachment: hive-360-2009-03-31.patch
Attached hive-360-2009-03-31.patch, a draft version.
1) add a new
[
https://issues.apache.org/jira/browse/HIVE-360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-360:
--
Attachment: hive-360-2009-03-31.patch
Attached hive-360-2009-03-31.patch, a draft version.
1) add a new
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-352:
--
Attachment: Hive-352-draft-2009-03-30.patch
An update version according Zheng's suggestions.
1) remove
[
https://issues.apache.org/jira/browse/HIVE-360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12693637#action_12693637
]
He Yongqiang commented on HIVE-360:
---
TOK_TABLEFILEFORMAT is already handled in
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-352:
--
Attachment: HIve-352-draft-2009-03-28.patch
A draft version of B2.2.
Thank you a lot for comments.
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12689492#action_12689492
]
He Yongqiang commented on HIVE-352:
---
{quote}
impose our own structure on the sequencefile
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12689794#action_12689794
]
He Yongqiang commented on HIVE-352:
---
Thanks, Raghotham Murthy.
Besides these two posts,
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12689151#action_12689151
]
He Yongqiang commented on HIVE-352:
---
One problem with this RCFile is that it needs to know
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12688606#action_12688606
]
He Yongqiang commented on HIVE-352:
---
Thank you for the advices, joydeep.
yeah,i am
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12688611#action_12688611
]
He Yongqiang commented on HIVE-352:
---
By So i guess i may need to discard SequenceFile,
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12683783#action_12683783
]
He Yongqiang commented on HIVE-352:
---
Thanks, Joydeep and Zheng. The advises are really
Make Hive support column based storage
--
Key: HIVE-352
URL: https://issues.apache.org/jira/browse/HIVE-352
Project: Hadoop Hive
Issue Type: New Feature
Reporter: he yongqiang
column based
[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12682740#action_12682740
]
he yongqiang commented on HIVE-352:
---
Thanks, Joydeep Sen Sarma. Your feedback is really
601 - 677 of 677 matches
Mail list logo
