[jira] Updated: (HIVE-1691) ANALYZE TABLE command should check columns in partitioin spec

2010-10-05 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1691: - Attachment: HIVE-1691.patch > ANALYZE TABLE command should check columns in partitioin s

[jira] Updated: (HIVE-1691) ANALYZE TABLE command should check columns in partitioin spec

2010-10-05 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1691: - Status: Patch Available (was: Open) > ANALYZE TABLE command should check columns in partitioin s

[jira] Created: (HIVE-1691) ANALYZE TABLE command should check columns in partitioin spec

2010-10-05 Thread Ning Zhang (JIRA)
Reporter: Ning Zhang Assignee: Ning Zhang ANALYZE TABEL PARTITION (col1, col2,...) should check whether col1, col2 etc are partition columns. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

Re: Analyze table compute statistics errors and OOM

2010-10-05 Thread Ning Zhang
On Oct 5, 2010, at 4:38 AM, Terje Marthinussen wrote: > Just tested analyze table with a trunk build (from yesterday, oct 4th). > > tried various variations (with or without partitions) of it, but regardless > of what I try, I either get: > -- > analyze table normalized compute > statistics; >

[jira] Updated: (HIVE-1376) Simple UDAFs with more than 1 parameter crash on empty row query

2010-10-04 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1376: - Status: Patch Available (was: Open) > Simple UDAFs with more than 1 parameter crash on empty row qu

[jira] Updated: (HIVE-1674) count(*) returns wrong result when a mapper returns empty results

2010-10-04 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1674: - Attachment: HIVE-1674.patch > count(*) returns wrong result when a mapper returns empty resu

[jira] Updated: (HIVE-1674) count(*) returns wrong result when a mapper returns empty results

2010-10-04 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1674: - Status: Patch Available (was: Open) > count(*) returns wrong result when a mapper returns empty resu

[jira] Commented: (HIVE-1611) Add alternative search-provider to Hive site

2010-10-01 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12917001#action_12917001 ] Ning Zhang commented on HIVE-1611: -- Thanks for the link Alex. I've talked to Ashi

[jira] Resolved: (HIVE-1684) intermittent failures in create_escape.q

2010-10-01 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang resolved HIVE-1684. -- Resolution: Duplicate duplicate of HIVE-1669. > intermittent failures in create_escap

[jira] Commented: (HIVE-1684) intermittent failures in create_escape.q

2010-10-01 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12916990#action_12916990 ] Ning Zhang commented on HIVE-1684: -- This is the same as HIVE-1669, which was introduce

[jira] Updated: (HIVE-1376) Simple UDAFs with more than 1 parameter crash on empty row query

2010-10-01 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1376: - Attachment: HIVE-1376.2.patch The previous patch failed on several test, particularly count(*) queries

[jira] Commented: (HIVE-1611) Add alternative search-provider to Hive site

2010-10-01 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12916927#action_12916927 ] Ning Zhang commented on HIVE-1611: -- Hi Alex, some questions: - Hive doesn't have

[jira] Commented: (HIVE-1526) Hive should depend on a release version of Thrift

2010-09-30 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12916798#action_12916798 ] Ning Zhang commented on HIVE-1526: -- I will take a look. > Hive should depe

[jira] Updated: (HIVE-1376) Simple UDAFs with more than 1 parameter crash on empty row query

2010-09-30 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1376: - Status: Open (was: Patch Available) > Simple UDAFs with more than 1 parameter crash on empty row qu

[jira] Updated: (HIVE-1157) UDFs can't be loaded via "add jar" when jar is on HDFS

2010-09-30 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1157: - Status: Open (was: Patch Available) > UDFs can't be loaded via "add jar" w

[jira] Commented: (HIVE-1427) Provide metastore schema migration scripts (0.5 -> 0.6)

2010-09-30 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12916742#action_12916742 ] Ning Zhang commented on HIVE-1427: -- Carl, this is the only 0.6 blocker that doesn&#x

[jira] Commented: (HIVE-1526) Hive should depend on a release version of Thrift

2010-09-30 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12916741#action_12916741 ] Ning Zhang commented on HIVE-1526: -- Carl and Todd, is this a blocking issue for 0.6

[jira] Updated: (HIVE-1376) Simple UDAFs with more than 1 parameter crash on empty row query

2010-09-30 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1376: - Status: Patch Available (was: Open) Assignee: Ning Zhang > Simple UDAFs with more than 1 parame

[jira] Updated: (HIVE-1376) Simple UDAFs with more than 1 parameter crash on empty row query

2010-09-30 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1376: - Attachment: HIVE-1376.patch Attaching a patch for review. This patch also fixes HIVE-1674 (count

[jira] Assigned: (HIVE-1674) count(*) returns wrong result when a mapper returns empty results

2010-09-30 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang reassigned HIVE-1674: Assignee: Ning Zhang > count(*) returns wrong result when a mapper returns empty resu

[jira] Created: (HIVE-1674) count(*) returns wrong result when a mapper returns empty results

2010-09-29 Thread Ning Zhang (JIRA)
Reporter: Ning Zhang select count(*) from src where false; will return # of mappers rather than 0. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

[jira] Commented: (HIVE-1638) convert commonly used udfs to generic udfs

2010-09-29 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12916256#action_12916256 ] Ning Zhang commented on HIVE-1638: -- Siying, great work! Also can you do an optimiza

[jira] Commented: (HIVE-1665) drop operations may cause file leak

2010-09-29 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12916249#action_12916249 ] Ning Zhang commented on HIVE-1665: -- What about 2 failed and rolling back 1) also fa

[jira] Resolved: (HIVE-1524) parallel execution failed if mapred.job.name is set

2010-09-28 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang resolved HIVE-1524. -- Release Note: Committed to branch 0.6. Thanks Yuanjun! Resolution: Fixed > parallel execut

[jira] Commented: (HIVE-675) add database/schema support Hive QL

2010-09-28 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12915990#action_12915990 ] Ning Zhang commented on HIVE-675: - That works. Thanks Carl! > add database/schema

[jira] Commented: (HIVE-1524) parallel execution failed if mapred.job.name is set

2010-09-28 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12915949#action_12915949 ] Ning Zhang commented on HIVE-1524: -- Currently branch 0.6 is broken. It may be cause

[jira] Commented: (HIVE-675) add database/schema support Hive QL

2010-09-28 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12915946#action_12915946 ] Ning Zhang commented on HIVE-675: - Hi Carl, Branch 0.6 currently is broken when runni

[jira] Commented: (HIVE-1524) parallel execution failed if mapred.job.name is set

2010-09-28 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12915651#action_12915651 ] Ning Zhang commented on HIVE-1524: -- Thanks for back porting to 0.6 yourchanges. The

[jira] Updated: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-27 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1378: - Status: Resolved (was: Patch Available) Resolution: Fixed Committed. Thanks Steven! > Ret

[jira] Updated: (HIVE-1669) non-deterministic display of storage parameter in test

2010-09-27 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1669: - Parent: HIVE-1658 Issue Type: Sub-task (was: Test) > non-deterministic display of stor

[jira] Commented: (HIVE-1658) Fix describe [extended] column formatting

2010-09-27 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12915437#action_12915437 ] Ning Zhang commented on HIVE-1658: -- Another issue is that now 'desc extended&

[jira] Resolved: (HIVE-1582) merge mapfiles task behaves incorrectly for 'inserting overwrite directory...'

2010-09-27 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang resolved HIVE-1582. -- Resolution: Not A Problem Taked to Namit and Yongqiang, this is not a bug. INSERT OVERWRITE to (HDFS

Re: Logging level

2010-09-25 Thread Ning Zhang
hive -hiveconf hive.root.logger=DEBUG,DRFA On Sep 25, 2010, at 11:27 PM, Steven Wong wrote: How can I control the logging level of Hive code that runs in the mappers/reducers? For example, how to set it to DEBUG? Thanks. Steven

[jira] Commented: (HIVE-1670) MapJoin throws EOFExeption when the mapjoined table has 0 column selected

2010-09-24 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12914764#action_12914764 ] Ning Zhang commented on HIVE-1670: -- Not sure whether this patch fixes that bug. Maybe

[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-24 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12914756#action_12914756 ] Ning Zhang commented on HIVE-1378: -- +1. testing. > Return value for map, arr

[jira] Updated: (HIVE-1670) MapJoin throws EOFExeption when the mapjoined table has 0 column selected

2010-09-24 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1670: - Status: Patch Available (was: Open) > MapJoin throws EOFExeption when the mapjoined table has 0 col

[jira] Updated: (HIVE-1670) MapJoin throws EOFExeption when the mapjoined table has 0 column selected

2010-09-24 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1670: - Attachment: HIVE-1670.patch > MapJoin throws EOFExeption when the mapjoined table has 0 column selec

[jira] Created: (HIVE-1670) MapJoin throws EOFExeption when the mapjoined table has 0 column selected

2010-09-24 Thread Ning Zhang (JIRA)
Issue Type: Bug Reporter: Ning Zhang Assignee: Ning Zhang select /*+mapjoin(b) */ sum(a.key) from src a join src b on (a.key=b.key); throws EOFException -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

[jira] Created: (HIVE-1669) non-deterministic display of storage parameter in test

2010-09-24 Thread Ning Zhang (JIRA)
: Ning Zhang With the change to beautify the 'desc extended table', the storage parameters are displayed in non-deterministic manner (since its implementation is HashMap). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

[jira] Updated: (HIVE-1659) parse_url_tuple: a UDTF version of parse_url

2010-09-24 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1659: - Status: Resolved (was: Patch Available) Resolution: Fixed Committed. Thanks Xing

[jira] Commented: (HIVE-1659) parse_url_tuple: a UDTF version of parse_url

2010-09-24 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12914602#action_12914602 ] Ning Zhang commented on HIVE-1659: -- Xing, there is a diff in show_functions.q. You nee

[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-24 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12914598#action_12914598 ] Ning Zhang commented on HIVE-1378: -- Before we decided to drop support for pre-0.20

[jira] Commented: (HIVE-1659) parse_url_tuple: a UDTF version of parse_url

2010-09-23 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12914360#action_12914360 ] Ning Zhang commented on HIVE-1659: -- Also when you generate the patch, you need to run

[jira] Commented: (HIVE-1659) parse_url_tuple: a UDTF version of parse_url

2010-09-23 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12914358#action_12914358 ] Ning Zhang commented on HIVE-1659: -- Xing, this patch doesn't apply cleanly with t

[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-23 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12914346#action_12914346 ] Ning Zhang commented on HIVE-1378: -- @john, should we run a survey on hive-user mai

[jira] Commented: (HIVE-1659) parse_url_tuple: a UDTF version of parse_url

2010-09-23 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12914337#action_12914337 ] Ning Zhang commented on HIVE-1659: -- Xing, the patch was not attached. Can you use the

[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-23 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12914335#action_12914335 ] Ning Zhang commented on HIVE-1378: -- Steven, tests passed for hadoop 0.20, but it faile

[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-23 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12914305#action_12914305 ] Ning Zhang commented on HIVE-1378: -- OK. This one applied cleanly. I'm startin

[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-23 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12914282#action_12914282 ] Ning Zhang commented on HIVE-1378: -- Changes look good. However there are conflicts

[jira] Updated: (HIVE-1361) table/partition level statistics

2010-09-23 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1361: - Attachment: HIVE-1361.5.java_only.patch HIVE-1361.5.patch uploading a new set of patches

[jira] Updated: (HIVE-1361) table/partition level statistics

2010-09-22 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1361: - Attachment: HIVE-1361.4.java_only.patch HIVE-1361.4.patch Uploading new patch that

[jira] Commented: (HIVE-1526) Hive should depend on a release version of Thrift

2010-09-22 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12913843#action_12913843 ] Ning Zhang commented on HIVE-1526: -- The Hive ODBC code is dependent on Thrift as well

[jira] Updated: (HIVE-1361) table/partition level statistics

2010-09-22 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1361: - Attachment: HIVE-1361.3.patch Updated HIVE-1361.3.patch. > table/partition level statist

[jira] Updated: (HIVE-1361) table/partition level statistics

2010-09-22 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1361: - Attachment: (was: HIVE-1361.3.patch) > table/partition level statist

[jira] Commented: (HIVE-1658) Fix describe [extended] column formatting

2010-09-22 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12913668#action_12913668 ] Ning Zhang commented on HIVE-1658: -- +1 on keeping the old format but add a &qu

[jira] Updated: (HIVE-1361) table/partition level statistics

2010-09-22 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1361: - Attachment: HIVE-1361.3.patch Uploading HIVE-1361.3.patch which passes all tests on hadoop 0.20 &

[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-21 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12913338#action_12913338 ] Ning Zhang commented on HIVE-1378: -- Steven, there are conflicts when applying to

[jira] Commented: (HIVE-1651) ScriptOperator should not forward any output to downstream operators if an exception is happened

2010-09-21 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12913301#action_12913301 ] Ning Zhang commented on HIVE-1651: -- Discussed with Joydeep offline. The side effect

[jira] Updated: (HIVE-1361) table/partition level statistics

2010-09-21 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1361: - Status: Patch Available (was: Open) > table/partition level statist

[jira] Updated: (HIVE-1361) table/partition level statistics

2010-09-21 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1361: - Attachment: HIVE-1361.2.patch HIVE-1361.2_java_only.patch Uploading a new patch

[jira] Commented: (HIVE-1659) parse_url_tuple: a UDTF version of parse_url

2010-09-21 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12913081#action_12913081 ] Ning Zhang commented on HIVE-1659: -- parse_url currently support 2 signatures: parse

[jira] Created: (HIVE-1659) parse_url_tuple: a UDTF version of parse_url

2010-09-21 Thread Ning Zhang (JIRA)
parse_url_tuple: a UDTF version of parse_url - Key: HIVE-1659 URL: https://issues.apache.org/jira/browse/HIVE-1659 Project: Hadoop Hive Issue Type: New Feature Reporter: Ning Zhang

[jira] Commented: (HIVE-1609) Support partition filtering in metastore

2010-09-20 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12912855#action_12912855 ] Ning Zhang commented on HIVE-1609: -- @namit, the Hive metastore already has the API to

[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-17 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12910899#action_12910899 ] Ning Zhang commented on HIVE-1378: -- Looks good in general. I've left some minor

[jira] Updated: (HIVE-1655) Adding consistency check at jobClose() when committing dynamic partitions

2010-09-17 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1655: - Attachment: HIVE-1655.patch > Adding consistency check at jobClose() when committing dynamic partiti

[jira] Updated: (HIVE-1655) Adding consistency check at jobClose() when committing dynamic partitions

2010-09-17 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1655: - Status: Patch Available (was: Open) > Adding consistency check at jobClose() when committing dyna

[jira] Commented: (HIVE-1655) Adding consistency check at jobClose() when committing dynamic partitions

2010-09-17 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12910880#action_12910880 ] Ning Zhang commented on HIVE-1655: -- Actually the _tmp files are taken care o

[jira] Created: (HIVE-1655) Adding consistency check at jobClose() when committing dynamic partitions

2010-09-17 Thread Ning Zhang (JIRA)
Issue Type: Improvement Reporter: Ning Zhang Assignee: Ning Zhang In case of dynamic partition insert, FileSinkOperator generated a directory for a new partition and the files in the directory is named with '_tmp*'. When a task succeed, the file is renamed to

[jira] Commented: (HIVE-1651) ScriptOperator should not forward any output to downstream operators if an exception is happened

2010-09-17 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12910834#action_12910834 ] Ning Zhang commented on HIVE-1651: -- @joydeep, the output file will not be committed i

[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-17 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12910758#action_12910758 ] Ning Zhang commented on HIVE-1378: -- Taking a look now. > Return value for map

[jira] Updated: (HIVE-1651) ScriptOperator should not forward any output to downstream operators if an exception is happened

2010-09-17 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1651: - Status: Patch Available (was: Open) > ScriptOperator should not forward any output to downstr

[jira] Updated: (HIVE-1651) ScriptOperator should not forward any output to downstream operators if an exception is happened

2010-09-17 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1651: - Attachment: HIVE-1651.patch > ScriptOperator should not forward any output to downstream operators if

[jira] Created: (HIVE-1651) ScriptOperator should not forward any output to downstream operators if an exception is happened

2010-09-17 Thread Ning Zhang (JIRA)
Project: Hadoop Hive Issue Type: Bug Reporter: Ning Zhang Assignee: Ning Zhang ScriptOperator spawns 2 threads for getting the stdout and stderr from the script and then forward the output from stdout to downstream operators. In case of any

[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-16 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12910455#action_12910455 ] Ning Zhang commented on HIVE-1378: -- Steven, there are conflicts when applying this p

[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-16 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12910444#action_12910444 ] Ning Zhang commented on HIVE-1378: -- Will take a look. > Return value for map, arr

[jira] Updated: (HIVE-1361) table/partition level statistics

2010-09-16 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1361: - Status: Patch Available (was: Open) > table/partition level statist

[jira] Updated: (HIVE-1648) Automatically gathering stats when reading a table/partition

2010-09-16 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1648: - Parent: HIVE-33 Issue Type: Sub-task (was: New Feature) > Automatically gathering stats w

[jira] Created: (HIVE-1648) Automatically gathering stats when reading a table/partition

2010-09-16 Thread Ning Zhang (JIRA)
Reporter: Ning Zhang HIVE-1361 introduces a new command 'ANALYZE TABLE T COMPUTE STATISTICS' to gathering stats. This requires additional scan of the data. Stats gathering can be piggy-backed on TableScanOperator whenever a table/partition is scanned (given not LIMI

[jira] Commented: (HIVE-33) [Hive]: Add ability to compute statistics on hive tables

2010-09-16 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-33?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12910358#action_12910358 ] Ning Zhang commented on HIVE-33: Patches for HIVE-1361 are ready for review. Comments

[jira] Updated: (HIVE-1361) table/partition level statistics

2010-09-16 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1361: - Attachment: HIVE-1361.patch HIVE-1361.java_only.patch Uploading a full version (HIVE-1361

[jira] Updated: (HIVE-1639) ExecDriver.addInputPaths() error if partition name contains a comma

2010-09-15 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1639: - Attachment: HIVE-1639.2.patch Added a test case. > ExecDriver.addInputPaths() error if partition n

[jira] Commented: (HIVE-1570) referencing an added file by it's name in a transform script does not work in hive local mode

2010-09-15 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12909943#action_12909943 ] Ning Zhang commented on HIVE-1570: -- Joy, scriptfile1.q actually faile

[jira] Updated: (HIVE-1639) ExecDriver.addInputPaths() error if partition name contains a comma

2010-09-15 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1639: - Status: Patch Available (was: Open) > ExecDriver.addInputPaths() error if partition name contain

[jira] Updated: (HIVE-1639) ExecDriver.addInputPaths() error if partition name contains a comma

2010-09-15 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1639: - Attachment: HIVE-1639.patch > ExecDriver.addInputPaths() error if partition name contains a co

[jira] Created: (HIVE-1639) ExecDriver.addInputPaths() error if partition name contains a comma

2010-09-15 Thread Ning Zhang (JIRA)
Reporter: Ning Zhang Assignee: Ning Zhang The ExecDriver.addInputPaths() calls FileInputFormat.addPaths(), which takes a comma-separated string representing a set of paths. If the path name of a input file contains a comma, this code throw an exception

[jira] Commented: (HIVE-1629) Patch to fix hashCode method in DoubleWritable class

2010-09-12 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12908639#action_12908639 ] Ning Zhang commented on HIVE-1629: -- Good question John. I think this patch doesn'

[jira] Resolved: (HIVE-1629) Patch to fix hashCode method in DoubleWritable class

2010-09-12 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang resolved HIVE-1629. -- Fix Version/s: 0.7.0 Resolution: Fixed Committed. Thanks Vaibhav! > Patch to fix hashC

[jira] Updated: (HIVE-1622) Use CombineHiveInputFormat for the merge job if hive.merge.mapredfiles=true

2010-09-12 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1622: - Attachment: HIVE-1622_0.17.patch oops, forgot the patch hadoop 0.17 logs. > Use CombineHiveInputFor

[jira] Commented: (HIVE-1629) Patch to fix hashCode method in DoubleWritable class

2010-09-12 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12908599#action_12908599 ] Ning Zhang commented on HIVE-1629: -- +1 Will commit if tests pass. > Patch to fix h

[jira] Assigned: (HIVE-1629) Patch to fix hashCode method in DoubleWritable class

2010-09-12 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang reassigned HIVE-1629: Assignee: Vaibhav Aggarwal > Patch to fix hashCode method in DoubleWritable cl

[jira] Commented: (HIVE-1629) Patch to fix hashCode method in DoubleWritable class

2010-09-10 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12908194#action_12908194 ] Ning Zhang commented on HIVE-1629: -- +long v = Double.doubleToLongBits(v

[jira] Updated: (HIVE-1622) Use CombineHiveInputFormat for the merge job if hive.merge.mapredfiles=true

2010-09-08 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1622: - Status: Patch Available (was: Open) > Use CombineHiveInputFormat for the merge job

[jira] Updated: (HIVE-1622) Use CombineHiveInputFormat for the merge job if hive.merge.mapredfiles=true

2010-09-08 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1622: - Attachment: HIVE-1622.patch > Use CombineHiveInputFormat for the merge job if hive.merge.mapredfiles=t

[jira] Created: (HIVE-1622) Use CombineHiveInputFormat for the merge job if hive.merge.mapredfiles=true

2010-09-08 Thread Ning Zhang (JIRA)
Issue Type: Improvement Reporter: Ning Zhang Assignee: Ning Zhang Currently map-only merge (using CombineHiveInputFormat) is only enabled for merging files generated by mappers. It should be used for files generated at readers as well. -- This message is automatically

[jira] Updated: (HIVE-1614) UDTF json_tuple should return null row when input is not a valid JSON string

2010-09-03 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1614: - Attachment: HIVE-1614.2.patch Added a catch for all throwable in the UDFT. > UDTF json_tuple sho

[jira] Updated: (HIVE-1614) UDTF json_tuple should return null row when input is not a valid JSON string

2010-09-03 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1614: - Status: Patch Available (was: Open) Affects Version/s: 0.7.0 > UDTF json_tuple sho

[jira] Updated: (HIVE-1614) UDTF json_tuple should return null row when input is not a valid JSON string

2010-09-03 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1614: - Attachment: HIVE-1614.patch > UDTF json_tuple should return null row when input is not a valid J

[jira] Created: (HIVE-1614) UDTF json_tuple should return null row when input is not a valid JSON string

2010-09-03 Thread Ning Zhang (JIRA)
Issue Type: Bug Reporter: Ning Zhang Assignee: Ning Zhang If the input column is not a valid JSON string, json_tuple will not return anything but this will prevent the downstream operators to access the left-hand side table. We should output a NULL row instead, similar

[jira] Commented: (HIVE-1467) dynamic partitioning should cluster by partitions

2010-09-02 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12905700#action_12905700 ] Ning Zhang commented on HIVE-1467: -- As discussed with Joydeep and Ashish, it seem

[jira] Updated: (HIVE-1598) use SequenceFile rather than TextFile format for hive query results

2010-08-31 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1598: - Attachment: HIVE-1598.2.patch Attached the test case and also removed some debugging info. These are the

  1   2   3   4   5   6   7   8   9   >