[jira] [Updated] (HIVE-4748) Fix TempletonUtilsTest failure on Windows
[ https://issues.apache.org/jira/browse/HIVE-4748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-4748: Summary: Fix TempletonUtilsTest failure on Windows (was: Fix TempletonUtilsTest failure on WIndows) Fix TempletonUtilsTest failure on Windows - Key: HIVE-4748 URL: https://issues.apache.org/jira/browse/HIVE-4748 Project: Hive Issue Type: Bug Components: HCatalog, Tests Environment: Windows Reporter: Shuaishuai Nie Assignee: Shuaishuai Nie Attachments: HIVE-4748.1.patch, HIVE-4748.2.patch The test was assuming that /tmp and /usr folders exist on the OS. As this is not true on Windows, the test fails. The fix modified the test such that it creates the files it needs before doing the verification. This is a test-only issue. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4748) Fix TempletonUtilsTest failure on Windows
[ https://issues.apache.org/jira/browse/HIVE-4748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-4748: Resolution: Fixed Status: Resolved (was: Patch Available) Patch committed to trunk. Thanks for the contribution [~shuainie] ! Fix TempletonUtilsTest failure on Windows - Key: HIVE-4748 URL: https://issues.apache.org/jira/browse/HIVE-4748 Project: Hive Issue Type: Bug Components: HCatalog, Tests Environment: Windows Reporter: Shuaishuai Nie Assignee: Shuaishuai Nie Attachments: HIVE-4748.1.patch, HIVE-4748.2.patch The test was assuming that /tmp and /usr folders exist on the OS. As this is not true on Windows, the test fails. The fix modified the test such that it creates the files it needs before doing the verification. This is a test-only issue. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-5197) TestE2EScenerios.createTaskAttempt should use MapRedUtil
[ https://issues.apache.org/jira/browse/HIVE-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-5197: Resolution: Fixed Status: Resolved (was: Patch Available) Patch committed to trunk. Thanks for the contribution Brock! TestE2EScenerios.createTaskAttempt should use MapRedUtil Key: HIVE-5197 URL: https://issues.apache.org/jira/browse/HIVE-5197 Project: Hive Issue Type: Test Reporter: Brock Noland Assignee: Brock Noland Priority: Minor Attachments: HIVE-5197.patch Basically we should use HCatMapRedUtil as opposed to new'ing the task attempt context. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4568) Beeline needs to support resolving variables
[
https://issues.apache.org/jira/browse/HIVE-4568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757495#comment-13757495
]
Hive QA commented on HIVE-4568:
---
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12601281/HIVE-4568.4.patch
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 2910 tests executed
*Failed tests:*
{noformat}
org.apache.hcatalog.mapreduce.TestHCatExternalDynamicPartitioned.testHCatDynamicPartitionedTable
org.apache.hive.beeline.src.test.TestBeeLineWithArgs.testHiveVarSubstitution
{noformat}
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/602/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/602/console
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests failed with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
Beeline needs to support resolving variables
Key: HIVE-4568
URL: https://issues.apache.org/jira/browse/HIVE-4568
Project: Hive
Issue Type: Improvement
Affects Versions: 0.10.0
Reporter: Xuefu Zhang
Assignee: Xuefu Zhang
Fix For: 0.12.0
Attachments: HIVE-4568-1.patch, HIVE-4568-2.patch, HIVE-4568.3.patch,
HIVE-4568.4.patch, HIVE-4568.patch
Previous Hive CLI allows user to specify hive variables at the command line
using option --hivevar. In user's script, reference to a hive variable will
be substituted with the value of the variable. In such way, user can
parameterize his/her script and invoke the script with different hive
variable values. The following script is one usage:
{code}
hive --hivevar
INPUT=/user/jenkins/oozie.1371538916178/examples/input-data/table
--hivevar
OUTPUT=/user/jenkins/oozie.1371538916178/examples/output-data/hive
-f script.q
{code}
script.q makes use of hive variables:
{code}
CREATE EXTERNAL TABLE test (a INT) STORED AS TEXTFILE LOCATION '${INPUT}';
INSERT OVERWRITE DIRECTORY '${OUTPUT}' SELECT * FROM test;
{code}
However, after upgrade to hiveserver2 and beeline, this functionality is
missing. Beeline doesn't take --hivevar option, and any hive variable isn't
passed to server so it cannot be used for substitution.
This JIRA is to address this issue, providing a backward compatible behavior
at Beeline.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [ANNOUNCE] New Hive Committer - Yin Huai
Congratulations Yin! Jarcec On Tue, Sep 03, 2013 at 09:49:55PM -0700, Carl Steinbach wrote: The Apache Hive PMC has voted to make Yin Huai a committer on the Apache Hive project. Please join me in congratulating Yin! Thanks. Carl signature.asc Description: Digital signature
[jira] [Updated] (HIVE-4366) wrong result in show role grant user
[ https://issues.apache.org/jira/browse/HIVE-4366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daisy.Yuan updated HIVE-4366: - Attachment: HIVE-4366.patch wrong result in show role grant user Key: HIVE-4366 URL: https://issues.apache.org/jira/browse/HIVE-4366 Project: Hive Issue Type: Bug Components: Authentication Affects Versions: 0.9.0, 0.10.0 Reporter: ransom.hezhiqiang Attachments: HIVE-4366.patch in test case authorization_1.q show role grant user hive_test_user the result is : role name:src_role role name:src_role the same result is print twice. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [ANNOUNCE] New Hive Committer - Yin Huai
Congrats Yin! On Tue, Sep 3, 2013 at 11:37 PM, Jarek Jarcec Cecho jar...@apache.orgwrote: Congratulations Yin! Jarcec On Tue, Sep 03, 2013 at 09:49:55PM -0700, Carl Steinbach wrote: The Apache Hive PMC has voted to make Yin Huai a committer on the Apache Hive project. Please join me in congratulating Yin! Thanks. Carl -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
Re: [ANNOUNCE] New Hive Committer - Yin Huai
Congrats !! On Tue, Sep 3, 2013 at 11:43 PM, Vaibhav Gumashta vgumas...@hortonworks.com wrote: Congrats Yin! On Tue, Sep 3, 2013 at 11:37 PM, Jarek Jarcec Cecho jar...@apache.orgwrote: Congratulations Yin! Jarcec On Tue, Sep 03, 2013 at 09:49:55PM -0700, Carl Steinbach wrote: The Apache Hive PMC has voted to make Yin Huai a committer on the Apache Hive project. Please join me in congratulating Yin! Thanks. Carl CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
[jira] [Commented] (HIVE-5197) TestE2EScenerios.createTaskAttempt should use MapRedUtil
[ https://issues.apache.org/jira/browse/HIVE-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757505#comment-13757505 ] Sushanth Sowmyan commented on HIVE-5197: [~brocknoland] : Looks good to me, but while making this change, did you, by any chance, verify if this works correctly on 2.x ? If so, HIVE-5135 can now be closed as a duplicate. If not, then we need to fix the shim loader to make sure that it does. TestE2EScenerios.createTaskAttempt should use MapRedUtil Key: HIVE-5197 URL: https://issues.apache.org/jira/browse/HIVE-5197 Project: Hive Issue Type: Test Reporter: Brock Noland Assignee: Brock Noland Priority: Minor Attachments: HIVE-5197.patch Basically we should use HCatMapRedUtil as opposed to new'ing the task attempt context. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4366) wrong result in show role grant user
[ https://issues.apache.org/jira/browse/HIVE-4366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daisy.Yuan updated HIVE-4366: - Attachment: HIVE-4366.patch when execute the hql, fetch the results is not through Fetch Operator, it will occures the problem like that in description. For example,show role grant user，explain select * from by tb sort by no, they will dispaly the last result row twice. The explain select * from tb sort by no results will two blank lines. We should set the row be null before get result from the resStream. We change it, but too many test result files need to be changed. wrong result in show role grant user Key: HIVE-4366 URL: https://issues.apache.org/jira/browse/HIVE-4366 Project: Hive Issue Type: Bug Components: Authentication Affects Versions: 0.9.0, 0.10.0 Reporter: ransom.hezhiqiang Attachments: HIVE-4366.patch, HIVE-4366.patch in test case authorization_1.q show role grant user hive_test_user the result is : role name:src_role role name:src_role the same result is print twice. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [ANNOUNCE] New Hive Committer - Yin Huai
Congrats Yin! Well deserved! Looking forward to many more contributions from you! On Tue, Sep 3, 2013 at 11:45 PM, Hari Subramaniyan hsubramani...@hortonworks.com wrote: Congrats !! On Tue, Sep 3, 2013 at 11:43 PM, Vaibhav Gumashta vgumas...@hortonworks.com wrote: Congrats Yin! On Tue, Sep 3, 2013 at 11:37 PM, Jarek Jarcec Cecho jar...@apache.org wrote: Congratulations Yin! Jarcec On Tue, Sep 03, 2013 at 09:49:55PM -0700, Carl Steinbach wrote: The Apache Hive PMC has voted to make Yin Huai a committer on the Apache Hive project. Please join me in congratulating Yin! Thanks. Carl CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
[jira] [Commented] (HIVE-5175) Wincompat : adds HADOOP_TIME_ZONE env property and user.timezone sysproperty
[ https://issues.apache.org/jira/browse/HIVE-5175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757519#comment-13757519 ] Thejas M Nair commented on HIVE-5175: - I don't see any reference to HADOOP_TIME_ZONE in hadoop code or in hive code. Looks like that change is not necessary. Wincompat : adds HADOOP_TIME_ZONE env property and user.timezone sysproperty Key: HIVE-5175 URL: https://issues.apache.org/jira/browse/HIVE-5175 Project: Hive Issue Type: Sub-task Components: Windows Reporter: Sushanth Sowmyan Assignee: Sushanth Sowmyan Attachments: HIVE-5175.patch Adding HADOOP_TIME_ZONE and env property user.timezone as US/Pacific, needed for certain tests in windows to pass. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [ANNOUNCE] New Hive Committer - Yin Huai
Congrats Yin! 2013/9/4 Thejas Nair the...@hortonworks.com Congrats Yin! Well deserved! Looking forward to many more contributions from you! On Tue, Sep 3, 2013 at 11:45 PM, Hari Subramaniyan hsubramani...@hortonworks.com wrote: Congrats !! On Tue, Sep 3, 2013 at 11:43 PM, Vaibhav Gumashta vgumas...@hortonworks.com wrote: Congrats Yin! On Tue, Sep 3, 2013 at 11:37 PM, Jarek Jarcec Cecho jar...@apache.org wrote: Congratulations Yin! Jarcec On Tue, Sep 03, 2013 at 09:49:55PM -0700, Carl Steinbach wrote: The Apache Hive PMC has voted to make Yin Huai a committer on the Apache Hive project. Please join me in congratulating Yin! Thanks. Carl CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. -- thanks 王联辉(Lianhui Wang) blog; http://blog.csdn.net/lance_123 兴趣方向：数据库，分布式，数据挖掘，编程语言，互联网技术等
[jira] [Commented] (HIVE-5203) FunctionRegistry.getMethodInternal() should prefer method arguments with closer affinity to the original argument types
[
https://issues.apache.org/jira/browse/HIVE-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757532#comment-13757532
]
Hive QA commented on HIVE-5203:
---
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12601280/HIVE-5203.1.patch
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 2909 tests executed
*Failed tests:*
{noformat}
org.apache.hcatalog.mapreduce.TestHCatExternalPartitioned.testHCatPartitionedTable
{noformat}
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/603/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/603/console
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests failed with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
FunctionRegistry.getMethodInternal() should prefer method arguments with
closer affinity to the original argument types
---
Key: HIVE-5203
URL: https://issues.apache.org/jira/browse/HIVE-5203
Project: Hive
Issue Type: Bug
Components: Types, UDF
Reporter: Jason Dere
Assignee: Jason Dere
Attachments: HIVE-5203.1.patch
When the function registry is trying to determine the best version of UDF
evaluate() to use based on a set of arguments passed in, it should prefer
methods where the argument types are more related to the original types. For
example if varchar is used with UDFFromUnixTime(), varchar is convertible to
both the double and string versions of evaluate() for that UDF. In this case
we would prefer that the function registry select the string version over the
double version, since varchar and string are both string types.
This doesn't really affect any of the existing types, but comes into play
with the addition of the varchar type (HIVE-4844).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [ANNOUNCE] New Hive Committer - Yin Huai
Congratulations, Yin! --Xuefu On Wed, Sep 4, 2013 at 12:53 AM, Lianhui Wang lianhuiwan...@gmail.comwrote: Congrats Yin! 2013/9/4 Thejas Nair the...@hortonworks.com Congrats Yin! Well deserved! Looking forward to many more contributions from you! On Tue, Sep 3, 2013 at 11:45 PM, Hari Subramaniyan hsubramani...@hortonworks.com wrote: Congrats !! On Tue, Sep 3, 2013 at 11:43 PM, Vaibhav Gumashta vgumas...@hortonworks.com wrote: Congrats Yin! On Tue, Sep 3, 2013 at 11:37 PM, Jarek Jarcec Cecho jar...@apache.org wrote: Congratulations Yin! Jarcec On Tue, Sep 03, 2013 at 09:49:55PM -0700, Carl Steinbach wrote: The Apache Hive PMC has voted to make Yin Huai a committer on the Apache Hive project. Please join me in congratulating Yin! Thanks. Carl CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. -- thanks 王联辉(Lianhui Wang) blog; http://blog.csdn.net/lance_123 兴趣方向：数据库，分布式，数据挖掘，编程语言，互联网技术等
Re: [ANNOUNCE] New Hive Committer - Yin Huai
Amazing news, congratz Yin! Well deserved! On Sep 4, 2013, at 6:49 AM, Carl Steinbach c...@apache.org wrote: The Apache Hive PMC has voted to make Yin Huai a committer on the Apache Hive project. Please join me in congratulating Yin! Thanks. Carl -- Alexander Alten-Lorenz http://mapredit.blogspot.com German Hadoop LinkedIn Group: http://goo.gl/N8pCF
Re: [ANNOUNCE] New Hive Committer - Yin Huai
Congrats, Yin! :) On Sep 4, 2013 1:13 AM, Alexander Alten-Lorenz wget.n...@gmail.com wrote: Amazing news, congratz Yin! Well deserved! On Sep 4, 2013, at 6:49 AM, Carl Steinbach c...@apache.org wrote: The Apache Hive PMC has voted to make Yin Huai a committer on the Apache Hive project. Please join me in congratulating Yin! Thanks. Carl -- Alexander Alten-Lorenz http://mapredit.blogspot.com German Hadoop LinkedIn Group: http://goo.gl/N8pCF
[jira] [Commented] (HIVE-5203) FunctionRegistry.getMethodInternal() should prefer method arguments with closer affinity to the original argument types
[ https://issues.apache.org/jira/browse/HIVE-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757544#comment-13757544 ] Ashutosh Chauhan commented on HIVE-5203: Jason's rationale for this change and subsequent explanation sounds reasonable to me. +1 FunctionRegistry.getMethodInternal() should prefer method arguments with closer affinity to the original argument types --- Key: HIVE-5203 URL: https://issues.apache.org/jira/browse/HIVE-5203 Project: Hive Issue Type: Bug Components: Types, UDF Reporter: Jason Dere Assignee: Jason Dere Attachments: HIVE-5203.1.patch When the function registry is trying to determine the best version of UDF evaluate() to use based on a set of arguments passed in, it should prefer methods where the argument types are more related to the original types. For example if varchar is used with UDFFromUnixTime(), varchar is convertible to both the double and string versions of evaluate() for that UDF. In this case we would prefer that the function registry select the string version over the double version, since varchar and string are both string types. This doesn't really affect any of the existing types, but comes into play with the addition of the varchar type (HIVE-4844). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4844) Add varchar data type
[ https://issues.apache.org/jira/browse/HIVE-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-4844: -- Attachment: HIVE-4844.D12699.1.patch jdere requested code review of HIVE-4844 [jira] Add varchar data type. Reviewers: JIRA Add new varchar data types which have support for more SQL-compliant behavior, such as SQL string comparison semantics, max length, etc. Char type will be added as another task. TEST PLAN EMPTY REVISION DETAIL https://reviews.facebook.net/D12699 AFFECTED FILES common/src/java/org/apache/hadoop/hive/common/type/HiveBaseChar.java common/src/java/org/apache/hadoop/hive/common/type/HiveVarchar.java common/src/test/org/apache/hadoop/hive/common/type/TestHiveVarchar.java data/files/datatypes.txt data/files/vc1.txt metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreUtils.java ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java ql/src/java/org/apache/hadoop/hive/ql/parse/BaseSemanticAnalyzer.java ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java ql/src/java/org/apache/hadoop/hive/ql/parse/HiveLexer.g ql/src/java/org/apache/hadoop/hive/ql/parse/HiveParser.g ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java ql/src/java/org/apache/hadoop/hive/ql/parse/TypeCheckProcFactory.java ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableDesc.java ql/src/java/org/apache/hadoop/hive/ql/udf/GenericUDFEncode.java ql/src/java/org/apache/hadoop/hive/ql/udf/UDFToString.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFComputeStats.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFBaseCompare.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFConcat.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFConcatWS.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFLower.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFReflect2.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFStringToMap.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFToDate.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFToVarchar.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFUpper.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFUtils.java ql/src/test/org/apache/hadoop/hive/ql/exec/TestFunctionRegistry.java ql/src/test/queries/clientpositive/alter_varchar1.q ql/src/test/queries/clientpositive/ctas_varchar.q ql/src/test/queries/clientpositive/partition_varchar1.q ql/src/test/queries/clientpositive/varchar_1.q ql/src/test/queries/clientpositive/varchar_2.q ql/src/test/queries/clientpositive/varchar_cast.q ql/src/test/queries/clientpositive/varchar_comparison.q ql/src/test/queries/clientpositive/varchar_join1.q ql/src/test/queries/clientpositive/varchar_nested_types.q ql/src/test/queries/clientpositive/varchar_udf1.q ql/src/test/queries/clientpositive/varchar_union1.q ql/src/test/results/clientpositive/alter_varchar1.q.out ql/src/test/results/clientpositive/ctas_varchar.q.out ql/src/test/results/clientpositive/partition_varchar1.q.out ql/src/test/results/clientpositive/varchar_1.q.out ql/src/test/results/clientpositive/varchar_2.q.out ql/src/test/results/clientpositive/varchar_cast.q.out ql/src/test/results/clientpositive/varchar_comparison.q.out ql/src/test/results/clientpositive/varchar_join1.q.out ql/src/test/results/clientpositive/varchar_nested_types.q.out ql/src/test/results/clientpositive/varchar_udf1.q.out ql/src/test/results/clientpositive/varchar_union1.q.out ql/src/test/results/compiler/plan/groupby2.q.xml ql/src/test/results/compiler/plan/udf6.q.xml serde/if/serde.thrift serde/src/gen/thrift/gen-cpp/serde_constants.cpp serde/src/gen/thrift/gen-cpp/serde_constants.h serde/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/serde/serdeConstants.java serde/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/serde/test/ThriftTestObj.java serde/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/serde2/thrift/test/Complex.java serde/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/serde2/thrift/test/MegaStruct.java serde/src/gen/thrift/gen-php/org/apache/hadoop/hive/serde/Types.php serde/src/gen/thrift/gen-py/org_apache_hadoop_hive_serde/constants.py serde/src/gen/thrift/gen-rb/serde_constants.rb serde/src/java/org/apache/hadoop/hive/serde2/SerDeUtils.java serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroObjectInspectorGenerator.java serde/src/java/org/apache/hadoop/hive/serde2/binarysortable/BinarySortableSerDe.java serde/src/java/org/apache/hadoop/hive/serde2/io/DoubleWritable.java serde/src/java/org/apache/hadoop/hive/serde2/io/HiveVarcharWritable.java serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyFactory.java
[jira] [Updated] (HIVE-4844) Add varchar data type
[ https://issues.apache.org/jira/browse/HIVE-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-4844: - Description: Add new varchar data types which have support for more SQL-compliant behavior, such as SQL string comparison semantics, max length, etc. Char type will be added as another task. NO PRECOMMIT TESTS - now dependent on HIVE-5203/5204/5206 was: Add new varchar data types which have support for more SQL-compliant behavior, such as SQL string comparison semantics, max length, etc. Char type will be added as another task. Add varchar data type - Key: HIVE-4844 URL: https://issues.apache.org/jira/browse/HIVE-4844 Project: Hive Issue Type: New Feature Components: Types Reporter: Jason Dere Assignee: Jason Dere Attachments: HIVE-4844.10.patch, HIVE-4844.11.patch, HIVE-4844.1.patch.hack, HIVE-4844.2.patch, HIVE-4844.3.patch, HIVE-4844.4.patch, HIVE-4844.5.patch, HIVE-4844.6.patch, HIVE-4844.7.patch, HIVE-4844.8.patch, HIVE-4844.9.patch, HIVE-4844.D12699.1.patch, screenshot.png Add new varchar data types which have support for more SQL-compliant behavior, such as SQL string comparison semantics, max length, etc. Char type will be added as another task. NO PRECOMMIT TESTS - now dependent on HIVE-5203/5204/5206 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4844) Add varchar data type
[ https://issues.apache.org/jira/browse/HIVE-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-4844: - Attachment: HIVE-4844.12.patch Attaching HIVE-4844.12.patch, which should now be a smaller patch since patch 11 has been broken up into several different subtasks. Add varchar data type - Key: HIVE-4844 URL: https://issues.apache.org/jira/browse/HIVE-4844 Project: Hive Issue Type: New Feature Components: Types Reporter: Jason Dere Assignee: Jason Dere Attachments: HIVE-4844.10.patch, HIVE-4844.11.patch, HIVE-4844.12.patch, HIVE-4844.1.patch.hack, HIVE-4844.2.patch, HIVE-4844.3.patch, HIVE-4844.4.patch, HIVE-4844.5.patch, HIVE-4844.6.patch, HIVE-4844.7.patch, HIVE-4844.8.patch, HIVE-4844.9.patch, HIVE-4844.D12699.1.patch, screenshot.png Add new varchar data types which have support for more SQL-compliant behavior, such as SQL string comparison semantics, max length, etc. Char type will be added as another task. NO PRECOMMIT TESTS - now dependent on HIVE-5203/5204/5206 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-5158) allow getting all partitions for table to also use direct SQL path
[ https://issues.apache.org/jira/browse/HIVE-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-5158: --- Status: Patch Available (was: Open) +1 allow getting all partitions for table to also use direct SQL path -- Key: HIVE-5158 URL: https://issues.apache.org/jira/browse/HIVE-5158 Project: Hive Issue Type: Improvement Reporter: Sergey Shelukhin Assignee: Sergey Shelukhin Attachments: HIVE-5158.D12573.1.patch, HIVE-5158.D12573.2.patch, HIVE-5158.D12573.3.patch, HIVE-5158.D12573.4.patch, HIVE-5158.D12573.5.patch While testing some queries I noticed that getPartitions can be very slow (which happens e.g. in non-strict mode with no partition column filter); with a table with many partitions it can take 10-12s easily. SQL perf path can also be used for this path. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-5209) JDBC support for varchar
Jason Dere created HIVE-5209: Summary: JDBC support for varchar Key: HIVE-5209 URL: https://issues.apache.org/jira/browse/HIVE-5209 Project: Hive Issue Type: Improvement Reporter: Jason Dere Assignee: Jason Dere Support returning varchar length in result set metadata -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-5209) JDBC support for varchar
[ https://issues.apache.org/jira/browse/HIVE-5209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-5209: - Component/s: Types JDBC JDBC support for varchar Key: HIVE-5209 URL: https://issues.apache.org/jira/browse/HIVE-5209 Project: Hive Issue Type: Improvement Components: JDBC, Types Reporter: Jason Dere Assignee: Jason Dere Support returning varchar length in result set metadata -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4994) Add WebHCat (Templeton) documentation to Hive wiki
[ https://issues.apache.org/jira/browse/HIVE-4994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757578#comment-13757578 ] Lefty Leverenz commented on HIVE-4994: -- The WebHCat docs are all converted to wikidocs: * WebHCat home page: [https://cwiki.apache.org/confluence/display/Hive/WebHCat] Next step: linking the WebHCat wikidocs to corresponding Hive and HCatalog docs, starting with the configuration docs. Add WebHCat (Templeton) documentation to Hive wiki -- Key: HIVE-4994 URL: https://issues.apache.org/jira/browse/HIVE-4994 Project: Hive Issue Type: Bug Components: Documentation Affects Versions: 0.11.0 Reporter: Lefty Leverenz Assignee: Lefty Leverenz WebHCat (Templeton) documentation in the Apache incubator had xml source files which generated html pdf output files. Now that HCatalog and WebHCat are part of the Hive project, all the WebHCat documents need to be added to the Hive wiki. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [ANNOUNCE] New Hive Committer - Yin Huai
Bravo, Yin! -- Lefty On Wed, Sep 4, 2013 at 4:17 AM, Sushanth Sowmyan khorg...@gmail.com wrote: Congrats, Yin! :) On Sep 4, 2013 1:13 AM, Alexander Alten-Lorenz wget.n...@gmail.com wrote: Amazing news, congratz Yin! Well deserved! On Sep 4, 2013, at 6:49 AM, Carl Steinbach c...@apache.org wrote: The Apache Hive PMC has voted to make Yin Huai a committer on the Apache Hive project. Please join me in congratulating Yin! Thanks. Carl -- Alexander Alten-Lorenz http://mapredit.blogspot.com German Hadoop LinkedIn Group: http://goo.gl/N8pCF
[jira] [Commented] (HIVE-5182) log more stuff via PerfLogger
[ https://issues.apache.org/jira/browse/HIVE-5182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757594#comment-13757594 ] Ashutosh Chauhan commented on HIVE-5182: Can you add it for * Utilities::getInputSummary() * CombineHiveInputFormat::getSplits() * HiveInputFormat::getSplits() * Utilities::serializeObject() * Utilities::deserializeObject() log more stuff via PerfLogger - Key: HIVE-5182 URL: https://issues.apache.org/jira/browse/HIVE-5182 Project: Hive Issue Type: Improvement Reporter: Sergey Shelukhin Assignee: Sergey Shelukhin Attachments: HIVE-5182.D12639.1.patch PerfLogger output is useful in understanding perf. There are large gaps in it, however, and it's not clear what is going on during these. Some sections are large and have no breakdown. It would be nice to add more stuff. At this point I'm not certain where exactly, whoever makes the patch (me?) will just need to look at the above gaps and fill them in. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-5182) log more stuff via PerfLogger
[ https://issues.apache.org/jira/browse/HIVE-5182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-5182: --- Status: Open (was: Patch Available) log more stuff via PerfLogger - Key: HIVE-5182 URL: https://issues.apache.org/jira/browse/HIVE-5182 Project: Hive Issue Type: Improvement Reporter: Sergey Shelukhin Assignee: Sergey Shelukhin Attachments: HIVE-5182.D12639.1.patch PerfLogger output is useful in understanding perf. There are large gaps in it, however, and it's not clear what is going on during these. Some sections are large and have no breakdown. It would be nice to add more stuff. At this point I'm not certain where exactly, whoever makes the patch (me?) will just need to look at the above gaps and fill them in. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5174) Wincompat : junit.file.schema configurability
[
https://issues.apache.org/jira/browse/HIVE-5174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757615#comment-13757615
]
Hive QA commented on HIVE-5174:
---
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12601295/HIVE-5174.2.patch
{color:red}ERROR:{color} -1 due to 4 failed/errored test(s), 2909 tests executed
*Failed tests:*
{noformat}
org.apache.hcatalog.mapreduce.TestHCatPartitioned.testHCatPartitionedTable
org.apache.hcatalog.fileformats.TestOrcDynamicPartitioned.testHCatDynamicPartitionedTable
org.apache.hcatalog.fileformats.TestOrcDynamicPartitioned.testHCatDynamicPartitionedTableMultipleTask
org.apache.hadoop.hive.cli.TestNegativeMinimrCliDriver.testNegativeCliDriver_mapreduce_stack_trace_hadoop20
{noformat}
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/605/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/605/console
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests failed with: TestsFailedException: 4 tests failed
{noformat}
This message is automatically generated.
Wincompat : junit.file.schema configurability
-
Key: HIVE-5174
URL: https://issues.apache.org/jira/browse/HIVE-5174
Project: Hive
Issue Type: Sub-task
Components: Windows
Reporter: Sushanth Sowmyan
Assignee: Sushanth Sowmyan
Attachments: HIVE-5174.2.patch, HIVE-5174.patch
Adding junit.file.schema and hadoop.testcp configurability to build, adding
set-hadoop-test-classpath target.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-5210) WebHCatJTShim implementations are missing Apache license headers
Jarek Jarcec Cecho created HIVE-5210:
Summary: WebHCatJTShim implementations are missing Apache license
headers
Key: HIVE-5210
URL: https://issues.apache.org/jira/browse/HIVE-5210
Project: Hive
Issue Type: Bug
Components: HCatalog
Reporter: Jarek Jarcec Cecho
Assignee: Jarek Jarcec Cecho
Fix For: 0.12.0
During investigation of SQOOP-1190, I've noticed that {{WebHCatJTShim}}
implementaion files do not have license headers.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-5210) WebHCatJTShim implementations are missing Apache license headers
[
https://issues.apache.org/jira/browse/HIVE-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jarek Jarcec Cecho updated HIVE-5210:
-
Attachment: HIVE-5210.patch
WebHCatJTShim implementations are missing Apache license headers
Key: HIVE-5210
URL: https://issues.apache.org/jira/browse/HIVE-5210
Project: Hive
Issue Type: Bug
Components: HCatalog
Reporter: Jarek Jarcec Cecho
Assignee: Jarek Jarcec Cecho
Fix For: 0.12.0
Attachments: HIVE-5210.patch
During investigation of SQOOP-1190, I've noticed that {{WebHCatJTShim}}
implementaion files do not have license headers.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-5210) WebHCatJTShim implementations are missing Apache license headers
[
https://issues.apache.org/jira/browse/HIVE-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jarek Jarcec Cecho updated HIVE-5210:
-
Status: Patch Available (was: Open)
WebHCatJTShim implementations are missing Apache license headers
Key: HIVE-5210
URL: https://issues.apache.org/jira/browse/HIVE-5210
Project: Hive
Issue Type: Bug
Components: HCatalog
Reporter: Jarek Jarcec Cecho
Assignee: Jarek Jarcec Cecho
Fix For: 0.12.0
Attachments: HIVE-5210.patch
During investigation of SQOOP-1190, I've noticed that {{WebHCatJTShim}}
implementaion files do not have license headers.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-5211) ALTER TABLE does not change the type of column for a table with AVRO data
Neha Tomar created HIVE-5211:
Summary: ALTER TABLE does not change the type of column for a
table with AVRO data
Key: HIVE-5211
URL: https://issues.apache.org/jira/browse/HIVE-5211
Project: Hive
Issue Type: Bug
Components: Metastore
Affects Versions: 0.11.0
Reporter: Neha Tomar
1 Created a table in Hive with AVRO data.
hive CREATE EXTERNAL TABLE sample ROW FORMAT SERDE
'org.apache.hadoop.hive.serde2.avro.AvroSerDe' STORED AS INPUTFORMAT
'org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat'
OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerOutputFormat'
LOCATION '/home/neha/test_data/avrodata'
TBLPROPERTIES ('avro.schema.literal'='{type: record,name:
TUPLE_3,fields: [ { name: sample_id,type: [ null, int ],doc:
autogenerated from Pig Field Schema} ]}'
);
OK
Time taken: 0.16 seconds
hive describe sample;
OK
sample_id int from deserializer
Time taken: 0.516 seconds, Fetched: 1 row(s)
Alter the type of column from int to bigint. It displays OK as the result
of DDL execution. However, describing the table still shows previous data
type.
hive alter table sample change sample_id int bigint;
OK
Time taken: 0.614 seconds
hive describe sample;
OK
sample_id int from deserializer
Time taken: 0.4 seconds, Fetched: 1 row(s)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5174) Wincompat : junit.file.schema configurability
[
https://issues.apache.org/jira/browse/HIVE-5174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757683#comment-13757683
]
Hive QA commented on HIVE-5174:
---
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12601295/HIVE-5174.2.patch
{color:red}ERROR:{color} -1 due to 7 failed/errored test(s), 2909 tests executed
*Failed tests:*
{noformat}
org.apache.hcatalog.mapreduce.TestSequenceFileReadWrite.testTextTableWriteRead
org.apache.hcatalog.mapreduce.TestHCatExternalDynamicPartitioned.testHCatDynamicPartitionedTable
org.apache.hcatalog.mapreduce.TestSequenceFileReadWrite.testSequenceTableWriteReadMR
org.apache.hcatalog.fileformats.TestOrcDynamicPartitioned.testHCatDynamicPartitionedTable
org.apache.hcatalog.fileformats.TestOrcDynamicPartitioned.testHCatDynamicPartitionedTableMultipleTask
org.apache.hcatalog.mapreduce.TestSequenceFileReadWrite.testSequenceTableWriteRead
org.apache.hcatalog.mapreduce.TestSequenceFileReadWrite.testTextTableWriteReadMR
{noformat}
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/606/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/606/console
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests failed with: TestsFailedException: 7 tests failed
{noformat}
This message is automatically generated.
Wincompat : junit.file.schema configurability
-
Key: HIVE-5174
URL: https://issues.apache.org/jira/browse/HIVE-5174
Project: Hive
Issue Type: Sub-task
Components: Windows
Reporter: Sushanth Sowmyan
Assignee: Sushanth Sowmyan
Attachments: HIVE-5174.2.patch, HIVE-5174.patch
Adding junit.file.schema and hadoop.testcp configurability to build, adding
set-hadoop-test-classpath target.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4211) Common column and partition column are defined the same type and union them, it will hints Schema of both sides of union should match.
[
https://issues.apache.org/jira/browse/HIVE-4211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757686#comment-13757686
]
Hive QA commented on HIVE-4211:
---
{color:red}Overall{color}: -1 no tests executed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12601307/HIVE-4211.patch
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/607/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/607/console
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Tests failed with: NonZeroExitCodeException: Command 'bash
/data/hive-ptest/working/scratch/source-prep.sh' failed with exit status 1 and
output '+ [[ -n '' ]]
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost
-Dhttp.proxyPort=3128'
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost
-Dhttp.proxyPort=3128'
+ cd /data/hive-ptest/working/
+ tee /data/hive-ptest/logs/PreCommit-HIVE-Build-607/source-prep.txt
+ mkdir -p maven ivy
+ [[ svn = \s\v\n ]]
+ [[ -n '' ]]
+ [[ -d apache-svn-trunk-source ]]
+ [[ ! -d apache-svn-trunk-source/.svn ]]
+ [[ ! -d apache-svn-trunk-source ]]
+ cd apache-svn-trunk-source
+ svn revert -R .
Reverted 'build-common.xml'
++ awk '{print $2}'
++ egrep -v '^X|^Performing status on external'
++ svn status --no-ignore
+ rm -rf build hcatalog/build hcatalog/core/build
hcatalog/storage-handlers/hbase/build hcatalog/server-extensions/build
hcatalog/webhcat/svr/build hcatalog/webhcat/java-client/build
hcatalog/hcatalog-pig-adapter/build common/src/gen
+ svn update
Fetching external item into 'hcatalog/src/test/e2e/harness'
External at revision 1519988.
At revision 1519988.
+ patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hive-ptest/working/scratch/build.patch
+ [[ -f /data/hive-ptest/working/scratch/build.patch ]]
+ chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh
+ /data/hive-ptest/working/scratch/smart-apply-patch.sh
/data/hive-ptest/working/scratch/build.patch
The patch does not appear to apply with p0 to p2
+ exit 1
'
{noformat}
This message is automatically generated.
Common column and partition column are defined the same type and union them,
it will hints Schema of both sides of union should match.
---
Key: HIVE-4211
URL: https://issues.apache.org/jira/browse/HIVE-4211
Project: Hive
Issue Type: Bug
Components: SQL
Affects Versions: 0.9.0, 0.11.0
Reporter: Daisy.Yuan
Labels: patch
Attachments: HIVE-4211.patch, PartitionColumnTypInfo.patch
create table UnionBoolA (id boolean, no boolean) row format delimited fields
terminated by ' ';
load data local inpath '/opt/files/unionboola.txt' into table UnionBoolA;
create table UnionPartionBool (id int) partitioned by (no boolean) row format
delimited fields terminated by ' ';
load data local inpath '/opt/files/unionpartint.txt' into table
UnionPartionBool partition(no=true);
unionboola.txt:
true true
false true
true true
false true
unionpartint.txt:
111
444
1122
44
when I execute
select * from( select no from UnionBoolA union all select no from
UnionPartionBool) unionResult, it is failed. The exception info is as
follows:
FAILED: Error in semantic analysis: 1:66 Schema of both sides of union should
match: Column no is of type boolean on first table and type string on second
table. Error encountered near token 'UnionPartionBool'
org.apache.hadoop.hive.ql.parse.SemanticException: 1:66 Schema of both sides
of union should match: Column no is of type boolean on first table and type
string on second table. Error encountered near token 'UnionPartionBool'
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genUnionPlan(SemanticAnalyzer.java:6295)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPlan(SemanticAnalyzer.java:6733)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPlan(SemanticAnalyzer.java:6748)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:7556)
at
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:244)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:621)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:525)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1153)
at
org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.execute(HiveServer.java:226)
at
org.apache.hadoop.hive.service.ThriftHive$Processor$execute.getResult(ThriftHive.java:630)
at
[jira] [Updated] (HIVE-5205) Javadoc warnings in HCatalog prevent Hive from building under OpenJDK7
[ https://issues.apache.org/jira/browse/HIVE-5205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-5205: --- Status: Patch Available (was: Open) Javadoc warnings in HCatalog prevent Hive from building under OpenJDK7 -- Key: HIVE-5205 URL: https://issues.apache.org/jira/browse/HIVE-5205 Project: Hive Issue Type: Sub-task Components: HCatalog Affects Versions: 0.11.0 Reporter: Konstantin Boudnik Fix For: 0.12.0 Attachments: HIVE-5205.patch when building Hive with OpenJDK7 the following warning message makes the build fail: [javadoc] /var/lib/jenkins/workspace/Shark-Hive-0.11-OJDK7/hcatalog/storage-handlers/hbase/src/java/org/apache/hcatalog/hbase/snapshot/RevisionManagerFactory.java:81: warning - @return tag has no arguments. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5205) Javadoc warnings in HCatalog prevent Hive from building under OpenJDK7
[ https://issues.apache.org/jira/browse/HIVE-5205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757699#comment-13757699 ] Brock Noland commented on HIVE-5205: +1 Javadoc warnings in HCatalog prevent Hive from building under OpenJDK7 -- Key: HIVE-5205 URL: https://issues.apache.org/jira/browse/HIVE-5205 Project: Hive Issue Type: Sub-task Components: HCatalog Affects Versions: 0.11.0 Reporter: Konstantin Boudnik Fix For: 0.12.0 Attachments: HIVE-5205.patch when building Hive with OpenJDK7 the following warning message makes the build fail: [javadoc] /var/lib/jenkins/workspace/Shark-Hive-0.11-OJDK7/hcatalog/storage-handlers/hbase/src/java/org/apache/hcatalog/hbase/snapshot/RevisionManagerFactory.java:81: warning - @return tag has no arguments. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5197) TestE2EScenerios.createTaskAttempt should use MapRedUtil
[ https://issues.apache.org/jira/browse/HIVE-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757701#comment-13757701 ] Brock Noland commented on HIVE-5197: Thanks Thejas! Sushanth yes it does and HIVE-5135 can be closed as a dup. I didn't see that one. TestE2EScenerios.createTaskAttempt should use MapRedUtil Key: HIVE-5197 URL: https://issues.apache.org/jira/browse/HIVE-5197 Project: Hive Issue Type: Test Reporter: Brock Noland Assignee: Brock Noland Priority: Minor Attachments: HIVE-5197.patch Basically we should use HCatMapRedUtil as opposed to new'ing the task attempt context. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [ANNOUNCE] New Hive Committer - Yin Huai
Congrats Yin!! On Wed, Sep 4, 2013 at 4:14 AM, Lefty Leverenz leftylever...@gmail.com wrote: Bravo, Yin! -- Lefty On Wed, Sep 4, 2013 at 4:17 AM, Sushanth Sowmyan khorg...@gmail.com wrote: Congrats, Yin! :) On Sep 4, 2013 1:13 AM, Alexander Alten-Lorenz wget.n...@gmail.com wrote: Amazing news, congratz Yin! Well deserved! On Sep 4, 2013, at 6:49 AM, Carl Steinbach c...@apache.org wrote: The Apache Hive PMC has voted to make Yin Huai a committer on the Apache Hive project. Please join me in congratulating Yin! Thanks. Carl -- Alexander Alten-Lorenz http://mapredit.blogspot.com German Hadoop LinkedIn Group: http://goo.gl/N8pCF -- Apache MRUnit - Unit testing MapReduce - http://mrunit.apache.org
[jira] [Commented] (HIVE-1511) Hive plan serialization is slow
[ https://issues.apache.org/jira/browse/HIVE-1511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757707#comment-13757707 ] Brock Noland commented on HIVE-1511: I knew that was going to happen. :) The issue is that we need to have RowSchema non-transient in Operator because Utilities.setColumnNameList uses it. Having RowSchema non-transient introduces a bunch of failures we'll need to resolve. Since that is the only place I know we require RowSchema, perhaps we could re-write setColumnNameList? Hive plan serialization is slow --- Key: HIVE-1511 URL: https://issues.apache.org/jira/browse/HIVE-1511 Project: Hive Issue Type: Improvement Affects Versions: 0.7.0, 0.11.0 Reporter: Ning Zhang Assignee: Mohammad Kamrul Islam Attachments: failedPlan.xml, generated_plan.xml, HIVE-1511.10.patch, HIVE-1511.11.patch, HIVE-1511.4.patch, HIVE-1511.5.patch, HIVE-1511.6.patch, HIVE-1511.7.patch, HIVE-1511.8.patch, HIVE-1511.9.patch, HIVE-1511.patch, HIVE-1511-wip2.patch, HIVE-1511-wip3.patch, HIVE-1511-wip4.patch, HIVE-1511.wip.9.patch, HIVE-1511-wip.patch, KryoHiveTest.java, run.sh As reported by Edward Capriolo: For reference I did this as a test case SELECT * FROM src where key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR ...(100 more of these) No OOM but I gave up after the test case did not go anywhere for about 2 minutes. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-5104) HCatStorer fails to store boolean type
[ https://issues.apache.org/jira/browse/HIVE-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-5104: --- Fix Version/s: 0.12.0 HCatStorer fails to store boolean type -- Key: HIVE-5104 URL: https://issues.apache.org/jira/browse/HIVE-5104 Project: Hive Issue Type: Bug Components: HCatalog Affects Versions: 0.11.0 Reporter: Ron Frohock Fix For: 0.12.0 Attachments: HIVE-5104.1.patch.txt, HIVE-5104.2.patch Unable to store boolean values to HCat table Assume in Hive you have two tables... CREATE TABLE btest(test as boolean); CREATE TABLE btest2(test as boolean); Then in Pig A = LOAD 'btest' USING org.apache.hcatalog.pig.HCatLoader(); STORE A INTO 'btest2' USING org.apache.hcatalog.pig.HCatStorer(); You will get an ERROR 115: Unsupported type 5: in Pig's Schema Checking HCatBaseStorer.java, the case for data types doesn't check for booleans. Might have been overlooked in adding boolean to Pig in 0.10 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: HIVE-5104 patch status?
Hi, Looks like your patch has been committed, but I just wanted to confirm for those lurking. If you have a patch up on a JIRA, emailing the dev list is one of the correct ways of engaging a committer. IRC is also a viable strategy. Thanks for your contribution!! Cheers, Brock On Tue, Sep 3, 2013 at 1:59 PM, Karl Gierach k...@sourcethought.com wrote: Hi, We at Sourcethought have contributed at patch to fix JIRA issue HIVE-5104 about 2 weeks back, although it appears that this patch has not received any comments. The patch is relevant for the both github Hive branch-0.11 and the trunk, as both source files were not changed since the 0.11 branch was created. What steps need to be taken to incorporate this patch into the next release? Do we need to request approval from a committer? Best Regards, Karl Gierach Lead Engineer SourceThought, Inc. -- Apache MRUnit - Unit testing MapReduce - http://mrunit.apache.org
Please add new contributors on JIRA
Hi, There are two JIRA's I cannot assign to the contributors. Can they be added as contributors in JIRA: Karl from https://issues.apache.org/jira/browse/HIVE-5104 Konstantin from https://issues.apache.org/jira/browse/HIVE-5205 Thanks! Brock
[jira] [Commented] (HIVE-1511) Hive plan serialization is slow
[ https://issues.apache.org/jira/browse/HIVE-1511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757736#comment-13757736 ] Leo Romanoff commented on HIVE-1511: Just FYI, Kryo's FieldSerializer provides methods that allow you to exclude certain fields from (de)serialization, as if they are not present. This way you can make certain fields transient from the serialization point of view, even if they are not really transient in the Java sense. I don't know if it would help you, but you could try to do the following right after creation of Kryo instances and registration of classes (i.e. kryo.register(My.class)) using those instances: FieldSerializer ser = (FieldSerializer)kryo.getSerializer(MySpecialClass.class); ser.removeField(fieldName); // Now you can use your Kryo instance and it won't (de)serialize the field called fieldName -Leo Hive plan serialization is slow --- Key: HIVE-1511 URL: https://issues.apache.org/jira/browse/HIVE-1511 Project: Hive Issue Type: Improvement Affects Versions: 0.7.0, 0.11.0 Reporter: Ning Zhang Assignee: Mohammad Kamrul Islam Attachments: failedPlan.xml, generated_plan.xml, HIVE-1511.10.patch, HIVE-1511.11.patch, HIVE-1511.4.patch, HIVE-1511.5.patch, HIVE-1511.6.patch, HIVE-1511.7.patch, HIVE-1511.8.patch, HIVE-1511.9.patch, HIVE-1511.patch, HIVE-1511-wip2.patch, HIVE-1511-wip3.patch, HIVE-1511-wip4.patch, HIVE-1511.wip.9.patch, HIVE-1511-wip.patch, KryoHiveTest.java, run.sh As reported by Edward Capriolo: For reference I did this as a test case SELECT * FROM src where key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR ...(100 more of these) No OOM but I gave up after the test case did not go anywhere for about 2 minutes. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5210) WebHCatJTShim implementations are missing Apache license headers
[
https://issues.apache.org/jira/browse/HIVE-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757743#comment-13757743
]
Hive QA commented on HIVE-5210:
---
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12601342/HIVE-5210.patch
{color:red}ERROR:{color} -1 due to 8 failed/errored test(s), 2909 tests executed
*Failed tests:*
{noformat}
org.apache.hcatalog.mapreduce.TestSequenceFileReadWrite.testTextTableWriteRead
org.apache.hcatalog.mapreduce.TestHCatExternalDynamicPartitioned.testHCatDynamicPartitionedTable
org.apache.hcatalog.mapreduce.TestSequenceFileReadWrite.testSequenceTableWriteReadMR
org.apache.hcatalog.fileformats.TestOrcDynamicPartitioned.testHCatDynamicPartitionedTable
org.apache.hcatalog.fileformats.TestOrcDynamicPartitioned.testHCatDynamicPartitionedTableMultipleTask
org.apache.hcatalog.mapreduce.TestSequenceFileReadWrite.testSequenceTableWriteRead
org.apache.hcatalog.pig.TestHCatLoaderStorer.testSmallTinyInt
org.apache.hcatalog.mapreduce.TestSequenceFileReadWrite.testTextTableWriteReadMR
{noformat}
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/612/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/612/console
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests failed with: TestsFailedException: 8 tests failed
{noformat}
This message is automatically generated.
WebHCatJTShim implementations are missing Apache license headers
Key: HIVE-5210
URL: https://issues.apache.org/jira/browse/HIVE-5210
Project: Hive
Issue Type: Bug
Components: HCatalog
Reporter: Jarek Jarcec Cecho
Assignee: Jarek Jarcec Cecho
Fix For: 0.12.0
Attachments: HIVE-5210.patch
During investigation of SQOOP-1190, I've noticed that {{WebHCatJTShim}}
implementaion files do not have license headers.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-5205) Javadoc warnings in HCatalog prevent Hive from building under OpenJDK7
[ https://issues.apache.org/jira/browse/HIVE-5205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-5205: --- Status: Open (was: Patch Available) Javadoc warnings in HCatalog prevent Hive from building under OpenJDK7 -- Key: HIVE-5205 URL: https://issues.apache.org/jira/browse/HIVE-5205 Project: Hive Issue Type: Sub-task Components: HCatalog Affects Versions: 0.11.0 Reporter: Konstantin Boudnik Fix For: 0.12.0 Attachments: HIVE-5205.patch when building Hive with OpenJDK7 the following warning message makes the build fail: [javadoc] /var/lib/jenkins/workspace/Shark-Hive-0.11-OJDK7/hcatalog/storage-handlers/hbase/src/java/org/apache/hcatalog/hbase/snapshot/RevisionManagerFactory.java:81: warning - @return tag has no arguments. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5205) Javadoc warnings in HCatalog prevent Hive from building under OpenJDK7
[ https://issues.apache.org/jira/browse/HIVE-5205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757754#comment-13757754 ] Brock Noland commented on HIVE-5205: Doesn't look to apply any more. Javadoc warnings in HCatalog prevent Hive from building under OpenJDK7 -- Key: HIVE-5205 URL: https://issues.apache.org/jira/browse/HIVE-5205 Project: Hive Issue Type: Sub-task Components: HCatalog Affects Versions: 0.11.0 Reporter: Konstantin Boudnik Fix For: 0.12.0 Attachments: HIVE-5205.patch when building Hive with OpenJDK7 the following warning message makes the build fail: [javadoc] /var/lib/jenkins/workspace/Shark-Hive-0.11-OJDK7/hcatalog/storage-handlers/hbase/src/java/org/apache/hcatalog/hbase/snapshot/RevisionManagerFactory.java:81: warning - @return tag has no arguments. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5210) WebHCatJTShim implementations are missing Apache license headers
[
https://issues.apache.org/jira/browse/HIVE-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757764#comment-13757764
]
Jarek Jarcec Cecho commented on HIVE-5210:
--
The test failures do not seem to be relevant to this patch.
WebHCatJTShim implementations are missing Apache license headers
Key: HIVE-5210
URL: https://issues.apache.org/jira/browse/HIVE-5210
Project: Hive
Issue Type: Bug
Components: HCatalog
Reporter: Jarek Jarcec Cecho
Assignee: Jarek Jarcec Cecho
Fix For: 0.12.0
Attachments: HIVE-5210.patch
During investigation of SQOOP-1190, I've noticed that {{WebHCatJTShim}}
implementaion files do not have license headers.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5210) WebHCatJTShim implementations are missing Apache license headers
[
https://issues.apache.org/jira/browse/HIVE-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757770#comment-13757770
]
Brock Noland commented on HIVE-5210:
Agreed and +1. FYI to [~thejas].
WebHCatJTShim implementations are missing Apache license headers
Key: HIVE-5210
URL: https://issues.apache.org/jira/browse/HIVE-5210
Project: Hive
Issue Type: Bug
Components: HCatalog
Reporter: Jarek Jarcec Cecho
Assignee: Jarek Jarcec Cecho
Fix For: 0.12.0
Attachments: HIVE-5210.patch
During investigation of SQOOP-1190, I've noticed that {{WebHCatJTShim}}
implementaion files do not have license headers.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5049) Create an ORC test case that has a 0.11 ORC file
[ https://issues.apache.org/jira/browse/HIVE-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757780#comment-13757780 ] Hudson commented on HIVE-5049: -- FAILURE: Integrated in Hive-trunk-hadoop2 #403 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/403/]) HIVE-5049 : Create an ORC test case that has a 0.11 ORC file (Prasanth J via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519868) * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestOrcFile.java * /hive/trunk/ql/src/test/resources/orc-file-11-format.orc Create an ORC test case that has a 0.11 ORC file Key: HIVE-5049 URL: https://issues.apache.org/jira/browse/HIVE-5049 Project: Hive Issue Type: Bug Reporter: Owen O'Malley Assignee: Prasanth J Fix For: 0.12.0 Attachments: HIVE-5049.patch.txt, orc-file-11-format.orc We should add a test case that includes a 0.11.0 ORC file to ensure compatibility for reading old ORC files is kept correct. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5104) HCatStorer fails to store boolean type
[ https://issues.apache.org/jira/browse/HIVE-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757773#comment-13757773 ] Hudson commented on HIVE-5104: -- FAILURE: Integrated in Hive-trunk-hadoop2 #403 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/403/]) HIVE-5104 : HCatStorer fails to store boolean type (Karl D. Gierach via Sushanth Sowmyan) (khorgath: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519839) * /hive/trunk/hcatalog/hcatalog-pig-adapter/src/main/java/org/apache/hcatalog/pig/HCatBaseStorer.java * /hive/trunk/hcatalog/hcatalog-pig-adapter/src/test/java/org/apache/hcatalog/pig/TestHCatStorer.java HCatStorer fails to store boolean type -- Key: HIVE-5104 URL: https://issues.apache.org/jira/browse/HIVE-5104 Project: Hive Issue Type: Bug Components: HCatalog Affects Versions: 0.11.0 Reporter: Ron Frohock Fix For: 0.12.0 Attachments: HIVE-5104.1.patch.txt, HIVE-5104.2.patch Unable to store boolean values to HCat table Assume in Hive you have two tables... CREATE TABLE btest(test as boolean); CREATE TABLE btest2(test as boolean); Then in Pig A = LOAD 'btest' USING org.apache.hcatalog.pig.HCatLoader(); STORE A INTO 'btest2' USING org.apache.hcatalog.pig.HCatStorer(); You will get an ERROR 115: Unsupported type 5: in Pig's Schema Checking HCatBaseStorer.java, the case for data types doesn't check for booleans. Might have been overlooked in adding boolean to Pig in 0.10 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4441) [HCatalog] WebHCat does not honor user home directory
[
https://issues.apache.org/jira/browse/HIVE-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757775#comment-13757775
]
Hudson commented on HIVE-4441:
--
FAILURE: Integrated in Hive-trunk-hadoop2 #403 (See
[https://builds.apache.org/job/Hive-trunk-hadoop2/403/])
HIVE-4441: WebHCat does not honor user home directory (Daniel Dai) (daijy:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519884)
* /hive/trunk/RELEASE_NOTES.txt
*
/hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/tool/TempletonUtils.java
[HCatalog] WebHCat does not honor user home directory
-
Key: HIVE-4441
URL: https://issues.apache.org/jira/browse/HIVE-4441
Project: Hive
Issue Type: Bug
Components: HCatalog
Reporter: Daniel Dai
Assignee: Daniel Dai
Fix For: 0.12.0
Attachments: HIVE-4441-1.patch, HIVE-4441-2.patch, HIVE-4441-3.patch,
HIVE-4441-4.patch
If I submit a job as user A and I specify statusdir as a relative path, I
would expect results to be stored in the folder relative to the user A's home
folder.
For example, if I run:
{code}curl -s -d user.name=hdinsightuser -d execute=show+tables; -d
statusdir=pokes.output 'http://localhost:50111/templeton/v1/hive'{code}
I get the results under:
{code}/user/hdp/pokes.output{code}
And I expect them to be under:
{code}/user/hdinsightuser/pokes.output{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4750) Fix TestCliDriver.list_bucket_dml_{6,7,8}.q on 0.23
[
https://issues.apache.org/jira/browse/HIVE-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757772#comment-13757772
]
Hudson commented on HIVE-4750:
--
FAILURE: Integrated in Hive-trunk-hadoop2 #403 (See
[https://builds.apache.org/job/Hive-trunk-hadoop2/403/])
HIVE-4750 : Fix TestCliDriver.list_bucket_dml_{6,7,8}.q on 0.23 (Prasanth J via
Ashutosh Chauhan) (hashutosh:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519857)
* /hive/trunk/ql/src/test/queries/clientpositive/list_bucket_dml_6.q
* /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_6.q.out
Fix TestCliDriver.list_bucket_dml_{6,7,8}.q on 0.23
---
Key: HIVE-4750
URL: https://issues.apache.org/jira/browse/HIVE-4750
Project: Hive
Issue Type: Sub-task
Affects Versions: 0.12.0
Reporter: Brock Noland
Assignee: Prasanth J
Fix For: 0.12.0
Attachments: HIVE-4750.2.patch, HIVE-4750.patch
Removing 6,7,8 from the scope of HIVE-4746.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4586) [HCatalog] WebHCat should return 404 error for undefined resource
[ https://issues.apache.org/jira/browse/HIVE-4586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757778#comment-13757778 ] Hudson commented on HIVE-4586: -- FAILURE: Integrated in Hive-trunk-hadoop2 #403 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/403/]) [HIVE-4586] - WebHCat should return 404 error for undefined resource (Daniel Dai) (daijy: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519818) * /hive/trunk/RELEASE_NOTES.txt * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/CatchallExceptionMapper.java * /hive/trunk/hcatalog/webhcat/svr/src/test/java/org/apache/hcatalog/templeton/TestWebHCatE2e.java [HCatalog] WebHCat should return 404 error for undefined resource - Key: HIVE-4586 URL: https://issues.apache.org/jira/browse/HIVE-4586 Project: Hive Issue Type: Bug Components: HCatalog Affects Versions: 0.11.0 Reporter: Daniel Dai Assignee: Daniel Dai Fix For: 0.12.0 Attachments: HIVE-4586-1.patch, HIVE-4586-2.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5096) Add q file tests for ORC predicate pushdown
[ https://issues.apache.org/jira/browse/HIVE-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757779#comment-13757779 ] Hudson commented on HIVE-5096: -- FAILURE: Integrated in Hive-trunk-hadoop2 #403 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/403/]) HIVE-5096 : Add q file tests for ORC predicate pushdown (Prasanth J via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519883) * /hive/trunk/data/files/over1k * /hive/trunk/ql/src/test/queries/clientpositive/orc_predicate_pushdown.q * /hive/trunk/ql/src/test/results/clientpositive/orc_predicate_pushdown.q.out Add q file tests for ORC predicate pushdown --- Key: HIVE-5096 URL: https://issues.apache.org/jira/browse/HIVE-5096 Project: Hive Issue Type: Test Components: CLI, File Formats, StorageHandler Affects Versions: 0.12.0 Reporter: Prasanth J Assignee: Prasanth J Labels: orcfile Fix For: 0.12.0 Attachments: HIVE-5096.patch Add q file tests that checks the validity of the results when predicate pushdown is turned on and off. Also test for filter expressions in table scan operator when predicate pushdown is turned on for ORC. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4442) [HCatalog] WebHCat should not override user.name parameter for Queue call
[ https://issues.apache.org/jira/browse/HIVE-4442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757774#comment-13757774 ] Hudson commented on HIVE-4442: -- FAILURE: Integrated in Hive-trunk-hadoop2 #403 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/403/]) HIVE-4442: WebHCat should not override user.name parameter for Queue call (Daniel Dai) (daijy: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519875) * /hive/trunk/RELEASE_NOTES.txt * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/DeleteDelegator.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/ListDelegator.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/Server.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/StatusDelegator.java * /hive/trunk/shims/src/0.20/java/org/apache/hadoop/hive/shims/Hadoop20Shims.java * /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java * /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/mapred/WebHCatJTShim20S.java * /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java * /hive/trunk/shims/src/0.23/java/org/apache/hadoop/mapred/WebHCatJTShim23.java * /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/HadoopShims.java [HCatalog] WebHCat should not override user.name parameter for Queue call - Key: HIVE-4442 URL: https://issues.apache.org/jira/browse/HIVE-4442 Project: Hive Issue Type: Bug Components: HCatalog Reporter: Daniel Dai Assignee: Daniel Dai Fix For: 0.12.0 Attachments: HIVE-4442-1.patch, HIVE-4442-2.patch, HIVE-4442-3.patch Currently templeton for the Queue call uses the user.name to filter the results of the call in addition to the default security. Ideally the filter is an optional parameter to the call independent of the security check. I would suggest a parameter in addition to GET queue (jobs) give you all the jobs a user have permission: GET queue?showall=true -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5212) HCatalog javadoc fails with Hadoop23
[
https://issues.apache.org/jira/browse/HIVE-5212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757796#comment-13757796
]
Brock Noland commented on HIVE-5212:
FYI [~sushanth]
HCatalog javadoc fails with Hadoop23
Key: HIVE-5212
URL: https://issues.apache.org/jira/browse/HIVE-5212
Project: Hive
Issue Type: Bug
Affects Versions: 0.12.0
Reporter: Brock Noland
Since HIVE-5014, the following fails:
{noformat}
cd hcatalog
ant package -Dmvn.hadoop.profile=hadoop23
{noformat}
with the following:
{noformat}
[javadoc] Building tree for all the packages and classes...
[javadoc]
/home/brock/workspaces/hive-apache/hive/hcatalog/core/build/lib/compile/hadoop-mapreduce-client-jobclient-2.0.3-alpha-tests.jar(org/apache/hadoop/mapreduce/TestLocalRunner.class):
warning: Cannot find annotation method 'timeout()' in type 'Test': class
file for org.junit.Test not found
[javadoc]
/home/brock/workspaces/hive-apache/hive/hcatalog/core/build/lib/compile/hadoop-mapreduce-client-jobclient-2.0.3-alpha-tests.jar(org/apache/hadoop/mapred/TestClientServiceDelegate.class):
warning: Cannot find annotation method 'value()' in type 'RunWith': class
file for org.junit.runner.RunWith not found
[javadoc] Building index for all the packages and classes...
[javadoc] Building index for all classes...
[javadoc] Generating
/home/brock/workspaces/hive-apache/hive/hcatalog/build/docs/api/help-doc.html...
[javadoc] 2 warnings
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-5212) HCatalog javadoc fails with Hadoop23
Brock Noland created HIVE-5212:
--
Summary: HCatalog javadoc fails with Hadoop23
Key: HIVE-5212
URL: https://issues.apache.org/jira/browse/HIVE-5212
Project: Hive
Issue Type: Bug
Affects Versions: 0.12.0
Reporter: Brock Noland
Since HIVE-5014, the following fails:
{noformat}
cd hcatalog
ant package -Dmvn.hadoop.profile=hadoop23
{noformat}
with the following:
{noformat}
[javadoc] Building tree for all the packages and classes...
[javadoc]
/home/brock/workspaces/hive-apache/hive/hcatalog/core/build/lib/compile/hadoop-mapreduce-client-jobclient-2.0.3-alpha-tests.jar(org/apache/hadoop/mapreduce/TestLocalRunner.class):
warning: Cannot find annotation method 'timeout()' in type 'Test': class file
for org.junit.Test not found
[javadoc]
/home/brock/workspaces/hive-apache/hive/hcatalog/core/build/lib/compile/hadoop-mapreduce-client-jobclient-2.0.3-alpha-tests.jar(org/apache/hadoop/mapred/TestClientServiceDelegate.class):
warning: Cannot find annotation method 'value()' in type 'RunWith': class file
for org.junit.runner.RunWith not found
[javadoc] Building index for all the packages and classes...
[javadoc] Building index for all classes...
[javadoc] Generating
/home/brock/workspaces/hive-apache/hive/hcatalog/build/docs/api/help-doc.html...
[javadoc] 2 warnings
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5014) [HCatalog] Fix HCatalog build issue on Windows
[ https://issues.apache.org/jira/browse/HIVE-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757776#comment-13757776 ] Hudson commented on HIVE-5014: -- FAILURE: Integrated in Hive-trunk-hadoop2 #403 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/403/]) HIVE-5014 : Fix HCatalog build issue on Windows (Daniel Dai via Sushanth Sowmyan) (khorgath: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519853) * /hive/trunk/hcatalog/build.xml [HCatalog] Fix HCatalog build issue on Windows -- Key: HIVE-5014 URL: https://issues.apache.org/jira/browse/HIVE-5014 Project: Hive Issue Type: Sub-task Components: HCatalog Reporter: Daniel Dai Assignee: Daniel Dai Fix For: 0.12.0 Attachments: HIVE-5014-1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5145) Fix TestCliDriver.list_bucket_query_multiskew_2.q on hadoop 0.23
[ https://issues.apache.org/jira/browse/HIVE-5145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1375#comment-1375 ] Hudson commented on HIVE-5145: -- FAILURE: Integrated in Hive-trunk-hadoop2 #403 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/403/]) HIVE-5145 : Fix TestCliDriver.list_bucket_query_multiskew_2.q on hadoop 0.23 (Prasanth J via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519862) * /hive/trunk/ql/src/test/queries/clientpositive/list_bucket_query_multiskew_2.q * /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_multiskew_2.q.out Fix TestCliDriver.list_bucket_query_multiskew_2.q on hadoop 0.23 Key: HIVE-5145 URL: https://issues.apache.org/jira/browse/HIVE-5145 Project: Hive Issue Type: Bug Components: Tests Reporter: Prasanth J Assignee: Prasanth J Fix For: 0.12.0 Attachments: HIVE-5145.2.patch, HIVE-5145.patch there is some determinism related to the output of list_bucket_query_multiskew_2.q test case. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5203) FunctionRegistry.getMethodInternal() should prefer method arguments with closer affinity to the original argument types
[
https://issues.apache.org/jira/browse/HIVE-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757837#comment-13757837
]
Edward Capriolo commented on HIVE-5203:
---
I have a couple more things I think we should do first.
{code}
for (Method m: udfMethods) {
+currentScore = 0;
+ListTypeInfo argumentsAccepted =
+TypeInfoUtils.getParameterTypeInfos(m, argumentsPassed.size());
+IteratorTypeInfo argsPassedIter = argumentsPassed.iterator();
{code}
Especially this one. We are addign a public method we should have tests around
it to document its functionality. java doc would be nice to.
{code}
public static PrimitiveGrouping getPrimitiveGrouping(PrimitiveCategory
primitiveCategory) {
+switch (primitiveCategory) {
{public}
FunctionRegistry.getMethodInternal() should prefer method arguments with
closer affinity to the original argument types
---
Key: HIVE-5203
URL: https://issues.apache.org/jira/browse/HIVE-5203
Project: Hive
Issue Type: Bug
Components: Types, UDF
Reporter: Jason Dere
Assignee: Jason Dere
Attachments: HIVE-5203.1.patch
When the function registry is trying to determine the best version of UDF
evaluate() to use based on a set of arguments passed in, it should prefer
methods where the argument types are more related to the original types. For
example if varchar is used with UDFFromUnixTime(), varchar is convertible to
both the double and string versions of evaluate() for that UDF. In this case
we would prefer that the function registry select the string version over the
double version, since varchar and string are both string types.
This doesn't really affect any of the existing types, but comes into play
with the addition of the varchar type (HIVE-4844).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4442) [HCatalog] WebHCat should not override user.name parameter for Queue call
[ https://issues.apache.org/jira/browse/HIVE-4442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757849#comment-13757849 ] Hudson commented on HIVE-4442: -- FAILURE: Integrated in Hive-trunk-hadoop2-ptest #83 (See [https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/83/]) HIVE-4442: WebHCat should not override user.name parameter for Queue call (Daniel Dai) (daijy: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519875) * /hive/trunk/RELEASE_NOTES.txt * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/DeleteDelegator.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/ListDelegator.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/Server.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/StatusDelegator.java * /hive/trunk/shims/src/0.20/java/org/apache/hadoop/hive/shims/Hadoop20Shims.java * /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java * /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/mapred/WebHCatJTShim20S.java * /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java * /hive/trunk/shims/src/0.23/java/org/apache/hadoop/mapred/WebHCatJTShim23.java * /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/HadoopShims.java [HCatalog] WebHCat should not override user.name parameter for Queue call - Key: HIVE-4442 URL: https://issues.apache.org/jira/browse/HIVE-4442 Project: Hive Issue Type: Bug Components: HCatalog Reporter: Daniel Dai Assignee: Daniel Dai Fix For: 0.12.0 Attachments: HIVE-4442-1.patch, HIVE-4442-2.patch, HIVE-4442-3.patch Currently templeton for the Queue call uses the user.name to filter the results of the call in addition to the default security. Ideally the filter is an optional parameter to the call independent of the security check. I would suggest a parameter in addition to GET queue (jobs) give you all the jobs a user have permission: GET queue?showall=true -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5049) Create an ORC test case that has a 0.11 ORC file
[ https://issues.apache.org/jira/browse/HIVE-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757856#comment-13757856 ] Hudson commented on HIVE-5049: -- FAILURE: Integrated in Hive-trunk-hadoop2-ptest #83 (See [https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/83/]) HIVE-5049 : Create an ORC test case that has a 0.11 ORC file (Prasanth J via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519868) * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestOrcFile.java * /hive/trunk/ql/src/test/resources/orc-file-11-format.orc Create an ORC test case that has a 0.11 ORC file Key: HIVE-5049 URL: https://issues.apache.org/jira/browse/HIVE-5049 Project: Hive Issue Type: Bug Reporter: Owen O'Malley Assignee: Prasanth J Fix For: 0.12.0 Attachments: HIVE-5049.patch.txt, orc-file-11-format.orc We should add a test case that includes a 0.11.0 ORC file to ensure compatibility for reading old ORC files is kept correct. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5145) Fix TestCliDriver.list_bucket_query_multiskew_2.q on hadoop 0.23
[ https://issues.apache.org/jira/browse/HIVE-5145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757853#comment-13757853 ] Hudson commented on HIVE-5145: -- FAILURE: Integrated in Hive-trunk-hadoop2-ptest #83 (See [https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/83/]) HIVE-5145 : Fix TestCliDriver.list_bucket_query_multiskew_2.q on hadoop 0.23 (Prasanth J via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519862) * /hive/trunk/ql/src/test/queries/clientpositive/list_bucket_query_multiskew_2.q * /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_multiskew_2.q.out Fix TestCliDriver.list_bucket_query_multiskew_2.q on hadoop 0.23 Key: HIVE-5145 URL: https://issues.apache.org/jira/browse/HIVE-5145 Project: Hive Issue Type: Bug Components: Tests Reporter: Prasanth J Assignee: Prasanth J Fix For: 0.12.0 Attachments: HIVE-5145.2.patch, HIVE-5145.patch there is some determinism related to the output of list_bucket_query_multiskew_2.q test case. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5104) HCatStorer fails to store boolean type
[ https://issues.apache.org/jira/browse/HIVE-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757847#comment-13757847 ] Hudson commented on HIVE-5104: -- FAILURE: Integrated in Hive-trunk-hadoop2-ptest #83 (See [https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/83/]) HIVE-5104 : HCatStorer fails to store boolean type (Karl D. Gierach via Sushanth Sowmyan) (khorgath: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519839) * /hive/trunk/hcatalog/hcatalog-pig-adapter/src/main/java/org/apache/hcatalog/pig/HCatBaseStorer.java * /hive/trunk/hcatalog/hcatalog-pig-adapter/src/test/java/org/apache/hcatalog/pig/TestHCatStorer.java HCatStorer fails to store boolean type -- Key: HIVE-5104 URL: https://issues.apache.org/jira/browse/HIVE-5104 Project: Hive Issue Type: Bug Components: HCatalog Affects Versions: 0.11.0 Reporter: Ron Frohock Fix For: 0.12.0 Attachments: HIVE-5104.1.patch.txt, HIVE-5104.2.patch Unable to store boolean values to HCat table Assume in Hive you have two tables... CREATE TABLE btest(test as boolean); CREATE TABLE btest2(test as boolean); Then in Pig A = LOAD 'btest' USING org.apache.hcatalog.pig.HCatLoader(); STORE A INTO 'btest2' USING org.apache.hcatalog.pig.HCatStorer(); You will get an ERROR 115: Unsupported type 5: in Pig's Schema Checking HCatBaseStorer.java, the case for data types doesn't check for booleans. Might have been overlooked in adding boolean to Pig in 0.10 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5149) ReduceSinkDeDuplication can pick the wrong partitioning columns
[ https://issues.apache.org/jira/browse/HIVE-5149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757857#comment-13757857 ] Hudson commented on HIVE-5149: -- FAILURE: Integrated in Hive-trunk-hadoop2-ptest #83 (See [https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/83/]) HIVE-5149 : ReduceSinkDeDuplication can pick the wrong partitioning columns (Yin Huai via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519805) * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/correlation/ReduceSinkDeDuplication.java * /hive/trunk/ql/src/test/results/clientpositive/groupby2.q.out * /hive/trunk/ql/src/test/results/clientpositive/groupby2_map_skew.q.out * /hive/trunk/ql/src/test/results/clientpositive/groupby_cube1.q.out * /hive/trunk/ql/src/test/results/clientpositive/groupby_rollup1.q.out * /hive/trunk/ql/src/test/results/clientpositive/reduce_deduplicate_extended.q.out ReduceSinkDeDuplication can pick the wrong partitioning columns --- Key: HIVE-5149 URL: https://issues.apache.org/jira/browse/HIVE-5149 Project: Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.11.0, 0.12.0 Reporter: Yin Huai Assignee: Yin Huai Priority: Blocker Fix For: 0.12.0 Attachments: HIVE-5149.1.patch, HIVE-5149.2.patch, HIVE-5149.3.patch https://mail-archives.apache.org/mod_mbox/hive-user/201308.mbox/%3CCAG6Lhyex5XPwszpihKqkPRpzri2k=m4qgc+cpar5yvr8sjt...@mail.gmail.com%3E -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4586) [HCatalog] WebHCat should return 404 error for undefined resource
[ https://issues.apache.org/jira/browse/HIVE-4586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757854#comment-13757854 ] Hudson commented on HIVE-4586: -- FAILURE: Integrated in Hive-trunk-hadoop2-ptest #83 (See [https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/83/]) [HIVE-4586] - WebHCat should return 404 error for undefined resource (Daniel Dai) (daijy: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519818) * /hive/trunk/RELEASE_NOTES.txt * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/CatchallExceptionMapper.java * /hive/trunk/hcatalog/webhcat/svr/src/test/java/org/apache/hcatalog/templeton/TestWebHCatE2e.java [HCatalog] WebHCat should return 404 error for undefined resource - Key: HIVE-4586 URL: https://issues.apache.org/jira/browse/HIVE-4586 Project: Hive Issue Type: Bug Components: HCatalog Affects Versions: 0.11.0 Reporter: Daniel Dai Assignee: Daniel Dai Fix For: 0.12.0 Attachments: HIVE-4586-1.patch, HIVE-4586-2.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4748) Fix TempletonUtilsTest failure on Windows
[ https://issues.apache.org/jira/browse/HIVE-4748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757858#comment-13757858 ] Hudson commented on HIVE-4748: -- FAILURE: Integrated in Hive-trunk-hadoop2-ptest #83 (See [https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/83/]) HIVE-4748 - Fix TempletonUtilsTest failure on Windows (Shuaishuai Nie via Thejas Nair) (thejas: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519915) * /hive/trunk/hcatalog/build-support/ant/test.xml * /hive/trunk/hcatalog/build.properties * /hive/trunk/hcatalog/webhcat/svr/src/test/java/org/apache/hcatalog/templeton/tool/TestTempletonUtils.java Fix TempletonUtilsTest failure on Windows - Key: HIVE-4748 URL: https://issues.apache.org/jira/browse/HIVE-4748 Project: Hive Issue Type: Bug Components: HCatalog, Tests Environment: Windows Reporter: Shuaishuai Nie Assignee: Shuaishuai Nie Attachments: HIVE-4748.1.patch, HIVE-4748.2.patch The test was assuming that /tmp and /usr folders exist on the OS. As this is not true on Windows, the test fails. The fix modified the test such that it creates the files it needs before doing the verification. This is a test-only issue. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5197) TestE2EScenerios.createTaskAttempt should use MapRedUtil
[ https://issues.apache.org/jira/browse/HIVE-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757859#comment-13757859 ] Hudson commented on HIVE-5197: -- FAILURE: Integrated in Hive-trunk-hadoop2-ptest #83 (See [https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/83/]) HIVE-5197: TestE2EScenerios.createTaskAttempt should use MapRedUtil (Brock Noland via Thejas Nair) (thejas: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519916) * /hive/trunk/hcatalog/hcatalog-pig-adapter/src/test/java/org/apache/hcatalog/pig/TestE2EScenarios.java TestE2EScenerios.createTaskAttempt should use MapRedUtil Key: HIVE-5197 URL: https://issues.apache.org/jira/browse/HIVE-5197 Project: Hive Issue Type: Test Reporter: Brock Noland Assignee: Brock Noland Priority: Minor Attachments: HIVE-5197.patch Basically we should use HCatMapRedUtil as opposed to new'ing the task attempt context. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5014) [HCatalog] Fix HCatalog build issue on Windows
[ https://issues.apache.org/jira/browse/HIVE-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757852#comment-13757852 ] Hudson commented on HIVE-5014: -- FAILURE: Integrated in Hive-trunk-hadoop2-ptest #83 (See [https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/83/]) HIVE-5014 : Fix HCatalog build issue on Windows (Daniel Dai via Sushanth Sowmyan) (khorgath: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519853) * /hive/trunk/hcatalog/build.xml [HCatalog] Fix HCatalog build issue on Windows -- Key: HIVE-5014 URL: https://issues.apache.org/jira/browse/HIVE-5014 Project: Hive Issue Type: Sub-task Components: HCatalog Reporter: Daniel Dai Assignee: Daniel Dai Fix For: 0.12.0 Attachments: HIVE-5014-1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [ANNOUNCE] New Hive Committer - Yin Huai
Congrats! On Wed, Sep 4, 2013 at 5:23 AM, Brock Noland br...@cloudera.com wrote: Congrats Yin!! On Wed, Sep 4, 2013 at 4:14 AM, Lefty Leverenz leftylever...@gmail.com wrote: Bravo, Yin! -- Lefty On Wed, Sep 4, 2013 at 4:17 AM, Sushanth Sowmyan khorg...@gmail.com wrote: Congrats, Yin! :) On Sep 4, 2013 1:13 AM, Alexander Alten-Lorenz wget.n...@gmail.com wrote: Amazing news, congratz Yin! Well deserved! On Sep 4, 2013, at 6:49 AM, Carl Steinbach c...@apache.org wrote: The Apache Hive PMC has voted to make Yin Huai a committer on the Apache Hive project. Please join me in congratulating Yin! Thanks. Carl -- Alexander Alten-Lorenz http://mapredit.blogspot.com German Hadoop LinkedIn Group: http://goo.gl/N8pCF -- Apache MRUnit - Unit testing MapReduce - http://mrunit.apache.org -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
[jira] [Commented] (HIVE-4441) [HCatalog] WebHCat does not honor user home directory
[
https://issues.apache.org/jira/browse/HIVE-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757850#comment-13757850
]
Hudson commented on HIVE-4441:
--
FAILURE: Integrated in Hive-trunk-hadoop2-ptest #83 (See
[https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/83/])
HIVE-4441: WebHCat does not honor user home directory (Daniel Dai) (daijy:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519897)
*
/hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/tool/TempletonUtils.java
HIVE-4441: WebHCat does not honor user home directory (Daniel Dai) (daijy:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519884)
* /hive/trunk/RELEASE_NOTES.txt
*
/hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/tool/TempletonUtils.java
[HCatalog] WebHCat does not honor user home directory
-
Key: HIVE-4441
URL: https://issues.apache.org/jira/browse/HIVE-4441
Project: Hive
Issue Type: Bug
Components: HCatalog
Reporter: Daniel Dai
Assignee: Daniel Dai
Fix For: 0.12.0
Attachments: HIVE-4441-1.patch, HIVE-4441-2.patch, HIVE-4441-3.patch,
HIVE-4441-4.patch
If I submit a job as user A and I specify statusdir as a relative path, I
would expect results to be stored in the folder relative to the user A's home
folder.
For example, if I run:
{code}curl -s -d user.name=hdinsightuser -d execute=show+tables; -d
statusdir=pokes.output 'http://localhost:50111/templeton/v1/hive'{code}
I get the results under:
{code}/user/hdp/pokes.output{code}
And I expect them to be under:
{code}/user/hdinsightuser/pokes.output{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5015) [HCatalog] Fix HCatalog unit tests on Windows
[ https://issues.apache.org/jira/browse/HIVE-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757848#comment-13757848 ] Hudson commented on HIVE-5015: -- FAILURE: Integrated in Hive-trunk-hadoop2-ptest #83 (See [https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/83/]) HIVE-5015 : Fix HCatalog unit tests on Windows (khorgath: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519907) * /hive/trunk/hcatalog/core/src/main/java/org/apache/hcatalog/mapreduce/FileOutputCommitterContainer.java * /hive/trunk/hcatalog/core/src/test/java/org/apache/hcatalog/cli/TestPermsGrp.java * /hive/trunk/hcatalog/core/src/test/java/org/apache/hcatalog/mapreduce/HCatBaseTest.java * /hive/trunk/hcatalog/core/src/test/java/org/apache/hcatalog/mapreduce/TestHCatPartitionPublish.java * /hive/trunk/hcatalog/core/src/test/java/org/apache/hcatalog/mapreduce/TestSequenceFileReadWrite.java * /hive/trunk/hcatalog/hcatalog-pig-adapter/src/test/java/org/apache/hcatalog/pig/TestHCatLoader.java * /hive/trunk/hcatalog/hcatalog-pig-adapter/src/test/java/org/apache/hcatalog/pig/TestHCatLoaderStorer.java * /hive/trunk/hcatalog/hcatalog-pig-adapter/src/test/java/org/apache/hcatalog/pig/TestHCatStorerMulti.java * /hive/trunk/hcatalog/hcatalog-pig-adapter/src/test/java/org/apache/hcatalog/pig/TestHCatStorerWrapper.java * /hive/trunk/hcatalog/storage-handlers/hbase/src/java/org/apache/hcatalog/hbase/snapshot/ZKUtil.java * /hive/trunk/hcatalog/storage-handlers/hbase/src/test/org/apache/hcatalog/hbase/ManyMiniCluster.java * /hive/trunk/hcatalog/storage-handlers/hbase/src/test/org/apache/hcatalog/hbase/SkeletonHBaseTest.java * /hive/trunk/hcatalog/storage-handlers/hbase/src/test/org/apache/hcatalog/hbase/TestHBaseInputFormat.java * /hive/trunk/hcatalog/storage-handlers/hbase/src/test/org/apache/hcatalog/hbase/TestSnapshots.java * /hive/trunk/hcatalog/webhcat/java-client/src/test/java/org/apache/hcatalog/api/TestHCatClient.java [HCatalog] Fix HCatalog unit tests on Windows - Key: HIVE-5015 URL: https://issues.apache.org/jira/browse/HIVE-5015 Project: Hive Issue Type: Sub-task Components: HCatalog Reporter: Daniel Dai Assignee: Daniel Dai Fix For: 0.12.0 Attachments: HIVE-5015-1.patch, HIVE-5015.2.patch Note: To run hcatalog unit tests on windows, we need to use a hadoop.jar for Windows. Checkout branch-1-win branch of hadoop, do a mvn-install. Then you can use the branch-1-win.hadoop for unit test. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4750) Fix TestCliDriver.list_bucket_dml_{6,7,8}.q on 0.23
[
https://issues.apache.org/jira/browse/HIVE-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757846#comment-13757846
]
Hudson commented on HIVE-4750:
--
FAILURE: Integrated in Hive-trunk-hadoop2-ptest #83 (See
[https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/83/])
HIVE-4750 : Fix TestCliDriver.list_bucket_dml_{6,7,8}.q on 0.23 (Prasanth J via
Ashutosh Chauhan) (hashutosh:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519857)
* /hive/trunk/ql/src/test/queries/clientpositive/list_bucket_dml_6.q
* /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_6.q.out
Fix TestCliDriver.list_bucket_dml_{6,7,8}.q on 0.23
---
Key: HIVE-4750
URL: https://issues.apache.org/jira/browse/HIVE-4750
Project: Hive
Issue Type: Sub-task
Affects Versions: 0.12.0
Reporter: Brock Noland
Assignee: Prasanth J
Fix For: 0.12.0
Attachments: HIVE-4750.2.patch, HIVE-4750.patch
Removing 6,7,8 from the scope of HIVE-4746.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5096) Add q file tests for ORC predicate pushdown
[ https://issues.apache.org/jira/browse/HIVE-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757855#comment-13757855 ] Hudson commented on HIVE-5096: -- FAILURE: Integrated in Hive-trunk-hadoop2-ptest #83 (See [https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/83/]) HIVE-5096 : Add q file tests for ORC predicate pushdown (Prasanth J via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519883) * /hive/trunk/data/files/over1k * /hive/trunk/ql/src/test/queries/clientpositive/orc_predicate_pushdown.q * /hive/trunk/ql/src/test/results/clientpositive/orc_predicate_pushdown.q.out Add q file tests for ORC predicate pushdown --- Key: HIVE-5096 URL: https://issues.apache.org/jira/browse/HIVE-5096 Project: Hive Issue Type: Test Components: CLI, File Formats, StorageHandler Affects Versions: 0.12.0 Reporter: Prasanth J Assignee: Prasanth J Labels: orcfile Fix For: 0.12.0 Attachments: HIVE-5096.patch Add q file tests that checks the validity of the results when predicate pushdown is turned on and off. Also test for filter expressions in table scan operator when predicate pushdown is turned on for ORC. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5129) Multiple table insert fails on count(distinct)
[
https://issues.apache.org/jira/browse/HIVE-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757851#comment-13757851
]
Hudson commented on HIVE-5129:
--
FAILURE: Integrated in Hive-trunk-hadoop2-ptest #83 (See
[https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/83/])
HIVE-5129 Multiple table insert fails on count distinct (Vikram Dixit via
Harish Butani) (rhbutani:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519764)
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java
* /hive/trunk/ql/src/test/queries/clientpositive/multi_insert_gby3.q
* /hive/trunk/ql/src/test/results/clientpositive/multi_insert_gby3.q.out
Multiple table insert fails on count(distinct)
--
Key: HIVE-5129
URL: https://issues.apache.org/jira/browse/HIVE-5129
Project: Hive
Issue Type: Bug
Components: Query Processor
Affects Versions: 0.11.0
Reporter: Vikram Dixit K
Assignee: Vikram Dixit K
Fix For: 0.12.0
Attachments: aggrTestMultiInsertData1.txt,
aggrTestMultiInsertData.txt, aggrTestMultiInsert.q, HIVE-5129.1.patch.txt,
HIVE-5129.2.WIP.patch.txt, HIVE-5129.3.patch.txt, HIVE-5129.4.patch,
HIVE-5129.4.patch.txt
Hive fails with a class cast exception on queries of the form:
{noformat}
from studenttab10k
insert overwrite table multi_insert_2_1
select name, avg(age) as avgage
group by name
insert overwrite table multi_insert_2_2
select name, age, sum(gpa) as sumgpa
group by name, age
insert overwrite table multi_insert_2_3
select name, count(distinct age) as distage
group by name;
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: HIVE-5104 patch status?
I'm not sure I understand what you are saying I see plenty of comments on your ticket. http://www.apache.org/dev/committers.html#committer-responsibilities Applying patches In order to grow and maintain healthy communities, committers need to discuss, review and apply patches submitted by volunteers. The Committers are also responsible for the quality and IP clearance of the code that goes into ASF repositories. Helping users Committers should monitor both the dev and user lists for the projects that they work on and (collectively) provide prompt and useful responses to questions from users. Monitoring commits and issues Committers should review commit email messages for their projects and point out anything that looks funny or that may bring in IP issues. Monitoring Bugzilla / Jira for bugs or enhancement requests is also a responsibility of Committers. Generally we (committers pmc) attempt to wade though the open jira issues and review and commit open issues. Not all of us are full time, and not all of us specialize across the entire code base, so the length of time a patch can stay out there is variable. My process is this: Review jira for things marked PATCH AVAILABLE If I understand the scope of the issue I review it and leave comments. If ready I wait for the test and then commit. I personally try to maintain a balance of 75% writing code 25% review but lately I am about 80% review 20% code. I would like us to move to a road map and feature based releases with smaller tuck-in issues. At the moment everything that flows into our jira looks the same to me as we have people going into several different directions, it makes it fairly hard to order the incoming issues in priority. On Wed, Sep 4, 2013 at 8:42 AM, Brock Noland br...@cloudera.com wrote: Hi, Looks like your patch has been committed, but I just wanted to confirm for those lurking. If you have a patch up on a JIRA, emailing the dev list is one of the correct ways of engaging a committer. IRC is also a viable strategy. Thanks for your contribution!! Cheers, Brock On Tue, Sep 3, 2013 at 1:59 PM, Karl Gierach k...@sourcethought.com wrote: Hi, We at Sourcethought have contributed at patch to fix JIRA issue HIVE-5104 about 2 weeks back, although it appears that this patch has not received any comments. The patch is relevant for the both github Hive branch-0.11 and the trunk, as both source files were not changed since the 0.11 branch was created. What steps need to be taken to incorporate this patch into the next release? Do we need to request approval from a committer? Best Regards, Karl Gierach Lead Engineer SourceThought, Inc. -- Apache MRUnit - Unit testing MapReduce - http://mrunit.apache.org
[jira] [Updated] (HIVE-5104) HCatStorer fails to store boolean type
[ https://issues.apache.org/jira/browse/HIVE-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-5104: --- Assignee: Karl D. Gierach HCatStorer fails to store boolean type -- Key: HIVE-5104 URL: https://issues.apache.org/jira/browse/HIVE-5104 Project: Hive Issue Type: Bug Components: HCatalog Affects Versions: 0.11.0 Reporter: Ron Frohock Assignee: Karl D. Gierach Fix For: 0.12.0 Attachments: HIVE-5104.1.patch.txt, HIVE-5104.2.patch Unable to store boolean values to HCat table Assume in Hive you have two tables... CREATE TABLE btest(test as boolean); CREATE TABLE btest2(test as boolean); Then in Pig A = LOAD 'btest' USING org.apache.hcatalog.pig.HCatLoader(); STORE A INTO 'btest2' USING org.apache.hcatalog.pig.HCatStorer(); You will get an ERROR 115: Unsupported type 5: in Pig's Schema Checking HCatBaseStorer.java, the case for data types doesn't check for booleans. Might have been overlooked in adding boolean to Pig in 0.10 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-5205) Javadoc warnings in HCatalog prevent Hive from building under OpenJDK7
[ https://issues.apache.org/jira/browse/HIVE-5205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-5205: --- Assignee: Konstantin Boudnik Javadoc warnings in HCatalog prevent Hive from building under OpenJDK7 -- Key: HIVE-5205 URL: https://issues.apache.org/jira/browse/HIVE-5205 Project: Hive Issue Type: Sub-task Components: HCatalog Affects Versions: 0.11.0 Reporter: Konstantin Boudnik Assignee: Konstantin Boudnik Fix For: 0.12.0 Attachments: HIVE-5205.patch when building Hive with OpenJDK7 the following warning message makes the build fail: [javadoc] /var/lib/jenkins/workspace/Shark-Hive-0.11-OJDK7/hcatalog/storage-handlers/hbase/src/java/org/apache/hcatalog/hbase/snapshot/RevisionManagerFactory.java:81: warning - @return tag has no arguments. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5197) TestE2EScenerios.createTaskAttempt should use MapRedUtil
[ https://issues.apache.org/jira/browse/HIVE-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757985#comment-13757985 ] Sushanth Sowmyan commented on HIVE-5197: [~brocknoland] Cool, will close that then. Thanks! TestE2EScenerios.createTaskAttempt should use MapRedUtil Key: HIVE-5197 URL: https://issues.apache.org/jira/browse/HIVE-5197 Project: Hive Issue Type: Test Reporter: Brock Noland Assignee: Brock Noland Priority: Minor Attachments: HIVE-5197.patch Basically we should use HCatMapRedUtil as opposed to new'ing the task attempt context. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HIVE-5135) HCatalog test TestE2EScenarios fails with hadoop 2.x
[ https://issues.apache.org/jira/browse/HIVE-5135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan resolved HIVE-5135. Resolution: Duplicate HCatalog test TestE2EScenarios fails with hadoop 2.x Key: HIVE-5135 URL: https://issues.apache.org/jira/browse/HIVE-5135 Project: Hive Issue Type: Bug Reporter: Sushanth Sowmyan Assignee: Sushanth Sowmyan Attachments: e2e.wip.patch HIVE-4388 makes a first couple of changes needed to fix unit tests with hadoop 2.x, and also modifies TestE2EScenarios to bring it up to date to use Shims, but TestE2EScenarios still fails because TaskAttemptId being instantiated with no arguments fails under hadoop 2.x. I'm attaching a patch here which sits on top of HIVE-4388 to fix the test under hadoop 2.x, but is a WIP. After HIVE-4388 gets committed, I will revisit this to check if we need to shim out TaskAttemptID or not, and test across versions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5104) HCatStorer fails to store boolean type
[ https://issues.apache.org/jira/browse/HIVE-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757950#comment-13757950 ] Hudson commented on HIVE-5104: -- FAILURE: Integrated in Hive-trunk-hadoop1-ptest #150 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/150/]) HIVE-5104 : HCatStorer fails to store boolean type (Karl D. Gierach via Sushanth Sowmyan) (khorgath: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519839) * /hive/trunk/hcatalog/hcatalog-pig-adapter/src/main/java/org/apache/hcatalog/pig/HCatBaseStorer.java * /hive/trunk/hcatalog/hcatalog-pig-adapter/src/test/java/org/apache/hcatalog/pig/TestHCatStorer.java HCatStorer fails to store boolean type -- Key: HIVE-5104 URL: https://issues.apache.org/jira/browse/HIVE-5104 Project: Hive Issue Type: Bug Components: HCatalog Affects Versions: 0.11.0 Reporter: Ron Frohock Assignee: Karl D. Gierach Fix For: 0.12.0 Attachments: HIVE-5104.1.patch.txt, HIVE-5104.2.patch Unable to store boolean values to HCat table Assume in Hive you have two tables... CREATE TABLE btest(test as boolean); CREATE TABLE btest2(test as boolean); Then in Pig A = LOAD 'btest' USING org.apache.hcatalog.pig.HCatLoader(); STORE A INTO 'btest2' USING org.apache.hcatalog.pig.HCatStorer(); You will get an ERROR 115: Unsupported type 5: in Pig's Schema Checking HCatBaseStorer.java, the case for data types doesn't check for booleans. Might have been overlooked in adding boolean to Pig in 0.10 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4442) [HCatalog] WebHCat should not override user.name parameter for Queue call
[ https://issues.apache.org/jira/browse/HIVE-4442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757952#comment-13757952 ] Hudson commented on HIVE-4442: -- FAILURE: Integrated in Hive-trunk-hadoop1-ptest #150 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/150/]) HIVE-4442: WebHCat should not override user.name parameter for Queue call (Daniel Dai) (daijy: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519875) * /hive/trunk/RELEASE_NOTES.txt * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/DeleteDelegator.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/ListDelegator.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/Server.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/StatusDelegator.java * /hive/trunk/shims/src/0.20/java/org/apache/hadoop/hive/shims/Hadoop20Shims.java * /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java * /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/mapred/WebHCatJTShim20S.java * /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java * /hive/trunk/shims/src/0.23/java/org/apache/hadoop/mapred/WebHCatJTShim23.java * /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/HadoopShims.java [HCatalog] WebHCat should not override user.name parameter for Queue call - Key: HIVE-4442 URL: https://issues.apache.org/jira/browse/HIVE-4442 Project: Hive Issue Type: Bug Components: HCatalog Reporter: Daniel Dai Assignee: Daniel Dai Fix For: 0.12.0 Attachments: HIVE-4442-1.patch, HIVE-4442-2.patch, HIVE-4442-3.patch Currently templeton for the Queue call uses the user.name to filter the results of the call in addition to the default security. Ideally the filter is an optional parameter to the call independent of the security check. I would suggest a parameter in addition to GET queue (jobs) give you all the jobs a user have permission: GET queue?showall=true -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-5213) remove hcatalog/shims directory
Eugene Koifman created HIVE-5213: Summary: remove hcatalog/shims directory Key: HIVE-5213 URL: https://issues.apache.org/jira/browse/HIVE-5213 Project: Hive Issue Type: Bug Components: HCatalog Affects Versions: 0.12.0 Reporter: Eugene Koifman Assignee: Eugene Koifman Fix For: 0.12.0 hcatalog/shims is no longer relevant. It should have been deleted as part of HIVE-4460 (it's in the .patch) but for some reason it's still in the tree. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5014) [HCatalog] Fix HCatalog build issue on Windows
[ https://issues.apache.org/jira/browse/HIVE-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757955#comment-13757955 ] Hudson commented on HIVE-5014: -- FAILURE: Integrated in Hive-trunk-hadoop1-ptest #150 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/150/]) HIVE-5014 : Fix HCatalog build issue on Windows (Daniel Dai via Sushanth Sowmyan) (khorgath: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519853) * /hive/trunk/hcatalog/build.xml [HCatalog] Fix HCatalog build issue on Windows -- Key: HIVE-5014 URL: https://issues.apache.org/jira/browse/HIVE-5014 Project: Hive Issue Type: Sub-task Components: HCatalog Reporter: Daniel Dai Assignee: Daniel Dai Fix For: 0.12.0 Attachments: HIVE-5014-1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5145) Fix TestCliDriver.list_bucket_query_multiskew_2.q on hadoop 0.23
[ https://issues.apache.org/jira/browse/HIVE-5145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757956#comment-13757956 ] Hudson commented on HIVE-5145: -- FAILURE: Integrated in Hive-trunk-hadoop1-ptest #150 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/150/]) HIVE-5145 : Fix TestCliDriver.list_bucket_query_multiskew_2.q on hadoop 0.23 (Prasanth J via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519862) * /hive/trunk/ql/src/test/queries/clientpositive/list_bucket_query_multiskew_2.q * /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_multiskew_2.q.out Fix TestCliDriver.list_bucket_query_multiskew_2.q on hadoop 0.23 Key: HIVE-5145 URL: https://issues.apache.org/jira/browse/HIVE-5145 Project: Hive Issue Type: Bug Components: Tests Reporter: Prasanth J Assignee: Prasanth J Fix For: 0.12.0 Attachments: HIVE-5145.2.patch, HIVE-5145.patch there is some determinism related to the output of list_bucket_query_multiskew_2.q test case. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5129) Multiple table insert fails on count(distinct)
[
https://issues.apache.org/jira/browse/HIVE-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757954#comment-13757954
]
Hudson commented on HIVE-5129:
--
FAILURE: Integrated in Hive-trunk-hadoop1-ptest #150 (See
[https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/150/])
HIVE-5129 Multiple table insert fails on count distinct (Vikram Dixit via
Harish Butani) (rhbutani:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519764)
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java
* /hive/trunk/ql/src/test/queries/clientpositive/multi_insert_gby3.q
* /hive/trunk/ql/src/test/results/clientpositive/multi_insert_gby3.q.out
Multiple table insert fails on count(distinct)
--
Key: HIVE-5129
URL: https://issues.apache.org/jira/browse/HIVE-5129
Project: Hive
Issue Type: Bug
Components: Query Processor
Affects Versions: 0.11.0
Reporter: Vikram Dixit K
Assignee: Vikram Dixit K
Fix For: 0.12.0
Attachments: aggrTestMultiInsertData1.txt,
aggrTestMultiInsertData.txt, aggrTestMultiInsert.q, HIVE-5129.1.patch.txt,
HIVE-5129.2.WIP.patch.txt, HIVE-5129.3.patch.txt, HIVE-5129.4.patch,
HIVE-5129.4.patch.txt
Hive fails with a class cast exception on queries of the form:
{noformat}
from studenttab10k
insert overwrite table multi_insert_2_1
select name, avg(age) as avgage
group by name
insert overwrite table multi_insert_2_2
select name, age, sum(gpa) as sumgpa
group by name, age
insert overwrite table multi_insert_2_3
select name, count(distinct age) as distage
group by name;
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4750) Fix TestCliDriver.list_bucket_dml_{6,7,8}.q on 0.23
[
https://issues.apache.org/jira/browse/HIVE-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757949#comment-13757949
]
Hudson commented on HIVE-4750:
--
FAILURE: Integrated in Hive-trunk-hadoop1-ptest #150 (See
[https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/150/])
HIVE-4750 : Fix TestCliDriver.list_bucket_dml_{6,7,8}.q on 0.23 (Prasanth J via
Ashutosh Chauhan) (hashutosh:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519857)
* /hive/trunk/ql/src/test/queries/clientpositive/list_bucket_dml_6.q
* /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_6.q.out
Fix TestCliDriver.list_bucket_dml_{6,7,8}.q on 0.23
---
Key: HIVE-4750
URL: https://issues.apache.org/jira/browse/HIVE-4750
Project: Hive
Issue Type: Sub-task
Affects Versions: 0.12.0
Reporter: Brock Noland
Assignee: Prasanth J
Fix For: 0.12.0
Attachments: HIVE-4750.2.patch, HIVE-4750.patch
Removing 6,7,8 from the scope of HIVE-4746.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5049) Create an ORC test case that has a 0.11 ORC file
[ https://issues.apache.org/jira/browse/HIVE-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757959#comment-13757959 ] Hudson commented on HIVE-5049: -- FAILURE: Integrated in Hive-trunk-hadoop1-ptest #150 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/150/]) HIVE-5049 : Create an ORC test case that has a 0.11 ORC file (Prasanth J via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519868) * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestOrcFile.java * /hive/trunk/ql/src/test/resources/orc-file-11-format.orc Create an ORC test case that has a 0.11 ORC file Key: HIVE-5049 URL: https://issues.apache.org/jira/browse/HIVE-5049 Project: Hive Issue Type: Bug Reporter: Owen O'Malley Assignee: Prasanth J Fix For: 0.12.0 Attachments: HIVE-5049.patch.txt, orc-file-11-format.orc We should add a test case that includes a 0.11.0 ORC file to ensure compatibility for reading old ORC files is kept correct. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4586) [HCatalog] WebHCat should return 404 error for undefined resource
[ https://issues.apache.org/jira/browse/HIVE-4586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757957#comment-13757957 ] Hudson commented on HIVE-4586: -- FAILURE: Integrated in Hive-trunk-hadoop1-ptest #150 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/150/]) [HIVE-4586] - WebHCat should return 404 error for undefined resource (Daniel Dai) (daijy: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519818) * /hive/trunk/RELEASE_NOTES.txt * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/CatchallExceptionMapper.java * /hive/trunk/hcatalog/webhcat/svr/src/test/java/org/apache/hcatalog/templeton/TestWebHCatE2e.java [HCatalog] WebHCat should return 404 error for undefined resource - Key: HIVE-4586 URL: https://issues.apache.org/jira/browse/HIVE-4586 Project: Hive Issue Type: Bug Components: HCatalog Affects Versions: 0.11.0 Reporter: Daniel Dai Assignee: Daniel Dai Fix For: 0.12.0 Attachments: HIVE-4586-1.patch, HIVE-4586-2.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5096) Add q file tests for ORC predicate pushdown
[ https://issues.apache.org/jira/browse/HIVE-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757958#comment-13757958 ] Hudson commented on HIVE-5096: -- FAILURE: Integrated in Hive-trunk-hadoop1-ptest #150 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/150/]) HIVE-5096 : Add q file tests for ORC predicate pushdown (Prasanth J via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519883) * /hive/trunk/data/files/over1k * /hive/trunk/ql/src/test/queries/clientpositive/orc_predicate_pushdown.q * /hive/trunk/ql/src/test/results/clientpositive/orc_predicate_pushdown.q.out Add q file tests for ORC predicate pushdown --- Key: HIVE-5096 URL: https://issues.apache.org/jira/browse/HIVE-5096 Project: Hive Issue Type: Test Components: CLI, File Formats, StorageHandler Affects Versions: 0.12.0 Reporter: Prasanth J Assignee: Prasanth J Labels: orcfile Fix For: 0.12.0 Attachments: HIVE-5096.patch Add q file tests that checks the validity of the results when predicate pushdown is turned on and off. Also test for filter expressions in table scan operator when predicate pushdown is turned on for ORC. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5197) TestE2EScenerios.createTaskAttempt should use MapRedUtil
[ https://issues.apache.org/jira/browse/HIVE-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757962#comment-13757962 ] Hudson commented on HIVE-5197: -- FAILURE: Integrated in Hive-trunk-hadoop1-ptest #150 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/150/]) HIVE-5197: TestE2EScenerios.createTaskAttempt should use MapRedUtil (Brock Noland via Thejas Nair) (thejas: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519916) * /hive/trunk/hcatalog/hcatalog-pig-adapter/src/test/java/org/apache/hcatalog/pig/TestE2EScenarios.java TestE2EScenerios.createTaskAttempt should use MapRedUtil Key: HIVE-5197 URL: https://issues.apache.org/jira/browse/HIVE-5197 Project: Hive Issue Type: Test Reporter: Brock Noland Assignee: Brock Noland Priority: Minor Attachments: HIVE-5197.patch Basically we should use HCatMapRedUtil as opposed to new'ing the task attempt context. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4748) Fix TempletonUtilsTest failure on Windows
[ https://issues.apache.org/jira/browse/HIVE-4748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757961#comment-13757961 ] Hudson commented on HIVE-4748: -- FAILURE: Integrated in Hive-trunk-hadoop1-ptest #150 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/150/]) HIVE-4748 - Fix TempletonUtilsTest failure on Windows (Shuaishuai Nie via Thejas Nair) (thejas: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519915) * /hive/trunk/hcatalog/build-support/ant/test.xml * /hive/trunk/hcatalog/build.properties * /hive/trunk/hcatalog/webhcat/svr/src/test/java/org/apache/hcatalog/templeton/tool/TestTempletonUtils.java Fix TempletonUtilsTest failure on Windows - Key: HIVE-4748 URL: https://issues.apache.org/jira/browse/HIVE-4748 Project: Hive Issue Type: Bug Components: HCatalog, Tests Environment: Windows Reporter: Shuaishuai Nie Assignee: Shuaishuai Nie Attachments: HIVE-4748.1.patch, HIVE-4748.2.patch The test was assuming that /tmp and /usr folders exist on the OS. As this is not true on Windows, the test fails. The fix modified the test such that it creates the files it needs before doing the verification. This is a test-only issue. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-5209) JDBC support for varchar
[ https://issues.apache.org/jira/browse/HIVE-5209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-5209: -- Attachment: HIVE-5209.D12705.1.patch jdere requested code review of HIVE-5209 [jira] JDBC support for varchar. Reviewers: JIRA HIVE-5209: JDBC support for varchar Support returning varchar length in result set metadata TEST PLAN EMPTY REVISION DETAIL https://reviews.facebook.net/D12705 AFFECTED FILES jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveBaseResultSet.java jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveMetaDataResultSet.java jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveQueryResultSet.java jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveResultSetMetaData.java jdbc/src/java/org/apache/hadoop/hive/jdbc/JdbcColumn.java jdbc/src/java/org/apache/hadoop/hive/jdbc/Utils.java jdbc/src/java/org/apache/hive/jdbc/HiveBaseResultSet.java jdbc/src/java/org/apache/hive/jdbc/HiveQueryResultSet.java jdbc/src/java/org/apache/hive/jdbc/HiveResultSetMetaData.java jdbc/src/java/org/apache/hive/jdbc/JdbcColumn.java jdbc/src/java/org/apache/hive/jdbc/Utils.java jdbc/src/test/org/apache/hadoop/hive/jdbc/TestJdbcDriver.java jdbc/src/test/org/apache/hive/jdbc/TestJdbcDriver2.java service/if/TCLIService.thrift service/src/gen/thrift/gen-cpp/TCLIService_constants.cpp service/src/gen/thrift/gen-cpp/TCLIService_constants.h service/src/gen/thrift/gen-cpp/TCLIService_types.cpp service/src/gen/thrift/gen-cpp/TCLIService_types.h service/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/service/ThriftHive.java service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TCLIServiceConstants.java service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TColumn.java service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TExecuteStatementReq.java service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TGetTablesReq.java service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TOpenSessionReq.java service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TOpenSessionResp.java service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TPrimitiveTypeEntry.java service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TRow.java service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TRowSet.java service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TStatus.java service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TStructTypeEntry.java service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TTableSchema.java service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TTypeDesc.java service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TTypeId.java service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TTypeQualifierValue.java service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TTypeQualifiers.java service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TUnionTypeEntry.java service/src/gen/thrift/gen-py/TCLIService/constants.py service/src/gen/thrift/gen-py/TCLIService/ttypes.py service/src/gen/thrift/gen-rb/t_c_l_i_service_constants.rb service/src/gen/thrift/gen-rb/t_c_l_i_service_types.rb service/src/java/org/apache/hive/service/cli/ColumnDescriptor.java service/src/java/org/apache/hive/service/cli/ColumnValue.java service/src/java/org/apache/hive/service/cli/Type.java service/src/java/org/apache/hive/service/cli/TypeDescriptor.java service/src/java/org/apache/hive/service/cli/TypeQualifiers.java MANAGE HERALD RULES https://reviews.facebook.net/herald/view/differential/ WHY DID I GET THIS EMAIL? https://reviews.facebook.net/herald/transcript/30471/ To: JIRA, jdere JDBC support for varchar Key: HIVE-5209 URL: https://issues.apache.org/jira/browse/HIVE-5209 Project: Hive Issue Type: Improvement Components: JDBC, Types Reporter: Jason Dere Assignee: Jason Dere Attachments: HIVE-5209.D12705.1.patch Support returning varchar length in result set metadata -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-5209) JDBC support for varchar
[ https://issues.apache.org/jira/browse/HIVE-5209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-5209: - Attachment: HIVE-5209.1.patch Attaching HIVE-5209.1.patch. JDBC support for varchar Key: HIVE-5209 URL: https://issues.apache.org/jira/browse/HIVE-5209 Project: Hive Issue Type: Improvement Components: JDBC, Types Reporter: Jason Dere Assignee: Jason Dere Attachments: HIVE-5209.1.patch, HIVE-5209.D12705.1.patch Support returning varchar length in result set metadata NO PRECOMMIT TESTS - dependent on HIVE-4844 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-5209) JDBC support for varchar
[ https://issues.apache.org/jira/browse/HIVE-5209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-5209: - Description: Support returning varchar length in result set metadata NO PRECOMMIT TESTS - dependent on HIVE-4844 was:Support returning varchar length in result set metadata JDBC support for varchar Key: HIVE-5209 URL: https://issues.apache.org/jira/browse/HIVE-5209 Project: Hive Issue Type: Improvement Components: JDBC, Types Reporter: Jason Dere Assignee: Jason Dere Attachments: HIVE-5209.1.patch, HIVE-5209.D12705.1.patch Support returning varchar length in result set metadata NO PRECOMMIT TESTS - dependent on HIVE-4844 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-5206) Support parameterized primitive types
[ https://issues.apache.org/jira/browse/HIVE-5206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13758002#comment-13758002 ] Jason Dere commented on HIVE-5206: -- The main intent of this feature is for char/varchar/decimal support. I suppose this could be used in some fashion to unify the integral types, but I think that would mean all integral types would need to use the same java/writable types. Is unifying the integral types something people have been talking about? Support parameterized primitive types - Key: HIVE-5206 URL: https://issues.apache.org/jira/browse/HIVE-5206 Project: Hive Issue Type: Improvement Components: Types Reporter: Jason Dere Assignee: Jason Dere Attachments: HIVE-5206.1.patch, HIVE-5206.D12693.1.patch Support for parameterized types is needed for char/varchar/decimal support. This adds a type parameters value to the PrimitiveTypeEntry/PrimitiveTypeInfo/PrimitiveObjectInspector objects. NO PRECOMMIT TESTS - dependent on HIVE-5203/HIVE-5204 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [ANNOUNCE] New Hive Committer - Yin Huai
Congrats! On Wed, Sep 4, 2013 at 10:23 AM, Jason Dere jd...@hortonworks.com wrote: Yin, congrats! Jason On Sep 4, 2013, at 7:54 AM, Eugene Koifman ekoif...@hortonworks.com wrote: Congrats! On Wed, Sep 4, 2013 at 5:23 AM, Brock Noland br...@cloudera.com wrote: Congrats Yin!! On Wed, Sep 4, 2013 at 4:14 AM, Lefty Leverenz leftylever...@gmail.com wrote: Bravo, Yin! -- Lefty On Wed, Sep 4, 2013 at 4:17 AM, Sushanth Sowmyan khorg...@gmail.com wrote: Congrats, Yin! :) On Sep 4, 2013 1:13 AM, Alexander Alten-Lorenz wget.n...@gmail.com wrote: Amazing news, congratz Yin! Well deserved! On Sep 4, 2013, at 6:49 AM, Carl Steinbach c...@apache.org wrote: The Apache Hive PMC has voted to make Yin Huai a committer on the Apache Hive project. Please join me in congratulating Yin! Thanks. Carl -- Alexander Alten-Lorenz http://mapredit.blogspot.com German Hadoop LinkedIn Group: http://goo.gl/N8pCF -- Apache MRUnit - Unit testing MapReduce - http://mrunit.apache.org -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
[jira] [Commented] (HIVE-5149) ReduceSinkDeDuplication can pick the wrong partitioning columns
[ https://issues.apache.org/jira/browse/HIVE-5149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757960#comment-13757960 ] Hudson commented on HIVE-5149: -- FAILURE: Integrated in Hive-trunk-hadoop1-ptest #150 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/150/]) HIVE-5149 : ReduceSinkDeDuplication can pick the wrong partitioning columns (Yin Huai via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519805) * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/correlation/ReduceSinkDeDuplication.java * /hive/trunk/ql/src/test/results/clientpositive/groupby2.q.out * /hive/trunk/ql/src/test/results/clientpositive/groupby2_map_skew.q.out * /hive/trunk/ql/src/test/results/clientpositive/groupby_cube1.q.out * /hive/trunk/ql/src/test/results/clientpositive/groupby_rollup1.q.out * /hive/trunk/ql/src/test/results/clientpositive/reduce_deduplicate_extended.q.out ReduceSinkDeDuplication can pick the wrong partitioning columns --- Key: HIVE-5149 URL: https://issues.apache.org/jira/browse/HIVE-5149 Project: Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.11.0, 0.12.0 Reporter: Yin Huai Assignee: Yin Huai Priority: Blocker Fix For: 0.12.0 Attachments: HIVE-5149.1.patch, HIVE-5149.2.patch, HIVE-5149.3.patch https://mail-archives.apache.org/mod_mbox/hive-user/201308.mbox/%3CCAG6Lhyex5XPwszpihKqkPRpzri2k=m4qgc+cpar5yvr8sjt...@mail.gmail.com%3E -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4441) [HCatalog] WebHCat does not honor user home directory
[
https://issues.apache.org/jira/browse/HIVE-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757953#comment-13757953
]
Hudson commented on HIVE-4441:
--
FAILURE: Integrated in Hive-trunk-hadoop1-ptest #150 (See
[https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/150/])
HIVE-4441: WebHCat does not honor user home directory (Daniel Dai) (daijy:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519897)
*
/hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/tool/TempletonUtils.java
HIVE-4441: WebHCat does not honor user home directory (Daniel Dai) (daijy:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519884)
* /hive/trunk/RELEASE_NOTES.txt
*
/hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/tool/TempletonUtils.java
[HCatalog] WebHCat does not honor user home directory
-
Key: HIVE-4441
URL: https://issues.apache.org/jira/browse/HIVE-4441
Project: Hive
Issue Type: Bug
Components: HCatalog
Reporter: Daniel Dai
Assignee: Daniel Dai
Fix For: 0.12.0
Attachments: HIVE-4441-1.patch, HIVE-4441-2.patch, HIVE-4441-3.patch,
HIVE-4441-4.patch
If I submit a job as user A and I specify statusdir as a relative path, I
would expect results to be stored in the folder relative to the user A's home
folder.
For example, if I run:
{code}curl -s -d user.name=hdinsightuser -d execute=show+tables; -d
statusdir=pokes.output 'http://localhost:50111/templeton/v1/hive'{code}
I get the results under:
{code}/user/hdp/pokes.output{code}
And I expect them to be under:
{code}/user/hdinsightuser/pokes.output{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
