[jira] [Commented] (HIVE-4505) Hive can't load transforms added using 'ADD FILE'
[
https://issues.apache.org/jira/browse/HIVE-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13655187#comment-13655187
]
Owen O'Malley commented on HIVE-4505:
-
Prasad,
in Gunther's patch, Hive Server 2 will use the session handle for the handle
identifier.
{code}
// set an explicit session name to control the download directory name
hiveConf.set(ConfVars.HIVESESSIONID.varname,
sessionHandle.getHandleIdentifier().toString());
{code}
So there isn't an issue, right?
The use of finally has bad properties with respect to debugability because any
exceptions thrown out of the finally block (including ones like OOM or NPE)
will hide the original exception.
The -f case is certainly a bug, still an improvement over the current trunk (or
Hive 0.10) behavior.
My inclination is to wait for the test cases that I launched this afternoon to
finish and roll the rc with Gunther's version of the patch tomorrow morning. We
can file a follow up jira with a refactoring of the CliDriver.run that doesn't
have so many return points. *smile*
Does that sounds reasonable?
Hive can't load transforms added using 'ADD FILE'
-
Key: HIVE-4505
URL: https://issues.apache.org/jira/browse/HIVE-4505
Project: Hive
Issue Type: Bug
Components: Query Processor
Affects Versions: 0.11.0
Reporter: Prasad Mujumdar
Assignee: Prasad Mujumdar
Priority: Blocker
Fix For: 0.11.0
Attachments: HIVE-4505-1.patch, HIVE-4505.2.patch, HIVE-4505-3.patch
ADD FILE mangles name of the resource when copying to resource download
directory. As a results following doesn't work:
{code:sql}
ADD FILE test.py;
SELECT TRANSFORM (id) USING 'python test.py' AS b FROM tab1;
{code}
The resource gets added with a different name every time which makes it
impossible to use transform in non-interactive mode.
This seems to be due to HIVE-3431
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4525) Support timestamps earlier than 1970 and later than 2038
[ https://issues.apache.org/jira/browse/HIVE-4525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-4525: -- Attachment: D10755.1.patch mbautin requested code review of [jira] [HIVE-4525] Support timestamps earlier than 1970 and later than 2038. Reviewers: JIRA, ashutoshc, sdong, cwsteinbach, omalley TimestampWritable currently serializes timestamps using the lower 31 bits of an int. This does not allow to store timestamps earlier than 1970 or later than approximately 03:14:07 UTC on 01/19/2038. This patch modifies TimestampWritable to support all timestamps that can be represented by java.sql.Timestamp. TEST PLAN - An extensive new TimestampWritable unit test - Existing unit tests REVISION DETAIL https://reviews.facebook.net/D10755 AFFECTED FILES hcatalog/storage-handlers/hbase/src/java/org/apache/hcatalog/hbase/snapshot/RevisionManagerFactory.java ql/src/java/org/apache/hadoop/hive/ql/udf/UDFToInteger.java serde/src/java/org/apache/hadoop/hive/serde2/binarysortable/BinarySortableSerDe.java serde/src/java/org/apache/hadoop/hive/serde2/io/TimestampWritable.java serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinaryUtils.java serde/src/test/org/apache/hadoop/hive/serde2/io/TestTimestampWritable.java MANAGE HERALD RULES https://reviews.facebook.net/herald/view/differential/ WHY DID I GET THIS EMAIL? https://reviews.facebook.net/herald/transcript/25737/ To: JIRA, ashutoshc, sdong, cwsteinbach, omalley, mbautin Support timestamps earlier than 1970 and later than 2038 Key: HIVE-4525 URL: https://issues.apache.org/jira/browse/HIVE-4525 Project: Hive Issue Type: Bug Reporter: Mikhail Bautin Assignee: Mikhail Bautin Attachments: D10755.1.patch TimestampWritable currently serializes timestamps using the lower 31 bits of an int. This does not allow to store timestamps earlier than 1970 or later than a certain point in 2038. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4505) Hive can't load transforms added using 'ADD FILE'
[
https://issues.apache.org/jira/browse/HIVE-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13655194#comment-13655194
]
Prasad Mujumdar commented on HIVE-4505:
---
[~owen.omalley] My concern was that the way session handle is constructed
(userid+VMid+date), there's still a possibility of running into conflict. But
still what we have is better than what's on trunk before. I am fine with
Gunther's patch for that case.
For CLI case, this might be a bit of problem to leave behind a new directory on
each invocation. The users have a workaround of changing the configuration back
to the old default. You might want to consider either restoring the default or
just adding Sessionstate.close() for the -f case.
Anyway, I am fine with keeping Gunther's patch in the RC. If are going to
commit that patch, then I can log a follow up ticket for 0.12.
Again, my apologies for not addressing the review comments sooner for the
blocker issue.
Hive can't load transforms added using 'ADD FILE'
-
Key: HIVE-4505
URL: https://issues.apache.org/jira/browse/HIVE-4505
Project: Hive
Issue Type: Bug
Components: Query Processor
Affects Versions: 0.11.0
Reporter: Prasad Mujumdar
Assignee: Prasad Mujumdar
Priority: Blocker
Fix For: 0.11.0
Attachments: HIVE-4505-1.patch, HIVE-4505.2.patch, HIVE-4505-3.patch
ADD FILE mangles name of the resource when copying to resource download
directory. As a results following doesn't work:
{code:sql}
ADD FILE test.py;
SELECT TRANSFORM (id) USING 'python test.py' AS b FROM tab1;
{code}
The resource gets added with a different name every time which makes it
impossible to use transform in non-interactive mode.
This seems to be due to HIVE-3431
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
cannot edit comments on Hive JIRA
Hello, I cannot edit my comments on JIRA. In some cases it is desirable to edit comments, e.g. to be able to correct a feature's design description. Could one of Hive JIRA admins please enable comment editing for my account? Thanks in advance! Mikhail
[jira] [Commented] (HIVE-4530) Enforce minmum ant version required in build script
[ https://issues.apache.org/jira/browse/HIVE-4530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13655289#comment-13655289 ] Hudson commented on HIVE-4530: -- Integrated in Hive-trunk-h0.21 #2097 (See [https://builds.apache.org/job/Hive-trunk-h0.21/2097/]) HIVE-4530. Enforce minmum ant version required in build script (Arup Malakar via cws) (Revision 1481161) Result = FAILURE cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1481161 Files : * /hive/trunk/build.xml Enforce minmum ant version required in build script Key: HIVE-4530 URL: https://issues.apache.org/jira/browse/HIVE-4530 Project: Hive Issue Type: Improvement Components: Build Infrastructure Reporter: Arup Malakar Assignee: Arup Malakar Priority: Minor Fix For: 0.12.0 Attachments: HIVE-4530-trunk-0.patch I observed that hive doesn't build with older versions of ant (I tried with 1.6.5). It would be a good idea to have the check in our build.xml. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Hive-trunk-h0.21 - Build # 2097 - Still Failing
Changes for Build #2072
[hashutosh] HIVE-4304 : Remove unused builtins and pdk submodules (Travis
Crawford via Ashutosh Chauhan)
[namit] HIVE-4310 optimize count(distinct) with hive.map.groupby.sorted
(Namit Jain via Gang Tim Liu)
[hashutosh] HIVE-4356 : remove duplicate impersonation parameters for
hiveserver2 (Gunther Hagleitner via Ashutosh Chauhan)
[hashutosh] HIVE-4318 : OperatorHooks hit performance even when not used
(Gunther Hagleitner via Ashutosh Chauhan)
[hashutosh] HIVE-4378 : Counters hit performance even when not used (Gunther
Hagleitner via Ashutosh Chauhan)
[omalley] HIVE-4189 : ORC fails with String column that ends in lots of nulls
(Kevin
Wilfong)
Changes for Build #2073
[hashutosh] 4248 : Implement a memory manager for ORC. Missed one test file.
(Owen Omalley via Ashutosh Chauhan)
[hashutosh] HIVE-4248 : Implement a memory manager for ORC (Owen Omalley via
Ashutosh Chauhan)
[hashutosh] HIVE-4103 : Remove System.gc() call from the map-join local-task
loop (Gopal V via Ashutosh Chauhan)
Changes for Build #2074
[namit] HIVE-4371 some issue with merging join trees
(Navis via namit)
[hashutosh] HIVE-4333 : most windowing tests fail on hadoop 2 (Harish Butani
via Ashutosh Chauhan)
[namit] HIVE-4342 NPE for query involving UNION ALL with nested JOIN and UNION
ALL
(Navis via namit)
[hashutosh] HIVE-4364 : beeline always exits with 0 status, should exit with
non-zero status on error (Rob Weltman via Ashutosh Chauhan)
[hashutosh] HIVE-4130 : Bring the Lead/Lag UDFs interface in line with Lead/Lag
UDAFs (Harish Butani via Ashutosh Chauhan)
Changes for Build #2075
[hashutosh] HIVE-2379 : Hive/HBase integration could be improved (Navis via
Ashutosh Chauhan)
[hashutosh] HIVE-4295 : Lateral view makes invalid result if CP is disabled
(Navis via Ashutosh Chauhan)
[hashutosh] HIVE-4365 : wrong result in left semi join (Navis via Ashutosh
Chauhan)
[hashutosh] HIVE-3861 : Upgrade hbase dependency to 0.94 (Gunther Hagleitner
via Ashutosh Chauhan)
Changes for Build #2076
[hashutosh] HIVE-3891 : physical optimizer changes for auto sort-merge join
(Namit Jain via Ashutosh Chauhan)
[namit] HIVE-4393 Make the deleteData flag accessable from DropTable/Partition
events
(Morgan Philips via namit)
[hashutosh] HIVE-4394 : test leadlag.q fails (Ashutosh Chauhan)
[namit] HIVE-4018 MapJoin failing with Distributed Cache error
(Amareshwari Sriramadasu via Namit Jain)
Changes for Build #2077
[namit] HIVE-4300 ant thriftif generated code that is checkedin is not
up-to-date
(Roshan Naik via namit)
Changes for Build #2078
[namit] HIVE-4409 Prevent incompatible column type changes
(Dilip Joseph via namit)
[namit] HIVE-4095 Add exchange partition in Hive
(Dheeraj Kumar Singh via namit)
[namit] HIVE-4005 Column truncation
(Kevin Wilfong via namit)
[namit] HIVE-3952 merge map-job followed by map-reduce job
(Vinod Kumar Vavilapalli via namit)
[hashutosh] HIVE-4412 : PTFDesc tries serialize transient fields like OIs, etc.
(Navis via Ashutosh Chauhan)
[khorgath] HIVE-4419 : webhcat - support ${WEBHCAT_PREFIX}/conf/ as config
directory (Thejas M Nair via Sushanth Sowmyan)
[namit] HIVE-4181 Star argument without table alias for UDTF is not working
(Navis via namit)
[hashutosh] HIVE-4407 : TestHCatStorer.testStoreFuncAllSimpleTypes fails
because of null case difference (Thejas Nair via Ashutosh Chauhan)
[hashutosh] HIVE-4369 : Many new failures on hadoop 2 (Vikram Dixit via
Ashutosh Chauhan)
Changes for Build #2079
[namit] HIVE-4424 MetaStoreUtils.java.orig checked in mistakenly by HIVE-4409
(Namit Jain)
[hashutosh] HIVE-4358 : Check for Map side processing in PTFOp is no longer
valid (Harish Butani via Ashutosh Chauhan)
Changes for Build #2080
[navis] HIVE-4068 Size of aggregation buffer which uses non-primitive type is
not estimated correctly (Navis)
[khorgath] HIVE-4420 : HCatalog unit tests stop after a failure (Alan Gates via
Sushanth Sowmyan)
[hashutosh] HIVE-3708 : Add mapreduce workflow information to job configuration
(Billie Rinaldi via Ashutosh Chauhan)
Changes for Build #2081
Changes for Build #2082
[hashutosh] HIVE-4423 : Improve RCFile::sync(long) 10x (Gopal V via Ashutosh
Chauhan)
[hashutosh] HIVE-4398 : HS2 Resource leak: operation handles not cleaned when
originating session is closed (Ashish Vaidya via Ashutosh Chauhan)
[hashutosh] HIVE-4019 : Ability to create and drop temporary partition function
(Brock Noland via Ashutosh Chauhan)
Changes for Build #2083
[navis] HIVE-4437 Missing file on HIVE-4068 (Navis)
Changes for Build #2084
Changes for Build #2085
Changes for Build #2086
[hashutosh] HIVE-4350 : support AS keyword for table alias (Matthew Weaver via
Ashutosh Chauhan)
[hashutosh] HIVE-4439 : Remove unused join configuration parameter:
hive.mapjoin.cache.numrows (Gunther Hagleitner via Ashutosh Chauhan)
[hashutosh] HIVE-4438 : Remove unused join configuration parameter:
hive.mapjoin.size.key (Gunther Hagleitner via
[jira] [Commented] (HIVE-4505) Hive can't load transforms added using 'ADD FILE'
[
https://issues.apache.org/jira/browse/HIVE-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13655291#comment-13655291
]
Owen O'Malley commented on HIVE-4505:
-
Thanks, Prasad.
How can you explain how to run into conflict with username+process+host+date?
It seems that would be a unique id (except in the Hive Server 2 case where
username, process, and host are identical).
This bug only happens in the case where the add file resource is on a non-local
filesystem. By far the majority of users seem to use a local file system, so I
think we can push fixing it to 0.11.1. *grin*
Hive can't load transforms added using 'ADD FILE'
-
Key: HIVE-4505
URL: https://issues.apache.org/jira/browse/HIVE-4505
Project: Hive
Issue Type: Bug
Components: Query Processor
Affects Versions: 0.11.0
Reporter: Prasad Mujumdar
Assignee: Prasad Mujumdar
Priority: Blocker
Fix For: 0.11.0
Attachments: HIVE-4505-1.patch, HIVE-4505.2.patch, HIVE-4505-3.patch
ADD FILE mangles name of the resource when copying to resource download
directory. As a results following doesn't work:
{code:sql}
ADD FILE test.py;
SELECT TRANSFORM (id) USING 'python test.py' AS b FROM tab1;
{code}
The resource gets added with a different name every time which makes it
impossible to use transform in non-interactive mode.
This seems to be due to HIVE-3431
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4498) TestBeeLineWithArgs.testPositiveScriptFile fails
[
https://issues.apache.org/jira/browse/HIVE-4498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Owen O'Malley updated HIVE-4498:
Resolution: Fixed
Status: Resolved (was: Patch Available)
I just committed this. Thanks, Thejas!
TestBeeLineWithArgs.testPositiveScriptFile fails
Key: HIVE-4498
URL: https://issues.apache.org/jira/browse/HIVE-4498
Project: Hive
Issue Type: Bug
Components: CLI, HiveServer2, JDBC
Reporter: Thejas M Nair
Assignee: Thejas M Nair
Priority: Blocker
Fix For: 0.11.0
Attachments: HIVE-4498.1.patch
TestBeeLineWithArgs.testPositiveScriptFile fails -
{code}
[junit] 0: jdbc:hive2://localhost:1 STARTED
testBreakOnErrorScriptFile
[junit] Output: Connecting to jdbc:hive2://localhost:1
[junit] Connected to: Hive (version 0.12.0-SNAPSHOT)
[junit] Driver: Hive (version 0.12.0-SNAPSHOT)
[junit] Transaction isolation: TRANSACTION_REPEATABLE_READ
[junit] Beeline version 0.12.0-SNAPSHOT by Apache Hive
[junit] ++
[junit] | database_name |
[junit] ++
[junit] ++
[junit] No rows selected (0.899 seconds)
[junit] Closing: org.apache.hive.jdbc.HiveConnection
[junit]
[junit] FAILED testPositiveScriptFile (ERROR) (2s)
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4505) Hive can't load transforms added using 'ADD FILE'
[
https://issues.apache.org/jira/browse/HIVE-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Owen O'Malley updated HIVE-4505:
Resolution: Fixed
Status: Resolved (was: Patch Available)
I just committed this. Thanks, Prasad and Gunther!
Hive can't load transforms added using 'ADD FILE'
-
Key: HIVE-4505
URL: https://issues.apache.org/jira/browse/HIVE-4505
Project: Hive
Issue Type: Bug
Components: Query Processor
Affects Versions: 0.11.0
Reporter: Prasad Mujumdar
Assignee: Prasad Mujumdar
Priority: Blocker
Fix For: 0.11.0
Attachments: HIVE-4505-1.patch, HIVE-4505.2.patch, HIVE-4505-3.patch
ADD FILE mangles name of the resource when copying to resource download
directory. As a results following doesn't work:
{code:sql}
ADD FILE test.py;
SELECT TRANSFORM (id) USING 'python test.py' AS b FROM tab1;
{code}
The resource gets added with a different name every time which makes it
impossible to use transform in non-interactive mode.
This seems to be due to HIVE-3431
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4527) Fix eclipse project template
[ https://issues.apache.org/jira/browse/HIVE-4527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-4527: Resolution: Fixed Fix Version/s: 0.11.0 Assignee: Carl Steinbach (was: Owen O'Malley) Status: Resolved (was: Patch Available) I just committed this. Thanks, Carl! Fix eclipse project template Key: HIVE-4527 URL: https://issues.apache.org/jira/browse/HIVE-4527 Project: Hive Issue Type: Bug Components: Build Infrastructure Reporter: Carl Steinbach Assignee: Carl Steinbach Priority: Minor Fix For: 0.11.0 Attachments: HIVE-4527-0.11.patch.txt, HIVE-4527-trunk.patch.txt The eclipse template is broken on trunk and branch-0.11. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[VOTE] Apache Hive 0.11.0 Release Candidate 2
Based on feedback from everyone, I have respun release candidate, RC2. Please take a look. We've fixed 7 problems with the previous RC: * Release notes were incorrect * HIVE-4018 - MapJoin failing with Distributed Cache error * HIVE-4421 - Improve memory usage by ORC dictionaries * HIVE-4500 - Ensure that HiveServer 2 closes log files. * HIVE-4494 - ORC map columns get class cast exception in some contexts * HIVE-4498 - Fix TestBeeLineWithArgs failure * HIVE-4505 - Hive can't load transforms with remote scripts * HIVE-4527 - Fix the eclipse template Source tag for RC2 is at: https://svn.apache.org/repos/asf/hive/tags/release-0.11.0rc2 Source tar ball and convenience binary artifacts can be found at: http://people.apache.org/~omalley/hive-0.11.0rc2/ This release has many goodies including HiveServer2, integrated hcatalog, windowing and analytical functions, decimal data type, better query planning, performance enhancements and various bug fixes. In total, we resolved more than 350 issues. Full list of fixed issues can be found at: http://s.apache.org/8Fr Voting will conclude in 72 hours. Hive PMC Members: Please test and vote. Thanks, Owen
[jira] [Commented] (HIVE-4505) Hive can't load transforms added using 'ADD FILE'
[
https://issues.apache.org/jira/browse/HIVE-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13655332#comment-13655332
]
Hudson commented on HIVE-4505:
--
Integrated in Hive-trunk-h0.21 #2098 (See
[https://builds.apache.org/job/Hive-trunk-h0.21/2098/])
HIVE-4505 Hive can't load transforms with remote scripts. (Prasad Majumdar
and Gunther Hagleitner
via omalley) (Revision 1481347)
Result = FAILURE
omalley :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1481347
Files :
* /hive/trunk
* /hive/trunk/build-common.xml
* /hive/trunk/cli/src/java/org/apache/hadoop/hive/cli/CliSessionState.java
* /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java
* /hive/trunk/ql/src/test/queries/clientpositive/remote_script.q
* /hive/trunk/ql/src/test/results/clientpositive/remote_script.q.out
*
/hive/trunk/service/src/java/org/apache/hive/service/cli/session/HiveSessionImpl.java
Hive can't load transforms added using 'ADD FILE'
-
Key: HIVE-4505
URL: https://issues.apache.org/jira/browse/HIVE-4505
Project: Hive
Issue Type: Bug
Components: Query Processor
Affects Versions: 0.11.0
Reporter: Prasad Mujumdar
Assignee: Prasad Mujumdar
Priority: Blocker
Fix For: 0.11.0
Attachments: HIVE-4505-1.patch, HIVE-4505.2.patch, HIVE-4505-3.patch
ADD FILE mangles name of the resource when copying to resource download
directory. As a results following doesn't work:
{code:sql}
ADD FILE test.py;
SELECT TRANSFORM (id) USING 'python test.py' AS b FROM tab1;
{code}
The resource gets added with a different name every time which makes it
impossible to use transform in non-interactive mode.
This seems to be due to HIVE-3431
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4530) Enforce minmum ant version required in build script
[ https://issues.apache.org/jira/browse/HIVE-4530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13655331#comment-13655331 ] Hudson commented on HIVE-4530: -- Integrated in Hive-trunk-hadoop2 #192 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/192/]) HIVE-4530. Enforce minmum ant version required in build script (Arup Malakar via cws) (Revision 1481161) Result = FAILURE cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1481161 Files : * /hive/trunk/build.xml Enforce minmum ant version required in build script Key: HIVE-4530 URL: https://issues.apache.org/jira/browse/HIVE-4530 Project: Hive Issue Type: Improvement Components: Build Infrastructure Reporter: Arup Malakar Assignee: Arup Malakar Priority: Minor Fix For: 0.12.0 Attachments: HIVE-4530-trunk-0.patch I observed that hive doesn't build with older versions of ant (I tried with 1.6.5). It would be a good idea to have the check in our build.xml. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4498) TestBeeLineWithArgs.testPositiveScriptFile fails
[
https://issues.apache.org/jira/browse/HIVE-4498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13655333#comment-13655333
]
Hudson commented on HIVE-4498:
--
Integrated in Hive-trunk-h0.21 #2098 (See
[https://builds.apache.org/job/Hive-trunk-h0.21/2098/])
HIVE-4498 TestBeeLineWithArgs.testPositiveScriptFile fails (Thejas Nair via
omalley) (Revision 1481345)
Result = FAILURE
omalley :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1481345
Files :
* /hive/trunk
*
/hive/trunk/service/src/java/org/apache/hive/service/auth/TUGIContainingProcessor.java
TestBeeLineWithArgs.testPositiveScriptFile fails
Key: HIVE-4498
URL: https://issues.apache.org/jira/browse/HIVE-4498
Project: Hive
Issue Type: Bug
Components: CLI, HiveServer2, JDBC
Reporter: Thejas M Nair
Assignee: Thejas M Nair
Priority: Blocker
Fix For: 0.11.0
Attachments: HIVE-4498.1.patch
TestBeeLineWithArgs.testPositiveScriptFile fails -
{code}
[junit] 0: jdbc:hive2://localhost:1 STARTED
testBreakOnErrorScriptFile
[junit] Output: Connecting to jdbc:hive2://localhost:1
[junit] Connected to: Hive (version 0.12.0-SNAPSHOT)
[junit] Driver: Hive (version 0.12.0-SNAPSHOT)
[junit] Transaction isolation: TRANSACTION_REPEATABLE_READ
[junit] Beeline version 0.12.0-SNAPSHOT by Apache Hive
[junit] ++
[junit] | database_name |
[junit] ++
[junit] ++
[junit] No rows selected (0.899 seconds)
[junit] Closing: org.apache.hive.jdbc.HiveConnection
[junit]
[junit] FAILED testPositiveScriptFile (ERROR) (2s)
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4527) Fix eclipse project template
[ https://issues.apache.org/jira/browse/HIVE-4527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13655334#comment-13655334 ] Hudson commented on HIVE-4527: -- Integrated in Hive-trunk-h0.21 #2098 (See [https://builds.apache.org/job/Hive-trunk-h0.21/2098/]) HIVE-4527 Fix eclipse project template (Carl Steinbach via omalley) (Revision 1481351) Result = FAILURE omalley : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1481351 Files : * /hive/trunk * /hive/trunk/eclipse-templates/.classpath Fix eclipse project template Key: HIVE-4527 URL: https://issues.apache.org/jira/browse/HIVE-4527 Project: Hive Issue Type: Bug Components: Build Infrastructure Reporter: Carl Steinbach Assignee: Carl Steinbach Priority: Minor Fix For: 0.11.0 Attachments: HIVE-4527-0.11.patch.txt, HIVE-4527-trunk.patch.txt The eclipse template is broken on trunk and branch-0.11. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Hive-trunk-h0.21 - Build # 2098 - Still Failing
Changes for Build #2072
[hashutosh] HIVE-4304 : Remove unused builtins and pdk submodules (Travis
Crawford via Ashutosh Chauhan)
[namit] HIVE-4310 optimize count(distinct) with hive.map.groupby.sorted
(Namit Jain via Gang Tim Liu)
[hashutosh] HIVE-4356 : remove duplicate impersonation parameters for
hiveserver2 (Gunther Hagleitner via Ashutosh Chauhan)
[hashutosh] HIVE-4318 : OperatorHooks hit performance even when not used
(Gunther Hagleitner via Ashutosh Chauhan)
[hashutosh] HIVE-4378 : Counters hit performance even when not used (Gunther
Hagleitner via Ashutosh Chauhan)
[omalley] HIVE-4189 : ORC fails with String column that ends in lots of nulls
(Kevin
Wilfong)
Changes for Build #2073
[hashutosh] 4248 : Implement a memory manager for ORC. Missed one test file.
(Owen Omalley via Ashutosh Chauhan)
[hashutosh] HIVE-4248 : Implement a memory manager for ORC (Owen Omalley via
Ashutosh Chauhan)
[hashutosh] HIVE-4103 : Remove System.gc() call from the map-join local-task
loop (Gopal V via Ashutosh Chauhan)
Changes for Build #2074
[namit] HIVE-4371 some issue with merging join trees
(Navis via namit)
[hashutosh] HIVE-4333 : most windowing tests fail on hadoop 2 (Harish Butani
via Ashutosh Chauhan)
[namit] HIVE-4342 NPE for query involving UNION ALL with nested JOIN and UNION
ALL
(Navis via namit)
[hashutosh] HIVE-4364 : beeline always exits with 0 status, should exit with
non-zero status on error (Rob Weltman via Ashutosh Chauhan)
[hashutosh] HIVE-4130 : Bring the Lead/Lag UDFs interface in line with Lead/Lag
UDAFs (Harish Butani via Ashutosh Chauhan)
Changes for Build #2075
[hashutosh] HIVE-2379 : Hive/HBase integration could be improved (Navis via
Ashutosh Chauhan)
[hashutosh] HIVE-4295 : Lateral view makes invalid result if CP is disabled
(Navis via Ashutosh Chauhan)
[hashutosh] HIVE-4365 : wrong result in left semi join (Navis via Ashutosh
Chauhan)
[hashutosh] HIVE-3861 : Upgrade hbase dependency to 0.94 (Gunther Hagleitner
via Ashutosh Chauhan)
Changes for Build #2076
[hashutosh] HIVE-3891 : physical optimizer changes for auto sort-merge join
(Namit Jain via Ashutosh Chauhan)
[namit] HIVE-4393 Make the deleteData flag accessable from DropTable/Partition
events
(Morgan Philips via namit)
[hashutosh] HIVE-4394 : test leadlag.q fails (Ashutosh Chauhan)
[namit] HIVE-4018 MapJoin failing with Distributed Cache error
(Amareshwari Sriramadasu via Namit Jain)
Changes for Build #2077
[namit] HIVE-4300 ant thriftif generated code that is checkedin is not
up-to-date
(Roshan Naik via namit)
Changes for Build #2078
[namit] HIVE-4409 Prevent incompatible column type changes
(Dilip Joseph via namit)
[namit] HIVE-4095 Add exchange partition in Hive
(Dheeraj Kumar Singh via namit)
[namit] HIVE-4005 Column truncation
(Kevin Wilfong via namit)
[namit] HIVE-3952 merge map-job followed by map-reduce job
(Vinod Kumar Vavilapalli via namit)
[hashutosh] HIVE-4412 : PTFDesc tries serialize transient fields like OIs, etc.
(Navis via Ashutosh Chauhan)
[khorgath] HIVE-4419 : webhcat - support ${WEBHCAT_PREFIX}/conf/ as config
directory (Thejas M Nair via Sushanth Sowmyan)
[namit] HIVE-4181 Star argument without table alias for UDTF is not working
(Navis via namit)
[hashutosh] HIVE-4407 : TestHCatStorer.testStoreFuncAllSimpleTypes fails
because of null case difference (Thejas Nair via Ashutosh Chauhan)
[hashutosh] HIVE-4369 : Many new failures on hadoop 2 (Vikram Dixit via
Ashutosh Chauhan)
Changes for Build #2079
[namit] HIVE-4424 MetaStoreUtils.java.orig checked in mistakenly by HIVE-4409
(Namit Jain)
[hashutosh] HIVE-4358 : Check for Map side processing in PTFOp is no longer
valid (Harish Butani via Ashutosh Chauhan)
Changes for Build #2080
[navis] HIVE-4068 Size of aggregation buffer which uses non-primitive type is
not estimated correctly (Navis)
[khorgath] HIVE-4420 : HCatalog unit tests stop after a failure (Alan Gates via
Sushanth Sowmyan)
[hashutosh] HIVE-3708 : Add mapreduce workflow information to job configuration
(Billie Rinaldi via Ashutosh Chauhan)
Changes for Build #2081
Changes for Build #2082
[hashutosh] HIVE-4423 : Improve RCFile::sync(long) 10x (Gopal V via Ashutosh
Chauhan)
[hashutosh] HIVE-4398 : HS2 Resource leak: operation handles not cleaned when
originating session is closed (Ashish Vaidya via Ashutosh Chauhan)
[hashutosh] HIVE-4019 : Ability to create and drop temporary partition function
(Brock Noland via Ashutosh Chauhan)
Changes for Build #2083
[navis] HIVE-4437 Missing file on HIVE-4068 (Navis)
Changes for Build #2084
Changes for Build #2085
Changes for Build #2086
[hashutosh] HIVE-4350 : support AS keyword for table alias (Matthew Weaver via
Ashutosh Chauhan)
[hashutosh] HIVE-4439 : Remove unused join configuration parameter:
hive.mapjoin.cache.numrows (Gunther Hagleitner via Ashutosh Chauhan)
[hashutosh] HIVE-4438 : Remove unused join configuration parameter:
hive.mapjoin.size.key (Gunther Hagleitner via
Hive-trunk-hadoop2 - Build # 192 - Failure
Changes for Build #167
[hashutosh] HIVE-4356 : remove duplicate impersonation parameters for
hiveserver2 (Gunther Hagleitner via Ashutosh Chauhan)
[hashutosh] HIVE-4318 : OperatorHooks hit performance even when not used
(Gunther Hagleitner via Ashutosh Chauhan)
[hashutosh] HIVE-4378 : Counters hit performance even when not used (Gunther
Hagleitner via Ashutosh Chauhan)
[omalley] HIVE-4189 : ORC fails with String column that ends in lots of nulls
(Kevin
Wilfong)
Changes for Build #168
[hashutosh] 4248 : Implement a memory manager for ORC. Missed one test file.
(Owen Omalley via Ashutosh Chauhan)
[hashutosh] HIVE-4248 : Implement a memory manager for ORC (Owen Omalley via
Ashutosh Chauhan)
[hashutosh] HIVE-4103 : Remove System.gc() call from the map-join local-task
loop (Gopal V via Ashutosh Chauhan)
[hashutosh] HIVE-4304 : Remove unused builtins and pdk submodules (Travis
Crawford via Ashutosh Chauhan)
[namit] HIVE-4310 optimize count(distinct) with hive.map.groupby.sorted
(Namit Jain via Gang Tim Liu)
Changes for Build #169
[hashutosh] HIVE-4333 : most windowing tests fail on hadoop 2 (Harish Butani
via Ashutosh Chauhan)
[namit] HIVE-4342 NPE for query involving UNION ALL with nested JOIN and UNION
ALL
(Navis via namit)
[hashutosh] HIVE-4364 : beeline always exits with 0 status, should exit with
non-zero status on error (Rob Weltman via Ashutosh Chauhan)
[hashutosh] HIVE-4130 : Bring the Lead/Lag UDFs interface in line with Lead/Lag
UDAFs (Harish Butani via Ashutosh Chauhan)
Changes for Build #170
[hashutosh] HIVE-4295 : Lateral view makes invalid result if CP is disabled
(Navis via Ashutosh Chauhan)
[hashutosh] HIVE-4365 : wrong result in left semi join (Navis via Ashutosh
Chauhan)
[hashutosh] HIVE-3861 : Upgrade hbase dependency to 0.94 (Gunther Hagleitner
via Ashutosh Chauhan)
[namit] HIVE-4371 some issue with merging join trees
(Navis via namit)
Changes for Build #171
[hashutosh] HIVE-2379 : Hive/HBase integration could be improved (Navis via
Ashutosh Chauhan)
Changes for Build #172
[hashutosh] HIVE-4394 : test leadlag.q fails (Ashutosh Chauhan)
[namit] HIVE-4018 MapJoin failing with Distributed Cache error
(Amareshwari Sriramadasu via Namit Jain)
Changes for Build #173
[namit] HIVE-4300 ant thriftif generated code that is checkedin is not
up-to-date
(Roshan Naik via namit)
[hashutosh] HIVE-3891 : physical optimizer changes for auto sort-merge join
(Namit Jain via Ashutosh Chauhan)
[namit] HIVE-4393 Make the deleteData flag accessable from DropTable/Partition
events
(Morgan Philips via namit)
Changes for Build #174
[khorgath] HIVE-4419 : webhcat - support ${WEBHCAT_PREFIX}/conf/ as config
directory (Thejas M Nair via Sushanth Sowmyan)
[namit] HIVE-4181 Star argument without table alias for UDTF is not working
(Navis via namit)
[hashutosh] HIVE-4407 : TestHCatStorer.testStoreFuncAllSimpleTypes fails
because of null case difference (Thejas Nair via Ashutosh Chauhan)
[hashutosh] HIVE-4369 : Many new failures on hadoop 2 (Vikram Dixit via
Ashutosh Chauhan)
Changes for Build #175
[hashutosh] HIVE-4358 : Check for Map side processing in PTFOp is no longer
valid (Harish Butani via Ashutosh Chauhan)
[namit] HIVE-4409 Prevent incompatible column type changes
(Dilip Joseph via namit)
[namit] HIVE-4095 Add exchange partition in Hive
(Dheeraj Kumar Singh via namit)
[namit] HIVE-4005 Column truncation
(Kevin Wilfong via namit)
[namit] HIVE-3952 merge map-job followed by map-reduce job
(Vinod Kumar Vavilapalli via namit)
[hashutosh] HIVE-4412 : PTFDesc tries serialize transient fields like OIs, etc.
(Navis via Ashutosh Chauhan)
Changes for Build #176
[hashutosh] HIVE-3708 : Add mapreduce workflow information to job configuration
(Billie Rinaldi via Ashutosh Chauhan)
[namit] HIVE-4424 MetaStoreUtils.java.orig checked in mistakenly by HIVE-4409
(Namit Jain)
Changes for Build #177
[navis] HIVE-4068 Size of aggregation buffer which uses non-primitive type is
not estimated correctly (Navis)
[khorgath] HIVE-4420 : HCatalog unit tests stop after a failure (Alan Gates via
Sushanth Sowmyan)
Changes for Build #178
Changes for Build #179
[hashutosh] HIVE-4423 : Improve RCFile::sync(long) 10x (Gopal V via Ashutosh
Chauhan)
[hashutosh] HIVE-4398 : HS2 Resource leak: operation handles not cleaned when
originating session is closed (Ashish Vaidya via Ashutosh Chauhan)
[hashutosh] HIVE-4019 : Ability to create and drop temporary partition function
(Brock Noland via Ashutosh Chauhan)
Changes for Build #180
[navis] HIVE-4437 Missing file on HIVE-4068 (Navis)
Changes for Build #181
Changes for Build #182
Changes for Build #183
[hashutosh] HIVE-4350 : support AS keyword for table alias (Matthew Weaver via
Ashutosh Chauhan)
[hashutosh] HIVE-4439 : Remove unused join configuration parameter:
hive.mapjoin.cache.numrows (Gunther Hagleitner via Ashutosh Chauhan)
[hashutosh] HIVE-4438 : Remove unused join configuration parameter:
[jira] [Updated] (HIVE-4233) The TGT gotten from class 'CLIService' should be renewed on time
[ https://issues.apache.org/jira/browse/HIVE-4233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-4233: Status: Open (was: Patch Available) I found an issue with hadoop 0.20, it is not checking if hadoop version is security enabled. Will run more tests with hadoop 0.20 and submit new patch. The TGT gotten from class 'CLIService' should be renewed on time - Key: HIVE-4233 URL: https://issues.apache.org/jira/browse/HIVE-4233 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 0.10.0 Environment: CentOS release 6.3 (Final) jdk1.6.0_31 HiveServer2 0.10.0-cdh4.2.0 Kerberos Security Reporter: Dongyong Wang Assignee: Thejas M Nair Priority: Critical Attachments: 0001-FIX-HIVE-4233.patch, HIVE-4233-2.patch, HIVE-4233-3.patch When the HIveServer2 have started more than 7 days, I use beeline shell to connect the HiveServer2,all operation failed. The log of HiveServer2 shows it was caused by the Kerberos auth failure,the exception stack trace is: 2013-03-26 11:55:20,932 ERROR hive.ql.metadata.Hive: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1084) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(RetryingMetaStoreClient.java:51) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:61) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:2140) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2151) at org.apache.hadoop.hive.ql.metadata.Hive.getDelegationToken(Hive.java:2275) at org.apache.hive.service.cli.CLIService.getDelegationTokenFromMetaStore(CLIService.java:358) at org.apache.hive.service.cli.thrift.ThriftCLIService.OpenSession(ThriftCLIService.java:127) at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1073) at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1058) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge20S.java:565) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:206) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.GeneratedConstructorAccessor52.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:513) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1082) ... 16 more Caused by: java.lang.IllegalStateException: This ticket is no longer valid at javax.security.auth.kerberos.KerberosTicket.toString(KerberosTicket.java:601) at java.lang.String.valueOf(String.java:2826) at java.lang.StringBuilder.append(StringBuilder.java:115) at sun.security.jgss.krb5.SubjectComber.findAux(SubjectComber.java:120) at sun.security.jgss.krb5.SubjectComber.find(SubjectComber.java:41) at sun.security.jgss.krb5.Krb5Util.getTicket(Krb5Util.java:130) at sun.security.jgss.krb5.Krb5InitCredential$1.run(Krb5InitCredential.java:328) at java.security.AccessController.doPrivileged(Native Method) at sun.security.jgss.krb5.Krb5InitCredential.getTgt(Krb5InitCredential.java:325) at sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:128) at sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:106) at sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:172) at sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:209) at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:195) at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:162) at
