Changes for Build #2392 [brock] HIVE-5445 - PTest2 should use testonly target
[hashutosh] HIVE-5490 : SUBSTR(col, 1, 0) returns wrong result in vectorized mode (Teddy Choi via Ashutosh Chauhan) [hashutosh] HIVE-4846 : Implement Vectorized Limit Operator (Sarvesh Sakalanaga via Ashutosh Chauhan) Changes for Build #2393 Changes for Build #2394 [hashutosh] HIVE-5494 : Vectorization throws exception with nested UDF. (Jitendra Nath Pandey via Ashutosh Chauhan) Changes for Build #2395 [brock] HIVE-5513 - Set the short version directly via build script (Prasad Mujumdar via Brock Noland) [brock] HIVE-5252 - Add ql syntax for inline java code creation (Edward Capriolo via Brock Noland) Changes for Build #2396 Changes for Build #2397 [hashutosh] HIVE-5512 : metastore filter pushdown should support between (Sergey Shelukhin via Ashutosh Chauhan) Changes for Build #2398 [hashutosh] HIVE-5479 : SBAP restricts hcat -e show databases (Sushanth Sowmyan via Ashutosh Chauhan) [hashutosh] HIVE-5485 : SBAP errors on null partition being passed into partition level authorization (Sushanth Sowmyan via Ashutosh Chauhan) [hashutosh] HIVE-5496 : hcat -e drop database if exists fails on authorizing non-existent null db (Sushanth Sowmyan via Ashutosh Chauhan) [hashutosh] HIVE-5474 : drop table hangs when concurrency=true (Jason Dere via Ashutosh Chauhan) Changes for Build #2399 [hashutosh] HIVE-5220 : Use factory methods to instantiate HiveDecimal instead of constructors (Xuefu Zhang via Ashutosh Chauhan) Changes for Build #2400 Changes for Build #2401 [ecapriolo] An explode function that includes the item's position in the array (Niko Stahl via egc) [brock] HIVE-5423 - Speed up testing of scalar UDFS (Edward Capriolo via Brock Noland) [thejas] HIVE-5508 : [WebHCat] ignore log collector e2e tests for Hadoop 2 (Daniel Dai via Thejas Nair) [thejas] HIVE-5535 : [WebHCat] Webhcat e2e test JOBS_2 fail due to permission when hdfs umask setting is 022 (Daniel Dai via Thejas Nair) [brock] HIVE-5526 - NPE in ConstantVectorExpression.evaluate(vrg) (Remus Rusanu via Brock Noland) [thejas] HIVE-5509 : [WebHCat] TestDriverCurl to use string comparison for jobid (Daniel Dai via Thejas Nair) [thejas] HIVE-5507: [WebHCat] test.other.user.name parameter is missing from build.xml in e2e harness (Daniel Dai via Thejas Nair) [daijy] HIVE-5448: webhcat duplicate test TestMapReduce_2 should be removed (Thejas M Nair via Daniel Dai) [daijy] HIVE-5453 : jobsubmission2.conf should use 'timeout' property (Eugene Koifman via Daniel Dai) Changes for Build #2402 Changes for Build #2403 [thejas] HIVE-5531: Hiverserver2 doesn't honor command line argument when initializing log4j (Shuaishuai Nie via Thejas Nair) [hashutosh] HIVE-4821 : Implement vectorized type casting for all types (Eric Hanson via Ashutosh Chauhan) [brock] HIVE-5492 - Explain query fails with NPE if a client doesn't call getResultSetSchema() (Xuefu Zhang via Brock Noland) Changes for Build #2404 [hashutosh] HIVE-5546 : A change in ORCInputFormat made by HIVE4113 was reverted by HIVE5391 (Yin Huai via Ashutosh Chauhan) Changes for Build #2405 [brock] HIVE-5435 - Milestone 5: PTest2 maven support Changes for Build #2406 [thejas] Updating release notes with 0.12 release [hashutosh] HIVE-5517 : Implement end-to-end tests for vectorized string and math functions, and casts (Eric Hanson via Ashutosh Chauhan) Changes for Build #2407 [hashutosh] HIVE-4850 : Implement vectorized JOIN operators (Remus Rusanu via Ashutosh Chauhan) [brock] HIVE-5575: ZooKeeper connection closed when unlock with retry (Chun Chen via Brock Noland) [brock] HIVE-5548: Tests under common directory don't run as part of 'ant test' (Xuefu Zhang via Brock Noland) [gunther] HIVE-5525: Vectorized query failing for partitioned tables. (Jitendra Nath Pandey via Gunther Hagleitner) Changes for Build #2408 [daijy] HIVE-5133: webhcat jobs that need to access metastore fails in secure mode (Eugene Koifman via Daniel Dai) Changes for Build #2409 Changes for Build #2410 Changes for Build #2411 [hashutosh] HIVE-5411 : Migrate expression serialization to Kryo (Ashutosh Chauhan via Thejas Nair) Changes for Build #2412 [brock] HIVE-5578 - hcat script doesn't include jars from HIVE_AUX_JARS_PATH (Mohammad Kamrul Islam via Brock Noland) [brock] HIVE-5070 - Implement listLocatedStatus() in ProxyFileSystem for 0.23 shim (shanyu zhao via Brock Noland) [hashutosh] HIVE-5574 : Unnecessary newline at the end of message of ParserException (Navis via Ashutosh Chauhan) [navis] HIVE-5572 : Fails of non-sql command are not propagated to jdbc2 client (Navis reviewed by Brock Noland) [hashutosh] HIVE-5559 : Stats publisher fails for list bucketing when IDs are too long (Jason Dere via Ashutosh Chauhan) Changes for Build #2413 [brock] HIVE-5132 - Can't access to hwi due to 'No Java compiler available' (Bing Li via Edward Capriolo) [brock] HIVE-4957 - Restrict number of bit vectors, to prevent out of Java heap memory (Shreepadma Venugopalan via Brock Noland) Changes for Build #2414 [hashutosh] HIVE-5594 : Exception in vectorized map join. (Jitendra Nath Pandey via Ashutosh Chauhan) [navis] HIVE-5597 : Fix typo of previous patch [navis] HIVE-5597 : Temporary fix for HIVE-5172 (possible NPE in TUGIContainingTransport) (agate via Navis) [navis] HIVE-5596 : hive-default.xml.template is invalid (Killua Huang via Navis) Changes for Build #2415 [brock] HIVE-5514 - webhcat_server.sh foreground option does not work as expected [brock] HIVE-5600 - Fix PTest2 Maven support Changes for Build #2416 [hashutosh] HIVE-5506 : Hive SPLIT function does not return array correctly (Vikram Dixit via Ashutosh Chauhan) Changes for Build #2417 [hashutosh] HIVE-5560 : Hive produces incorrect results on multi-distinct query (Navis via Ashutosh Chauhan) [hashutosh] HIVE-5430 : Refactor VectorizationContext and handle NOT expression with nulls. (Jitendra Nath Pandey via Ashutosh Chauhan) [brock] HIVE-5454 - HCatalog runs a partition listing with an empty filter (Harsh J via Brock Noland) [brock] HIVE-5599 - Change default logging level to INFO (Brock Noland, Reviewed by Thejas M Nair) [brock] HIVE-5350 - Cleanup exception handling around parallel orderby (Navis via Brock Noland) [brock] HIVE-5605 - AddResourceOperation, DeleteResourceOperation, DfsOperation, SetOperation should be removed from org.apache.hive.service.cli.operation (Vaibhav Gumashta via Brock Noland) [hashutosh] HIVE-784 : Support uncorrelated subqueries in the WHERE clause (Harish Butani via Ashutosh Chauhan) [hashutosh] HIVE-5403 : Move loading of filesystem, ugi, metastore client to hive session (Vikram Dixit via Ashutosh Chauhan) Changes for Build #2418 [hashutosh] HIVE-5220 : Add option for removing intermediate directory for partition, which is empty (Navis via Ashutosh Chauhan) Changes for Build #2419 [brock] HIVE-5625 - Fix issue with metastore version restriction test. (Vikram Dixit K via Brock Noland) Changes for Build #2420 [navis] HIVE-5577 : Remove TestNegativeCliDriver script_broken_pipe1 (Brock Noland via Navis) [hashutosh] HIVE-5619 : Allow concat() to accept mixed string/binary args (Jason Dere via Ashutosh Chauhan) [thejas] HIVE-5482 : JDBC should depend on httpclient.version and httpcore.version 4.1.3 to be consistent with other modules (Vaibhav Gumashta via Thejas Nair) [gunther] HIVE-5403: Perflogger broken due to HIVE-5403 (Vikram Dixit K via Gunther Hagleitner) [thejas] HIVE-5216 : Need to annotate public API in HCatalog (Eugene Koifman via Thejas Nair) [hashutosh] HIVE-5629 : Fix two javadoc failures in HCatalog (Brock Noland via Ashutosh Chauhan) [hashutosh] HIVE-5637 : Sporadic minimr test failure (Navis via Ashutosh Chauhan) Changes for Build #2421 [hashutosh] HIVE-5628 : ListBucketingPrunnerTest and DynamicMultiDimeCollectionTest should start with Test not end with it (Brock Noland via Ashutosh Chauhan) Changes for Build #2422 [thejas] HIVE-5440: HiveServer2 doesn't apply SQL operation's config property (Prasad Mujumdar via Thejas Nair) [hashutosh] HIVE-5552 : Merging of QBJoinTrees doesnt handle filter pushdowns correctly (Harish Butani via Ashutosh Chauhan) [thejas] HIVE-5511 : percentComplete returned by job status from WebHCat is null (Eugene Koifman via Thejas Nair) Changes for Build #2423 Changes for Build #2424 [brock] HIVE-4974 - JDBC2 statements and result sets are not able to return their parents (Chris Dome via Brock Noland) [brock] HIVE-3976 - Support specifying scale and precision with Hive decimal type (Xuefu Zhang via Brock Noland) Changes for Build #2425 Changes for Build #2426 [brock] HIVE-5667 - ThriftCLIService log messages jumbled up (Vaibhav Gumashta via Brock Noland) Changes for Build #2427 [thejas] HIVE-5295 : HiveConnection#configureConnection tries to execute statement even after it is closed (Vaibhav Gumashta via Thejas Nair) [hashutosh] HIVE-5554 : add more comments to CombineHiveInputFormat.java, BucketizedHiveInputFormat.java (Thejas Nair via Ashutosh Chauhan) [brock] HIVE-5450 - pTest2 TestReportParser is failing due to .svn directory (Brock Noland reviewed by Ashutosh Chauhan) [hashutosh] HIVE-5666 : use Path instead of String for IOContext.inputPath (Thejas Nair via Ashutosh Chauhan) [hashutosh] HIVE-5656 : Hive produces unclear, confusing SemanticException when dealing with mod or pmod by zero (Xuefu Zhang via Ashutosh Chauhan) [hashutosh] HIVE-5653 : Vectorized Shuffle Join produces incorrect results (Remus Rusanu via Ashutosh Chauhan) [hashutosh] HIVE-5648 : error when casting partition column to varchar in where clause (Jason Dere via Ashutosh Chauhan) [hashutosh] HIVE-5576 : Blank lines missing from .q.out files created on Windows for testcase=TestCliDriver (Remus Rusanu via Ashutosh Chauhan) Changes for Build #2428 [thejas] HIVE-5668: path normalization in MapOperator is expensive (Thejas Nair reviewed by Gunther Hagleitner) [hashutosh] HIVE-5604 : Fix validation of nested expressions. (Jitendra Nath Pandey via Ashutosh Chauhan) [hashutosh] HIVE-5602 : Micro optimize select operator (Ed Capriolo via Ashutosh Chauhan) [brock] HIVE-5676 - Cleanup test cases as done during mavenization (Brock Noland reviewed by Ashutosh Chauhan) [thejas] HIVE-5486 : HiveServer2 should create base scratch directories at startup (Prasad Mujumdar via Thejas Nair) Changes for Build #2429 [hashutosh] HIVE-5681 : Validation doesn't catch SMBMapJoin (Jitendra Nath Pandey via Ashutosh Chauhan) [thejas] HIVE-5519 : Use paging mechanism for templeton get requests. (Hari Sankar Sivarama Subramaniyan via Thejas Nair) Changes for Build #2430 [hashutosh] HIVE-5670 : annoying ZK exceptions are annoying (Sergey Shelukhin via Ashutosh Chauhan) [hashutosh] HIVE-5613 : Subquery support: disallow nesting of SubQueries (Harish Butani via Ashutosh Chauhan) [hashutosh] HIVE-5698 : A few test file missing apache license header (Xuefu Zhang via Ashutosh Chauhan) [daijy] HIVE-5696: WebHCat e2e tests/jobsubmission.conf file is malformed and loosing tests ( Eugene Koifman via Daniel Dai ) Changes for Build #2431 [hashutosh] HIVE-5693 : Rewrite some tests to reduce test time (Navis via Ashutosh Chauhan) [hashutosh] HIVE-5582 : Implement BETWEEN filter in vectorized mode (Eric Hanson via Ashutosh Chauhan) [hashutosh] HIVE-5556 : Pushdown join conditions (Harish Butani via Ashutosh Chauhan) Changes for Build #2432 [brock] HIVE-5716 - Fix broken tests after maven merge (1) (Brock Noland reviewed by Thejas M Nair and Ashutosh Chauhan) [thejas] HIVE-5483 : use metastore statistics to optimize max/min/etc. queries (Ashutosh Chauhan via Thejas Nair) [daijy] HIVE-5510: [WebHCat] GET job/queue return wrong job information [brock] HIVE-5610 - Merge maven branch into trunk (delete ant) [brock] HIVE-5610 - Merge maven branch into trunk (maven rollforward) [brock] HIVE-5610 - Merge maven branch into trunk (patch) Changes for Build #2433 Changes for Build #2434 [hashutosh] HIVE-3959 : Update Partition Statistics in Metastore Layer (Ashutosh Chauhan, Bhushan Mandhani, Gang Tim Liu via Thejas Nair) Changes for Build #2435 [hashutosh] HIVE-5503 : TopN optimization in VectorReduceSink (Sergey Shelukhin via Ashutosh Chauhan) [brock] HIVE-5695 - PTest2 fix shutdown, duplicate runs, and add client retry [brock] HIVE-5708 - PTest2 should trim long logs when posting to jira Changes for Build #2436 [thejas] HIVE-5547 : webhcat pig job submission should ship hive tar if -usehcatalog is specified (Eugene Koifman via Thejas Nair) [thejas] HIVE-5715 : HS2 should not "start" a session for every command (Gunther Hagleitner via Thejas Nair) Changes for Build #2437 Changes for Build #2438 [brock] HIVE-5740: Tar files should extract to the directory of the same name minus tar.gz (Brock Noland reviewed by Xuefu Zhang) [brock] HIVE-5611: Add assembly (i.e.) tar creation to pom (Szehon Ho via Brock Noland) [brock] HIVE-5707: Validate values for ConfVar (Navis via Brock Noland) [brock] HIVE-5721: Incremental build is disabled by MCOMPILER-209 (Navis via Brock Noland) Changes for Build #2439 [brock] HIVE-5354 - Decimal precision/scale support in ORC file (Xuefu Zhang via Brock Noland) [brock] HIVE-4523 - round() function with specified decimal places not consistent with mysql (Xuefu Zhang via Brock Noland) [thejas] HIVE-5542 : Webhcat is failing to run ddl command on a secure cluster (Sushanth Sowmyan via Thejas Nair) Changes for Build #2440 [brock] HIVE-5730: Beeline throws non-terminal NPE upon starting, after mavenization (Szehon Ho reviewed by Navis) Changes for Build #2441 [omalley] HIVE-5425 Provide a configuration option to control the default stripe size for ORC. (omalley reviewed by gunther) [omalley] Revert HIVE-5583 since it broke the build. [hashutosh] HIVE-5583 : Implement support for IN (list-of-constants) filter in vectorized mode (Eric Hanson via Ashutosh Chauhan) [brock] HIVE-5355 - JDBC support for decimal precision/scale Changes for Build #2443 [brock] HIVE-5351 - Secure-Socket-Layer (SSL) support for HiveServer2 (Prasad Mujumdar via Brock Noland) [hashutosh] HIVE-5583 : Implement support for IN (list-of-constants) filter in vectorized mode (Eric Hanson via Ashutosh Chauhan) [brock] HIVE-5773 - Fix build due to conflict between HIVE-5711 and HIVE-5713 [brock] HIVE-5711 - Fix eclipse:eclipse maven goal (Carl Steinbach via Brock Noland) [brock] HIVE-5752 - log4j properties appear to have been lost in maven upgrade (Sergey Shelukhin via Brock Noland) [brock] HIVE-5713 - Verify versions of libraries post maven merge (Brock Noland reviewed by Gunther Hagleitner) [brock] HIVE-5765 - Beeline throws NPE when -e option is used (Szehon Ho via Brock Noland) [xuefu] HIVE-5726: The DecimalTypeInfo instance associated with a decimal constant is not in line with the precision/scale of the constant (reviewed by Brock) [xuefu] HIVE-5655: Hive incorrecly handles divide-by-zero case (reviewed by Edward and Brock) [xuefu] HIVE-5191: Add char data type (Jason via Xuefu) Changes for Build #2444 [brock] HIVE-5780 - Add the missing declaration of HIVE_CLI_SERVICE_PROTOCOL_V4 in TCLIService.thrift (Prasad Mujumdar via Brock Noland) Changes for Build #2445 [gunther] HIVE-5601: NPE in ORC's PPD when using select * from table with where predicate (Prasanth J via Owen O'Malley and Gunther Hagleitner) [gunther] HIVE-5562: Provide stripe level column statistics in ORC (Patch by Prasanth J, reviewed by Owen O'Malley, committed by Gunther Hagleitner) [hashutosh] HIVE-3777 : add a property in the partition to figure out if stats are accurate (Ashutosh Chauhan via Thejas Nair) Changes for Build #2446 [hashutosh] HIVE-5691 : Intermediate columns are incorrectly initialized for partitioned tables. (Jitendra Nath Pandey via Gunther Hagleitner) [hashutosh] HIVE-5779 : Subquery in where clause with distinct fails with mapjoin turned on with serialization error. (Ashutosh Chauhan via Harish Butani) [gunther] HIVE-5632 (partial): Adding test data to data/files to enable pre-commit tests to run. (Prasanth J via Gunther Hagleitner) Changes for Build #2447 [cws] HIVE-5786: Remove HadoopShims methods that were needed for pre-Hadoop 0.20 (Jason Dere via cws) [thejas] HIVE-5229 : Better thread management for HiveServer2 async threads (Vaibhav Gumashta via Thejas Nair) [gunther] HIVE-5745: TestHiveLogging is failing (at least on mac) (Gunther Hagleitner, reviewed by Ashutosh Chauhan) Changes for Build #2448 [hashutosh] HIVE-5699 : Add unit test for vectorized BETWEEN for timestamp inputs (Eric Hanson via Ashutosh Chauhan) [hashutosh] HIVE-5767 : in SemanticAnalyzer#doPhase1, handling for TOK_UNION falls thru into TOK_INSERT (Sergey Shelukhin via Ashutosh Chauhan) [hashutosh] HIVE-5657 : TopN produces incorrect results with count(distinct) (Sergey Shelukhin via Ashutosh Chauhan) Changes for Build #2450 [hashutosh] HIVE-5683 : JDBC support for char (Jason Dere via Xuefu Zhang) [hashutosh] HIVE-5626 : enable metastore direct SQL for drop/similar queries (Sergey Shelukhin via Ashutosh Chauhan) [hashutosh] HIVE-5700 : enforce single date format for partition column storage (Sergey Shelukhin via Ashutosh Chauhan) [hashutosh] HIVE-5753 : Remove collector from Operator base class (Mohammad Islam via Ashutosh Chauhan) [hashutosh] HIVE-5737 : Provide StructObjectInspector for UDTFs rather than ObjectInspect[] (Navis via Ashutosh Chauhan) [hashutosh] HIVE-5790 : maven test build failure shows wrong error message (Mohammad Islam via Ashutosh Chauhan) [hashutosh] HIVE-5722 : Skip generating vectorization code if possible (Navis via Brock Noland) [hashutosh] HIVE-5697 : Correlation Optimizer may generate wrong plans for cases involving outer join (Yin Huai via Ashutosh Chauhan) [hashutosh] HIVE-4880 : Rearrange explain order of stages simpler (Navis via Ashutosh Chauhan) [xuefu] HIVE-5286: Negative test date_literal1.q fails on java7 because the syntax is valid (Szehon via Xuefu) [hashutosh] HIVE-3990 : Provide input threshold for direct-fetcher (Navis via Ashutosh Chauhan) Changes for Build #2451 [hashutosh] HIVE-4116 : Can't use views using map datatype. (Navis via Ashutosh Chauhan) Changes for Build #2452 [thejas] HIVE-5643 : ZooKeeperHiveLockManager.getQuorumServers incorrectly appends the custom zk port to quorum hosts (Venki Korukanti reviewed by Edward Capriolo via Thejas Nair) [gunther] HIVE-5632: Eliminate splits based on SARGs using stripe statistics in ORC (Patch by Prasanth J, reviewed by Eric Hanson and Gunther Hagleitner) [hashutosh] HIVE-5557 : Push down qualifying Where clause predicates as join conditions (Harish Butani via Ashutosh Chauhan) [brock] HBASE-4388 - Upgrade HBase to 0.96 (Brock Noland, Sushanth Sowmyan, Gunther Hagleitner, and others) Changes for Build #2453 [hashutosh] HIVE-5685 : partition column type validation doesn't work in some cases (Vikram Dixit via Ashutosh Chauhan) [hashutosh] HIVE-5788 : select * fails for table after adding new columns using rcfile storage format (Szehon Ho via Ashutosh Chauhan) Changes for Build #2454 [brock] HIVE-5782 - PTest2 should be able to ride out price spikes [brock] HIVE-5729 - Beeline displays version as ???? after mavenization (Navis via Brock Noland) [brock] HIVE-5732 - HiveServer2: Duplicated new OperationManager in SessionManager (Navis via Brock Noland) [brock] HIVE-5717 - Generate javadoc and source jars (Szehon Ho via Brock Noland) [hashutosh] HIVE-5791 : TestUseDatabase in hcategory failed to pass when illegal filename in /tmp (Jin Jie via Ashutosh Chauhan) Changes for Build #2455 [hashutosh] HIVE-5813 : Multi-way Left outer join fails in vectorized mode (Ashutosh Chauhan via Thejas Nair, Eric Hanson & Remus Rusanu) Changes for Build #2456 [xuefu] HIVE-5825: Case statement type checking too restrictive for parameterized types (Jason via Xuefu) [xuefu] HIVE-5564: Need to accomodate table decimal columns that were defined prior to HIVE-3976 (Reviewed by Brock) Changes for Build #2457 Changes for Build #2458 [rhbutani] HIVE-5369 Annotate hive operator tree with statistics from metastore (Prasanth Jayachandran via Harish Butani) [hashutosh] HIVE-5809 : incorrect stats in some cases with hive.stats.autogather=true (Ashutosh Chauhan via Navis) [brock] HIVE-5741: Fix binary packaging build eg include hcatalog, resolve pom issues (Brock Noland reviewed by Xuefu Zhang) No tests ran. The Apache Jenkins build system has built Hive-trunk-h0.21 (build #2458) Status: Still Failing Check console output at https://builds.apache.org/job/Hive-trunk-h0.21/2458/ to view the results.
