[jira] [Created] (HIVE-27160) Iceberg: Optimise delete (entire) data from table
Denys Kuzmenko created HIVE-27160: - Summary: Iceberg: Optimise delete (entire) data from table Key: HIVE-27160 URL: https://issues.apache.org/jira/browse/HIVE-27160 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko Currently, in MOR mode, Hive creates "positional delete" files during deletes. With "Delete from ", the entire dataset in the table or partition is written as a "positional delete" file. During the read operation, all these files are read again causing huge delay. Proposal: apply "truncate" optimization in case of "delete *". -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27155) Iceberg: Vectorize virtual columns
Denys Kuzmenko created HIVE-27155:
-
Summary: Iceberg: Vectorize virtual columns
Key: HIVE-27155
URL: https://issues.apache.org/jira/browse/HIVE-27155
Project: Hive
Issue Type: Task
Reporter: Denys Kuzmenko
Vectorization gets disabled at runtime with the following reason:
{code}
Select expression for SELECT operator: Virtual column PARTITION__SPEC__ID is
not supported
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (HIVE-26995) Iceberg: Enhance time travel syntax with expressions
Denys Kuzmenko created HIVE-26995: - Summary: Iceberg: Enhance time travel syntax with expressions Key: HIVE-26995 URL: https://issues.apache.org/jira/browse/HIVE-26995 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26873) Whiltelist iceberg configs for sql std authorization
Denys Kuzmenko created HIVE-26873: - Summary: Whiltelist iceberg configs for sql std authorization Key: HIVE-26873 URL: https://issues.apache.org/jira/browse/HIVE-26873 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26811) SharedWorkOptimizer: take the union of virtual columns in mergeable TableScan
Denys Kuzmenko created HIVE-26811: - Summary: SharedWorkOptimizer: take the union of virtual columns in mergeable TableScan Key: HIVE-26811 URL: https://issues.apache.org/jira/browse/HIVE-26811 Project: Hive Issue Type: Bug Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26704) Cleaner shouldn't be blocked by global min open txnId
Denys Kuzmenko created HIVE-26704: - Summary: Cleaner shouldn't be blocked by global min open txnId Key: HIVE-26704 URL: https://issues.apache.org/jira/browse/HIVE-26704 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26645) Preparing for 4.0.0-GA development
Denys Kuzmenko created HIVE-26645: - Summary: Preparing for 4.0.0-GA development Key: HIVE-26645 URL: https://issues.apache.org/jira/browse/HIVE-26645 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26487) Auto-compaction may hang or skip some of the eligible items
Denys Kuzmenko created HIVE-26487: - Summary: Auto-compaction may hang or skip some of the eligible items Key: HIVE-26487 URL: https://issues.apache.org/jira/browse/HIVE-26487 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26433) HivePrivilegeObject's objectName is NULL when JdbcStorageHandler is used with METASTORE type
Denys Kuzmenko created HIVE-26433: - Summary: HivePrivilegeObject's objectName is NULL when JdbcStorageHandler is used with METASTORE type Key: HIVE-26433 URL: https://issues.apache.org/jira/browse/HIVE-26433 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26416) AcidUtils$MetaDataFile.isRawFormatFile() throws InvalidProtocolBufferException for non-ORC file
Denys Kuzmenko created HIVE-26416:
-
Summary: AcidUtils$MetaDataFile.isRawFormatFile() throws
InvalidProtocolBufferException for non-ORC file
Key: HIVE-26416
URL: https://issues.apache.org/jira/browse/HIVE-26416
Project: Hive
Issue Type: Task
Reporter: Denys Kuzmenko
{code}
Caused by: com.google.protobuf.InvalidProtocolBufferException: Protocol message
tag had invalid wire type.
at
com.google.protobuf.InvalidProtocolBufferException.invalidWireType(InvalidProtocolBufferException.java:99)
at
com.google.protobuf.UnknownFieldSet$Builder.mergeFieldFrom(UnknownFieldSet.java:498)
at
com.google.protobuf.GeneratedMessage.parseUnknownField(GeneratedMessage.java:193)
at org.apache.orc.OrcProto$PostScript.(OrcProto.java:18763)
at org.apache.orc.OrcProto$PostScript.(OrcProto.java:18721)
at
org.apache.orc.OrcProto$PostScript$1.parsePartialFrom(OrcProto.java:18859)
at
org.apache.orc.OrcProto$PostScript$1.parsePartialFrom(OrcProto.java:18854)
at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
at org.apache.orc.OrcProto$PostScript.parseFrom(OrcProto.java:19253)
at org.apache.orc.impl.ReaderImpl.extractPostScript(ReaderImpl.java:454)
at org.apache.orc.impl.ReaderImpl.extractFileTail(ReaderImpl.java:582)
at org.apache.orc.impl.ReaderImpl.(ReaderImpl.java:369)
at
org.apache.hadoop.hive.ql.io.orc.ReaderImpl.(ReaderImpl.java:61)
at
org.apache.hadoop.hive.ql.io.orc.OrcFile.createReader(OrcFile.java:112)
at
org.apache.hadoop.hive.ql.io.AcidUtils$MetaDataFile.isRawFormatFile(AcidUtils.java:2585)
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (HIVE-26293) Migrate remaining exclusive DDL operations to EXCL_WRITE lock & bug fixes
Denys Kuzmenko created HIVE-26293: - Summary: Migrate remaining exclusive DDL operations to EXCL_WRITE lock & bug fixes Key: HIVE-26293 URL: https://issues.apache.org/jira/browse/HIVE-26293 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Created] (HIVE-26252) Missing locks in case of MERGE with multiple branches
Denys Kuzmenko created HIVE-26252: - Summary: Missing locks in case of MERGE with multiple branches Key: HIVE-26252 URL: https://issues.apache.org/jira/browse/HIVE-26252 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Created] (HIVE-26165) Remove READ locks for ACID tables with SoftDelete enabled
Denys Kuzmenko created HIVE-26165: - Summary: Remove READ locks for ACID tables with SoftDelete enabled Key: HIVE-26165 URL: https://issues.apache.org/jira/browse/HIVE-26165 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Created] (HIVE-26149) Non blocking DROP DATABASE implementation
Denys Kuzmenko created HIVE-26149: - Summary: Non blocking DROP DATABASE implementation Key: HIVE-26149 URL: https://issues.apache.org/jira/browse/HIVE-26149 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (HIVE-26129) Non blocking DROP CONNECTOR
Denys Kuzmenko created HIVE-26129: - Summary: Non blocking DROP CONNECTOR Key: HIVE-26129 URL: https://issues.apache.org/jira/browse/HIVE-26129 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko Use a less restrictive lock for data connectors, they do not have any dependencies on other tables. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (HIVE-26121) Hive transaction rollback should be thread-safe
Denys Kuzmenko created HIVE-26121: - Summary: Hive transaction rollback should be thread-safe Key: HIVE-26121 URL: https://issues.apache.org/jira/browse/HIVE-26121 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (HIVE-26106) Non blocking ADD, DROP CONSTRAINT
Denys Kuzmenko created HIVE-26106: - Summary: Non blocking ADD, DROP CONSTRAINT Key: HIVE-26106 URL: https://issues.apache.org/jira/browse/HIVE-26106 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (HIVE-26076) Non blocking ADD PARTITION if not exists
Denys Kuzmenko created HIVE-26076: - Summary: Non blocking ADD PARTITION if not exists Key: HIVE-26076 URL: https://issues.apache.org/jira/browse/HIVE-26076 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (HIVE-26053) Non blocking DROP VIEW
Denys Kuzmenko created HIVE-26053: - Summary: Non blocking DROP VIEW Key: HIVE-26053 URL: https://issues.apache.org/jira/browse/HIVE-26053 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (HIVE-26052) Non-blocking DROP MATERIALIZED VIEW implementation
Denys Kuzmenko created HIVE-26052: - Summary: Non-blocking DROP MATERIALIZED VIEW implementation Key: HIVE-26052 URL: https://issues.apache.org/jira/browse/HIVE-26052 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (HIVE-26051) Non blocking Alter Materialized View Rewrite
Denys Kuzmenko created HIVE-26051: - Summary: Non blocking Alter Materialized View Rewrite Key: HIVE-26051 URL: https://issues.apache.org/jira/browse/HIVE-26051 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (HIVE-26023) Non blocking REPLACE, RENAME COLUMNS implementation
Denys Kuzmenko created HIVE-26023: - Summary: Non blocking REPLACE, RENAME COLUMNS implementation Key: HIVE-26023 URL: https://issues.apache.org/jira/browse/HIVE-26023 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (HIVE-25956) Non blocking RENAME TABLE implementation
Denys Kuzmenko created HIVE-25956: - Summary: Non blocking RENAME TABLE implementation Key: HIVE-25956 URL: https://issues.apache.org/jira/browse/HIVE-25956 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (HIVE-25934) Non blocking RENAME PARTITION implementation
Denys Kuzmenko created HIVE-25934: - Summary: Non blocking RENAME PARTITION implementation Key: HIVE-25934 URL: https://issues.apache.org/jira/browse/HIVE-25934 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (HIVE-25904) ObjectStore's updateTableColumnStatistics is not ThreadSafe
Denys Kuzmenko created HIVE-25904: - Summary: ObjectStore's updateTableColumnStatistics is not ThreadSafe Key: HIVE-25904 URL: https://issues.apache.org/jira/browse/HIVE-25904 Project: Hive Issue Type: Bug Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (HIVE-25881) isEligibleForCompaction runs under the ForkJoinPool.commonPool
Denys Kuzmenko created HIVE-25881: - Summary: isEligibleForCompaction runs under the ForkJoinPool.commonPool Key: HIVE-25881 URL: https://issues.apache.org/jira/browse/HIVE-25881 Project: Hive Issue Type: Bug Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (HIVE-25781) Restore multi-threaded support in Cleaner
Denys Kuzmenko created HIVE-25781: - Summary: Restore multi-threaded support in Cleaner Key: HIVE-25781 URL: https://issues.apache.org/jira/browse/HIVE-25781 Project: Hive Issue Type: Sub-task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (HIVE-25755) TestTxnCommands classes refactor
Denys Kuzmenko created HIVE-25755: - Summary: TestTxnCommands classes refactor Key: HIVE-25755 URL: https://issues.apache.org/jira/browse/HIVE-25755 Project: Hive Issue Type: Test Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (HIVE-25710) Config used to enable non-blocking TRUNCATE is not properly propagated
Denys Kuzmenko created HIVE-25710: - Summary: Config used to enable non-blocking TRUNCATE is not properly propagated Key: HIVE-25710 URL: https://issues.apache.org/jira/browse/HIVE-25710 Project: Hive Issue Type: Sub-task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (HIVE-25688) Non blocking DROP PARTITION implementation
Denys Kuzmenko created HIVE-25688: - Summary: Non blocking DROP PARTITION implementation Key: HIVE-25688 URL: https://issues.apache.org/jira/browse/HIVE-25688 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (HIVE-25645) Query-based compaction doesn't work when partition column type is boolean
Denys Kuzmenko created HIVE-25645: - Summary: Query-based compaction doesn't work when partition column type is boolean Key: HIVE-25645 URL: https://issues.apache.org/jira/browse/HIVE-25645 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-25631) Initiator speed-up: only read compaction history once per loop
Denys Kuzmenko created HIVE-25631: - Summary: Initiator speed-up: only read compaction history once per loop Key: HIVE-25631 URL: https://issues.apache.org/jira/browse/HIVE-25631 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-25623) Create a parametrized test to check against the disabled MIN_HISTORY config
Denys Kuzmenko created HIVE-25623: - Summary: Create a parametrized test to check against the disabled MIN_HISTORY config Key: HIVE-25623 URL: https://issues.apache.org/jira/browse/HIVE-25623 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-25603) Restore original method signature in VectorizedOrcAcidRowBatchReader.getDeleteDeltaDirsFromSplit
Denys Kuzmenko created HIVE-25603: - Summary: Restore original method signature in VectorizedOrcAcidRowBatchReader.getDeleteDeltaDirsFromSplit Key: HIVE-25603 URL: https://issues.apache.org/jira/browse/HIVE-25603 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-25516) ITestDbTxnManager is broken after HIVE-24120
Denys Kuzmenko created HIVE-25516: - Summary: ITestDbTxnManager is broken after HIVE-24120 Key: HIVE-25516 URL: https://issues.apache.org/jira/browse/HIVE-25516 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-25503) Add cleanup for the duplicate COMPLETED_TXN_COMPONENTS entries
Denys Kuzmenko created HIVE-25503: - Summary: Add cleanup for the duplicate COMPLETED_TXN_COMPONENTS entries Key: HIVE-25503 URL: https://issues.apache.org/jira/browse/HIVE-25503 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko Performace improvement. Accumulated entries in COMPLETED_TXN_COMPONENTS can lead to query performance degradation. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-25502) Cleaner causes data loss when processing aborted txn with DP
Denys Kuzmenko created HIVE-25502: - Summary: Cleaner causes data loss when processing aborted txn with DP Key: HIVE-25502 URL: https://issues.apache.org/jira/browse/HIVE-25502 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-25441) Incorrect deltas split for sub-compactions when using `hive.compactor.max.num.delta`
Denys Kuzmenko created HIVE-25441: - Summary: Incorrect deltas split for sub-compactions when using `hive.compactor.max.num.delta` Key: HIVE-25441 URL: https://issues.apache.org/jira/browse/HIVE-25441 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-25393) Prevent concurrent compaction and DDL operations
Denys Kuzmenko created HIVE-25393: - Summary: Prevent concurrent compaction and DDL operations Key: HIVE-25393 URL: https://issues.apache.org/jira/browse/HIVE-25393 Project: Hive Issue Type: Task Reporter: Denys Kuzmenko Introduce read locks in compaction (MR, Minor Query-based) that would prevent concurrency issues with DDL operations (DROP/RENAME table). -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-25259) Tweak delta metrics with custom MBean for Prometheus
Denys Kuzmenko created HIVE-25259: - Summary: Tweak delta metrics with custom MBean for Prometheus Key: HIVE-25259 URL: https://issues.apache.org/jira/browse/HIVE-25259 Project: Hive Issue Type: Sub-task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-25217) Move isEligibleForCompaction evaluation under the Initiator thread pool
Denys Kuzmenko created HIVE-25217: - Summary: Move isEligibleForCompaction evaluation under the Initiator thread pool Key: HIVE-25217 URL: https://issues.apache.org/jira/browse/HIVE-25217 Project: Hive Issue Type: Bug Reporter: Denys Kuzmenko Checking for eligibility >1 mil of distinct table / partition combinations can take a while by the Initiator since all steps are performed in the main thread. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-25050) Disable 'hive.metastore.acid.truncate.usebase' config as it's introducing backward incompatible change
Denys Kuzmenko created HIVE-25050: - Summary: Disable 'hive.metastore.acid.truncate.usebase' config as it's introducing backward incompatible change Key: HIVE-25050 URL: https://issues.apache.org/jira/browse/HIVE-25050 Project: Hive Issue Type: Bug Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24985) Create metrics about locks
Denys Kuzmenko created HIVE-24985: - Summary: Create metrics about locks Key: HIVE-24985 URL: https://issues.apache.org/jira/browse/HIVE-24985 Project: Hive Issue Type: Sub-task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24974) Create new metrics about the number of delta files in the ACID table
Denys Kuzmenko created HIVE-24974: - Summary: Create new metrics about the number of delta files in the ACID table Key: HIVE-24974 URL: https://issues.apache.org/jira/browse/HIVE-24974 Project: Hive Issue Type: Sub-task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24932) Create new metric about Initiator / Worker hosts
Denys Kuzmenko created HIVE-24932: - Summary: Create new metric about Initiator / Worker hosts Key: HIVE-24932 URL: https://issues.apache.org/jira/browse/HIVE-24932 Project: Hive Issue Type: Sub-task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24921) Create new metrics about open transactions
Denys Kuzmenko created HIVE-24921: - Summary: Create new metrics about open transactions Key: HIVE-24921 URL: https://issues.apache.org/jira/browse/HIVE-24921 Project: Hive Issue Type: Sub-task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24906) Suffix the table location with UUID/txnId
Denys Kuzmenko created HIVE-24906: - Summary: Suffix the table location with UUID/txnId Key: HIVE-24906 URL: https://issues.apache.org/jira/browse/HIVE-24906 Project: Hive Issue Type: Sub-task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24879) Create new metric about ACID metadata size
Denys Kuzmenko created HIVE-24879: - Summary: Create new metric about ACID metadata size Key: HIVE-24879 URL: https://issues.apache.org/jira/browse/HIVE-24879 Project: Hive Issue Type: Sub-task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24874) Worker performance metric
Denys Kuzmenko created HIVE-24874: - Summary: Worker performance metric Key: HIVE-24874 URL: https://issues.apache.org/jira/browse/HIVE-24874 Project: Hive Issue Type: Sub-task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24871) Initiator / Cleaner performance should be measured with PerformanceLogger
Denys Kuzmenko created HIVE-24871: - Summary: Initiator / Cleaner performance should be measured with PerformanceLogger Key: HIVE-24871 URL: https://issues.apache.org/jira/browse/HIVE-24871 Project: Hive Issue Type: Sub-task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24781) Allow to use user defined queue for query based compaction
Denys Kuzmenko created HIVE-24781: - Summary: Allow to use user defined queue for query based compaction Key: HIVE-24781 URL: https://issues.apache.org/jira/browse/HIVE-24781 Project: Hive Issue Type: Improvement Reporter: Denys Kuzmenko Provide a change such that all compaction jobs, both fully acid and insert only jobs are submitted to a dedicated queue. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24754) Skip extra work in Cleaner if queue is empty
Denys Kuzmenko created HIVE-24754: - Summary: Skip extra work in Cleaner if queue is empty Key: HIVE-24754 URL: https://issues.apache.org/jira/browse/HIVE-24754 Project: Hive Issue Type: Improvement Reporter: Denys Kuzmenko Avoid number of DB calls in Cleaner if there are no candidates for cleaning. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24667) Truncate optimization to avoid unnecessary per partition DB get operations
Denys Kuzmenko created HIVE-24667: - Summary: Truncate optimization to avoid unnecessary per partition DB get operations Key: HIVE-24667 URL: https://issues.apache.org/jira/browse/HIVE-24667 Project: Hive Issue Type: Sub-task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24374) Do not remove metadata for aborted writes that were batched with valid ones in the same delta file
Denys Kuzmenko created HIVE-24374: - Summary: Do not remove metadata for aborted writes that were batched with valid ones in the same delta file Key: HIVE-24374 URL: https://issues.apache.org/jira/browse/HIVE-24374 Project: Hive Issue Type: Bug Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24211) Replace Snapshot invalidate logic with WriteSet check for txn conflict detection
Denys Kuzmenko created HIVE-24211: - Summary: Replace Snapshot invalidate logic with WriteSet check for txn conflict detection Key: HIVE-24211 URL: https://issues.apache.org/jira/browse/HIVE-24211 Project: Hive Issue Type: Bug Reporter: Denys Kuzmenko *Issue with concurrent writes on partitioned table:* Concurrent writes on different partitions should execute in parallel without issues. They acquire a shared lock on table level and exclusive write on partition level (hive.txn.xlock.write=true). However there is a problem with the Snapshot validation. It compares valid writeIds seen by current transaction, recorded before locking, with the actual list of writeIds. The Issue is that writeId in Snapshot has no information on partition, meaning that concurrent writes to different partitions would be seen as writes to the same non-partitioned table causing Snapshot to be obsolete. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24150) Refactor CommitTxnRequest field order
Denys Kuzmenko created HIVE-24150: - Summary: Refactor CommitTxnRequest field order Key: HIVE-24150 URL: https://issues.apache.org/jira/browse/HIVE-24150 Project: Hive Issue Type: Bug Environment: Refactor CommitTxnRequest field order (keyValue and exclWriteEnabled). HIVE-24125 introduced backward incompatible change. Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24125) Incorrect transaction snapshot invalidation with unnecessary writeset check for exclusive operations
Denys Kuzmenko created HIVE-24125: - Summary: Incorrect transaction snapshot invalidation with unnecessary writeset check for exclusive operations Key: HIVE-24125 URL: https://issues.apache.org/jira/browse/HIVE-24125 Project: Hive Issue Type: Bug Reporter: Denys Kuzmenko fixes: https://docs.google.com/document/d/1NVfk479_SxVIWPLXYmZkU8MYQE5nhcHbKMrf3bO_qwI -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24000) Put exclusive MERGE INSERT under the feature flag
Denys Kuzmenko created HIVE-24000: - Summary: Put exclusive MERGE INSERT under the feature flag Key: HIVE-24000 URL: https://issues.apache.org/jira/browse/HIVE-24000 Project: Hive Issue Type: Bug Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23832) Cleaner skips processing when using blocking compaction
Denys Kuzmenko created HIVE-23832: - Summary: Cleaner skips processing when using blocking compaction Key: HIVE-23832 URL: https://issues.apache.org/jira/browse/HIVE-23832 Project: Hive Issue Type: Bug Reporter: Denys Kuzmenko When using blocking compaction Cleaner skips processing due to the open txn (by ALTER TABLE) below Compactor one. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23503) ValidTxnManager doesn't consider txns opened and committed between snapshot generation and locking when evaluating ValidTxnListState
Denys Kuzmenko created HIVE-23503: - Summary: ValidTxnManager doesn't consider txns opened and committed between snapshot generation and locking when evaluating ValidTxnListState Key: HIVE-23503 URL: https://issues.apache.org/jira/browse/HIVE-23503 Project: Hive Issue Type: Bug Components: Transactions Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23349) Concurrent MERGE INSERT operations produce duplicates
Denys Kuzmenko created HIVE-23349: - Summary: Concurrent MERGE INSERT operations produce duplicates Key: HIVE-23349 URL: https://issues.apache.org/jira/browse/HIVE-23349 Project: Hive Issue Type: Bug Components: Transactions Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23293) Locks: Implement zero-wait readers
Denys Kuzmenko created HIVE-23293: - Summary: Locks: Implement zero-wait readers Key: HIVE-23293 URL: https://issues.apache.org/jira/browse/HIVE-23293 Project: Hive Issue Type: Sub-task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23032) Add batching in Lock generation
Denys Kuzmenko created HIVE-23032: - Summary: Add batching in Lock generation Key: HIVE-23032 URL: https://issues.apache.org/jira/browse/HIVE-23032 Project: Hive Issue Type: Improvement Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22999) typeCast issue while constant propagation when cbo is disabled
Denys Kuzmenko created HIVE-22999: - Summary: typeCast issue while constant propagation when cbo is disabled Key: HIVE-22999 URL: https://issues.apache.org/jira/browse/HIVE-22999 Project: Hive Issue Type: Test Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22906) Redundant checkLock Mutex blocks concurrent Lock requests
Denys Kuzmenko created HIVE-22906: - Summary: Redundant checkLock Mutex blocks concurrent Lock requests Key: HIVE-22906 URL: https://issues.apache.org/jira/browse/HIVE-22906 Project: Hive Issue Type: Improvement Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22888) Rewrite checkLock inner select with JOIN operator
Denys Kuzmenko created HIVE-22888: - Summary: Rewrite checkLock inner select with JOIN operator Key: HIVE-22888 URL: https://issues.apache.org/jira/browse/HIVE-22888 Project: Hive Issue Type: Improvement Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22772) Log opType and session level information for each operation
Denys Kuzmenko created HIVE-22772: - Summary: Log opType and session level information for each operation Key: HIVE-22772 URL: https://issues.apache.org/jira/browse/HIVE-22772 Project: Hive Issue Type: Improvement Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22730) Do not acquire read lock for dummy input
Denys Kuzmenko created HIVE-22730: - Summary: Do not acquire read lock for dummy input Key: HIVE-22730 URL: https://issues.apache.org/jira/browse/HIVE-22730 Project: Hive Issue Type: Bug Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22649) TestHiveCli fix: scratchdir should be writable
Denys Kuzmenko created HIVE-22649: - Summary: TestHiveCli fix: scratchdir should be writable Key: HIVE-22649 URL: https://issues.apache.org/jira/browse/HIVE-22649 Project: Hive Issue Type: Sub-task Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22640) Decimal64ColumnVector: ClassCastException when partition column type is Decimal
Denys Kuzmenko created HIVE-22640: - Summary: Decimal64ColumnVector: ClassCastException when partition column type is Decimal Key: HIVE-22640 URL: https://issues.apache.org/jira/browse/HIVE-22640 Project: Hive Issue Type: Bug Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22625) Syntax Error in findPotentialCompactions SQL query for MySql/Postgres
Denys Kuzmenko created HIVE-22625: - Summary: Syntax Error in findPotentialCompactions SQL query for MySql/Postgres Key: HIVE-22625 URL: https://issues.apache.org/jira/browse/HIVE-22625 Project: Hive Issue Type: Bug Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22622) Hive allows to create a struct with duplicate attribute names
Denys Kuzmenko created HIVE-22622:
-
Summary: Hive allows to create a struct with duplicate attribute
names
Key: HIVE-22622
URL: https://issues.apache.org/jira/browse/HIVE-22622
Project: Hive
Issue Type: Bug
Reporter: Denys Kuzmenko
When you create at table with a struct with twice the same attribute name, hive
allow you to create it.
create table test_struct( duplicateColumn struct);
You can insert data into it :
insert into test_struct select named_struct("id",1,"id",1);
But you can not read it :
select * from test_struct;
Return : java.io.IOException: java.io.IOException: Error reading file:
hdfs://.../test_struct/delta_001_001_/bucket_0 ,
We can create and insert. but fail on read the Struct part of the tables. We
can still read all other columns (if we have more than one) but not the struct
anymore.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HIVE-22606) AvroSerde logs avro.schema.literal under INFO level
Denys Kuzmenko created HIVE-22606: - Summary: AvroSerde logs avro.schema.literal under INFO level Key: HIVE-22606 URL: https://issues.apache.org/jira/browse/HIVE-22606 Project: Hive Issue Type: Bug Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22596) RawStore used by Initiator is not thread-safe
Denys Kuzmenko created HIVE-22596: - Summary: RawStore used by Initiator is not thread-safe Key: HIVE-22596 URL: https://issues.apache.org/jira/browse/HIVE-22596 Project: Hive Issue Type: Improvement Reporter: Denys Kuzmenko RawStore used by Initiator is not thread-safe. To avoid synchronization, we can use ThreadLocal variables. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22568) Process compaction candidates in parallel by the Initiator
Denys Kuzmenko created HIVE-22568: - Summary: Process compaction candidates in parallel by the Initiator Key: HIVE-22568 URL: https://issues.apache.org/jira/browse/HIVE-22568 Project: Hive Issue Type: Improvement Reporter: Denys Kuzmenko `checkForCompaction` includes many file metadata checks and may be expensive. Therefore, make sense using a thread pool here and running `checkForCompactions` in parallel. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22506) Read-only transactions feature flag
Denys Kuzmenko created HIVE-22506: - Summary: Read-only transactions feature flag Key: HIVE-22506 URL: https://issues.apache.org/jira/browse/HIVE-22506 Project: Hive Issue Type: Bug Reporter: Denys Kuzmenko Introduce a feature flag, so that read-only transaction functionality could be conditionally turned on/off. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22367) Transaction type not retrieved from OpenTxnRequest
Denys Kuzmenko created HIVE-22367: - Summary: Transaction type not retrieved from OpenTxnRequest Key: HIVE-22367 URL: https://issues.apache.org/jira/browse/HIVE-22367 Project: Hive Issue Type: Bug Components: Transactions Reporter: Denys Kuzmenko When opening a transaction, its type should be extracted from OpenTxnRequest object. Currently it's hardcoded with TxnType.DEFAULT. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22282) Obtain LLAP delegation token only when LLAP is configured for Kerberos authentication
Denys Kuzmenko created HIVE-22282: - Summary: Obtain LLAP delegation token only when LLAP is configured for Kerberos authentication Key: HIVE-22282 URL: https://issues.apache.org/jira/browse/HIVE-22282 Project: Hive Issue Type: Bug Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22244) Added default ACLs for znodes on a non-kerberized cluster
Denys Kuzmenko created HIVE-22244: - Summary: Added default ACLs for znodes on a non-kerberized cluster Key: HIVE-22244 URL: https://issues.apache.org/jira/browse/HIVE-22244 Project: Hive Issue Type: Bug Components: Metastore Reporter: Denys Kuzmenko Set default ACLs for znodes on a non-kerberized cluster: Create/Read/Delete/Write/Admin to the world -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22231) Hive query with big size via knox fails with 'Broken pipe (Write failed)
Denys Kuzmenko created HIVE-22231: - Summary: Hive query with big size via knox fails with 'Broken pipe (Write failed) Key: HIVE-22231 URL: https://issues.apache.org/jira/browse/HIVE-22231 Project: Hive Issue Type: Bug Reporter: Denys Kuzmenko When a big query is being passed to HS2, HS2 has to wait for complete query before responding with 401. Once knox receives 401, it will send next request with negotiate header. Issue here that HS2 is responding with 401 even before complete query is transferred. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22195) Configure authentication type for Zookeeper when different from the default cluster wide
Denys Kuzmenko created HIVE-22195: - Summary: Configure authentication type for Zookeeper when different from the default cluster wide Key: HIVE-22195 URL: https://issues.apache.org/jira/browse/HIVE-22195 Project: Hive Issue Type: Improvement Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (HIVE-22176) Configure Kerberos for HMS Client via HS2 configuration
Denys Kuzmenko created HIVE-22176: - Summary: Configure Kerberos for HMS Client via HS2 configuration Key: HIVE-22176 URL: https://issues.apache.org/jira/browse/HIVE-22176 Project: Hive Issue Type: Improvement Reporter: Denys Kuzmenko -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (HIVE-22166) Configure Kerberos for Hive Ranger Client via HS2 configuration
Denys Kuzmenko created HIVE-22166: - Summary: Configure Kerberos for Hive Ranger Client via HS2 configuration Key: HIVE-22166 URL: https://issues.apache.org/jira/browse/HIVE-22166 Project: Hive Issue Type: Improvement Reporter: Denys Kuzmenko In Hive we would like to have possibility to enable Kerberos partially (i.e only Ranger, Atlas and HMS). However, since hadoop security is a global flag there are many places that need to be commented out to avoid the UGI cluster wide configuration. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (HIVE-21412) PostExecOrcFileDump doesn't work with ACID tables
Denys Kuzmenko created HIVE-21412: - Summary: PostExecOrcFileDump doesn't work with ACID tables Key: HIVE-21412 URL: https://issues.apache.org/jira/browse/HIVE-21412 Project: Hive Issue Type: Bug Reporter: Denys Kuzmenko -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-21116) HADOOP_CREDSTORE_PASSWORD is not populated under yarn.app.mapreduce.am.admin.user.env
Denys Kuzmenko created HIVE-21116: - Summary: HADOOP_CREDSTORE_PASSWORD is not populated under yarn.app.mapreduce.am.admin.user.env Key: HIVE-21116 URL: https://issues.apache.org/jira/browse/HIVE-21116 Project: Hive Issue Type: Bug Reporter: Denys Kuzmenko -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-21030) Add credential store env properties redaction in JobConf
Denys Kuzmenko created HIVE-21030: - Summary: Add credential store env properties redaction in JobConf Key: HIVE-21030 URL: https://issues.apache.org/jira/browse/HIVE-21030 Project: Hive Issue Type: Bug Reporter: Denys Kuzmenko -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-20924) Property 'hive.driver.parallel.compilation.global.limit' should be immutable at runtime
Denys Kuzmenko created HIVE-20924: - Summary: Property 'hive.driver.parallel.compilation.global.limit' should be immutable at runtime Key: HIVE-20924 URL: https://issues.apache.org/jira/browse/HIVE-20924 Project: Hive Issue Type: Bug Components: HiveServer2 Reporter: Denys Kuzmenko -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-20914) AccessControlException: Permission denied when "hive.exec.submitviachild" is true
Denys Kuzmenko created HIVE-20914:
-
Summary: AccessControlException: Permission denied when
"hive.exec.submitviachild" is true
Key: HIVE-20914
URL: https://issues.apache.org/jira/browse/HIVE-20914
Project: Hive
Issue Type: Bug
Reporter: Denys Kuzmenko
{code}
Exception in thread "main" java.lang.RuntimeException:
org.apache.hadoop.security.AccessControlException: Permission denied:
user=hive, access=EXECUTE, inode="/tmp/hive/hdfs":hdfs:supergroup:drwx-- at
org.apache.hadoop.hdfs.server.namenode.DefaultAuthorizationProvider.checkFsPermission(DefaultAuthorizationProvider.java:279)
at
org.apache.hadoop.hdfs.server.namenode.DefaultAuthorizationProvider.check(DefaultAuthorizationProvider.java:260)
at
org.apache.hadoop.hdfs.server.namenode.DefaultAuthorizationProvider.checkTraverse(DefaultAuthorizationProvider.java:201)
at
org.apache.hadoop.hdfs.server.namenode.DefaultAuthorizationProvider.checkPermission(DefaultAuthorizationProvider.java:154)
at
org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:152)
at
org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:3877)
at
org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:3860)
at
org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkTraverse(FSDirectory.java:3847)
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkTraverse(FSNamesystem.java:6822)
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInternal(FSNamesystem.java:4551)
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInt(FSNamesystem.java:4529)
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:4502)
at
org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:884)
at
org.apache.hadoop.hdfs.server.namenode.AuthorizationProviderProxyClientProtocol.mkdirs(AuthorizationProviderProxyClientProtocol.java:328)
at
org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:641)
at
org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:617)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1073) at
org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2281) at
org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2277) at
java.security.AccessController.doPrivileged(Native Method) at
javax.security.auth.Subject.doAs(Subject.java:422) at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1920)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2275) at
org.apache.hadoop.hive.ql.Context.getScratchDir(Context.java:285) at
org.apache.hadoop.hive.ql.Context.getMRScratchDir(Context.java:328) at
org.apache.hadoop.hive.ql.Context.getMRTmpPath(Context.java:444) at
org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:243) at
org.apache.hadoop.hive.ql.exec.mr.ExecDriver.main(ExecDriver.java:771) at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498) at
org.apache.hadoop.util.RunJar.run(RunJar.java:221) at
org.apache.hadoop.util.RunJar.main(RunJar.java:136)
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (HIVE-20795) Rename CompileLockTest.java to follow the test's naming convention.
Denys Kuzmenko created HIVE-20795: - Summary: Rename CompileLockTest.java to follow the test's naming convention. Key: HIVE-20795 URL: https://issues.apache.org/jira/browse/HIVE-20795 Project: Hive Issue Type: Bug Reporter: Denys Kuzmenko -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-20737) LocalHiveSparkClient and SparkSession race condition fix
Denys Kuzmenko created HIVE-20737: - Summary: LocalHiveSparkClient and SparkSession race condition fix Key: HIVE-20737 URL: https://issues.apache.org/jira/browse/HIVE-20737 Project: Hive Issue Type: Bug Components: Hive Reporter: Denys Kuzmenko -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-20722) Switch HS2 CompileLock to use fair locks
Denys Kuzmenko created HIVE-20722: - Summary: Switch HS2 CompileLock to use fair locks Key: HIVE-20722 URL: https://issues.apache.org/jira/browse/HIVE-20722 Project: Hive Issue Type: Improvement Reporter: Denys Kuzmenko -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-20711) Race Condition when Multi-Threading in SessionState.createRootHDFSDir
Denys Kuzmenko created HIVE-20711: - Summary: Race Condition when Multi-Threading in SessionState.createRootHDFSDir Key: HIVE-20711 URL: https://issues.apache.org/jira/browse/HIVE-20711 Project: Hive Issue Type: Bug Components: HiveServer2 Reporter: Denys Kuzmenko java.util.concurrent.ExecutionException: java.lang.RuntimeException: The root scratch dir: /home/hiveptest/hive-ptest-cloudera-slaves-17e5-13.gce.cloudera.com-hiveptest-0/cdh-source/itests/hive-unit/target/tmp/scratchdir on HDFS should be writable. Current permissions are: rwxr-xr-x at org.apache.hadoop.hive.ql.session.SessionState.createRootHDFSDir(SessionState.java:714) at org.apache.hadoop.hive.ql.session.SessionState.createSessionDirs(SessionState.java:637) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:567) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:532) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:512) at -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-20647) HadoopVer was ignored in QTestUtil
denys kuzmenko created HIVE-20647: - Summary: HadoopVer was ignored in QTestUtil Key: HIVE-20647 URL: https://issues.apache.org/jira/browse/HIVE-20647 Project: Hive Issue Type: Bug Components: Test Reporter: denys kuzmenko Attachments: HIVE-20647.1.patch -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-20535) Add new configuration to set the size of the global compile lock
denys kuzmenko created HIVE-20535: - Summary: Add new configuration to set the size of the global compile lock Key: HIVE-20535 URL: https://issues.apache.org/jira/browse/HIVE-20535 Project: Hive Issue Type: Task Components: HiveServer2 Reporter: denys kuzmenko When removing the compile lock, it is quite risky to remove it entirely. It would be good to provide a pool size for the concurrent compilation, so the administrator can limit the load -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-20466) Improve org.apache.hadoop.hive.ql.exec.FunctionTask Experience
denys kuzmenko created HIVE-20466: - Summary: Improve org.apache.hadoop.hive.ql.exec.FunctionTask Experience Key: HIVE-20466 URL: https://issues.apache.org/jira/browse/HIVE-20466 Project: Hive Issue Type: Improvement Components: Hive Reporter: denys kuzmenko -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-20465) ProxyFileSystem.listStatusIterator function override required once migrated to Hadoop 3.2.0 +
denys kuzmenko created HIVE-20465: - Summary: ProxyFileSystem.listStatusIterator function override required once migrated to Hadoop 3.2.0 + Key: HIVE-20465 URL: https://issues.apache.org/jira/browse/HIVE-20465 Project: Hive Issue Type: Test Reporter: denys kuzmenko -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-20394) Cleaned up HBaseQTest runner
denys kuzmenko created HIVE-20394: - Summary: Cleaned up HBaseQTest runner Key: HIVE-20394 URL: https://issues.apache.org/jira/browse/HIVE-20394 Project: Hive Issue Type: Bug Components: Tests Affects Versions: 4.0.0 Reporter: denys kuzmenko Assignee: denys kuzmenko 1. Set proper HBase cluster destroy order 2. General clean up -- This message was sent by Atlassian JIRA (v7.6.3#76005)
