[jira] [Created] (HIVE-24211) Replace Snapshot invalidate logic with WriteSet check for txn conflict detection
Denys Kuzmenko created HIVE-24211: - Summary: Replace Snapshot invalidate logic with WriteSet check for txn conflict detection Key: HIVE-24211 URL: https://issues.apache.org/jira/browse/HIVE-24211 Project: Hive Issue Type: Bug Reporter: Denys Kuzmenko *Issue with concurrent writes on partitioned table:* Concurrent writes on different partitions should execute in parallel without issues. They acquire a shared lock on table level and exclusive write on partition level (hive.txn.xlock.write=true). However there is a problem with the Snapshot validation. It compares valid writeIds seen by current transaction, recorded before locking, with the actual list of writeIds. The Issue is that writeId in Snapshot has no information on partition, meaning that concurrent writes to different partitions would be seen as writes to the same non-partitioned table causing Snapshot to be obsolete. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24212) Refactor to take advantage of listStatus optimisations in cloud storage connectors
Rajesh Balamohan created HIVE-24212: --- Summary: Refactor to take advantage of listStatus optimisations in cloud storage connectors Key: HIVE-24212 URL: https://issues.apache.org/jira/browse/HIVE-24212 Project: Hive Issue Type: Improvement Reporter: Rajesh Balamohan https://issues.apache.org/jira/browse/HADOOP-17022, https://issues.apache.org/jira/browse/HADOOP-17281, https://issues.apache.org/jira/browse/HADOOP-16830 etc help in reducing number of roundtrips to remote systems in cloud storage. Creating this ticket to do minor refactoring to take advantage of the above optimizations. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24213) Incorrect exception in the Merge MapJoinTask into its child MapRedTask optimizer
Zoltan Matyus created HIVE-24213:
Summary: Incorrect exception in the Merge MapJoinTask into its
child MapRedTask optimizer
Key: HIVE-24213
URL: https://issues.apache.org/jira/browse/HIVE-24213
Project: Hive
Issue Type: Bug
Components: Physical Optimizer
Affects Versions: 4.0.0
Reporter: Zoltan Matyus
Assignee: Zoltan Matyus
The {{CommonJoinTaskDispatcher#mergeMapJoinTaskIntoItsChildMapRedTask}} method
throws a {{SemanticException}} if the number of {{FileSinkOperator}}s it finds
is not exactly 1. The exception is valid if zero operators are found, but there
can be valid use cases where multiple FileSinkOperators exist.
Example: the MapJoin and it child are used in a common table expression, which
is used for multiple inserts.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HIVE-24214) Reduce alter_table() function overloading in metastore
Ashish Sharma created HIVE-24214:
Summary: Reduce alter_table() function overloading in metastore
Key: HIVE-24214
URL: https://issues.apache.org/jira/browse/HIVE-24214
Project: Hive
Issue Type: Improvement
Components: Standalone Metastore
Reporter: Ashish Sharma
Assignee: Ashish Sharma
Reduce following overloading method to less number of methods
void alter_table(String catName, String dbName, String tblName, Table newTable,
EnvironmentContext envContext)
throws InvalidOperationException, MetaException, TException;
default void alter_table(String catName, String dbName, String tblName, Table
newTable)
throws InvalidOperationException, MetaException, TException {
alter_table(catName, dbName, tblName, newTable, null);
}
@Deprecated
void alter_table(String defaultDatabaseName, String tblName, Table table,
boolean cascade) throws InvalidOperationException, MetaException,
TException;
@Deprecated
void alter_table_with_environmentContext(String databaseName, String tblName,
Table table,
EnvironmentContext environmentContext) throws InvalidOperationException,
MetaException,
TException;
void alter_table(String catName, String databaseName, String tblName, Table
table,
EnvironmentContext environmentContext, String validWriteIdList)
throws InvalidOperationException, MetaException, TException;
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HIVE-24217) HMS storage backend for HPL/SQL stored procedures
Attila Magyar created HIVE-24217: Summary: HMS storage backend for HPL/SQL stored procedures Key: HIVE-24217 URL: https://issues.apache.org/jira/browse/HIVE-24217 Project: Hive Issue Type: Bug Components: Hive, hpl/sql, Metastore Reporter: Attila Magyar Assignee: Attila Magyar HPL/SQL procedures are currently stored in text files. The goal of this Jira is to implement a Metastore backend for storing and loading these procedures. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24216) Release Hive 4.0
Igor Dvorzhak created HIVE-24216: Summary: Release Hive 4.0 Key: HIVE-24216 URL: https://issues.apache.org/jira/browse/HIVE-24216 Project: Hive Issue Type: Task Reporter: Igor Dvorzhak It seems like a new major Hive release is long overdue and required for Java 11 support. Are there any reason why Hive didn't see any major.minor release for over 2 years already? -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24215) Total function count is incorrect in Replication Metrics
Aasha Medhi created HIVE-24215: -- Summary: Total function count is incorrect in Replication Metrics Key: HIVE-24215 URL: https://issues.apache.org/jira/browse/HIVE-24215 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
Review Request 72919: HIVE-24204:fix
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72919/ --- Review request for hive. Repository: hive-git Description --- HIVE-24204:fix Diffs - llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/QueryFragmentInfo.java 6f0630c3dc2e63636cbe8fc3c311059441cfc0ed llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/QueryInfo.java f985768b8603dbad37b334939318110a87854b7f llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/QueryTracker.java 7e646c5588f266eed3b19c7acaee52990e3652cd llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/TaskRunnerCallable.java c3a74afd3d9dcaf2aece374c4ecd35c0daa72ce3 llap-server/src/test/org/apache/hadoop/hive/llap/daemon/impl/TaskExecutorTestHelpers.java f0b9ee913a21cf9f9fcca20669c8f594fbd3de06 Diff: https://reviews.apache.org/r/72919/diff/1/ Testing --- Thanks, Yuriy Baltovskyy
Review Request 72918: fix HIVE-24208 bug
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72918/ --- Review request for hive. Repository: hive-git Description --- fix HIVE-24208 bug Diffs - ql/src/java/org/apache/hadoop/hive/llap/ChannelOutputStream.java dbe90d633a65f03b4cf8e133c1762b3e3a8733c7 Diff: https://reviews.apache.org/r/72918/diff/1/ Testing --- Thanks, Yuriy Baltovskyy
