[jira] [Created] (HIVE-24676) show locks call failing for postgres RDBMS if the txnId filter is passed
Aasha Medhi created HIVE-24676: -- Summary: show locks call failing for postgres RDBMS if the txnId filter is passed Key: HIVE-24676 URL: https://issues.apache.org/jira/browse/HIVE-24676 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24558) Handle update in table level regular expression.
Aasha Medhi created HIVE-24558: -- Summary: Handle update in table level regular expression. Key: HIVE-24558 URL: https://issues.apache.org/jira/browse/HIVE-24558 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24502) Store table level regular expression used during dump for table level replication
Aasha Medhi created HIVE-24502: -- Summary: Store table level regular expression used during dump for table level replication Key: HIVE-24502 URL: https://issues.apache.org/jira/browse/HIVE-24502 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24371) Ranger Replication fallback to updateIfExists
Aasha Medhi created HIVE-24371: -- Summary: Ranger Replication fallback to updateIfExists Key: HIVE-24371 URL: https://issues.apache.org/jira/browse/HIVE-24371 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi Ranger Replication fallback to updateIfExists Add dummy resource as workaround while creating the deny policy to avoid it from overriding the actual policy -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24328) Run distcp in parallel for all file entries in repl load.
Aasha Medhi created HIVE-24328: -- Summary: Run distcp in parallel for all file entries in repl load. Key: HIVE-24328 URL: https://issues.apache.org/jira/browse/HIVE-24328 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24306) Launch single copy task for single batch of partitions in repl load for managed table
Aasha Medhi created HIVE-24306: -- Summary: Launch single copy task for single batch of partitions in repl load for managed table Key: HIVE-24306 URL: https://issues.apache.org/jira/browse/HIVE-24306 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24254) Remove setOwner call in ReplChangeManager
Aasha Medhi created HIVE-24254: -- Summary: Remove setOwner call in ReplChangeManager Key: HIVE-24254 URL: https://issues.apache.org/jira/browse/HIVE-24254 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24246) Fix for Ranger Deny policy overriding policy with same resource name
Aasha Medhi created HIVE-24246: -- Summary: Fix for Ranger Deny policy overriding policy with same resource name Key: HIVE-24246 URL: https://issues.apache.org/jira/browse/HIVE-24246 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24215) Total function count is incorrect in Replication Metrics
Aasha Medhi created HIVE-24215: -- Summary: Total function count is incorrect in Replication Metrics Key: HIVE-24215 URL: https://issues.apache.org/jira/browse/HIVE-24215 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24197) Check for write transactions for the db under replication at a frequent interval
Aasha Medhi created HIVE-24197: -- Summary: Check for write transactions for the db under replication at a frequent interval Key: HIVE-24197 URL: https://issues.apache.org/jira/browse/HIVE-24197 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24134) Revert deletion of HiveStrictManagedMigration
Aasha Medhi created HIVE-24134: -- Summary: Revert deletion of HiveStrictManagedMigration Key: HIVE-24134 URL: https://issues.apache.org/jira/browse/HIVE-24134 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi Partial revert of https://issues.apache.org/jira/browse/HIVE-23995 to keep the migration code -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24127) Dump events from default catalog only
Aasha Medhi created HIVE-24127: -- Summary: Dump events from default catalog only Key: HIVE-24127 URL: https://issues.apache.org/jira/browse/HIVE-24127 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi Don't dump events from spark catalog. In bootstrap we skip spark tables. In inceremental load also we should skip spark events. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24117) Fix for not setting managed table location in incremental load
Aasha Medhi created HIVE-24117: -- Summary: Fix for not setting managed table location in incremental load Key: HIVE-24117 URL: https://issues.apache.org/jira/browse/HIVE-24117 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24109) Load partitions in parallel for managed tables in the bootstrap phase
Aasha Medhi created HIVE-24109: -- Summary: Load partitions in parallel for managed tables in the bootstrap phase Key: HIVE-24109 URL: https://issues.apache.org/jira/browse/HIVE-24109 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24102) Add ENGINE=InnoDB for replication mysql schema changes
Aasha Medhi created HIVE-24102: -- Summary: Add ENGINE=InnoDB for replication mysql schema changes Key: HIVE-24102 URL: https://issues.apache.org/jira/browse/HIVE-24102 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24095) Load partitions in parallel in the bootstrap phase
Aasha Medhi created HIVE-24095: -- Summary: Load partitions in parallel in the bootstrap phase Key: HIVE-24095 URL: https://issues.apache.org/jira/browse/HIVE-24095 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24032) Remove hadoop shims dependency and use FileSystem Api directly from standalone metastore
Aasha Medhi created HIVE-24032: -- Summary: Remove hadoop shims dependency and use FileSystem Api directly from standalone metastore Key: HIVE-24032 URL: https://issues.apache.org/jira/browse/HIVE-24032 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24019) Flaky test AsyncResponseHandlerTest
Aasha Medhi created HIVE-24019: -- Summary: Flaky test AsyncResponseHandlerTest Key: HIVE-24019 URL: https://issues.apache.org/jira/browse/HIVE-24019 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Mustafa Iman -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23995) Don't set location for managed tables in case of repl load
Aasha Medhi created HIVE-23995: -- Summary: Don't set location for managed tables in case of repl load Key: HIVE-23995 URL: https://issues.apache.org/jira/browse/HIVE-23995 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23993) Handle irrecoverable errors
Aasha Medhi created HIVE-23993: -- Summary: Handle irrecoverable errors Key: HIVE-23993 URL: https://issues.apache.org/jira/browse/HIVE-23993 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23961) Enable external table replication by default
Aasha Medhi created HIVE-23961: -- Summary: Enable external table replication by default Key: HIVE-23961 URL: https://issues.apache.org/jira/browse/HIVE-23961 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23955) Classification of Error Codes in Replication
Aasha Medhi created HIVE-23955: -- Summary: Classification of Error Codes in Replication Key: HIVE-23955 URL: https://issues.apache.org/jira/browse/HIVE-23955 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23897) Create a common Retry Interface for replication
Aasha Medhi created HIVE-23897: -- Summary: Create a common Retry Interface for replication Key: HIVE-23897 URL: https://issues.apache.org/jira/browse/HIVE-23897 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23881) Deprecate get_open_txns to use get_open_txns_req method.
Aasha Medhi created HIVE-23881: -- Summary: Deprecate get_open_txns to use get_open_txns_req method. Key: HIVE-23881 URL: https://issues.apache.org/jira/browse/HIVE-23881 Project: Hive Issue Type: Task Reporter: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23863) Use the current UGI to make calls to Ranger Service
Aasha Medhi created HIVE-23863: -- Summary: Use the current UGI to make calls to Ranger Service Key: HIVE-23863 URL: https://issues.apache.org/jira/browse/HIVE-23863 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23813) Fix Flaky tests due to JDO ConnectionException
Aasha Medhi created HIVE-23813: -- Summary: Fix Flaky tests due to JDO ConnectionException Key: HIVE-23813 URL: https://issues.apache.org/jira/browse/HIVE-23813 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23790) The error message length of 2000 is exceeded for scheduled query
Aasha Medhi created HIVE-23790: -- Summary: The error message length of 2000 is exceeded for scheduled query Key: HIVE-23790 URL: https://issues.apache.org/jira/browse/HIVE-23790 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi {code:java} 2020-07-01 08:24:23,916 ERROR org.apache.thrift.server.TThreadPoolServer: [pool-7-thread-189]: Error occurred during processing of message. org.datanucleus.exceptions.NucleusUserException: Attempt to store value "FAILED: Execution Error, return code 30045 from org.apache.hadoop.hive.ql.exec.repl.DirCopyTask. Permission denied: user=hive, access=WRITE, inode="/":hdfs:supergroup:drwxr-xr-x at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:496) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:336) at org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer$RangerAccessControlEnforcer.checkDefaultEnforcer(RangerHdfsAuthorizer.java:626) at org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer$RangerAccessControlEnforcer.checkRangerPermission(RangerHdfsAuthorizer.java:388) at org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer$RangerAccessControlEnforcer.checkPermissionWithContext(RangerHdfsAuthorizer.java:229) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:239) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1908) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1892) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkAncestorAccess(FSDirectory.java:1851) at org.apache.hadoop.hdfs.server.namenode.FSDirMkdirOp.mkdirs(FSDirMkdirOp.java:60) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3226) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:1130) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:729) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:528) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1070) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:985) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:913) at java.base/java.security.AccessController.doPrivileged(Native Method) at java.base/javax.security.auth.Subject.doAs(Subject.java:423) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1876) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2882) " in column ""ERROR_MESSAGE"" that has maximum length of 2000. Please correct your data! at org.datanucleus.store.rdbms.mapping.datastore.CharRDBMSMapping.setString(CharRDBMSMapping.java:254) ~[datanucleus-rdbms-4.1.19.jar:?] at org.datanucleus.store.rdbms.mapping.java.SingleFieldMapping.setString(SingleFieldMapping.java:180) ~[datanucleus-rdbms-4.1.19.jar:?] at org.datanucleus.store.rdbms.fieldmanager.ParameterSetter.storeStringField(ParameterSetter.java:158) ~[datanucleus-rdbms-4.1.19.jar:?] at org.datanucleus.state.AbstractStateManager.providedStringField(AbstractStateManager.java:1448) ~[datanucleus-core-4.1.17.jar:?] at org.datanucleus.state.StateManagerImpl.providedStringField(StateManagerImpl.java:120) ~[datanucleus-core-4.1.17.jar:?] at org.apache.hadoop.hive.metastore.model.MScheduledExecution.dnProvideField(MScheduledExecution.java) ~[hive-exec-3.1.3000.7.2.1.0-246.jar:3.1.3000.7.2.1.0-246] at org.apache.hadoop.hive.metastore.model.MScheduledExecution.dnProvideFields(MScheduledExecution.java) ~[hive-exec-3.1.3000.7.2.1.0-246.jar:3.1.3000.7.2.1.0-246] at org.datanucleus.state.StateManagerImpl.provideFields(StateManagerImpl.java:1170) ~[datanucleus-core-4.1.17.jar:?] at org.datanucleus.store.rdbms.request.UpdateRequest.execute(UpdateRequest.java:326) ~[datanucleus-rdbms-4.1.19.jar:?] at org.datanucleus.store.rdbms.RDBMSPersistenceHandler.updateObjectInTable(RDBMSPersistenceHandler.java:409) ~[datanucleus-rdbms-4.1.19.jar:?] at org.datanucleus.store.rdbms.RDBMSPersistenceHandler.updateObject(RDBMSPersistenceHandler.java:383) ~[datanucleus-rdbms-4.1.19.jar:?] at org.datanucleus.state.StateManagerImpl.flush(StateManagerImpl.java:4585) ~[datanucleus-core-4.1.17.jar:?] at org.datanucleus.flush.Fl
[jira] [Created] (HIVE-23784) Fix Replication Metrics Sink to DB
Aasha Medhi created HIVE-23784: -- Summary: Fix Replication Metrics Sink to DB Key: HIVE-23784 URL: https://issues.apache.org/jira/browse/HIVE-23784 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23755) Fix Ranger Url extra slash
Aasha Medhi created HIVE-23755: -- Summary: Fix Ranger Url extra slash Key: HIVE-23755 URL: https://issues.apache.org/jira/browse/HIVE-23755 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23697) Fix comments in the mysql metastore script
Aasha Medhi created HIVE-23697: -- Summary: Fix comments in the mysql metastore script Key: HIVE-23697 URL: https://issues.apache.org/jira/browse/HIVE-23697 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23696) DB Metadata and Progress column not taking the defined length
Aasha Medhi created HIVE-23696: -- Summary: DB Metadata and Progress column not taking the defined length Key: HIVE-23696 URL: https://issues.apache.org/jira/browse/HIVE-23696 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23668) Clean up Task for Hive Metrics
Aasha Medhi created HIVE-23668: -- Summary: Clean up Task for Hive Metrics Key: HIVE-23668 URL: https://issues.apache.org/jira/browse/HIVE-23668 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23659) Add Retry for Ranger Replication
Aasha Medhi created HIVE-23659: -- Summary: Add Retry for Ranger Replication Key: HIVE-23659 URL: https://issues.apache.org/jira/browse/HIVE-23659 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23585) Retrieve replication instance metrics details
Aasha Medhi created HIVE-23585: -- Summary: Retrieve replication instance metrics details Key: HIVE-23585 URL: https://issues.apache.org/jira/browse/HIVE-23585 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23560) Optimize bootstrap dump to abort only write Transactions
Aasha Medhi created HIVE-23560: -- Summary: Optimize bootstrap dump to abort only write Transactions Key: HIVE-23560 URL: https://issues.apache.org/jira/browse/HIVE-23560 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi Currently before doing a bootstrap dump, we abort all open transactions after waiting for a configured time. We are proposing to abort only write transactions and leave the read and repl created transactions as is. This doc talks about it in detail https://docs.google.com/document/d/1tLTg_K2EHRUaBaBfoto6l4x7726uohht3dPCGqyI_LI/edit# -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23519) Read Ranger Configs from Classpath
Aasha Medhi created HIVE-23519: -- Summary: Read Ranger Configs from Classpath Key: HIVE-23519 URL: https://issues.apache.org/jira/browse/HIVE-23519 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23516) Store hive replication policy execution metrics
Aasha Medhi created HIVE-23516: -- Summary: Store hive replication policy execution metrics Key: HIVE-23516 URL: https://issues.apache.org/jira/browse/HIVE-23516 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23474) Deny Repl Dump if the database is a target of replication
Aasha Medhi created HIVE-23474: -- Summary: Deny Repl Dump if the database is a target of replication Key: HIVE-23474 URL: https://issues.apache.org/jira/browse/HIVE-23474 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23433) Add Deny Policy on Target Database After Ranger Replication to avoid writes and repl dump
Aasha Medhi created HIVE-23433: -- Summary: Add Deny Policy on Target Database After Ranger Replication to avoid writes and repl dump Key: HIVE-23433 URL: https://issues.apache.org/jira/browse/HIVE-23433 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23432) Add Ranger Replication Metrics
Aasha Medhi created HIVE-23432: -- Summary: Add Ranger Replication Metrics Key: HIVE-23432 URL: https://issues.apache.org/jira/browse/HIVE-23432 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23362) Repl dump returns dump location and repl id even in case of failure
Aasha Medhi created HIVE-23362: -- Summary: Repl dump returns dump location and repl id even in case of failure Key: HIVE-23362 URL: https://issues.apache.org/jira/browse/HIVE-23362 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi {code:java} 03:52:13.352 [HiveServer2-Background-Pool: Thread-76] ERROR hive.log - error in initSerDe: java.lang.ClassNotFoundException Class org.apache.hive.storage.jdbc.JdbcSerDe not found java.lang.ClassNotFoundException: Class org.apache.hive.storage.jdbc.JdbcSerDe not found at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2565) ~[data_analytics_studio-event-processor-1.4.2.7.2.0.0-127.jar:?] at org.apache.hadoop.hive.metastore.HiveMetaStoreUtils.getDeserializer(HiveMetaStoreUtils.java:84) [data_analytics_studio-event-processor-1.4.2.7.2.0.0-127.jar:?] at org.apache.hadoop.hive.metastore.HiveMetaStoreUtils.getDeserializer(HiveMetaStoreUtils.java:77) [data_analytics_studio-event-processor-1.4.2.7.2.0.0-127.jar:?] at org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:329) [data_analytics_studio-event-processor-1.4.2.7.2.0.0-127.jar:?] at org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:311) [data_analytics_studio-event-processor-1.4.2.7.2.0.0-127.jar:?] at org.apache.hadoop.hive.ql.metadata.Table.getColsInternal(Table.java:711) [data_analytics_studio-event-processor-1.4.2.7.2.0.0-127.jar:?] at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:694) [data_analytics_studio-event-processor-1.4.2.7.2.0.0-127.jar:?] at org.apache.hadoop.hive.ql.metadata.Table.setStatsStateLikeNewTable(Table.java:1167) [data_analytics_studio-event-processor-1.4.2.7.2.0.0-127.jar:?] {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23351) Ranger Replication Scheduling
Aasha Medhi created HIVE-23351: -- Summary: Ranger Replication Scheduling Key: HIVE-23351 URL: https://issues.apache.org/jira/browse/HIVE-23351 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23309) Lazy Initialization of Hadoop Shims
Aasha Medhi created HIVE-23309: -- Summary: Lazy Initialization of Hadoop Shims Key: HIVE-23309 URL: https://issues.apache.org/jira/browse/HIVE-23309 Project: Hive Issue Type: Bug Reporter: Aasha Medhi Assignee: Aasha Medhi Initialize hadoop-shims only if CM is enabled -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23235) Checkpointing in repl dump failing for orc format
Aasha Medhi created HIVE-23235: -- Summary: Checkpointing in repl dump failing for orc format Key: HIVE-23235 URL: https://issues.apache.org/jira/browse/HIVE-23235 Project: Hive Issue Type: Bug Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23040) Checkpointing for repl dump incremental phase
Aasha Medhi created HIVE-23040: -- Summary: Checkpointing for repl dump incremental phase Key: HIVE-23040 URL: https://issues.apache.org/jira/browse/HIVE-23040 Project: Hive Issue Type: Bug Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23039) Checkpointing for repl dump bootstrap phase
Aasha Medhi created HIVE-23039: -- Summary: Checkpointing for repl dump bootstrap phase Key: HIVE-23039 URL: https://issues.apache.org/jira/browse/HIVE-23039 Project: Hive Issue Type: Bug Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22998) Dump partition info if hive.repl.dump.metadata.only.for.external.table conf is enabled
Aasha Medhi created HIVE-22998: -- Summary: Dump partition info if hive.repl.dump.metadata.only.for.external.table conf is enabled Key: HIVE-22998 URL: https://issues.apache.org/jira/browse/HIVE-22998 Project: Hive Issue Type: Bug Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22990) Build acknowledgement mechanism for repl dump and load
Aasha Medhi created HIVE-22990: -- Summary: Build acknowledgement mechanism for repl dump and load Key: HIVE-22990 URL: https://issues.apache.org/jira/browse/HIVE-22990 Project: Hive Issue Type: Bug Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22954) Schedule
Aasha Medhi created HIVE-22954: -- Summary: Schedule Key: HIVE-22954 URL: https://issues.apache.org/jira/browse/HIVE-22954 Project: Hive Issue Type: Bug Reporter: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22926) Scheduling Repl Dump Task using Hive scheduler
Aasha Medhi created HIVE-22926: -- Summary: Scheduling Repl Dump Task using Hive scheduler Key: HIVE-22926 URL: https://issues.apache.org/jira/browse/HIVE-22926 Project: Hive Issue Type: Bug Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22890) Repl load tries to load function if table name contains _function
Aasha Medhi created HIVE-22890: -- Summary: Repl load tries to load function if table name contains _function Key: HIVE-22890 URL: https://issues.apache.org/jira/browse/HIVE-22890 Project: Hive Issue Type: Bug Reporter: Aasha Medhi Assignee: Aasha Medhi Repl load tries to load function if table name contains _function. Similarly for the below contants {code:java} public static final String FUNCTIONS_ROOT_DIR_NAME = "_functions"; public static final String CONSTRAINTS_ROOT_DIR_NAME = "_constraints"; public static final String INC_BOOTSTRAP_ROOT_DIR_NAME = "_bootstrap"; public static final String REPL_TABLE_LIST_DIR_NAME = "_tables"; {code} The code just checks for contains(FUNCTIONS_ROOT_DIR_NAME). So even if any table or db name contains _functions, it takes the Function Load flow. Similarly for contraints etc. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22860) Support metadata only replication for external tables
Aasha Medhi created HIVE-22860: -- Summary: Support metadata only replication for external tables Key: HIVE-22860 URL: https://issues.apache.org/jira/browse/HIVE-22860 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22848) Disallow creating managed table at encryption zone root
Aasha Medhi created HIVE-22848: -- Summary: Disallow creating managed table at encryption zone root Key: HIVE-22848 URL: https://issues.apache.org/jira/browse/HIVE-22848 Project: Hive Issue Type: Bug Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22844) Validate cm configs, add retries in fs apis for cm
Aasha Medhi created HIVE-22844: -- Summary: Validate cm configs, add retries in fs apis for cm Key: HIVE-22844 URL: https://issues.apache.org/jira/browse/HIVE-22844 Project: Hive Issue Type: Bug Reporter: Aasha Medhi Assignee: Aasha Medhi # Retry create cm root logic # Validate fallbackEncryptionZone # Rename encryptionZones to cmRootLocations to be more accurate # Check cmRootEncrypted.isAbsolute() first before we go for creating anything # Validate fallbackNonEncryptedCmRootDir if it's really not encrypted # Refactor deleteTableData logic -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22843) Use bounded map for storing encryption zone to cmroot mapping
Aasha Medhi created HIVE-22843: -- Summary: Use bounded map for storing encryption zone to cmroot mapping Key: HIVE-22843 URL: https://issues.apache.org/jira/browse/HIVE-22843 Project: Hive Issue Type: Bug Reporter: Aasha Medhi Currently cm uses a hashmap to store encryption zone to cm mapping. This may lead to OOM. Analyse the same and move to bounded map if needed. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22736) Support replication across multiple encryption zones
Aasha Medhi created HIVE-22736: -- Summary: Support replication across multiple encryption zones Key: HIVE-22736 URL: https://issues.apache.org/jira/browse/HIVE-22736 Project: Hive Issue Type: Bug Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)