Re: [ANNOUNCE] Denys Kuzmenko joins Hive PMC
Congratulations Denys ! On Mon, Feb 7, 2022 at 10:36 PM Laszlo Pinter wrote: > Congrats Denys! > > On Mon, Feb 7, 2022, 6:00 PM László Bodor > wrote: > > > Congrats Denys!! > > > > Naresh P R ezt írta (időpont: 2022. febr. > 7., > > H, 17:43): > > > > > Congrats Denys, well deserved !!! > > > --- > > > Regards, > > > Naresh P R > > > > > > On Mon, Feb 7, 2022 at 8:40 AM Ashutosh Chauhan > > > wrote: > > > > > > > Hi, > > > > > > > > I'm pleased to announce that Denys has accepted an invitation to > > > > join the Hive PMC. Denys has been a consistent and helpful > > > > figure in the Hive community for which we are very grateful. We > > > > look forward to the continued contributions and support. > > > > > > > > Please join me in congratulating Denys! > > > > > > > > Ashutosh (On behalf of Hive PMC) > > > > > > > > > >
Re: [ANNOUNCE] New committer: Ayush Saxena
Congratulations Ayush. Well deserved !! On Mon, Feb 7, 2022 at 10:36 PM Laszlo Pinter wrote: > Congrats Ayush! > > On Mon, Feb 7, 2022, 5:54 PM Pravin Sinha wrote: > > > Congrats, Ayush !! > > Well deserved. Keep up the good work. > > > > ~Pravin > > > > On Mon, Feb 7, 2022 at 10:11 PM Battula, Brahma Reddy > > wrote: > > > > > Congratulations Ayush Saxena!! Well Deserved!. > > > > > > From: László Bodor > > > Date: Monday, 7 February 2022 at 9:20 PM > > > To: dev@hive.apache.org > > > Subject: Re: [ANNOUNCE] New committer: Ayush Saxena > > > Welcome Ayush, well deserved! > > > > > > Ashutosh Chauhan ezt írta (időpont: 2022. febr. > > 7., > > > H, 16:35): > > > > > > > Hi all, > > > > Apache Hive's Project Management Committee (PMC) has invited Ayush > > > > to become a committer, and we are pleased to announce that he has > > > accepted! > > > > > > > > Ayush welcome, thank you for your contributions, and we look forward > to > > > > your > > > > further interactions with the community! > > > > Ashutosh (on behalf of Hive PMC) > > > > > > > > > >
Re: [EXTERNAL] Hive meetup
+1 > On 22-Feb-2021, at 11:54 PM, Matt McCline > wrote: > > Definitely interested. > > -Original Message- > From: Zoltan Haindrich > Sent: Monday, February 22, 2021 10:17 AM > To: dev@hive.apache.org > Subject: [EXTERNAL] Hive meetup > > Hey All! > > It was quite some time ago when we had a meetup - and in these covid times it > would be online-only anyway :) We were mentioning this lately here and there > at Cloudera. > I think we could have a few talks spanning 2-3 hours or so. > > Are there any interest in it? > > I would be happy to talk about how hive-test-kube works and how hive-dev-box > is employed during testing. > > cheers, > Zoltan
[jira] [Created] (HIVE-24676) show locks call failing for postgres RDBMS if the txnId filter is passed
Aasha Medhi created HIVE-24676: -- Summary: show locks call failing for postgres RDBMS if the txnId filter is passed Key: HIVE-24676 URL: https://issues.apache.org/jira/browse/HIVE-24676 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24558) Handle update in table level regular expression.
Aasha Medhi created HIVE-24558: -- Summary: Handle update in table level regular expression. Key: HIVE-24558 URL: https://issues.apache.org/jira/browse/HIVE-24558 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24502) Store table level regular expression used during dump for table level replication
Aasha Medhi created HIVE-24502: -- Summary: Store table level regular expression used during dump for table level replication Key: HIVE-24502 URL: https://issues.apache.org/jira/browse/HIVE-24502 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24371) Ranger Replication fallback to updateIfExists
Aasha Medhi created HIVE-24371: -- Summary: Ranger Replication fallback to updateIfExists Key: HIVE-24371 URL: https://issues.apache.org/jira/browse/HIVE-24371 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi Ranger Replication fallback to updateIfExists Add dummy resource as workaround while creating the deny policy to avoid it from overriding the actual policy -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24328) Run distcp in parallel for all file entries in repl load.
Aasha Medhi created HIVE-24328: -- Summary: Run distcp in parallel for all file entries in repl load. Key: HIVE-24328 URL: https://issues.apache.org/jira/browse/HIVE-24328 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24306) Launch single copy task for single batch of partitions in repl load for managed table
Aasha Medhi created HIVE-24306: -- Summary: Launch single copy task for single batch of partitions in repl load for managed table Key: HIVE-24306 URL: https://issues.apache.org/jira/browse/HIVE-24306 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24254) Remove setOwner call in ReplChangeManager
Aasha Medhi created HIVE-24254: -- Summary: Remove setOwner call in ReplChangeManager Key: HIVE-24254 URL: https://issues.apache.org/jira/browse/HIVE-24254 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24246) Fix for Ranger Deny policy overriding policy with same resource name
Aasha Medhi created HIVE-24246: -- Summary: Fix for Ranger Deny policy overriding policy with same resource name Key: HIVE-24246 URL: https://issues.apache.org/jira/browse/HIVE-24246 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24215) Total function count is incorrect in Replication Metrics
Aasha Medhi created HIVE-24215: -- Summary: Total function count is incorrect in Replication Metrics Key: HIVE-24215 URL: https://issues.apache.org/jira/browse/HIVE-24215 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24197) Check for write transactions for the db under replication at a frequent interval
Aasha Medhi created HIVE-24197: -- Summary: Check for write transactions for the db under replication at a frequent interval Key: HIVE-24197 URL: https://issues.apache.org/jira/browse/HIVE-24197 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24134) Revert deletion of HiveStrictManagedMigration
Aasha Medhi created HIVE-24134: -- Summary: Revert deletion of HiveStrictManagedMigration Key: HIVE-24134 URL: https://issues.apache.org/jira/browse/HIVE-24134 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi Partial revert of https://issues.apache.org/jira/browse/HIVE-23995 to keep the migration code -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24127) Dump events from default catalog only
Aasha Medhi created HIVE-24127: -- Summary: Dump events from default catalog only Key: HIVE-24127 URL: https://issues.apache.org/jira/browse/HIVE-24127 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi Don't dump events from spark catalog. In bootstrap we skip spark tables. In inceremental load also we should skip spark events. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24117) Fix for not setting managed table location in incremental load
Aasha Medhi created HIVE-24117: -- Summary: Fix for not setting managed table location in incremental load Key: HIVE-24117 URL: https://issues.apache.org/jira/browse/HIVE-24117 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24109) Load partitions in parallel for managed tables in the bootstrap phase
Aasha Medhi created HIVE-24109: -- Summary: Load partitions in parallel for managed tables in the bootstrap phase Key: HIVE-24109 URL: https://issues.apache.org/jira/browse/HIVE-24109 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24102) Add ENGINE=InnoDB for replication mysql schema changes
Aasha Medhi created HIVE-24102: -- Summary: Add ENGINE=InnoDB for replication mysql schema changes Key: HIVE-24102 URL: https://issues.apache.org/jira/browse/HIVE-24102 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24095) Load partitions in parallel in the bootstrap phase
Aasha Medhi created HIVE-24095: -- Summary: Load partitions in parallel in the bootstrap phase Key: HIVE-24095 URL: https://issues.apache.org/jira/browse/HIVE-24095 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24032) Remove hadoop shims dependency and use FileSystem Api directly from standalone metastore
Aasha Medhi created HIVE-24032: -- Summary: Remove hadoop shims dependency and use FileSystem Api directly from standalone metastore Key: HIVE-24032 URL: https://issues.apache.org/jira/browse/HIVE-24032 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24019) Flaky test AsyncResponseHandlerTest
Aasha Medhi created HIVE-24019: -- Summary: Flaky test AsyncResponseHandlerTest Key: HIVE-24019 URL: https://issues.apache.org/jira/browse/HIVE-24019 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Mustafa Iman -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23995) Don't set location for managed tables in case of repl load
Aasha Medhi created HIVE-23995: -- Summary: Don't set location for managed tables in case of repl load Key: HIVE-23995 URL: https://issues.apache.org/jira/browse/HIVE-23995 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23993) Handle irrecoverable errors
Aasha Medhi created HIVE-23993: -- Summary: Handle irrecoverable errors Key: HIVE-23993 URL: https://issues.apache.org/jira/browse/HIVE-23993 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23961) Enable external table replication by default
Aasha Medhi created HIVE-23961: -- Summary: Enable external table replication by default Key: HIVE-23961 URL: https://issues.apache.org/jira/browse/HIVE-23961 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23955) Classification of Error Codes in Replication
Aasha Medhi created HIVE-23955: -- Summary: Classification of Error Codes in Replication Key: HIVE-23955 URL: https://issues.apache.org/jira/browse/HIVE-23955 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23897) Create a common Retry Interface for replication
Aasha Medhi created HIVE-23897: -- Summary: Create a common Retry Interface for replication Key: HIVE-23897 URL: https://issues.apache.org/jira/browse/HIVE-23897 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23881) Deprecate get_open_txns to use get_open_txns_req method.
Aasha Medhi created HIVE-23881: -- Summary: Deprecate get_open_txns to use get_open_txns_req method. Key: HIVE-23881 URL: https://issues.apache.org/jira/browse/HIVE-23881 Project: Hive Issue Type: Task Reporter: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23863) Use the current UGI to make calls to Ranger Service
Aasha Medhi created HIVE-23863: -- Summary: Use the current UGI to make calls to Ranger Service Key: HIVE-23863 URL: https://issues.apache.org/jira/browse/HIVE-23863 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23813) Fix Flaky tests due to JDO ConnectionException
Aasha Medhi created HIVE-23813: -- Summary: Fix Flaky tests due to JDO ConnectionException Key: HIVE-23813 URL: https://issues.apache.org/jira/browse/HIVE-23813 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23790) The error message length of 2000 is exceeded for scheduled query
Aasha Medhi created HIVE-23790:
--
Summary: The error message length of 2000 is exceeded for
scheduled query
Key: HIVE-23790
URL: https://issues.apache.org/jira/browse/HIVE-23790
Project: Hive
Issue Type: Task
Reporter: Aasha Medhi
Assignee: Aasha Medhi
{code:java}
2020-07-01 08:24:23,916 ERROR org.apache.thrift.server.TThreadPoolServer:
[pool-7-thread-189]: Error occurred during processing of message.
org.datanucleus.exceptions.NucleusUserException: Attempt to store value
"FAILED: Execution Error, return code 30045 from
org.apache.hadoop.hive.ql.exec.repl.DirCopyTask. Permission denied: user=hive,
access=WRITE, inode="/":hdfs:supergroup:drwxr-xr-x
at
org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:496)
at
org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:336)
at
org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer$RangerAccessControlEnforcer.checkDefaultEnforcer(RangerHdfsAuthorizer.java:626)
at
org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer$RangerAccessControlEnforcer.checkRangerPermission(RangerHdfsAuthorizer.java:388)
at
org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer$RangerAccessControlEnforcer.checkPermissionWithContext(RangerHdfsAuthorizer.java:229)
at
org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:239)
at
org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1908)
at
org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1892)
at
org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkAncestorAccess(FSDirectory.java:1851)
at
org.apache.hadoop.hdfs.server.namenode.FSDirMkdirOp.mkdirs(FSDirMkdirOp.java:60)
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3226)
at
org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:1130)
at
org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:729)
at
org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:528)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1070)
at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:985)
at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:913)
at java.base/java.security.AccessController.doPrivileged(Native Method)
at java.base/javax.security.auth.Subject.doAs(Subject.java:423)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1876)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2882)
" in column ""ERROR_MESSAGE"" that has maximum length of 2000. Please correct
your data!
at
org.datanucleus.store.rdbms.mapping.datastore.CharRDBMSMapping.setString(CharRDBMSMapping.java:254)
~[datanucleus-rdbms-4.1.19.jar:?]
at
org.datanucleus.store.rdbms.mapping.java.SingleFieldMapping.setString(SingleFieldMapping.java:180)
~[datanucleus-rdbms-4.1.19.jar:?]
at
org.datanucleus.store.rdbms.fieldmanager.ParameterSetter.storeStringField(ParameterSetter.java:158)
~[datanucleus-rdbms-4.1.19.jar:?]
at
org.datanucleus.state.AbstractStateManager.providedStringField(AbstractStateManager.java:1448)
~[datanucleus-core-4.1.17.jar:?]
at
org.datanucleus.state.StateManagerImpl.providedStringField(StateManagerImpl.java:120)
~[datanucleus-core-4.1.17.jar:?]
at
org.apache.hadoop.hive.metastore.model.MScheduledExecution.dnProvideField(MScheduledExecution.java)
~[hive-exec-3.1.3000.7.2.1.0-246.jar:3.1.3000.7.2.1.0-246]
at
org.apache.hadoop.hive.metastore.model.MScheduledExecution.dnProvideFields(MScheduledExecution.java)
~[hive-exec-3.1.3000.7.2.1.0-246.jar:3.1.3000.7.2.1.0-246]
at
org.datanucleus.state.StateManagerImpl.provideFields(StateManagerImpl.java:1170)
~[datanucleus-core-4.1.17.jar:?]
at
org.datanucleus.store.rdbms.request.UpdateRequest.execute(UpdateRequest.java:326)
~[datanucleus-rdbms-4.1.19.jar:?]
at
org.datanucleus.store.rdbms.RDBMSPersistenceHandler.updateObjectInTable(RDBMSPersistenceHandler.java:409)
~[datanucleus-rdbms-4.1.19.jar:?]
at
org.datanucleus.store.rdbms.RDBMSPersistenceHandler.updateObject(RDBMSPersistenceHandler.java:383)
~[datanucleus-rdbms-4.1.19.jar:?]
at
org.datanucleus.state.StateManagerImpl.flush(StateManagerImpl.j
[jira] [Created] (HIVE-23784) Fix Replication Metrics Sink to DB
Aasha Medhi created HIVE-23784: -- Summary: Fix Replication Metrics Sink to DB Key: HIVE-23784 URL: https://issues.apache.org/jira/browse/HIVE-23784 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23755) Fix Ranger Url extra slash
Aasha Medhi created HIVE-23755: -- Summary: Fix Ranger Url extra slash Key: HIVE-23755 URL: https://issues.apache.org/jira/browse/HIVE-23755 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23697) Fix comments in the mysql metastore script
Aasha Medhi created HIVE-23697: -- Summary: Fix comments in the mysql metastore script Key: HIVE-23697 URL: https://issues.apache.org/jira/browse/HIVE-23697 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23696) DB Metadata and Progress column not taking the defined length
Aasha Medhi created HIVE-23696: -- Summary: DB Metadata and Progress column not taking the defined length Key: HIVE-23696 URL: https://issues.apache.org/jira/browse/HIVE-23696 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23668) Clean up Task for Hive Metrics
Aasha Medhi created HIVE-23668: -- Summary: Clean up Task for Hive Metrics Key: HIVE-23668 URL: https://issues.apache.org/jira/browse/HIVE-23668 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23659) Add Retry for Ranger Replication
Aasha Medhi created HIVE-23659: -- Summary: Add Retry for Ranger Replication Key: HIVE-23659 URL: https://issues.apache.org/jira/browse/HIVE-23659 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23585) Retrieve replication instance metrics details
Aasha Medhi created HIVE-23585: -- Summary: Retrieve replication instance metrics details Key: HIVE-23585 URL: https://issues.apache.org/jira/browse/HIVE-23585 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23560) Optimize bootstrap dump to abort only write Transactions
Aasha Medhi created HIVE-23560: -- Summary: Optimize bootstrap dump to abort only write Transactions Key: HIVE-23560 URL: https://issues.apache.org/jira/browse/HIVE-23560 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi Currently before doing a bootstrap dump, we abort all open transactions after waiting for a configured time. We are proposing to abort only write transactions and leave the read and repl created transactions as is. This doc talks about it in detail https://docs.google.com/document/d/1tLTg_K2EHRUaBaBfoto6l4x7726uohht3dPCGqyI_LI/edit# -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23519) Read Ranger Configs from Classpath
Aasha Medhi created HIVE-23519: -- Summary: Read Ranger Configs from Classpath Key: HIVE-23519 URL: https://issues.apache.org/jira/browse/HIVE-23519 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23516) Store hive replication policy execution metrics
Aasha Medhi created HIVE-23516: -- Summary: Store hive replication policy execution metrics Key: HIVE-23516 URL: https://issues.apache.org/jira/browse/HIVE-23516 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23474) Deny Repl Dump if the database is a target of replication
Aasha Medhi created HIVE-23474: -- Summary: Deny Repl Dump if the database is a target of replication Key: HIVE-23474 URL: https://issues.apache.org/jira/browse/HIVE-23474 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23433) Add Deny Policy on Target Database After Ranger Replication to avoid writes and repl dump
Aasha Medhi created HIVE-23433: -- Summary: Add Deny Policy on Target Database After Ranger Replication to avoid writes and repl dump Key: HIVE-23433 URL: https://issues.apache.org/jira/browse/HIVE-23433 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23432) Add Ranger Replication Metrics
Aasha Medhi created HIVE-23432: -- Summary: Add Ranger Replication Metrics Key: HIVE-23432 URL: https://issues.apache.org/jira/browse/HIVE-23432 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23362) Repl dump returns dump location and repl id even in case of failure
Aasha Medhi created HIVE-23362:
--
Summary: Repl dump returns dump location and repl id even in case
of failure
Key: HIVE-23362
URL: https://issues.apache.org/jira/browse/HIVE-23362
Project: Hive
Issue Type: Task
Reporter: Aasha Medhi
Assignee: Aasha Medhi
{code:java}
03:52:13.352 [HiveServer2-Background-Pool: Thread-76] ERROR hive.log - error in
initSerDe: java.lang.ClassNotFoundException Class
org.apache.hive.storage.jdbc.JdbcSerDe not found
java.lang.ClassNotFoundException: Class org.apache.hive.storage.jdbc.JdbcSerDe
not found
at
org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2565)
~[data_analytics_studio-event-processor-1.4.2.7.2.0.0-127.jar:?]
at
org.apache.hadoop.hive.metastore.HiveMetaStoreUtils.getDeserializer(HiveMetaStoreUtils.java:84)
[data_analytics_studio-event-processor-1.4.2.7.2.0.0-127.jar:?]
at
org.apache.hadoop.hive.metastore.HiveMetaStoreUtils.getDeserializer(HiveMetaStoreUtils.java:77)
[data_analytics_studio-event-processor-1.4.2.7.2.0.0-127.jar:?]
at
org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:329)
[data_analytics_studio-event-processor-1.4.2.7.2.0.0-127.jar:?]
at
org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:311)
[data_analytics_studio-event-processor-1.4.2.7.2.0.0-127.jar:?]
at
org.apache.hadoop.hive.ql.metadata.Table.getColsInternal(Table.java:711)
[data_analytics_studio-event-processor-1.4.2.7.2.0.0-127.jar:?]
at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:694)
[data_analytics_studio-event-processor-1.4.2.7.2.0.0-127.jar:?]
at
org.apache.hadoop.hive.ql.metadata.Table.setStatsStateLikeNewTable(Table.java:1167)
[data_analytics_studio-event-processor-1.4.2.7.2.0.0-127.jar:?]
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HIVE-23351) Ranger Replication Scheduling
Aasha Medhi created HIVE-23351: -- Summary: Ranger Replication Scheduling Key: HIVE-23351 URL: https://issues.apache.org/jira/browse/HIVE-23351 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23309) Lazy Initialization of Hadoop Shims
Aasha Medhi created HIVE-23309: -- Summary: Lazy Initialization of Hadoop Shims Key: HIVE-23309 URL: https://issues.apache.org/jira/browse/HIVE-23309 Project: Hive Issue Type: Bug Reporter: Aasha Medhi Assignee: Aasha Medhi Initialize hadoop-shims only if CM is enabled -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23235) Checkpointing in repl dump failing for orc format
Aasha Medhi created HIVE-23235: -- Summary: Checkpointing in repl dump failing for orc format Key: HIVE-23235 URL: https://issues.apache.org/jira/browse/HIVE-23235 Project: Hive Issue Type: Bug Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23040) Checkpointing for repl dump incremental phase
Aasha Medhi created HIVE-23040: -- Summary: Checkpointing for repl dump incremental phase Key: HIVE-23040 URL: https://issues.apache.org/jira/browse/HIVE-23040 Project: Hive Issue Type: Bug Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23039) Checkpointing for repl dump bootstrap phase
Aasha Medhi created HIVE-23039: -- Summary: Checkpointing for repl dump bootstrap phase Key: HIVE-23039 URL: https://issues.apache.org/jira/browse/HIVE-23039 Project: Hive Issue Type: Bug Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22998) Dump partition info if hive.repl.dump.metadata.only.for.external.table conf is enabled
Aasha Medhi created HIVE-22998: -- Summary: Dump partition info if hive.repl.dump.metadata.only.for.external.table conf is enabled Key: HIVE-22998 URL: https://issues.apache.org/jira/browse/HIVE-22998 Project: Hive Issue Type: Bug Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22990) Build acknowledgement mechanism for repl dump and load
Aasha Medhi created HIVE-22990: -- Summary: Build acknowledgement mechanism for repl dump and load Key: HIVE-22990 URL: https://issues.apache.org/jira/browse/HIVE-22990 Project: Hive Issue Type: Bug Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22954) Schedule
Aasha Medhi created HIVE-22954: -- Summary: Schedule Key: HIVE-22954 URL: https://issues.apache.org/jira/browse/HIVE-22954 Project: Hive Issue Type: Bug Reporter: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22926) Scheduling Repl Dump Task using Hive scheduler
Aasha Medhi created HIVE-22926: -- Summary: Scheduling Repl Dump Task using Hive scheduler Key: HIVE-22926 URL: https://issues.apache.org/jira/browse/HIVE-22926 Project: Hive Issue Type: Bug Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22890) Repl load tries to load function if table name contains _function
Aasha Medhi created HIVE-22890:
--
Summary: Repl load tries to load function if table name contains
_function
Key: HIVE-22890
URL: https://issues.apache.org/jira/browse/HIVE-22890
Project: Hive
Issue Type: Bug
Reporter: Aasha Medhi
Assignee: Aasha Medhi
Repl load tries to load function if table name contains _function. Similarly
for the below contants
{code:java}
public static final String FUNCTIONS_ROOT_DIR_NAME = "_functions";
public static final String CONSTRAINTS_ROOT_DIR_NAME = "_constraints";
public static final String INC_BOOTSTRAP_ROOT_DIR_NAME = "_bootstrap";
public static final String REPL_TABLE_LIST_DIR_NAME = "_tables";
{code}
The code just checks for contains(FUNCTIONS_ROOT_DIR_NAME). So even if any
table or db name contains _functions, it takes the Function Load flow.
Similarly for contraints etc.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HIVE-22860) Support metadata only replication for external tables
Aasha Medhi created HIVE-22860: -- Summary: Support metadata only replication for external tables Key: HIVE-22860 URL: https://issues.apache.org/jira/browse/HIVE-22860 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22848) Disallow creating managed table at encryption zone root
Aasha Medhi created HIVE-22848: -- Summary: Disallow creating managed table at encryption zone root Key: HIVE-22848 URL: https://issues.apache.org/jira/browse/HIVE-22848 Project: Hive Issue Type: Bug Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22844) Validate cm configs, add retries in fs apis for cm
Aasha Medhi created HIVE-22844: -- Summary: Validate cm configs, add retries in fs apis for cm Key: HIVE-22844 URL: https://issues.apache.org/jira/browse/HIVE-22844 Project: Hive Issue Type: Bug Reporter: Aasha Medhi Assignee: Aasha Medhi # Retry create cm root logic # Validate fallbackEncryptionZone # Rename encryptionZones to cmRootLocations to be more accurate # Check cmRootEncrypted.isAbsolute() first before we go for creating anything # Validate fallbackNonEncryptedCmRootDir if it's really not encrypted # Refactor deleteTableData logic -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22843) Use bounded map for storing encryption zone to cmroot mapping
Aasha Medhi created HIVE-22843: -- Summary: Use bounded map for storing encryption zone to cmroot mapping Key: HIVE-22843 URL: https://issues.apache.org/jira/browse/HIVE-22843 Project: Hive Issue Type: Bug Reporter: Aasha Medhi Currently cm uses a hashmap to store encryption zone to cm mapping. This may lead to OOM. Analyse the same and move to bounded map if needed. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22736) Support replication across multiple encryption zones
Aasha Medhi created HIVE-22736: -- Summary: Support replication across multiple encryption zones Key: HIVE-22736 URL: https://issues.apache.org/jira/browse/HIVE-22736 Project: Hive Issue Type: Bug Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
