Re: Metastore Client listPartitionSpecs and listPartitionsWithAuthInfo

2020-04-20 Thread William Shen
and org.apache.hadoop.hive.metastore.HiveMetaStoreClient#dropPartition On Mon, Apr 20, 2020 at 4:28 PM William Shen wrote: > Hi all, > > I am investigating the source get_partitions_with_auth calls in my > metastore audit log. However, as I narrowed down to a specific Spark job > based on the table accessed and the context of

Metastore Client listPartitionSpecs and listPartitionsWithAuthInfo

2020-04-20 Thread William Shen
Hi all, I am investigating the source get_partitions_with_auth calls in my metastore audit log. However, as I narrowed down to a specific Spark job based on the table accessed and the context of the surrounding calls, I could not make sense of how the job issued the call... The job invoked only

Running multiple HMS pointing to the same MySQL

2020-02-14 Thread William Shen
Hi, We're thinking about running multiple instances of Hive Metastore Server (pointing to the same MySQL store) to tackle the HMS load issue we're experiencing. We're thinking about having READ only use cases contact one HMS and the mixed/heavier use cases contact the other HMS. In the past, we

Re: Converting Hive Column from Varchar to String

2019-07-18 Thread William Shen
t; > On Thu, Jul 18, 2019 at 8:27 AM Devopam Mittra wrote: > >> The table has data in it perhaps that is beyond ASCII. >> Easier way is to go for additional column , update with data and the drop >> the older one after validation of records in String type col. >> &

Re: Converting Hive Column from Varchar to String

2019-07-17 Thread William Shen
: No On Wed, Jul 17, 2019 at 4:14 PM William Shen wrote: > Hi all, > > I assumed that it should be compatible to convert column type varchar to > string, however, after running ALTER TABLE table CHANGE col col STRING, I > encounter the following error when querying the column from h

Converting Hive Column from Varchar to String

2019-07-17 Thread William Shen
Hi all, I assumed that it should be compatible to convert column type varchar to string, however, after running ALTER TABLE table CHANGE col col STRING, I encounter the following error when querying the column from hive: Failed with exception