----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/56191/#review163935 -----------------------------------------------------------
Fix it, then Ship it! sentry-provider/sentry-provider-db/src/main/java/org/apache/sentry/service/thrift/HMSFollower.java (line 73) <https://reviews.apache.org/r/56191/#comment235464> Would be good to make retry times and sleep time configurable. Also retries for 10 times, is it too much? - Hao Hao On Feb. 2, 2017, 5:11 a.m., Vamsee Yarlagadda wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/56191/ > ----------------------------------------------------------- > > (Updated Feb. 2, 2017, 5:11 a.m.) > > > Review request for sentry, Alexander Kolbasov, Lei Xu, Hao Hao, kalyan kumar > kalvagadda, and Vadim Spector. > > > Repository: sentry > > > Description > ------- > > SENTRY-1619: Fix the secure HMS connection code in HMSFollower > -- HMSFollower has bugs in implementing logic that's preventing secure HMS > connection from taking place. > > 1. Need to use the right principal and keytab to use for the connection. > 2. Fix the while blocks to allow the connection setup to happen. > > > Diffs > ----- > > > sentry-provider/sentry-provider-db/src/main/java/org/apache/sentry/service/thrift/HMSFollower.java > 749c2ce8f89fe5960af5a4b48ff45a38091350f4 > > Diff: https://reviews.apache.org/r/56191/diff/ > > > Testing > ------- > > Sentry server log: > ```bash > 2017-02-01 14:02:48,537 INFO org.apache.sentry.service.thrift.HMSFollower: > HMSFollower is being initialized > 2017-02-01 14:02:50,545 INFO DataNucleus.Persistence: Property > datanucleus.cache.level2 unknown - will be ignored > 2017-02-01 14:02:51,911 WARN com.jolbox.bonecp.BoneCPConfig: Max Connections > < 1. Setting to 20 > 2017-02-01 14:02:57,186 WARN com.jolbox.bonecp.BoneCPConfig: Max Connections > < 1. Setting to 20 > 2017-02-01 14:02:57,335 INFO org.apache.sentry.service.thrift.SentryService: > Attempting to start... > 2017-02-01 14:02:57,345 INFO > org.apache.sentry.service.thrift.SentryKerberosContext: Logging in with new > Context > 2017-02-01 14:02:57,403 INFO org.apache.sentry.service.thrift.SentryService: > ProcessorFactory being used: > org.apache.sentry.provider.db.service.thrift.SentryPolicyStoreProcessorFactory > 2017-02-01 14:02:57,711 INFO DataNucleus.Persistence: Property > datanucleus.cache.level2 unknown - will be ignored > 2017-02-01 14:02:58,969 WARN com.jolbox.bonecp.BoneCPConfig: Max Connections > < 1. Setting to 20 > 2017-02-01 14:02:59,035 WARN com.jolbox.bonecp.BoneCPConfig: Max Connections > < 1. Setting to 20 > 2017-02-01 14:02:59,533 INFO org.apache.sentry.hdfs.SentryPlugin: Sentry HDFS > plugin initialized !! > 2017-02-01 14:02:59,561 INFO org.apache.sentry.service.thrift.SentryService: > ProcessorFactory being used: > org.apache.sentry.provider.db.generic.service.thrift.SentryGenericPolicyProcessorFactory > 2017-02-01 14:02:59,699 INFO DataNucleus.Persistence: Property > datanucleus.cache.level2 unknown - will be ignored > 2017-02-01 14:03:00,776 WARN com.jolbox.bonecp.BoneCPConfig: Max Connections > < 1. Setting to 20 > 2017-02-01 14:03:00,854 WARN com.jolbox.bonecp.BoneCPConfig: Max Connections > < 1. Setting to 20 > 2017-02-01 14:03:00,917 INFO org.apache.sentry.service.thrift.SentryService: > ProcessorFactory being used: > org.apache.sentry.hdfs.SentryHDFSServiceProcessorFactory > 2017-02-01 14:03:00,917 INFO > org.apache.sentry.hdfs.SentryHDFSServiceProcessorFactory: Calling > registerProcessor from SentryHDFSServiceProcessorFactory > 2017-02-01 14:03:00,945 INFO org.apache.sentry.service.thrift.SentryService: > Serving on nightly-1.gce.cloudera.com/172.31.112.33:8038 > 2017-02-01 14:03:01,133 INFO org.eclipse.jetty.server.Server: > jetty-7.6.16.v20140903 > 2017-02-01 14:03:01,159 INFO org.eclipse.jetty.server.handler.ContextHandler: > started o.e.j.s.h.ContextHandler{/,null} > 2017-02-01 14:03:01,180 INFO org.eclipse.jetty.server.handler.ContextHandler: > started o.e.j.s.ServletContextHandler{/,null} > 2017-02-01 14:03:01,211 INFO org.eclipse.jetty.server.AbstractConnector: > Started [email protected]:29000 > 2017-02-01 14:03:01,510 WARN org.apache.sentry.hdfs.SentryPlugin: Recieved > Authz Path FULL update [6].. > > 2017-02-01 14:04:23,514 INFO org.apache.sentry.service.thrift.HMSFollower: > Making a kerberos connection to HMS > 2017-02-01 14:04:46,255 INFO org.apache.sentry.service.thrift.HMSFollower: > Using kerberos principal: sentry/[email protected] > 2017-02-01 14:05:15,016 INFO > org.apache.sentry.service.thrift.SentryKerberosContext: Logging in with new > Context > 2017-02-01 14:05:20,783 INFO org.apache.sentry.service.thrift.HMSFollower: > Established kerberos context, will now connect to HMS > 2017-02-01 14:05:35,212 INFO hive.metastore: Trying to connect to metastore > with URI thrift://nightly-1.gce.cloudera.com:9083 > 2017-02-01 14:05:37,210 INFO hive.metastore: Opened a connection to > metastore, current connections: 1 > 2017-02-01 14:05:37,212 INFO hive.metastore: Connected to metastore. > > ``` > > > Sentry server log (Intentionally bringing down HMS makes the HMSFollower > thread to start the processing again) > ```bash > 2017-02-01 19:03:41,793 INFO hive.metastore: Waiting 1 seconds before next > connection attempt. > 2017-02-01 19:03:47,708 ERROR org.apache.sentry.service.thrift.HMSFollower: > Cannot connect to HMS > java.security.PrivilegedActionException: MetaException(message:Could not > connect to meta store using any of the URIs provided. Most recent failure: > org.apache.thrift.transport.TTransportException: java.net.ConnectException: > Connection refused > at org.apache.thrift.transport.TSocket.open(TSocket.java:226) > at > org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:266) > at > org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37) > at > org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52) > at > org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1848) > at > org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49) > at > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:464) > at > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:244) > at > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:187) > at > org.apache.sentry.service.thrift.HMSFollower$1.run(HMSFollower.java:179) > at > org.apache.sentry.service.thrift.HMSFollower$1.run(HMSFollower.java:176) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at > org.apache.sentry.service.thrift.HMSFollower.getMetaStoreClient(HMSFollower.java:176) > at > org.apache.sentry.service.thrift.HMSFollower.run(HMSFollower.java:206) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.net.ConnectException: Connection refused > at java.net.PlainSocketImpl.socketConnect(Native Method) > at > java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) > at > java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) > at > java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) > at java.net.Socket.connect(Socket.java:579) > at org.apache.thrift.transport.TSocket.open(TSocket.java:221) > ... 24 more > ) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at > org.apache.sentry.service.thrift.HMSFollower.getMetaStoreClient(HMSFollower.java:176) > at > org.apache.sentry.service.thrift.HMSFollower.run(HMSFollower.java:206) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > Caused by: MetaException(message:Could not connect to meta store using any of > the URIs provided. Most recent failure: > org.apache.thrift.transport.TTransportException: java.net.ConnectException: > Connection refused > at org.apache.thrift.transport.TSocket.open(TSocket.java:226) > at > org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:266) > at > org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37) > at > org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52) > at > org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1848) > at > org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49) > at > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:464) > at > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:244) > at > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:187) > at > org.apache.sentry.service.thrift.HMSFollower$1.run(HMSFollower.java:179) > at > org.apache.sentry.service.thrift.HMSFollower$1.run(HMSFollower.java:176) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at > org.apache.sentry.service.thrift.HMSFollower.getMetaStoreClient(HMSFollower.java:176) > at > org.apache.sentry.service.thrift.HMSFollower.run(HMSFollower.java:206) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.net.ConnectException: Connection refused > at java.net.PlainSocketImpl.socketConnect(Native Method) > at > java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) > at > java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) > at > java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) > at java.net.Socket.connect(Socket.java:579) > at org.apache.thrift.transport.TSocket.open(TSocket.java:221) > ... 24 more > ) > at > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:512) > at > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:244) > at > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:187) > at > org.apache.sentry.service.thrift.HMSFollower$1.run(HMSFollower.java:179) > at > org.apache.sentry.service.thrift.HMSFollower$1.run(HMSFollower.java:176) > ... 11 more > 2017-02-01 19:11:34,913 INFO org.apache.sentry.SentryMain: Configuring log4j > to use > [/var/run/cloudera-scm-agent/process/745-sentry-SENTRY_SERVER/sentry-log4j.properties] > 2017-02-01 19:11:35,364 INFO org.apache.sentry.service.thrift.SentryService: > Configured on address nightly-1.gce.cloudera.com/172.31.112.33:8038 > 2017-02-01 19:11:35,371 INFO org.apache.sentry.service.thrift.SentryService: > Using kerberos principal: sentry/[email protected] > 2017-02-01 19:11:35,402 INFO > org.apache.sentry.service.thrift.LeaderStatusMonitor: Leader election > protocol disabled, assuming single active server > 2017-02-01 19:11:36,746 INFO org.apache.sentry.service.thrift.HMSFollower: > HMSFollower is being initialized > 2017-02-01 19:11:37,795 INFO DataNucleus.Persistence: Property > datanucleus.cache.level2 unknown - will be ignored > 2017-02-01 19:11:38,272 WARN com.jolbox.bonecp.BoneCPConfig: Max Connections > < 1. Setting to 20 > 2017-02-01 19:11:41,771 WARN com.jolbox.bonecp.BoneCPConfig: Max Connections > < 1. Setting to 20 > 2017-02-01 19:11:41,868 INFO org.apache.sentry.service.thrift.SentryService: > Attempting to start... > 2017-02-01 19:11:41,874 INFO > org.apache.sentry.service.thrift.SentryKerberosContext: Logging in with new > Context > 2017-02-01 19:11:41,917 INFO org.apache.sentry.service.thrift.SentryService: > ProcessorFactory being used: > org.apache.sentry.provider.db.service.thrift.SentryPolicyStoreProcessorFactory > 2017-02-01 19:11:42,047 INFO DataNucleus.Persistence: Property > datanucleus.cache.level2 unknown - will be ignored > > > 2017-02-01 19:11:43,213 WARN com.jolbox.bonecp.BoneCPConfig: Max Connections > < 1. Setting to 20 > > 2017-02-01 19:11:43,321 WARN com.jolbox.bonecp.BoneCPConfig: Max Connections > < 1. Setting to 20 > > 2017-02-01 19:11:43,422 INFO org.apache.sentry.service.thrift.SentryService: > ProcessorFactory being used: > org.apache.sentry.provider.db.generic.service.thrift.SentryGenericPolicyProcessorFactory > > 2017-02-01 19:11:43,789 INFO DataNucleus.Persistence: Property > datanucleus.cache.level2 unknown - will be ignored > 2017-02-01 19:11:45,182 WARN com.jolbox.bonecp.BoneCPConfig: Max Connections > < 1. Setting to 20 > 2017-02-01 19:11:45,281 WARN com.jolbox.bonecp.BoneCPConfig: Max Connections > < 1. Setting to 20 > 2017-02-01 19:11:45,395 INFO org.apache.sentry.service.thrift.SentryService: > Serving on nightly-1.gce.cloudera.com/172.31.112.33:8038 > 2017-02-01 19:11:45,566 INFO org.eclipse.jetty.server.Server: > jetty-7.6.16.v20140903 > 2017-02-01 19:11:45,581 INFO org.eclipse.jetty.server.handler.ContextHandler: > started o.e.j.s.h.ContextHandler{/,null} > 2017-02-01 19:11:45,593 INFO org.eclipse.jetty.server.handler.ContextHandler: > started o.e.j.s.ServletContextHandler{/,null} > 2017-02-01 19:11:45,615 INFO org.eclipse.jetty.server.AbstractConnector: > Started [email protected]:29000 > 2017-02-01 19:12:42,458 INFO org.apache.sentry.service.thrift.HMSFollower: > Making a kerberos connection to HMS > 2017-02-01 19:12:42,458 INFO org.apache.sentry.service.thrift.HMSFollower: > Using kerberos principal: sentry/[email protected] > 2017-02-01 19:12:42,459 INFO > org.apache.sentry.service.thrift.SentryKerberosContext: Logging in with new > Context > 2017-02-01 19:12:42,461 INFO org.apache.sentry.service.thrift.HMSFollower: > Established kerberos context, will now connect to HMS > 2017-02-01 19:13:19,631 INFO hive.metastore: Trying to connect to metastore > with URI thrift://nightly-1.gce.cloudera.com:9083 > 2017-02-01 19:13:21,035 WARN hive.metastore: Failed to connect to the > MetaStore Server... > 2017-02-01 19:13:21,035 INFO hive.metastore: Waiting 1 seconds before next > connection attempt. > 2017-02-01 19:13:22,035 INFO hive.metastore: Trying to connect to metastore > with URI thrift://nightly-1.gce.cloudera.com:9083 > 2017-02-01 19:13:22,064 WARN hive.metastore: Failed to connect to the > MetaStore Server... > 2017-02-01 19:13:22,064 INFO hive.metastore: Waiting 1 seconds before next > connection attempt. > 2017-02-01 19:13:23,065 INFO hive.metastore: Trying to connect to metastore > with URI thrift://nightly-1.gce.cloudera.com:9083 > 2017-02-01 19:13:23,077 WARN hive.metastore: Failed to connect to the > MetaStore Server... > 2017-02-01 19:13:23,077 INFO hive.metastore: Waiting 1 seconds before next > connection attempt. > 2017-02-01 19:13:24,077 INFO hive.metastore: Trying to connect to metastore > with URI thrift://nightly-1.gce.cloudera.com:9083 > 2017-02-01 19:13:24,099 WARN hive.metastore: Failed to connect to the > MetaStore Server... > 2017-02-01 19:13:24,099 INFO hive.metastore: Waiting 1 seconds before next > connection attempt. > 2017-02-01 19:13:25,099 INFO hive.metastore: Trying to connect to metastore > with URI thrift://nightly-1.gce.cloudera.com:9083 > 2017-02-01 19:13:25,120 WARN hive.metastore: Failed to connect to the > MetaStore Server... > 2017-02-01 19:13:25,120 INFO hive.metastore: Waiting 1 seconds before next > connection attempt. > 2017-02-01 19:13:34,414 INFO hive.metastore: Trying to connect to metastore > with URI thrift://nightly-1.gce.cloudera.com:9083 > 2017-02-01 19:13:34,418 WARN hive.metastore: Failed to connect to the > MetaStore Server... > 2017-02-01 19:13:34,418 INFO hive.metastore: Waiting 1 seconds before next > connection attempt. > 2017-02-01 19:13:35,418 INFO hive.metastore: Trying to connect to metastore > with URI thrift://nightly-1.gce.cloudera.com:9083 > 2017-02-01 19:13:35,421 WARN hive.metastore: Failed to connect to the > MetaStore Server... > 2017-02-01 19:13:35,421 INFO hive.metastore: Waiting 1 seconds before next > connection attempt. > 2017-02-01 19:13:36,421 INFO hive.metastore: Trying to connect to metastore > with URI thrift://nightly-1.gce.cloudera.com:9083 > 2017-02-01 19:13:36,424 WARN hive.metastore: Failed to connect to the > MetaStore Server... > 2017-02-01 19:13:36,424 INFO hive.metastore: Waiting 1 seconds before next > connection attempt. > 2017-02-01 19:13:37,425 INFO hive.metastore: Trying to connect to metastore > with URI thrift://nightly-1.gce.cloudera.com:9083 > 2017-02-01 19:13:37,427 WARN hive.metastore: Failed to connect to the > MetaStore Server... > 2017-02-01 19:13:37,428 INFO hive.metastore: Waiting 1 seconds before next > connection attempt. > 2017-02-01 19:13:38,428 INFO hive.metastore: Trying to connect to metastore > with URI thrift://nightly-1.gce.cloudera.com:9083 > 2017-02-01 19:13:38,431 WARN hive.metastore: Failed to connect to the > MetaStore Server... > 2017-02-01 19:13:38,431 INFO hive.metastore: Waiting 1 seconds before next > connection attempt. > 2017-02-01 19:13:42,436 INFO hive.metastore: Trying to connect to metastore > with URI thrift://nightly-1.gce.cloudera.com:9083 > 2017-02-01 19:13:42,438 WARN hive.metastore: Failed to connect to the > MetaStore Server... > 2017-02-01 19:13:42,439 INFO hive.metastore: Waiting 1 seconds before next > connection attempt. > 2017-02-01 19:13:43,439 INFO hive.metastore: Trying to connect to metastore > with URI thrift://nightly-1.gce.cloudera.com:9083 > 2017-02-01 19:13:43,444 WARN hive.metastore: Failed to connect to the > MetaStore Server... > 2017-02-01 19:13:43,444 INFO hive.metastore: Waiting 1 seconds before next > connection attempt. > 2017-02-01 19:13:44,444 INFO hive.metastore: Trying to connect to metastore > with URI thrift://nightly-1.gce.cloudera.com:9083 > 2017-02-01 19:13:44,447 WARN hive.metastore: Failed to connect to the > MetaStore Server... > 2017-02-01 19:13:44,447 INFO hive.metastore: Waiting 1 seconds before next > connection attempt. > 2017-02-01 19:13:45,447 INFO hive.metastore: Trying to connect to metastore > with URI thrift://nightly-1.gce.cloudera.com:9083 > 2017-02-01 19:13:45,449 WARN hive.metastore: Failed to connect to the > MetaStore Server... > 2017-02-01 19:13:45,450 INFO hive.metastore: Waiting 1 seconds before next > connection attempt. > 2017-02-01 19:13:46,450 INFO hive.metastore: Trying to connect to metastore > with URI thrift://nightly-1.gce.cloudera.com:9083 > 2017-02-01 19:13:46,451 WARN hive.metastore: Failed to connect to the > MetaStore Server... > 2017-02-01 19:13:46,451 INFO hive.metastore: Waiting 1 seconds before next > connection attempt. > 2017-02-01 19:13:50,455 INFO hive.metastore: Trying to connect to metastore > with URI thrift://nightly-1.gce.cloudera.com:9083 > 2017-02-01 19:13:50,458 WARN hive.metastore: Failed to connect to the > MetaStore Server... > 2017-02-01 19:13:50,458 INFO hive.metastore: Waiting 1 seconds before next > connection attempt. > 2017-02-01 19:13:51,458 INFO hive.metastore: Trying to connect to metastore > with URI thrift://nightly-1.gce.cloudera.com:9083 > 2017-02-01 19:13:51,460 WARN hive.metastore: Failed to connect to the > MetaStore Server... > 2017-02-01 19:13:51,460 INFO hive.metastore: Waiting 1 seconds before next > connection attempt. > 2017-02-01 19:13:52,460 INFO hive.metastore: Trying to connect to metastore > with URI thrift://nightly-1.gce.cloudera.com:9083 > 2017-02-01 19:13:52,463 WARN hive.metastore: Failed to connect to the > MetaStore Server... > 2017-02-01 19:13:52,463 INFO hive.metastore: Waiting 1 seconds before next > connection attempt. > 2017-02-01 19:13:53,463 INFO hive.metastore: Trying to connect to metastore > with URI thrift://nightly-1.gce.cloudera.com:9083 > 2017-02-01 19:13:53,465 WARN hive.metastore: Failed to connect to the > MetaStore Server... > 2017-02-01 19:13:53,465 INFO hive.metastore: Waiting 1 seconds before next > connection attempt. > 2017-02-01 19:13:54,465 INFO hive.metastore: Trying to connect to metastore > with URI thrift://nightly-1.gce.cloudera.com:9083 > 2017-02-01 19:13:54,468 WARN hive.metastore: Failed to connect to the > MetaStore Server... > 2017-02-01 19:13:54,468 INFO hive.metastore: Waiting 1 seconds before next > connection attempt. > 2017-02-01 19:14:07,218 ERROR org.apache.sentry.service.thrift.HMSFollower: > HMSFollower cannot connect to HMS!! > 2017-02-01 19:14:07,991 INFO org.apache.sentry.service.thrift.HMSFollower: > Making a kerberos connection to HMS > 2017-02-01 19:14:07,992 INFO org.apache.sentry.service.thrift.HMSFollower: > Using kerberos principal: sentry/[email protected] > 2017-02-01 19:14:07,993 INFO > org.apache.sentry.service.thrift.SentryKerberosContext: Logging in with new > Context > 2017-02-01 19:14:07,998 INFO org.apache.sentry.service.thrift.HMSFollower: > Established kerberos context, will now connect to HMS > 2017-02-01 19:23:01,286 INFO hive.metastore: Trying to connect to metastore > with URI thrift://nightly-1.gce.cloudera.com:9083 > 2017-02-01 19:23:01,479 INFO hive.metastore: Opened a connection to > metastore, current connections: 1 > 2017-02-01 19:23:01,480 INFO hive.metastore: Connected to metastore. > 2017-02-01 19:23:01,480 INFO org.apache.sentry.service.thrift.HMSFollower: > Secure connection established with HMS > ``` > > > Thanks, > > Vamsee Yarlagadda > >
