Hi all,
Was https://issues.apache.org/jira/browse/NIFI-3530 fixed in the just-released nifi v1.2? In my PutHiveStreaming Hive Metastore URI = thrift://en1-dev1-tbdp.local.alipay.net:9083 Hive Configuration Resources = /usr/hdp/2.4.3.0-227/etc/hive/conf.dist/hive-site.xml Database Name = poc Table Name = table1 Kerberos Principal=nifi/[email protected] Kerberos Keytab=/home/nifi/nifi.keytab when running the PutHiveStreaming, it shows 2017-05-13 00:28:11,321 INFO [put-hive-streaming-0] hive.metastore Trying to connect to metastore with URI thrift://en1-dev1-tbdp.local.alipay.net:9083 2017-05-13 00:28:53,666 INFO [Write-Ahead Local State Provider Maintenance] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@578483bd checkpointed with 0 Records and 0 Swap Files in 14 milliseconds (Stop-the-world time = 1 milliseconds, Clear Edit Logs time = 1 millis), max Transaction ID -1 2017-05-13 00:28:54,427 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Initiating checkpoint of FlowFile Repository 2017-05-13 00:28:54,486 INFO [pool-10-thread-1] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@4c617143 checkpointed with 2 Records and 0 Swap Files in 58 milliseconds (Stop-the-world time = 26 milliseconds, Clear Edit Logs time = 16 millis), max Transaction ID 4 2017-05-13 00:28:54,486 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Successfully checkpointed FlowFile Repository with 2 records in 58 milliseconds 2017-05-13 00:30:53,673 INFO [Write-Ahead Local State Provider Maintenance] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@578483bd checkpointed with 0 Records and 0 Swap Files in 5 milliseconds (Stop-the-world time = 1 milliseconds, Clear Edit Logs time = 0 millis), max Transaction ID -1 2017-05-13 00:30:54,486 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Initiating checkpoint of FlowFile Repository 2017-05-13 00:30:54,542 INFO [pool-10-thread-1] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@4c617143 checkpointed with 2 Records and 0 Swap Files in 55 milliseconds (Stop-the-world time = 24 milliseconds, Clear Edit Logs time = 15 millis), max Transaction ID 4 2017-05-13 00:30:54,542 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Successfully checkpointed FlowFile Repository with 2 records in 55 milliseconds In hivemetastore.log, it has below error 2017-05-13 00:28:06,798 INFO [org.apache.hadoop.hive.ql.txn.compactor.HouseKeeperServiceBase$1-0]: txn.AcidCompactionHistoryService (AcidCompactionHistoryService.java:run(76)) - History reaper reaper ran for 0seconds. isAliveCounter=-2147482060 2017-05-13 00:28:11,370 ERROR [pool-6-thread-200]: server.TThreadPoolServer (TThreadPoolServer.java:run(296)) - Error occurred during processing of message. java.lang.RuntimeException: org.apache.thrift.transport.TTransportException: Invalid status -128 at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219) at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:609) at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:606) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1704) at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge.java:606) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:268) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.thrift.transport.TTransportException: Invalid status -128 at org.apache.thrift.transport.TSaslTransport.sendAndThrowMessage(TSaslTransport.java:232) at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:184) at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125) at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271) at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41) at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216) ... 10 more nifi a/c is ensured to have right to access hdfs/hive before running. . Please would anyone share me any experience on fixing this? Thanks, Forest
