If storm and hive run as different users, check your permissions in HDFS. The storm user will need permissions to write to your table (this is likely under /apps/hive/warehouse ). Similarly, the hive user will need to be able to access and modify the files created by the storm user. This can cause the errors you are seeing.
You may need to set superusers and/or umasks in hdfs config to help with this. You may also need to set the umask for the local file system or assign users to groups. You may also need to set permissions on /tmp/hive on the local file systems. [http://www.cisco.com/web/europe/images/email/signature/est2014/logo_06.png?ct=1398192119726] Grant Overby Software Engineer Cisco.com<http://www.cisco.com/> [email protected]<mailto:[email protected]> Mobile: 865 724 4910 [http://www.cisco.com/assets/swa/img/thinkbeforeyouprint.gif] Think before you print. This email may contain confidential and privileged material for the sole use of the intended recipient. Any review, use, distribution or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive for the recipient), please contact the sender by reply email and delete all copies of this message. Please click here<http://www.cisco.com/web/about/doing_business/legal/cri/index.html> for Company Registration Information. From: Sunit Swain <[email protected]<mailto:[email protected]>> Reply-To: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>> Date: Wednesday, March 18, 2015 at 12:38 AM To: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>> Subject: Re: How to use storm's HiveBolt I am using storm 0.9.3 and trying to make use of the HiveBolt to stream the data directly into hive tables. I am following this example: https://github.com/hkropp/storm-hive-streaming-example But instead of a kafkaspout I am using a random data generating spout to keep things simple. When I submit the topology, the bolt thread is able to connect to my hive-metastore but then fails with these errors once it was: " Non-local session path expected to be non-null" and then : "Failed connecting to EndPoint hive " I also made sure that the table is already created and accessible. I also tried it on partitioned and un-partitioned tables. Any help as to what is going wrong? Regards, Sunit On Wed, Mar 18, 2015 at 9:51 AM, Sunit Swain <[email protected]<mailto:[email protected]>> wrote: I am using storm 0.9.3 and trying to make use of the HiveBolt to stream the data directly into hive tables. I am following this example: https://github.com/hkropp/storm-hive-streaming-example But instead of a kafkaspout I am using a random data generating spout to keep things simple. When I submit the topology, the bolt thread is able to connect to my hive-metastore but then fails with these errors once it was: " Non-local session path expected to be non-null" and then : "Failed connecting to EndPoint hive " I also made sure that the table is already created and accessible. I also tried it on partitioned and un-partitioned tables. Any help as to what is going wrong? Regards, Sunit
