Hello.
I have problem with storm hive bolt.
When my hive bolt is executed I get error below in storm logs:
2017-04-13 10:18:49.418 h.metastore [INFO] Trying to connect to
metastore with URI thrift://hdp1.local:9083
2017-04-13 10:18:49.727 h.metastore [INFO] Connected to metastore.
2017-04-13 10:18:50.179 h.metastore [INFO] Trying to connect to
metastore with URI thrift://hdp1.local:9083
2017-04-13 10:18:50.182 h.metastore [INFO] Connected to metastore.
2017-04-13 10:18:50.649 o.a.s.d.executor [ERROR]
java.lang.RuntimeException: java.lang.RuntimeException: The root
scratch dir: /tmp/hive on HDFS should be writable. Current permissions
are: rwxr-xr-x
at
org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:444)
~[stormjar.jar:?]
And then in storm logs I can see
2017-04-13 10:18:52.157 o.a.h.h.q.Driver [ERROR] FAILED:
NullPointerException Non-local session path expected to be non-null
java.lang.NullPointerException: Non-local session path expected to be non-null
at com.google.common.base.Preconditions.checkNotNull(Preconditions.java:204)
at
org.apache.hadoop.hive.ql.session.SessionState.getHDFSSessionPath(SessionState.java:590)
I think that the first error is source om my problem.
I have no idea why I get this error
When I list directories insode /tmp I can see that /tmp/hive is
writable (drwxrwxrwx).
sudo -u hdfs hadoop fs -ls /tmp
Found 8 items
drwx------ - ambari-qa hdfs 0 2017-04-10 11:13 /tmp/ambari-qa
drwxr-xr-x - hdfs hdfs 0 2017-04-10 11:09
/tmp/entity-file-history
drwxrwxrwx - hive hdfs 0 2017-04-13 10:11 /tmp/hive
-rwxr-xr-x 3 hdfs hdfs 1890 2017-04-10 11:10
/tmp/ida8c0da01_date091017
-rwxr-xr-x 3 ambari-qa hdfs 1890 2017-04-10 11:16
/tmp/idtest.ambari-qa.1491815773.15.in
-rwxr-xr-x 3 ambari-qa hdfs 957 2017-04-10 11:16
/tmp/idtest.ambari-qa.1491815773.15.pig
drwxr-xr-x - ambari-qa hdfs 0 2017-04-10 11:14 /tmp/tezsmokeinput
drwxr-xr-x - ambari-qa hdfs 0 2017-04-10 11:14 /tmp/tezsmokeoutput
root@hdp:~#
Can you help me with that ?
pozdrawiam
Marcin Kasiński
http://itzone.pl
