Hi,

Unable to create table pointing to S3 after enabling Ranger.

This is database we created before enabling Ranger.


   1. SET fs.s3a.impl=org.apache.hadoop.fs.s3a.S3AFileSystem;
   2. SET fs.s3a.access.key=xxxxxxx;
   3. SET fs.s3a.secret.key=yyyyyyyyyyyyyyy;
   4.
   5.
   6. CREATE DATABASE IF NOT EXISTS backup_s3a1
   7. COMMENT "s3a schema test"
   8. LOCATION "s3a://gd-de-dp-db-hcat-backup-schema/";

After Ranger was enabled, we try to create another database but it is
throwing error.


   1. 0: jdbc:hive2://usw2dxdpmn01.local:> SET
fs.s3a.impl=org.apache.hadoop.fs.s3a.S3AFileSystem;
   2. Error: Error while processing statement: Cannot modify
fs.s3a.impl at runtime. It is not in list of params that are allowed
to be modified at runtime (state=42000,code=1)
   3.



I configured the credentials in the core-site.xml and always returns
"undefined" when I am trying to see the values for  below commands. This is
in our " dev" environment where Ranger is enabled. In   other environment
where Ranger is not installed , we are not facing this problem.


   1. 0: jdbc:hive2://usw2dxdpmn01:10010> set  fs.s3a.impl;
   2. +-----------------------------------------------------+--+
   3. |                         set                         |
   4. +-----------------------------------------------------+--+
   5. | fs.s3a.impl=org.apache.hadoop.fs.s3a.S3AFileSystem  |
   6. +-----------------------------------------------------+--+
   7. 1 row selected (0.006 seconds)
   8. 0: jdbc:hive2://usw2dxdpmn01:10010> set fs.s3a.access.key;
   9. +---------------------------------+--+
   10. |               set               |
   11. +---------------------------------+--+
   12. | fs.s3a.access.key is undefined  |
   13. +---------------------------------+--+
   14. 1 row selected (0.005 seconds)
   15. 0: jdbc:hive2://usw2dxdpmn01:10010> set fs.s3a.secret.key;
   16. +---------------------------------+--+
   17. |               set               |
   18. +---------------------------------+--+
   19. | fs.s3a.secret.key is undefined  |
   20. +---------------------------------+--+
   21. 1 row selected (0.005 seconds)


Any help or pointers is appreciated.

Reply via email to