| Addshore created this task. Addshore added projects: User-Addshore, WMDE-Analytics-Engineering, Wikidata. Herald added a subscriber: Aklapper. |
TASK DESCRIPTION
https://grafana.wikimedia.org/dashboard/db/wikidata-special-entitydata
The user running the script to add the data does not have access to hive / hadoop!
addshore@stat1002:/a/analytics-wmde/src/scripts/src/wikidata$ sudo -u analytics-wmde php specialEntityData.php
2016-07-28 14:25:42 START /a/analytics-wmde/src/scripts/src/wikidata/specialEntityData.php
addshore@stat1002:/a/analytics-wmde/src/scripts/src/wikidata$ sudo -u analytics-wmde cat entitydata_errors_1.txt
log4j:WARN No such property [maxBackupIndex] in org.apache.log4j.DailyRollingFileAppender.
FAILED: SemanticException Unable to determine if hdfs://analytics-hadoop/wmf/data/wmf/webrequest is encrypted: org.apache.hadoop.security.AccessControlException: Permission denied: user=analytics-wmde, access=READ, inode="/wmf/data/wmf/webrequest":hdfs:analytics-privatedata-users:drwxr-x---
at org.apache.hadoop.hdfs.server.namenode.DefaultAuthorizationProvider.checkFsPermission(DefaultAuthorizationProvider.java:257)
at org.apache.hadoop.hdfs.server.namenode.DefaultAuthorizationProvider.check(DefaultAuthorizationProvider.java:238)
at org.apache.hadoop.hdfs.server.namenode.DefaultAuthorizationProvider.checkPermission(DefaultAuthorizationProvider.java:151)
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:138)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:6605)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:6587)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPathAccess(FSNamesystem.java:6512)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getEZForPath(FSNamesystem.java:9122)
at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getEZForPath(NameNodeRpcServer.java:1608)
at org.apache.hadoop.hdfs.server.namenode.AuthorizationProviderProxyClientProtocol.getEZForPath(AuthorizationProviderProxyClientProtocol.java:926)
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getEZForPath(ClientNamenodeProtocolServerSideTranslatorPB.java:1343)
at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:617)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1060)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2086)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2082)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2080)TASK DETAIL
EMAIL PREFERENCES
To: Addshore
Cc: Addshore, Aklapper, D3r1ck01, Izno, Wikidata-bugs, aude, Mbch331
Cc: Addshore, Aklapper, D3r1ck01, Izno, Wikidata-bugs, aude, Mbch331
_______________________________________________ Wikidata-bugs mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
