[
https://issues.apache.org/jira/browse/FALCON-446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056241#comment-14056241
]
Venkatesh Seetharam commented on FALCON-446:
--------------------------------------------
bq. The idea of pre-processing and post-processing is so that we can combine
all falcon related logic inside these instead of having multiple actions for
each step
Agreed, but its quite generic today with out being aware of what the lifecycle
is. In this case, you will introduce a replication specific logic which is not
desirable.
> Hive Replications fail because of permissions issue
> ---------------------------------------------------
>
> Key: FALCON-446
> URL: https://issues.apache.org/jira/browse/FALCON-446
> Project: Falcon
> Issue Type: Bug
> Components: replication
> Affects Versions: 0.5
> Reporter: Venkatesh Seetharam
> Assignee: Venkatesh Seetharam
> Labels: hive
> Fix For: 0.6
>
> Attachments: FALCON-446-v1.patch, FALCON-446.patch
>
>
> {code}
> 3782 [main] INFO org.apache.hadoop.hive.ql.exec.Task - Copying data from
> file:/grid/0/hdp/yarn/local/usercache/hrt_qa/appcache/application_1400833228766_0501/container_1400833228766_0501_01_000002/tmp/yarn/hive_2014-05-23_12-29-47_090_1701018059611451226-1/-local-10000/_metadata
> to
> hdfs://hor3n25.gq1.ygridcore.net:8020/projects/ivory/staging/FALCON_FEED_REPLICATION_raaw-logs16-f80d8f5d-406e-49f8-8e2b-4caa58e53639_corp-6ce8cdf0-ce74-40fd-9601-143971a93eb9/default/HCatReplication_oneSourceOneTarget_hyphen/dt=2010-01-01-20/2010-01-01-20-00/corp-2a555e7f-1c65-4ac0-b3ef-1edd2c7fdd4b/data
> 3800 [main] ERROR org.apache.hadoop.hive.ql.exec.Task - Failed with
> exception Permission denied: user=hrt_qa, access=WRITE,
> inode="/projects/ivory/staging":falcon:hdfs:drwxr-xr-x
> at
> org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkFsPermission(FSPermissionChecker.java:265)
> at
> org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:251)
> at
> org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:232)
> at
> org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:176)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:5509)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:5491)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkAncestorAccess(FSNamesystem.java:5465)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInternal(FSNamesystem.java:3608)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInt(FSNamesystem.java:3578)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3552)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:760)
> at
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:558)
> at
> org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)
> at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:928)
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2013)
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2009)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1557)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2007)
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
