[
https://issues.apache.org/jira/browse/OOZIE-1624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387508#comment-14387508
]
Purshotam Shah commented on OOZIE-1624:
---------------------------------------
{quote}
Those duplicates are only by file names and file size and checksum is not
checked and sometimes that can be a problem.
{quote}
Should be part of sharelib check, sharelib should not load any file which file
size is 0.
{quote}
I think that is what is being done now, just that it has to be on the full path
instead of the file name. For eg: If both hbase and hive had a thrift.jar in
sharelib, setting ./hbase/thrift.jar should make put the hive thrift.jar. If
thrift.jar has to be totally excluded then .thrift.jar can be specified.
{quote}
Full path is never exposed to user and it can change. And i guess user doesn't
care about sharelib dir structure.
./hbase/thrift.jar can be changed to ./hbase/aux/lib/thrift.jar in future
release and in that case user has to go can change his regex pattern.
We can do something like, {sharelib_tag}/regex_pattern. If user need to use
multiple sharelib tag, then he can use {sharelib_tag} as prefix to exclude jars
from only that sharelib tag.
But i guess it will complicate things. Ask of this JIRA is just to exclude few
files from sharelib so that user can override it. If needed we can create
different JIRA to enhance this.
> Exclusion pattern for sharelib.
> -------------------------------
>
> Key: OOZIE-1624
> URL: https://issues.apache.org/jira/browse/OOZIE-1624
> Project: Oozie
> Issue Type: Sub-task
> Reporter: Purshotam Shah
> Assignee: Purshotam Shah
> Attachments: OOZIE-1624-V2.patch, OOZIE-1624-v1.patch
>
>
> Sharelib may bring some jar which might conflict with user jars.
> Ex. Sharelib hive has json-2.xxxx.jar, where as some of the user use-case
> need higher version of json jar.
> He should be able to exclude sharelib json jar and bring his own version.
> <property>
> <name>oozie.action.sharelib.for.hive.exclusion</name>
> <value>json-\*.jar|abc-*.jar</value>
> </property>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
