[jira] [Commented] (HIVE-24032) Remove hadoop shims dependency and use FileSystem Api directly from standalone metastore
[ https://issues.apache.org/jira/browse/HIVE-24032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17184120#comment-17184120 ] Peter Vary commented on HIVE-24032: --- [~aasha]: Thanks for the explanation! Peter > Remove hadoop shims dependency and use FileSystem Api directly from > standalone metastore > > > Key: HIVE-24032 > URL: https://issues.apache.org/jira/browse/HIVE-24032 > Project: Hive > Issue Type: Task >Reporter: Aasha Medhi >Assignee: Aasha Medhi >Priority: Major > Labels: pull-request-available > Attachments: HIVE-24032.01.patch, HIVE-24032.02.patch, > HIVE-24032.03.patch > > Time Spent: 1h 20m > Remaining Estimate: 0h > > Remove hadoop shims dependency from standalone metastore. > Rename hive.repl.data.copy.lazy hive conf to > hive.repl.run.data.copy.tasks.on.target -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-24032) Remove hadoop shims dependency and use FileSystem Api directly from standalone metastore
[ https://issues.apache.org/jira/browse/HIVE-24032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17184110#comment-17184110 ] Aasha Medhi commented on HIVE-24032: Shims dependency is removed from the standalone-metastore module. [~vihangk1] had done some work to make the standalone-metastore indepdent and impala also uses this. We had to add shims dependencies for one of the replication related changes. We have reverted that now with this patch. Please note this is only for standalone-metastore module. Also shims were introduced to support multiple hadoop versions but as of now we just support one. Even with ozone the FS apis can be used directly. So that was another reason for not introducing shims in standalone-metastore. > Remove hadoop shims dependency and use FileSystem Api directly from > standalone metastore > > > Key: HIVE-24032 > URL: https://issues.apache.org/jira/browse/HIVE-24032 > Project: Hive > Issue Type: Task >Reporter: Aasha Medhi >Assignee: Aasha Medhi >Priority: Major > Labels: pull-request-available > Attachments: HIVE-24032.01.patch, HIVE-24032.02.patch, > HIVE-24032.03.patch > > Time Spent: 1h 20m > Remaining Estimate: 0h > > Remove hadoop shims dependency from standalone metastore. > Rename hive.repl.data.copy.lazy hive conf to > hive.repl.run.data.copy.tasks.on.target -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-24032) Remove hadoop shims dependency and use FileSystem Api directly from standalone metastore
[
https://issues.apache.org/jira/browse/HIVE-24032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17183992#comment-17183992
]
Peter Vary commented on HIVE-24032:
---
[~anishek], [~aasha]: I left a comment on the pull request 2 days ago which
might be missed in the noise:
{quote}
Why is this a good thing?
AFAIK we introduced the Shims to be able to abstract out Hadoop dependencies
and being able to work with different versions of Hadoop altogether. Removing
shims will again fix as to a specific Hadoop version.
{quote}
I see that this was committed, but I still would like to understand the
reasoning behind this change. Do we plan to remove the whole Shims module?
Thanks,
Peter
> Remove hadoop shims dependency and use FileSystem Api directly from
> standalone metastore
>
>
> Key: HIVE-24032
> URL: https://issues.apache.org/jira/browse/HIVE-24032
> Project: Hive
> Issue Type: Task
>Reporter: Aasha Medhi
>Assignee: Aasha Medhi
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-24032.01.patch, HIVE-24032.02.patch,
> HIVE-24032.03.patch
>
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> Remove hadoop shims dependency from standalone metastore.
> Rename hive.repl.data.copy.lazy hive conf to
> hive.repl.run.data.copy.tasks.on.target
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-24032) Remove hadoop shims dependency and use FileSystem Api directly from standalone metastore
[ https://issues.apache.org/jira/browse/HIVE-24032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177780#comment-17177780 ] Pravin Sinha commented on HIVE-24032: - +1 > Remove hadoop shims dependency and use FileSystem Api directly from > standalone metastore > > > Key: HIVE-24032 > URL: https://issues.apache.org/jira/browse/HIVE-24032 > Project: Hive > Issue Type: Task >Reporter: Aasha Medhi >Assignee: Aasha Medhi >Priority: Major > Labels: pull-request-available > Attachments: HIVE-24032.01.patch, HIVE-24032.02.patch > > Time Spent: 1h 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
