[
https://issues.apache.org/jira/browse/IGNITE-9473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16604613#comment-16604613
]
Rob Gibbon commented on IGNITE-9473:
------------------------------------
I was able to get past this by modifying the file:
modules/hadoop/src/main/java/org/apache/ignite/hadoop/fs/v1/IgniteHadoopFileSystem.java
I changed the method checkPath so that it just calls super.checkPath and
removed the rest of the content. Probably the method could be removed
altogether.
I now appear to be able to get the resources to download to the tez container.
Will upload a patch a bit later because I also had to slightly change one of
the test classes to comply with Hadoop 3.1.1.
> InvalidPathException when localizing resources for Tez job
> ----------------------------------------------------------
>
> Key: IGNITE-9473
> URL: https://issues.apache.org/jira/browse/IGNITE-9473
> Project: Ignite
> Issue Type: Bug
> Components: igfs
> Affects Versions: 2.6
> Environment: Hadoop 3.1.1
> Ignite 2.6
> Reporter: Rob Gibbon
> Priority: Major
>
> When running a Hive on Tez job with an IGFS backend, I get an error:
>
> InvalidPathException: Invalid path name Wrong path authority [expected=igfs@,
> actual=null]
>
> The path is interpreted by the Yarn resource localizer as
> igfs:/apps/tez/tez.tar.gz.
>
> The path is configured in tez.lib.uris as /apps/tez/tez.tar.gz
>
> The defaultFS is configured as igfs://igfs@/
>
> The system works for everything else.
> exact error message logged:
> localizer.ResourceLocalizationService: Failed to download resource \{ {
> igfs:/apps/tez/tez.tar.gz, 1536087125000, ARCHIVE, null
> },pending,[(container_1536139312517_0016_01_000001)],592502389438828,DOWNLOADING}
>
> Need help with this...
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
