To add a bit of background, in past experience it's usually required a bit of work to get each new filesystem to work well with Impala because they have different performance characteristics and different bugs/quirks in the connector implementations.
On Wed, Aug 30, 2017 at 6:41 AM, Andrey Kuznetsov <[email protected] > wrote: > Hi, > Looks like, > Has been done: > https://issues.apache.org/jira/browse/IMPALA-5862 > > Best regards, > ANDREY KUZNETSOV > Software Engineering Team Leader, Assessment Global Discipline Head (Java) > > Office: +7 482 263 00 70 x 42766 Cell: +7 920 154 05 72 Email: and > [email protected] > Tver, Russia epam.com > > CONFIDENTIALITY CAUTION AND DISCLAIMER > This message is intended only for the use of the individual(s) or > entity(ies) to which it is addressed and contains information that is > legally privileged and confidential. If you are not the intended recipient, > or the person responsible for delivering the message to the intended > recipient, you are hereby notified that any dissemination, distribution or > copying of this communication is strictly prohibited. All unintended > recipients are obliged to delete this message and destroy any printed > copies. > > -----Original Message----- > From: Jim Apple [mailto:[email protected]] > Sent: Wednesday, August 30, 2017 3:42 PM > To: dev@impala <[email protected]> > Cc: Special SBER-BPOC Team <[email protected]> > Subject: Re: IGFS (Ignite FS) support > > Doesn't look like there is a JIRA yet: > https://issues.apache.org/jira/issues/?jql=project%20% > 3D%20IMPALA%20AND%20text%20~%20%22ignite%22 > > https://issues.apache.org/jira/issues/?jql=project%20% > 3D%20IMPALA%20AND%20text%20~%20%22igfs%22 > > You might want to file one as a single point of coordination for people > interested in this work. > > On Wed, Aug 30, 2017 at 2:59 AM, Andrey Kuznetsov < > [email protected]> wrote: > > Hi team, > > My team has faced with follow issue: > > Impala doesn't work with IGFS because IgniteHadoopFileSystem is not > validated as WritableFilesystem, because IgniteHadoopFileSystem does not > extend org.apache.hadoop.hdfs.DistributedFileSystem and not listed in > others acceptable file systems list: > > > > * Returns true iff the given location is on a filesystem that Impala > can write to. > > > > */ > > > > public static boolean isImpalaWritableFilesystem(String location) > > > > throws IOException { > > > > Path path = new Path(location); > > > > return (FileSystemUtil.isDistributedFileSystem(path) || > > > > FileSystemUtil.isLocalFileSystem(path) || > > > > FileSystemUtil.isS3AFileSystem(path) || > > > > FileSystemUtil.isADLFileSystem(path)); > > > > } > > > > > > Does anybody know if we plan to support IGFS? > > > > Best regards, > > ANDREY KUZNETSOV >
