It looks like Alluxio provides some kind of Hadoop Filesystem API wrapper:
http://www.alluxio.org/docs/master/en/File-System-API.html#hadoop-api. I
don't know if it's been upstreamed into Apache Hadoop.

We do use similar Hadoop Filesystem API adapters to provide S3 and Isilon
support without massive code changes so it seems likely that it's possible
to do the same for Alluxio. Our experience with S3 and Isilon was that it
required additional work to get it to work and perform well because
different filesystems have different quirks even if they implement the same
interface.

It would require at least some small code changes to switch it on (e.g. you
can grep for S3AFilesystem to see how we turned on S3 support). Please let
us know if you experiment with it and have any success (or no success).

- Tim

On Thu, Dec 8, 2016 at 9:07 AM, Jim Apple <[email protected]> wrote:

> I don't know that Impala has been tested with Alluxio.
>
> This mailing list is deprecated; please use [email protected].
> org
>
>
> On Wednesday, December 7, 2016 at 11:08:59 PM UTC-8, [email protected]
> wrote:
>>
>> Hi
>> How are you configure the impala on the alluxio;
>>
>> Alluxio: Open Source Memory Speed Virtual Distributed Storage
>> Alluxio: http://alluxio.org/
>>
> --
> You received this message because you are subscribed to the Google Groups
> "Impala Dev" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [email protected].
>

Reply via email to