Re: Manta Object Store Support

2016-06-15 Thread Elijah Zupancic
Please disregard this. I’ve figured out how to get it working. Once I realized that error logging for Hadoop Filesystem drivers wasn’t enabled by logback by default, then everything clicked into place. I’ll be back to ask more questions. Thank you for your time, Elijah Zupancic > On May 6,

Re: Manta Object Store Support

2016-05-26 Thread Jacques Nadeau
It should "just work". Nothing in the logs? -- Jacques Nadeau CTO and Co-Founder, Dremio On Wed, May 25, 2016 at 7:01 PM, Elijah Zupancic wrote: > Hi Tomer, > > Thanks for your advice about creating a Hadoop FileSystem implementation. > I just finished a prototypical

Re: Manta Object Store Support

2016-05-25 Thread Elijah Zupancic
Hi Tomer, Thanks for your advice about creating a Hadoop FileSystem implementation. I just finished a prototypical implementation of a Hadoop file system for Manta: https://github.com/dekobon/hadoop-manta I see the example for enabling S3 with Apache

Re: Manta Object Store Support

2016-05-06 Thread Tomer Shiran
Does Manta have a Hadoop FileSystem API implementation? That's what Drill uses for S3, HDFS, MapR-FS, Azure Blob Storage, etc. You could potentially write a Drill storage plugin, but you get a lot for free if you already have the file system implementation. On Fri, May 6, 2016 at 9:43 AM, Elijah

Getting Started & Adding Manta Object Store Support

2016-05-06 Thread Elijah Zupancic
I'm trying to get started contributing to Apache Drill. I've got the project checked out and it is building to my satisfaction. Right now, I'm trying to add support for the open source object store Manta (https://github.com/joyent/manta ). I thought that this

Manta Object Store Support

2016-05-06 Thread Elijah Zupancic
I'm trying to get started contributing to Apache Drill. I've got the project checked out and it is building to my satisfaction. Right now, I'm trying to add support for the open source object store Manta ( https://github.com/joyent/manta). I thought that this would be a good learning project.