Re: Adding support for a new object store

2014-08-27 Thread Reynold Xin
Hi Rajendran, I'm assuming you have some concept of schema and you are intending to integrate with SchemaRDD instead of normal RDDs. More responses inline below. On Fri, Aug 22, 2014 at 2:21 AM, Rajendran Appavu appra...@in.ibm.com wrote: I am new to Spark source code and looking to see if

Re: Adding support for a new object store

2014-08-27 Thread Reynold Xin
Linking to the JIRA tracking APIs to hook into the planner: https://issues.apache.org/jira/browse/SPARK-3248 On Wed, Aug 27, 2014 at 1:56 PM, Reynold Xin r...@databricks.com wrote: Hi Rajendran, I'm assuming you have some concept of schema and you are intending to integrate with SchemaRDD

Adding support for a new object store

2014-08-22 Thread Rajendran Appavu
I am new to Spark source code and looking to see if i can add push-down support of spark filters to the storage (in my case an object store). I am willing to consider