For performance, will foreign data format support, same as native ones?

Thanks,
James


On Wed, Oct 8, 2014 at 11:03 PM, Cheng Lian <lian.cs....@gmail.com> wrote:

> The foreign data source API PR also matters here
> https://www.github.com/apache/spark/pull/2475
>
> Foreign data source like ORC can be added more easily and systematically
> after this PR is merged.
>
> On 10/9/14 8:22 AM, James Yu wrote:
>
>> Thanks Mark! I will keep eye on it.
>>
>> @Evan, I saw people use both format, so I really want to have Spark
>> support
>> ORCFile.
>>
>>
>> On Wed, Oct 8, 2014 at 11:12 AM, Mark Hamstra <m...@clearstorydata.com>
>> wrote:
>>
>>  https://github.com/apache/spark/pull/2576
>>>
>>>
>>>
>>> On Wed, Oct 8, 2014 at 11:01 AM, Evan Chan <velvia.git...@gmail.com>
>>> wrote:
>>>
>>>  James,
>>>>
>>>> Michael at the meetup last night said there was some development
>>>> activity around ORCFiles.
>>>>
>>>> I'm curious though, what are the pros and cons of ORCFiles vs Parquet?
>>>>
>>>> On Wed, Oct 8, 2014 at 10:03 AM, James Yu <jym2...@gmail.com> wrote:
>>>>
>>>>> Didn't see anyone asked the question before, but I was wondering if
>>>>>
>>>> anyone
>>>>
>>>>> knows if Spark/SparkSQL will support ORCFile format soon? ORCFile is
>>>>> getting more and more popular hi Hive world.
>>>>>
>>>>> Thanks,
>>>>> James
>>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
>>>> For additional commands, e-mail: dev-h...@spark.apache.org
>>>>
>>>>
>>>>
>

Reply via email to