This is a cool idea. And it is fairly straightforward. I hacked up an
illustration this evening: https://gist.github.com/MLnick/7880766
The better approach would be to amend the sklearn svmlight code to accept
iterables of strings in addition to file handles, and then pretty much no
additional code should be required (though since that part is in Cython I
am not sure, I'm just assuming it should work by eyeballing for now).
Olivier, might it make sense to put on the Wiki page for the event a few
ideas of what to look at / tackle? Not sure if this is usually done or
helpful etc for these events.
N
On Thu, Dec 5, 2013 at 3:33 AM, Mathieu Blondel <[email protected]>wrote:
> It seems to me that an utility script to convert an svmlight file to an
> RDD could be useful.
>
> Mathieu
>
>
> On Thu, Dec 5, 2013 at 4:29 AM, Peter Prettenhofer <
> [email protected]> wrote:
>
>> Great news - looking forward to the outcome of the sprint!
>>
>>
>> 2013/12/4 Olivier Grisel <[email protected]>
>>
>>> I meant San Francisco...
>>>
>>> --
>>> Olivier
>>>
>>>
>>> ------------------------------------------------------------------------------
>>> Sponsored by Intel(R) XDK
>>> Develop, test and display web and hybrid apps with a single code base.
>>> Download it for free now!
>>>
>>> http://pubads.g.doubleclick.net/gampad/clk?id=111408631&iu=/4140/ostg.clktrk
>>> _______________________________________________
>>> Scikit-learn-general mailing list
>>> [email protected]
>>> https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
>>>
>>
>>
>>
>> --
>> Peter Prettenhofer
>>
>>
>> ------------------------------------------------------------------------------
>> Sponsored by Intel(R) XDK
>> Develop, test and display web and hybrid apps with a single code base.
>> Download it for free now!
>>
>> http://pubads.g.doubleclick.net/gampad/clk?id=111408631&iu=/4140/ostg.clktrk
>> _______________________________________________
>> Scikit-learn-general mailing list
>> [email protected]
>> https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
>>
>>
>
>
> ------------------------------------------------------------------------------
> Sponsored by Intel(R) XDK
> Develop, test and display web and hybrid apps with a single code base.
> Download it for free now!
>
> http://pubads.g.doubleclick.net/gampad/clk?id=111408631&iu=/4140/ostg.clktrk
> _______________________________________________
> Scikit-learn-general mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
>
>
------------------------------------------------------------------------------
Sponsored by Intel(R) XDK
Develop, test and display web and hybrid apps with a single code base.
Download it for free now!
http://pubads.g.doubleclick.net/gampad/clk?id=111408631&iu=/4140/ostg.clktrk
_______________________________________________
Scikit-learn-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
