Ok great I'll use the cartesian spark API call, so what I'd still like some
thoughts on where the code that calls the cartesian should live in our
directory structure.
> Date: Thu, 18 Sep 2014 15:33:59 -0400
> From: [email protected]
> To: [email protected]
> Subject: Re: Mahout-1539-computation of gaussian kernel between 2 arrays of
> shapes
>
> Saikat,
>
> Spark has the cartesian() method that will align all pairs of points;
> that's the nontrivial part of determining an RBF kernel. After that it's
> a simple matter of performing the equation that's given on the
> scikit-learn doc page.
>
> However, like you said it'll also have to be implemented using the
> Mahout DSL. I can envision that users would like to compute pairwise
> metrics for a lot more than just RBF kernels (pairwise Euclidean
> distance, etc), so my guess would be a DSL implementation of cartesian()
> is what you're looking for. You can build the other methods on top of that.
>
> Correct me if I'm wrong.
>
> Shannon
>
> On 9/18/14, 3:28 PM, Saikat Kanjilal wrote:
> > http://scikit-learn.org/stable/modules/generated/sklearn.metrics.pairwise.rbf_kernel.html
> > I need to implement the above in the scala world and expose a DSL API to
> > call the computation when computing the affinity matrix.
> >
> >> From: [email protected]
> >> Date: Thu, 18 Sep 2014 10:04:34 -0700
> >> Subject: Re: Mahout-1539-computation of gaussian kernel between 2 arrays
> >> of shapes
> >> To: [email protected]
> >>
> >> There are number of non-traditional linear algebra operations like this
> >> that are important to implement.
> >>
> >> Can you describe what you intend to do so that we can discuss the shape of
> >> the API and computation?
> >>
> >>
> >>
> >> On Wed, Sep 17, 2014 at 9:28 PM, Saikat Kanjilal <[email protected]>
> >> wrote:
> >>
> >>> Dmitry et al,As part of the above JIRA I need to calculate the gaussian
> >>> kernel between 2 shapes, I looked through mahout-math-scala and didnt see
> >>> anything to do this, any objections to me adding some code under
> >>> scalabindings to do this?
> >>> Thanks in advance.
> >
>