Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/20629
Thank you for reviewing @holdenk âº
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/20629
Merged to master :) Thank you :)
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-ma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93016/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20629
**[Test build #93016 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93016/testReport)**
for PR 20629 at commit
[`926c353`](https://github.com/apache/spark/commit/9
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20629
**[Test build #93016 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93016/testReport)**
for PR 20629 at commit
[`926c353`](https://github.com/apache/spark/commit/92
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/962/
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/20629
After I merged your other PR this has some minor conflicts so needs an
update, but I'd be happy to try and get this in end of next week during my next
review session :)
---
--
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/20629
@holdenk @sethah any more comments on this? As 2.4 release is approaching I
think it would be great to have this in, so we can remove the deprecated APIs
in 3.0... Thanks.
---
--
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92477/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20629
**[Test build #92477 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92477/testReport)**
for PR 20629 at commit
[`701b98a`](https://github.com/apache/spark/commit/7
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92476/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20629
**[Test build #92476 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92476/testReport)**
for PR 20629 at commit
[`5a5c31f`](https://github.com/apache/spark/commit/5
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/587/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20629
**[Test build #92477 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92477/testReport)**
for PR 20629 at commit
[`701b98a`](https://github.com/apache/spark/commit/70
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20629
**[Test build #92476 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92476/testReport)**
for PR 20629 at commit
[`5a5c31f`](https://github.com/apache/spark/commit/5a
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20629
**[Test build #92475 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92475/testReport)**
for PR 20629 at commit
[`be954c6`](https://github.com/apache/spark/commit/b
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92475/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/585/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20629
**[Test build #92475 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92475/testReport)**
for PR 20629 at commit
[`be954c6`](https://github.com/apache/spark/commit/be
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/20629
Thanks @holdenk @sethah, then I'll update this PR accordingly. Thanks.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.a
Github user sethah commented on the issue:
https://github.com/apache/spark/pull/20629
+1 for @mgaido91's plan
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: review
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/20629
ping @sethah?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@s
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/20629
ping @sethah :)
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/20629
cc @sethah
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spar
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/20629
kindly ping @holdenk @MLnick
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/20629
kindly ping @holdenk @MLnick
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/20629
@holdenk I am not sure about requiring or not cluster centers for this
metric. On one side, since the `ClusteringEvaluator` should be a general
interface for all clustering models and some of them
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89205/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20629
**[Test build #89205 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89205/testReport)**
for PR 20629 at commit
[`ca8c2ec`](https://github.com/apache/spark/commit/c
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89207/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20629
**[Test build #89207 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89207/testReport)**
for PR 20629 at commit
[`9c8cc67`](https://github.com/apache/spark/commit/9
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution//
Tes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20629
**[Test build #89207 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89207/testReport)**
for PR 20629 at commit
[`9c8cc67`](https://github.com/apache/spark/commit/9c
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2220/
Tes
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20629
**[Test build #89205 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89205/testReport)**
for PR 20629 at commit
[`ca8c2ec`](https://github.com/apache/spark/commit/ca
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/20629
@holdenk I am not sure I got 100% what you meant, so I'll try to answer but
let me know if I missed something.
The problem of doing 2 passes is related to cluster centers. The API of
`Clus
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/20629
So when you say "second pass over the data" - from looking at this it seems
like it would could do this with just a second map to look up the predictions
in the already computed cluster centers, not
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/20629
kindly ping @MLnick @jkbradley @hhbyyh
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional command
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/20629
kindly ping @MLnick @jkbradley @hhbyyh
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88307/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20629
**[Test build #88307 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88307/testReport)**
for PR 20629 at commit
[`05680ea`](https://github.com/apache/spark/commit/0
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1562/
Tes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/20629
@MLnick I checked and adding the `computeCosts` to `ClusteringEvaluator`
has a small drawback: we have to compute the centers for each cluster and then
we can compute the costs, which involved two
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20629
**[Test build #88307 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88307/testReport)**
for PR 20629 at commit
[`05680ea`](https://github.com/apache/spark/commit/05
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/20629
sorry @MLnick, what do you think about my previous comment? Any thoughts?
Thanks.
---
-
To unsubscribe, e-mail: reviews-unsubsc
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/20629
yes, I agree with you @MLnick. I'd like to ping also @jkbradley and @hhbyyh
who drove the PR which introduce `computeCost`.
In order to move the same metric to `ClusteringEvaluator`, I thin
Github user MLnick commented on the issue:
https://github.com/apache/spark/pull/20629
Right - so while itâs perhaps a lower quality metric it is different. So I
wonder if deprecation is the right approach (vs say putting the within
cluster sum squares into ClusteringEvaluator)
Github user MLnick commented on the issue:
https://github.com/apache/spark/pull/20629
Sorry I mean putting the metric in evaluator and then also deprecating
computCost
On Sun, 18 Feb 2018 at 20:41, Nick Pentreath
wrote:
> Right - so while itâs perhaps a lower qua
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/20629
thanks for taking a look at this @MLnick. No, it doesn't, in the sense that
it returns a different result: this is the sum of the squared euclidean
distance between a point and the centroid of the
Github user MLnick commented on the issue:
https://github.com/apache/spark/pull/20629
Just want to check - does `computeCost` do the same thing as the silhouette
metric?
---
-
To unsubscribe, e-mail: reviews-unsubsc
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87510/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20629
**[Test build #87510 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87510/testReport)**
for PR 20629 at commit
[`2f79bb2`](https://github.com/apache/spark/commit/2
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20629
**[Test build #87510 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87510/testReport)**
for PR 20629 at commit
[`2f79bb2`](https://github.com/apache/spark/commit/2f
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/937/
Test
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20629
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
69 matches
Mail list logo