Github user yanboliang commented on the issue:
https://github.com/apache/spark/pull/14948
Yep, these changes are not overlapping with #14937 for the most part, and
they are actually same changes for the overlapping part. Let's make this PR
focus on the optimization of initialization step and to fix it's likely to
return duplicate centroids.
For reducing initialization steps to 2 for default k-means||, I wonder the
impact to the total training iteration number. It will definitely reduce the
initialization time, but whether it will introduce more training iterations due
to not good enough initial centers? If it does not introduce extra iterations
for most cases, I think it's OK. Or we should trade off the initialization and
training iterations. Thanks!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
