Github user mengxr commented on the pull request:
https://github.com/apache/spark/pull/4986#issuecomment-79350101
The number of clusters won't be very large. Flattening an
`Array[Array[Double]]` doesn't copy the data, so there is no overhead. The
content of parquet file is easy to inspect if we list each center as a record.
I think we should just use `Array[Double]` instead being blocked by
`MatrixUDT`. `GMM` models are usually dense.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
