Github user BryanCutler commented on the issue:
https://github.com/apache/spark/pull/16782
Hi @avi8tr , what exactly about this proposed fix is not thread-safe?
`_input_kwargs` also performs another function which is to only contain the
params explicitly set by the user. These get passed along separately with a
complete set of default values to the underlying pyspark.ml param maps. What
you are proposing does not account for that and would require major
restructuring as many of the pyspark.ml classes have huge param lists.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]