Github user shivaram commented on the issue:
https://github.com/apache/spark/pull/12836
I think I found the commit which causes this problem -
https://github.com/apache/spark/commit/6dde27404cb3d921d75dd6afca4b383f9df5976a
added toString to include arrays and the output we get is from calling mkString
on Array[Byte] in MapPartitionsInR.
@NarineK can you see if we can override `stringArgs` in the
`MapPartitionsInR` node to only contain the elements we want to print ? We'll
need to something similar for the new nodes added in this PR as well
cc @liancheng @clockfly Is there some easier way to exclude some args from
being printed in the plan ?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
