Github user felixcheung commented on the issue:
https://github.com/apache/spark/pull/19147
relaying my questions from the dev@ thread:
+1 for type in string form.
Would it be correct to assume there will be data type check, for example
the returned pandas data frame column data types match what are specified. We
have seen quite a bit of issues/confusions with that in R.
Would it make sense to have a more generic decorator name so that it could
also be useable for other efficient vectorized format in the future? Or do we
anticipate the decorator to be format specific and will have more in the future?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
