HyukjinKwon commented on pull request #32036:
URL: https://github.com/apache/spark/pull/32036#issuecomment-813354631
Yeah, thanks for pointing that out. I actually more meant
`spark.pandas-on-spark.blahblah` by the configuration name in Spark, e.g.)
`spark.set("spark.pandas-on-spark.blahblah", "true")`. Since Koalas has its own
option system, we won't likely have to deal with it for now but you never know
what's going to happen in the future though ..
Speaking of `pyspark.pandas` and `pyspark.koalas`, I understand it's
difficult to choose one over another as each has distinct limitations and
benefits - there was a hot debate on this offline too.
Again, thanks for your contribution in Koalas @garawalid. This PR would have
never been possible without you.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
