zhengruifeng commented on PR #48139: URL: https://github.com/apache/spark/pull/48139#issuecomment-2359975787
> To @xinrong-meng and @zhengruifeng , does it mean Spark is okay because it is not using `plotly` backend if it doesn't exist? > > * [[SPARK-49531][PYTHON][CONNECT] Support line plot with plotly backend #48139 (comment)](https://github.com/apache/spark/pull/48139#issuecomment-2357825412) > > I'm a little confused about this part. If Spark can choose non-plotly fallback, why do we have `skip` statements? plotting should be able to switch the backend, e.g. 1, the plotting in pandas api on spark support both `plotly` and `matplotlib` https://github.com/apache/spark/blob/62cdc564d5b3cf7684f0e95e9b31691019c9035f/python/pyspark/pandas/config.py#L300-L309 2, polars support both `altair` and `HvPlot` https://github.com/pola-rs/polars/blob/120a5e2d97f0baef2025f0f2c5c0c40a712a2c25/py-polars/polars/series/plotting.py#L127-L142 IMO, we make the `plotly` the default backend, but as a optional dependency. If `plotly` is not installed, the `df.plot` fails with ImportError error, but the remaining part of pyspark should be still available. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
