WeichenXu123 commented on PR #37734:
URL: https://github.com/apache/spark/pull/37734#issuecomment-1384095881
Merged to apache/spark master.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
WeichenXu123 commented on PR #37734:
URL: https://github.com/apache/spark/pull/37734#issuecomment-1336407074
@leewyang Does `df.limit(10).cache().withColumn` address the issue ?
@HyukjinKwon Looks like
https://github.com/apache/spark/pull/37734#issuecomment-1315678614 is a
WeichenXu123 commented on PR #37734:
URL: https://github.com/apache/spark/pull/37734#issuecomment-1311877149
@mengxr Could you make a final pass ? The PR is LGTM once all my comments
addressed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please
WeichenXu123 commented on PR #37734:
URL: https://github.com/apache/spark/pull/37734#issuecomment-1306665478
Some more comments, mainly about doc and adding more data checking. PR is
near ready!
--
This is an automated message from the Apache Git Service.
To respond to the message,
WeichenXu123 commented on PR #37734:
URL: https://github.com/apache/spark/pull/37734#issuecomment-1306594350
> > Pls also fix the linter failure:
https://github.com/leewyang/spark/actions/runs/3397174449/jobs/5649073867#step:16:71
>
> Updated to latest master, which got rid of the
WeichenXu123 commented on PR #37734:
URL: https://github.com/apache/spark/pull/37734#issuecomment-1305628531
Pls also fix the linter failure:
https://github.com/leewyang/spark/actions/runs/3397174449/jobs/5649073867#step:16:71
--
This is an automated message from the Apache Git Service.
WeichenXu123 commented on PR #37734:
URL: https://github.com/apache/spark/pull/37734#issuecomment-1234139636
But I think we'd better design and discuss the API first. @mengxr Do you
have any suggestions ?
--
This is an automated message from the Apache Git Service.
To respond to the