EnricoMi commented on PR #38223:
URL: https://github.com/apache/spark/pull/38223#issuecomment-1451889010
@HyukjinKwon why has this been reverted? a86324cb
CI looked pretty green:
https://github.com/apache/spark/actions/runs/4129838944/jobs/7135888364
--
This is an automated message
EnricoMi commented on PR #38223:
URL: https://github.com/apache/spark/pull/38223#issuecomment-1371196200
@HyukjinKwon @cloud-fan @xinrong-meng can we get this into Spark 3.4?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub
EnricoMi commented on PR #38223:
URL: https://github.com/apache/spark/pull/38223#issuecomment-1346169923
@HyukjinKwon @cloud-fan can we get this merged before 3.4.0 branch freezes?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
EnricoMi commented on PR #38223:
URL: https://github.com/apache/spark/pull/38223#issuecomment-1327349167
All done, all green.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific
EnricoMi commented on PR #38223:
URL: https://github.com/apache/spark/pull/38223#issuecomment-1297528721
@HyukjinKwon I have addressed your comment.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go
EnricoMi commented on PR #38223:
URL: https://github.com/apache/spark/pull/38223#issuecomment-1286734504
I have also limited the schema string in the error message to 1024
characters / missing and unexpected columns to 5.
--
This is an automated message from the Apache Git Service.
To
EnricoMi commented on PR #38223:
URL: https://github.com/apache/spark/pull/38223#issuecomment-1277118325
@HyukjinKwon @cloud-fan @zhengruifeng @itholic
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
EnricoMi commented on PR #38223:
URL: https://github.com/apache/spark/pull/38223#issuecomment-1276295368
The `... Schema: id, val` bit can grow arbitrarily large, maybe this should
be limited to the first X columns or characters.
If there are multiple calls to `applyInPandas` in a
