gaogaotiantian commented on code in PR #58274:
URL: https://github.com/apache/spark/pull/58274#discussion_r4009211386
##########
.github/workflows/build_and_test.yml:
##########
@@ -155,7 +155,7 @@ jobs:
docs=true
java25=true
else
- pyspark_install=false
+ pyspark_periodic=false
Review Comment:
I think `import pyspark` requires the pre-compiled artifact right? Maybe we
can write the test in a way that it does not even rely on `pyspark`. However,
for pre-merge tests, we have to compile the thing anyway. For scheduled CIs,
it's just some extra work for each heavy CI. I don't think we gain a lot if we
have a separate CI for it. Structure wise maybe it's better? But we still want
to test against the Python matrix and different OSes, so this is probably the
easier way to do.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
