GideonPotok commented on PR #45738:
URL: https://github.com/apache/spark/pull/45738#issuecomment-2046822456
> did you try to run this suite locally and investigate any potential issues?
@uros-db I would love to. I need to fix my setup though, first -- there is
an issue I have been putting off where any unit tests (in the spark codebase)
that make use of the local file system seems to hang indefinitely when run
locally: any tests that use `.noop` write, that use `CREATE TABLE... USING
PARQUET`, or when running this suite in particular
(`org.apache.spark.sql.execution.datasources.csv.CSVLegacyTimeParserSuite`). I
would love to know how you recommend that I look into figuring out the root
cause, so I can fix my local setup...
I usually run from sbt directly. I can provide additional setup details, eg
my jvmopts and sbt jvm opts. I have also done some cursory JVM performance
profiling and can provide some of those measurements.
Let me know what to look into first. Thanks so much.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
