GideonPotok commented on PR #45453:
URL: https://github.com/apache/spark/pull/45453#issuecomment-2000575009
@dbatomic It is coming along.
So far, Benchmark results are:
```
OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Mac OS X 14.4
Apple M3 Max
filter - UCS_BASIC_LCASE: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
filter - UCS_BASIC_LCASE 0 0
0 70.4 14.2 1.0X
OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Mac OS X 14.4
Apple M3 Max
hashFunction - UCS_BASIC_LCASE: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
hashFunction - UCS_BASIC_LCASE 0 0
0 92.3 10.8 1.0X
```
There would be a few more sets of results, but the process is thrashing,
maybe. I am working through the run getting frozen after finishing
`benchmarkHashFunction`. The process is not running out of heap space. CPU
usage is effectively 0% which I would think would mean the process is stuck on
IO.
Any ideas?
I am having the same sort of performance hanging when trying to run
`org.apache.spark.sql.execution.benchmark.InsertTableWithDynamicPartitionsBenchmark`
just to see if the problem was specific to the newly created tests...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
