kykrueger commented on PR #1847: URL: https://github.com/apache/systemds/pull/1847#issuecomment-1617645181
Over the weekend I added the option to set dtypes in the io loading scripts. I still want to add the additional benchmarks for materializing the data of different types in the other direction (systemds -> python). For now, here are the results from a test with 20 repeats for the data-types configured in the test at them moment: ``` -- Running IO benchmarks on 500_250_dense double: read.dml; 40.781715454 double: load_native.py; 39.19094614699134 int: read.dml; 32.824596657 int: load_native.py; 36.457156577002024 string: read.dml; 34.440663763 string: load_native.py; 38.71029913998791 boolean: read.dml; 33.266684618 boolean: load_native.py; 36.68671202700352 double: load_numpy.py; 32.85507999898982 double: load_pandas.py; 512.6433556610136 float: load_numpy.py; 38.261559439997654 float: load_pandas.py; 546.0650390849914 long: load_numpy.py; 39.400702337006805 long: load_pandas.py; 536.5950958920002 int64: load_numpy.py; 32.98173662999761 int64: load_pandas.py; 487.0634801320266 int32: load_numpy.py; 32.48500068101566 int32: load_pandas.py; 489.97116349000135 uint8: load_numpy.py; 31.86706029099878 uint8: load_pandas.py; 496.9151880980062 string: load_numpy.py; string: load_pandas.py; 504.3096235789999 bool: load_numpy.py; 33.19832509398111 bool: load_pandas.py; 479.9256292580103 ``` I'm undecided about the order to run them in to have logs which make the most sense for you to read. Currently they are just grouped in a way that made the proof-of-concept script easier to write. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@systemds.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
