kykrueger commented on PR #1847: URL: https://github.com/apache/systemds/pull/1847#issuecomment-1627369924
@Baunsgaard I took a look at isolating the time to materialize to python from systemds, and it doesn't look like there are any easy ways to do this at the moment. There would be an ugly solution of creating two new benchmarks which force a transformation and then the transformation + materialization, then calculate the difference between the operations as the time needed to pass from systemds to python. However, I'd take a step back from this one and suggest that first a materialization feature is added to systemds akin to what is available in spark. This might be useful in more contexts, and make more features easier to benchmark in the future. Shall we close merge this PR without that feature after all? Also, I've noticed that the PRs show as closed instead of merged, is that because of local merging, could you try merging from the github UI for better Github Achievements tracking? Best, -- Kyle -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@systemds.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
