REASY commented on issue #4973: URL: https://github.com/apache/arrow-rs/issues/4973#issuecomment-1774070380
Yeap, I tried to use DHAT, but nothing much is visible there, https://github.com/REASY/parquet-example-rs#memory-profiler Also I wanted to make sure there is no memory leaks, so run valgrind to check memory related issue, it takes ~4 hours, but nothing was reported: ``` ➜ parquet-example-rs git:(main) ✗ cargo install cargo-valgrind ➜ parquet-example-rs git:(main) ✗ cargo valgrind run -- --output-parquet-folder output --rows 1000 --statistics-mode page Compiling parquet-example-rs v0.1.0 (/home/artavazd.balaian/work/github/REASY/parquet-example-rs) Finished dev [unoptimized + debuginfo] target(s) in 2.14s Running `/home/artavazd.balaian/.cargo/bin/cargo-valgrind target/debug/parquet-example-rs --output-parquet-folder output --rows 1000 --statistics-mode page` Received args: AppArgs { output_parquet_folder: "output", rows: 1000, statistics_mode: Page } Processed 500 msgs with throughout 0.073 msg/s Processed 1000 msgs with throughout 0.073 msg/s Wrote 1000 Lidar Point Cloud to parquet in 13759.010 seconds, average throughput 0.073 msg/s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
