JasonLi-cn commented on PR #11758:
URL: https://github.com/apache/datafusion/pull/11758#issuecomment-2276991962
> 405
> 🤔
>
> ```
> Query 17 iteration 4 took 6144.7 ms and returned 10 rows
> Q18: SELECT "UserID", extract(minute FROM
to_timestamp_seconds("EventTime")) AS m, "SearchPhrase", COUNT(*) FROM hits
GROUP BY "UserID", m, "SearchPhrase" ORDER BY COUNT(*) DESC LIMIT\
> 10;
> ./bench.sh: line 410: 1005229 Killed $CARGO_COMMAND --bin
dfbench -- clickbench --iterations 5 --path "${DATA_DIR}/hits.parquet"
--queries-path "${SCRIPT_DIR}/queries\
> /clickbench/queries.sql" -o ${RESULTS_FILE}
> alamb@aal-dev:~/datafusion-benchmarking$
> ```
>
> It appears on this branch the kernel killed the process due to out of
memory (which does not happen on main)
>
> ```
> alamb@aal-dev:~/datafusion-benchmarking$sudo dmesg | tail
> [262830.944639] [1003196] 0 1003196 4230 1440 69632
0 0 sshd
> [262830.944642] [1003273] 1001 1003273 4305 1341 69632
0 0 sshd
> [262830.944644] [1003274] 1001 1003274 2308 1152 53248
0 0 bash
> [262830.944646] [1003284] 1001 1003284 2080 864 57344
0 0 tmux: client
> [262830.944648] [1003287] 1001 1003287 2765 1230 61440
0 0 bash
> [262830.944650] [1005223] 1001 1005223 2007 768 57344
0 0 bash
> [262830.944652] [1005229] 1001 1005229 25851352 16101822 170872832
0 0 dfbench
> [262830.944654]
oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=user.slice,mems_allowed=0,global_oom,task_memcg=/user.slice/user-1001.slice/session-14.scope,task=dfbench,pi\
> d=1005229,uid=1001
> [262830.944733] Out of memory: Killed process 1005229 (dfbench)
total-vm:103405408kB, anon-rss:64403832kB, file-rss:3456kB, shmem-rss:0kB,
UID:1001 pgtables:166868kB oom_score_adj:0
> [262833.485378] oom_reaper: reaped process 1005229 (dfbench), now
anon-rss:0kB, file-rss:1140kB, shmem-rss:0kB
> alamb@aal-dev:~/datafusion-benchmarking$
> ```
Thank you @alamb 🙏. Let me analyze it further 🤔
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
