alamb commented on issue #15949:
URL: https://github.com/apache/datafusion/issues/15949#issuecomment-2891161932
I noticed the above query has only 91 groups:
```sql
DataFusion CLI v47.0.0
> SELECT
"OS",
AVG(to_timestamp("ResponseEndTiming")-to_timestamp("ResponseStartTiming"))
as
avg_response_time,AVG(to_timestamp("ResponseEndTiming")-to_timestamp("ConnectTiming"))
as avg_latency
FROM
'data/hits_partitioned'
GROUP BY
"OS"
ORDER BY
avg_latency DESC;
+-----+-------------------------------------------+------------------------------------------+
| OS | avg_response_time | avg_latency
|
+-----+-------------------------------------------+------------------------------------------+
| 103 | 0 days 0 hours 13 mins 47.509466437 secs | 0 days 0 hours 13 mins
47.509466437 secs |
| 74 | 0 days 0 hours 12 mins 51.287431013 secs | 0 days 0 hours 13 mins
47.184892702 secs |
| 49 | 0 days 0 hours 13 mins 9.107811258 secs | 0 days 0 hours 13 mins
42.811185779 secs |
| 77 | 0 days 0 hours 9 mins 47.668864464 secs | 0 days 0 hours 11 mins
26.796840642 secs |
| 112 | 0 days 0 hours 3 mins 19.018355160 secs | 0 days 0 hours 8 mins
32.958042116 secs |
| 70 | 0 days 0 hours 1 mins 31.113089802 secs | 0 days 0 hours 8 mins
8.089117199 secs |
| 59 | 0 days 0 hours 0 mins -59.687500000 secs | 0 days 0 hours 4 mins
44.562500000 secs |
| 101 | 0 days 0 hours 0 mins 27.485986881 secs | 0 days 0 hours 4 mins
24.220234545 secs |
| 12 | 0 days 0 hours 0 mins 0.915553578 secs | 0 days 0 hours 3 mins
21.616990075 secs |
| 39 | 0 days 0 hours 2 mins 11.248827183 secs | 0 days 0 hours 3 mins
1.060289083 secs |
| 46 | 0 days 0 hours 2 mins 51.602040816 secs | 0 days 0 hours 2 mins
51.602040816 secs |
| 104 | 0 days 0 hours -1 mins -41.261186264 secs | 0 days 0 hours 2 mins
7.463059313 secs |
| 45 | 0 days 0 hours 0 mins 31.872238129 secs | 0 days 0 hours 1 mins
37.324755565 secs |
| 7 | 0 days 0 hours -2 mins -38.098571146 secs | 0 days 0 hours 1 mins
35.758543491 secs |
| 126 | 0 days 0 hours -2 mins -25.507751501 secs | 0 days 0 hours 1 mins
32.933894412 secs |
| 33 | 0 days 0 hours -2 mins -11.200000000 secs | 0 days 0 hours 1 mins
31.200000000 secs |
| 9 | 0 days 0 hours -3 mins -53.293441768 secs | 0 days 0 hours 1 mins
28.609912908 secs |
| 11 | 0 days 0 hours -3 mins -48.205086798 secs | 0 days 0 hours 1 mins
23.773112636 secs |
| 44 | 0 days 0 hours -2 mins -30.470355300 secs | 0 days 0 hours 1 mins
22.076928357 secs |
| 1 | 0 days 0 hours -2 mins -22.108601400 secs | 0 days 0 hours 1 mins
16.524448796 secs |
| 2 | 0 days 0 hours -2 mins -10.731476126 secs | 0 days 0 hours 1 mins
16.255794248 secs |
| 37 | 0 days 0 hours -1 mins -4.520792848 secs | 0 days 0 hours 1 mins
7.226195102 secs |
| 116 | 0 days 0 hours 0 mins 32.117647058 secs | 0 days 0 hours 1 mins
6.509803921 secs |
| 0 | 0 days 0 hours 0 mins 29.708039353 secs | 0 days 0 hours 0 mins
58.786563598 secs |
| 57 | 0 days 0 hours 0 mins -54.983173266 secs | 0 days 0 hours 0 mins
56.604541731 secs |
| 3 | 0 days 0 hours -1 mins -57.406106095 secs | 0 days 0 hours 0 mins
54.878138590 secs |
| 5 | 0 days 0 hours -1 mins -14.716715226 secs | 0 days 0 hours 0 mins
46.498521635 secs |
| 68 | 0 days 0 hours -1 mins -41.598033744 secs | 0 days 0 hours 0 mins
41.615774557 secs |
| 67 | 0 days 0 hours 0 mins 27.802898817 secs | 0 days 0 hours 0 mins
37.835699842 secs |
| 38 | 0 days 0 hours -1 mins -0.347826086 secs | 0 days 0 hours 0 mins
36.797101449 secs |
| 98 | 0 days 0 hours -1 mins -25.621956238 secs | 0 days 0 hours 0 mins
36.477770676 secs |
| 34 | 0 days 0 hours -1 mins -18.701492537 secs | 0 days 0 hours 0 mins
27.402985074 secs |
| 35 | 0 days 0 hours 0 mins -35.877821173 secs | 0 days 0 hours 0 mins
21.667386721 secs |
| 17 | 0 days 0 hours -1 mins -38.074618882 secs | 0 days 0 hours 0 mins
17.008558438 secs |
| 58 | 0 days 0 hours -3 mins -54.294117647 secs | 0 days 0 hours 0 mins
16.588235294 secs |
| 54 | 0 days 0 hours 0 mins -53.554054054 secs | 0 days 0 hours 0 mins
16.304054054 secs |
| 14 | 0 days 0 hours -3 mins -2.845982142 secs | 0 days 0 hours 0 mins
14.861607142 secs |
| 13 | 0 days 0 hours -1 mins -6.324333862 secs | 0 days 0 hours 0 mins
13.454561496 secs |
| 10 | 0 days 0 hours 0 mins 8.780079478 secs | 0 days 0 hours 0 mins
9.103530175 secs |
| 71 | 0 days 0 hours 0 mins 7.617299688 secs | 0 days 0 hours 0 mins
7.712214154 secs |
| .
|
| .
|
| .
|
+-----+-------------------------------------------+------------------------------------------+
91 row(s) fetched. (First 40 displayed. Use --maxrows to adjust)
Elapsed 0.224 seconds.
```
I recommend we also add other columns to the `GROUP BY` to increase the
number of groups / challenge of the aggregate? That could also be a second
query potentially
```sql
GROUP BY
"RegionID",
"UserAgent",
"OS"
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]