lgbo-ustc opened a new issue, #7732: URL: https://github.com/apache/incubator-gluten/issues/7732
### Backend CH (ClickHouse) ### Bug description [Expected behavior] and [actual behavior]. ``` 2024-10-30 15:36:59.600 <Debug> AggregateDataBlockConverter: Convert bucket 54 into one block, rows: 6105, cols: 15, bytes:1.17 MiB, total bucket: 256, total rows: 1248702, time: 2 2024-10-30 15:36:59.603 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 604.94 KiB, max limit: 1.00 MiB, current memory usage: 1.27 GiB 2024-10-30 15:36:59.611 <Debug> AggregateDataBlockConverter: Convert bucket 55 into one block, rows: 6213, cols: 15, bytes:1.17 MiB, total bucket: 256, total rows: 1242489, time: 2 2024-10-30 15:36:59.614 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 1.18 MiB, max limit: 1.00 MiB, current memory usage: 1.27 GiB 2024-10-30 15:36:59.643 <Debug> AggregateDataBlockConverter: Convert bucket 56 into one block, rows: 6263, cols: 15, bytes:1.17 MiB, total bucket: 256, total rows: 1236226, time: 3 2024-10-30 15:36:59.646 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 606.31 KiB, max limit: 1.00 MiB, current memory usage: 1.27 GiB 2024-10-30 15:36:59.655 <Debug> AggregateDataBlockConverter: Convert bucket 57 into one block, rows: 6096, cols: 15, bytes:1.17 MiB, total bucket: 256, total rows: 1230130, time: 3 2024-10-30 15:36:59.657 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 1.18 MiB, max limit: 1.00 MiB, current memory usage: 1.27 GiB 2024-10-30 15:36:59.693 <Debug> AggregateDataBlockConverter: Convert bucket 58 into one block, rows: 6350, cols: 15, bytes:1.18 MiB, total bucket: 256, total rows: 1223780, time: 3 2024-10-30 15:36:59.695 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 607.06 KiB, max limit: 1.00 MiB, current memory usage: 1.27 GiB 2024-10-30 15:36:59.705 <Debug> AggregateDataBlockConverter: Convert bucket 59 into one block, rows: 6244, cols: 15, bytes:1.17 MiB, total bucket: 256, total rows: 1217536, time: 3 2024-10-30 15:36:59.707 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 1.18 MiB, max limit: 1.00 MiB, current memory usage: 1.27 GiB 2024-10-30 15:36:59.742 <Debug> AggregateDataBlockConverter: Convert bucket 60 into one block, rows: 6226, cols: 15, bytes:1.17 MiB, total bucket: 256, total rows: 1211310, time: 3 2024-10-30 15:36:59.745 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 606.00 KiB, max limit: 1.00 MiB, current memory usage: 1.27 GiB 2024-10-30 15:36:59.753 <Debug> AggregateDataBlockConverter: Convert bucket 61 into one block, rows: 6295, cols: 15, bytes:1.17 MiB, total bucket: 256, total rows: 1205015, time: 3 2024-10-30 15:36:59.755 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 1.18 MiB, max limit: 1.00 MiB, current memory usage: 1.27 GiB 2024-10-30 15:36:59.788 <Debug> AggregateDataBlockConverter: Convert bucket 62 into one block, rows: 6110, cols: 15, bytes:1.17 MiB, total bucket: 256, total rows: 1198905, time: 2 2024-10-30 15:36:59.790 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 605.00 KiB, max limit: 1.00 MiB, current memory usage: 1.27 GiB 2024-10-30 15:36:59.798 <Debug> AggregateDataBlockConverter: Convert bucket 63 into one block, rows: 6213, cols: 15, bytes:1.17 MiB, total bucket: 256, total rows: 1192692, time: 2 2024-10-30 15:36:59.800 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 1.18 MiB, max limit: 1.00 MiB, current memory usage: 1.27 GiB 2024-10-30 15:36:59.835 <Debug> AggregateDataBlockConverter: Convert bucket 64 into one block, rows: 6234, cols: 15, bytes:1.17 MiB, total bucket: 256, total rows: 1186458, time: 3 2024-10-30 15:36:59.837 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 606.06 KiB, max limit: 1.00 MiB, current memory usage: 1.27 GiB 2024-10-30 15:36:59.846 <Debug> AggregateDataBlockConverter: Convert bucket 65 into one block, rows: 6172, cols: 15, bytes:1.17 MiB, total bucket: 256, total rows: 1180286, time: 3 2024-10-30 15:36:59.849 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 1.18 MiB, max limit: 1.00 MiB, current memory usage: 1.27 GiB 2024-10-30 15:36:59.882 <Debug> AggregateDataBlockConverter: Convert bucket 66 into one block, rows: 6332, cols: 15, bytes:1.18 MiB, total bucket: 256, total rows: 1173954, time: 3 2024-10-30 15:36:59.884 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 606.91 KiB, max limit: 1.00 MiB, current memory usage: 1.27 GiB 2024-10-30 15:36:59.893 <Debug> AggregateDataBlockConverter: Convert bucket 67 into one block, rows: 6169, cols: 15, bytes:1.17 MiB, total bucket: 256, total rows: 1167785, time: 3 2024-10-30 15:36:59.896 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 1.18 MiB, max limit: 1.00 MiB, current memory usage: 1.27 GiB 2024-10-30 15:36:59.931 <Debug> AggregateDataBlockConverter: Convert bucket 68 into one block, rows: 6173, cols: 15, bytes:1.17 MiB, total bucket: 256, total rows: 1161612, time: 3 2024-10-30 15:36:59.934 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 605.53 KiB, max limit: 1.00 MiB, current memory usage: 1.27 GiB 2024-10-30 15:36:59.943 <Debug> AggregateDataBlockConverter: Convert bucket 69 into one block, rows: 6197, cols: 15, bytes:1.17 MiB, total bucket: 256, total rows: 1155415, time: 3 2024-10-30 15:36:59.946 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 1.18 MiB, max limit: 1.00 MiB, current memory usage: 1.27 GiB 2024-10-30 15:36:59.981 <Debug> AggregateDataBlockConverter: Convert bucket 70 into one block, rows: 6223, cols: 15, bytes:1.17 MiB, total bucket: 256, total rows: 1149192, time: 3 2024-10-30 15:36:59.983 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 605.97 KiB, max limit: 1.00 MiB, current memory usage: 1.27 GiB 2024-10-30 15:36:59.992 <Debug> AggregateDataBlockConverter: Convert bucket 71 into one block, rows: 6203, cols: 15, bytes:1.17 MiB, total bucket: 256, total rows: 1142989, time: 3 2024-10-30 15:36:59.994 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 1.18 MiB, max limit: 1.00 MiB, current memory usage: 1.27 GiB 2024-10-30 15:37:00.021 <Debug> AggregateDataBlockConverter: Convert bucket 72 into one block, rows: 6047, cols: 15, bytes:1.17 MiB, total bucket: 256, total rows: 1136942, time: 2 2024-10-30 15:37:00.023 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 604.44 KiB, max limit: 1.00 MiB, current memory usage: 1.27 GiB 2024-10-30 15:37:00.032 <Debug> AggregateDataBlockConverter: Convert bucket 73 into one block, rows: 6184, cols: 15, bytes:1.17 MiB, total bucket: 256, total rows: 1130758, time: 3 2024-10-30 15:37:00.034 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 1.18 MiB, max limit: 1.00 MiB, current memory usage: 1.40 GiB 2024-10-30 15:37:00.067 <Debug> AggregateDataBlockConverter: Convert bucket 74 into one block, rows: 6285, cols: 15, bytes:1.17 MiB, total bucket: 256, total rows: 1124473, time: 3 2024-10-30 15:37:00.070 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 606.50 KiB, max limit: 1.00 MiB, current memory usage: 1.40 GiB 2024-10-30 15:37:00.079 <Debug> AggregateDataBlockConverter: Convert bucket 75 into one block, rows: 6134, cols: 15, bytes:1.17 MiB, total bucket: 256, total rows: 1118339, time: 3 2024-10-30 15:37:00.081 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 1.18 MiB, max limit: 1.00 MiB, current memory usage: 1.40 GiB 2024-10-30 15:37:00.113 <Debug> AggregateDataBlockConverter: Convert bucket 76 into one block, rows: 6317, cols: 15, bytes:1.17 MiB, total bucket: 256, total rows: 1112022, time: 3 2024-10-30 15:37:00.115 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 606.78 KiB, max limit: 1.00 MiB, current memory usage: 1.40 GiB 2024-10-30 15:37:00.125 <Debug> AggregateDataBlockConverter: Convert bucket 77 into one block, rows: 6174, cols: 15, bytes:1.17 MiB, total bucket: 256, total rows: 1105848, time: 3 2024-10-30 15:37:00.127 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 1.18 MiB, max limit: 1.00 MiB, current memory usage: 1.40 GiB 2024-10-30 15:37:00.159 <Debug> AggregateDataBlockConverter: Convert bucket 78 into one block, rows: 6210, cols: 15, bytes:1.17 MiB, total bucket: 256, total rows: 1099638, time: 3 2024-10-30 15:37:00.162 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 605.84 KiB, max limit: 1.00 MiB, current memory usage: 1.40 GiB 2024-10-30 15:37:00.171 <Debug> AggregateDataBlockConverter: Convert bucket 79 into one block, rows: 6338, cols: 15, bytes:1.18 MiB, total bucket: 256, total rows: 1093300, time: 3 2024-10-30 15:37:00.173 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 1.18 MiB, max limit: 1.00 MiB, current memory usage: 1.40 GiB 2024-10-30 15:37:00.206 <Debug> AggregateDataBlockConverter: Convert bucket 80 into one block, rows: 6377, cols: 15, bytes:1.18 MiB, total bucket: 256, total rows: 1086923, time: 3 2024-10-30 15:37:00.208 <Debug> GraceMergingAggregatedTransform: flush pending bytes. pending_bytes: 607.28 KiB, max limit: 1.00 MiB, current memory usage: 1.40 GiB 2024-10-30 15:37:00.217 <Debug> AggregateDataBlockConverter: Convert bucket 81 into one block, rows: 6393, cols: 15, bytes:1.18 MiB, total bucket: 256, total rows: 1080530, time: 3 ``` ### Spark version None ### Spark configurations _No response_ ### System information _No response_ ### Relevant logs _No response_ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
