lgbo-ustc commented on issue #6790: URL: https://github.com/apache/incubator-gluten/issues/6790#issuecomment-2285284571
May be the same problem ``` [2024-08-13T02:37:56.671Z] java.lang.IllegalStateException: Internal Error class org.apache.gluten.execution.ProjectExecTransformer has column support mismatch: [2024-08-13T02:37:56.671Z] ProjectExecTransformer [c_last_name#14821, c_first_name#14820, d_date#14757, coalesce(c_last_name#14821, ) AS projected_partitioning_value_0#58675, isnull(c_last_name#14821) AS projected_partitioning_value_1#58676, coalesce(c_first_name#14820, ) AS projected_partitioning_value_2#58677, isnull(c_first_name#14820) AS projected_partitioning_value_3#58678, coalesce(d_date#14757, 1970-01-01) AS projected_partitioning_value_4#58679, isnull(d_date#14757) AS projected_partitioning_value_5#58680] [2024-08-13T02:37:56.672Z] +- HashAggregateTransformer(keys=[c_last_name#14821, c_first_name#14820, d_date#14757], functions=[], isStreamingAgg=false, output=[c_last_name#14821, c_first_name#14820, d_date#14757]) [2024-08-13T02:37:56.672Z] +- ColumnarExchange hashpartitioning(c_last_name#14821, c_first_name#14820, d_date#14757, 5), ENSURE_REQUIREMENTS, [plan_id=350544], [id=#350544], [OUTPUT] List(c_last_name:StringType, c_first_name:StringType, d_date:DateType), [OUTPUT] List(c_last_name:StringType, c_first_name:StringType, d_date:DateType) [2024-08-13T02:37:56.672Z] +- HashAggregateTransformer(keys=[c_last_name#14821, c_first_name#14820, d_date#14757], functions=[], isStreamingAgg=false, output=[c_last_name#14821, c_first_name#14820, d_date#14757]) [2024-08-13T02:37:56.672Z] +- ProjectExecTransformer [c_last_name#14821, c_first_name#14820, d_date#14757] [2024-08-13T02:37:56.672Z] +- CHBroadcastHashJoinExecTransformer [ss_customer_sk#15499], [c_customer_sk#14812], Inner, BuildRight, false [2024-08-13T02:37:56.672Z] :- ProjectExecTransformer [ss_customer_sk#15499, d_date#14757] [2024-08-13T02:37:56.672Z] : +- CHBroadcastHashJoinExecTransformer [ss_sold_date_sk#15519], [d_date_sk#14755], Inner, BuildRight, false [2024-08-13T02:37:56.672Z] : :- FilterExecTransformer isnotnull(ss_customer_sk#15499) [2024-08-13T02:37:56.672Z] : : +- NativeFileScan parquet tpcdsdb.store_sales[ss_customer_sk#15499,ss_sold_date_sk#15519] Batched: true, DataFilters: [isnotnull(ss_customer_sk#15499)], Format: Parquet, Location: InMemoryFileIndex(1823 paths)[file:/data/tpcds-data-sf1-decimal/store_sales/ss_sold_date_sk=24512..., PartitionFilters: [isnotnull(ss_sold_date_sk#15519), dynamicpruningexpression(ss_sold_date_sk#15519 IN dynamicpruni..., PushedFilters: [IsNotNull(ss_customer_sk)], ReadSchema: struct<ss_customer_sk:int> [2024-08-13T02:37:56.672Z] : : +- ColumnarSubqueryBroadcast dynamicpruning#58574, 0, [d_date_sk#14755], [id=#350042] [2024-08-13T02:37:56.672Z] : : +- ColumnarBroadcastExchange HashedRelationBroadcastMode(List(cast(input[0, int, true] as bigint)),false), [plan_id=350041] [2024-08-13T02:37:56.672Z] : : +- ^(4516) ProjectExecTransformer [d_date_sk#14755, d_date#14757] [2024-08-13T02:37:56.672Z] : : +- ^(4516) FilterExecTransformer (((isnotnull(d_month_seq#14758) AND (d_month_seq#14758 >= 1212)) AND (d_month_seq#14758 <= 1223)) AND isnotnull(d_date_sk#14755)) [2024-08-13T02:37:56.672Z] : : +- ^(4516) NativeFileScan parquet tpcdsdb.date_dim[d_date_sk#14755,d_date#14757,d_month_seq#14758] Batched: true, DataFilters: [isnotnull(d_month_seq#14758), (d_month_seq#14758 >= 1212), (d_month_seq#14758 <= 1223), isnotnul..., Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/data/tpcds-data-sf1-decimal/date_dim], PartitionFilters: [], PushedFilters: [IsNotNull(d_month_seq), GreaterThanOrEqual(d_month_seq,1212), LessThanOrEqual(d_month_seq,1223),..., ReadSchema: struct<d_date_sk:int,d_date:date,d_month_seq:int> [2024-08-13T02:37:56.672Z] : +- ColumnarBroadcastExchange HashedRelationBroadcastMode(List(cast(input[0, int, true] as bigint)),false), [plan_id=350522] [2024-08-13T02:37:56.672Z] : +- ProjectExecTransformer [d_date_sk#14755, d_date#14757] [2024-08-13T02:37:56.672Z] : +- FilterExecTransformer (((isnotnull(d_month_seq#14758) AND (d_month_seq#14758 >= 1212)) AND (d_month_seq#14758 <= 1223)) AND isnotnull(d_date_sk#14755)) [2024-08-13T02:37:56.672Z] : +- NativeFileScan parquet tpcdsdb.date_dim[d_date_sk#14755,d_date#14757,d_month_seq#14758] Batched: true, DataFilters: [isnotnull(d_month_seq#14758), (d_month_seq#14758 >= 1212), (d_month_seq#14758 <= 1223), isnotnul..., Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/data/tpcds-data-sf1-decimal/date_dim], PartitionFilters: [], PushedFilters: [IsNotNull(d_month_seq), GreaterThanOrEqual(d_month_seq,1212), LessThanOrEqual(d_month_seq,1223),..., ReadSchema: struct<d_date_sk:int,d_date:date,d_month_seq:int> [2024-08-13T02:37:56.672Z] +- ColumnarBroadcastExchange HashedRelationBroadcastMode(List(cast(input[0, int, false] as bigint)),false), [plan_id=350525] [2024-08-13T02:37:56.672Z] +- FilterExecTransformer isnotnull(c_customer_sk#14812) [2024-08-13T02:37:56.672Z] +- NativeFileScan parquet tpcdsdb.customer[c_customer_sk#14812,c_first_name#14820,c_last_name#14821] Batched: true, DataFilters: [isnotnull(c_customer_sk#14812)], Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/data/tpcds-data-sf1-decimal/customer], PartitionFilters: [], PushedFilters: [IsNotNull(c_customer_sk)], ReadSchema: struct<c_customer_sk:int,c_first_name:string,c_last_name:string> ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
