milenkovicm commented on PR #14631: URL: https://github.com/apache/datafusion/pull/14631#issuecomment-2659959591
@alamb I'm testing this branch in ballista just to verify it. Apparently ballista tests fail, with this branch first, but with latest main as well (without this patch) so not related to this patch. Error log: ``` [2025-02-14T17:57:07Z DEBUG ballista_scheduler::scheduler_server::query_stage_scheduler] processing task status updates from b77a5230-b9f6-4bf9-a914-ef337642e31e: [] [2025-02-14T17:57:07Z DEBUG ballista_scheduler::state::task_manager] Preparing task definition for TaskDescription[session_id: cd7a5bec-bda2-4908-bec4-2d62387ea568,job: EBoAKBv, stage: 1.0, partition: 0 task_id 0, task attempt 0] ShuffleWriterExec: None CoalesceBatchesExec: target_batch_size=8192 FilterExec: id@0 > 4 DataSourceExec: file_groups={1 group: [[var/folders/h_/cdg2zx090212402xhrwhv62w0000gn/T/.tmp9gafz6/YnnsNOURHACqq5wx_0.parquet]]}, projection=[id, string_col, timestamp_col], file_type=parquet, predicate=id@0 > 4, pruning_predicate=id_null_count@1 != row_count@2 AND id_max@0 > 4, required_guarantees=[] [2025-02-14T17:57:07Z DEBUG ballista_scheduler::scheduler_server::query_stage_scheduler] processing task status updates from af0d3817-31e6-4336-b753-e84f9e466db1: [] [2025-02-14T17:57:07Z INFO ballista_executor::execution_loop] Received task: [TID 0 EBoAKBv/1.0/0.0] [2025-02-14T17:57:07Z WARN datafusion_common::config] `enable_options_value_normalization` is deprecated and ignored [2025-02-14T17:57:07Z WARN ballista_executor::execution_loop] Failed to run task: DataFusionError(Internal("Could not create `ExprBoundaries`: in `try_from_column` `col_index` \n has gone out of bounds with a value of 3, the schema has 3 columns.")) ``` you may have educated guess where the issue is -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org