Ma77Ball commented on issue #3825: URL: https://github.com/apache/texera/issues/3825#issuecomment-3368545363
Currently, the system can process that many columns (as shown below). <img width="956" height="954" alt="Image" src="https://github.com/user-attachments/assets/202a016e-4d70-4b51-af56-1e90fece81de"; /> However, if the output is not passed to an operator that reduces the number of columns, the frontend will crash. <img width="953" height="983" alt="Image" src="https://github.com/user-attachments/assets/e623134a-07ea-48d7-af13-6521457db10d"; /> I'm examining two key potential issues: the result panel is not optimized for this task, and the schema propagation step currently uses 100 rows to evaluate the schema, which may be excessive, especially with larger datasets (1 million columns). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
