Hi Team, I have installed Texera and am able to execute workflows successfully. I would like to understand how large-scale data processing is handled in Texera.
If the input data size is very large, will Texera process it reliably without crashing, or are there any known limitations related to file size, memory, or cluster resources? I also could not find any option to configure parallelism for the file fetch/file scan operator. How can parallelism be configured for this operator? Thanks & Regards Rahul
