Re: EXT: Dual Write to HDFS and MinIO in faster way

Hi Prem, You can try to write to HDFS then read from HDFS and write to MinIO. This will prevent duplicate transformation. You can also try persisting the dataframe using the DISK_ONLY level. Regards, Vibhor From: Prem Sahoo Date: Tuesday, 21 May 2024 at 8:16 AM To: Spark dev list Subject:

Re: EXT: Re: Missing string replace function

Hi Khalid, See https://issues.apache.org/jira/browse/SPARK-31628. It might just be a syntactic sugar over the StringReplace class, but it makes the