GitHub user ammarchalifah added a comment to the discussion: Deployment Guide
for Spark on EMR
But I'm facing difficulty with reading Parquet file from S3. Without Gluten,
reading Parquet from S3 with
```
return (
spark.read.schema(input_data_schema)
.option("basePath", base_path)
.option("recursiveFileLookup", "true")
.parquet(*paths)
)
```
works fine. With Gluten enabled, it just behaves as if the file doesn't exist
and returned an empty dataframe.
GitHub link:
https://github.com/apache/incubator-gluten/discussions/11279#discussioncomment-15230385
----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
