MyqueWooMiddo opened a new issue, #1215:
URL: https://github.com/apache/sedona/issues/1215
## Expected behavior
a tiff file should be generated in output dir
## Actual behavior
Just a _SUCCESS file found
I can find tiff file created in HDFS audit.log , but there's not 'rename'
cmd .
I can find "SparkHadoopMapRedUtil: No need to commit output of task because
needsTaskCommit=false: attempt_xxx
BasicWriteTaskStatsTracker: Expected 1 files, but only saw 0. This could be
due to the output format not writing empty files, or files being not
immediately visible in the filesystem." in executor log.
## Steps to reproduce the problem
inside spark-shell
var df = spark.read.format("binaryFile").load("/user/spark/raster/input.tif")
df.write.format("raster").mode(org.apache.spark.sql.SaveMode.Overwrite).save("output")
## Settings
Sedona version = 1.5.0/1.5.1
Apache Spark version = 3.2.2
API type = Scala
Scala version = 2.12
JRE version = 1.8
Environment = Standalone
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
