sagarlakshmipathy commented on issue #2638:
URL:
https://github.com/apache/incubator-gluten/issues/2638#issuecomment-1996766487
@zhouyuan
i'm hitting the same error with v1.1.0. i wonder what needs to change in my
case?
```
./spark-3.4.1-bin-hadoop3/bin/spark-shell --master yarn --deploy-mode
client --conf spark.plugins=io.glutenproject.GlutenPlugif
spark.memory.offHeap.enabled=true --conf spark.memory.offHeap.size=30g
--conf
spark.shuffle.manager=org.apache.spark.shuffle.sort.ColumnarShuffleManager
--conf spark.serializer=org.apache.spark.serializer.KryoSerializer --conf
"spark.sql.extensions=io.delta.sql.DeltaSparkSessionExtension" --conf
"spark.sql.catalog.spark_catalog=org.apache.spark.sql.delta.catalog.DeltaCatalog"
--jars hudi-benchmarks-0.1-SNAPSHOT.jar --packages
org.apache.hadoop:hadoop-aws:3.3.4,org.apache.hudi:hudi-spark3.4-bundle_2.12:0.14.1
```
`scala> (0 until
10).toDF("a").write.format("delta").mode("overwrite").save("s3a://s3-calls-log-bucket/test/test_gluten_table")
`
`
scala>
spark.read.format("delta").load("s3a://s3-calls-log-bucket/test/test_gluten_table").show()
`
```
24/03/14 07:52:15 WARN TaskSetManager: Lost task 0.0 in stage 10.0 (TID 105)
(ip-10-0-102-188.us-west-2.compute.internal executor 1):
io.glutenproject.exception.GlutenException: java.lang.RuntimeException:
Exception: VeloxRuntimeError
Error Source: RUNTIME
Error Code: INVALID_STATE
Reason: Failed to get metadata for S3 object due to: 'Network connection'.
Path:'s3://s3-calls-log-bucket/test/test_gluten_table/part-00000-e172ddcb-2f73-4248-b692-2a7b496f82af-c000.snappy.parquet',
SDK Error Type:99, HTTP Status Code:-1, S3 Service:'Unknown',
Message:'curlCode: 7, Couldn't connect to server', RequestID:''
Retriable: False
```
Don't worry about the hudi jars, those are part of my application
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
