hudi-bot opened a new issue, #15481:
URL: https://github.com/apache/hudi/issues/15481
Presto and Trino don't work in Docker Demo M1 mac. We have been able to get
the other components to work on m1 but not Presto or Trino. Trino may work just
by updating the image that is used for adhoc-1/2 because the Trino images we
made for aarch64 are
{code:java}
apachehudi/hudi-hadoop_2.8.4-trinoworker_368:linux-arm64-0.12.0
apachehudi/hudi-hadoop_2.8.4-trinocoordinator_368:linux-arm64-0.12.0 {code}
Presto will definitely be difficult because it does not support m1 mac
currently
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-4984
- Type: Bug
---
## Comments
16/Nov/22 20:57;jonvex;After adding presto back to the config, I was able to
open presto in docker. Sometimes it would be able to run commands before
hanging and other times it would hang right from the start. I believe it is
running out of memory due to [https://github.com/prestodb/presto/issues/11160]
having some similar errors and also having `-XX:OnOutOfMemoryError="kill -9 %p`
as a config set;;;
---
17/Nov/22 19:24;jonvex;Using the existing images, when we try to use trino
we get this error
{code:java}
jon@MacBook-Pro hudi % docker exec -it adhoc-2 trino --server
trino-coordinator-1:8091
OCI runtime exec failed: exec failed: unable to start container process:
exec: "trino": executable file not found in $PATH: unknown{code};;;
---
17/Nov/22 19:31;jonvex;For presto,
We tried using the arm version of the image
{code:java}
apachehudi/hudi-hadoop_2.8.4-prestobase_0.271:linux-arm64-0.10.1{code}
{{but got the error }}
{code:java}
Presto requires amd64 or ppc64le on Linux (found aarch64) {code}
{{I built an upgraded version of presto to .275 which is}}
{code:java}
apachehudi/hudi-hadoop_2.8.4-prestobase_0.275:latest {code}
{{but that timed out when I tried to run presto queries}}
{{We also tried to increase PRESTO_JVM_MAX_HEAP to 1024M, for both .271 and
.275 but both timed out as well}};;;
---
17/Nov/22 19:32;jonvex;Not really sure where to go with presto, but with
trino we could still try building arm images. This will take some work as the
java11 base image needs to be rebuilt so that is more difficult than building
the presto arm images on top of an existing arm base image that we had for
0.10.1;;;
---
17/Nov/22 21:21;jonvex;Upped docker cpu to 7 cores and tried .271 and .275
presto but same issues as before occurred;;;
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
