quitozang opened a new issue #2432:
URL: https://github.com/apache/hudi/issues/2432
When i write hudi data using DeltaStreamer, sometimes will get this error
below
**Environment Description**
* Hudi version : 0.6.0
* Spark version : 2.4.4
* Hive version : 2.1.1
* Hadoop version : 3.2.1
* Storage (HDFS/S3/GCS..) : HDFS
* Running on Docker? (yes/no) : no
**Additional context**
2021-01-11 19:29:01,966 [pool-19-thread-1] INFO io.javalin.Javalin -
Starting Javalin ...
2021-01-11 19:29:01,975 [pool-19-thread-1] ERROR io.javalin.Javalin -
Failed to start Javalin
2021-01-11 19:29:01,975 [pool-19-thread-1] ERROR
org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer - Shutting down
delta-sync due to exception
java.lang.RuntimeException: Port already in use. Make sure no other process
is using port 0 and try again.
at io.javalin.Javalin.start(Javalin.java:157)
at io.javalin.Javalin.start(Javalin.java:119)
at
org.apache.hudi.timeline.service.TimelineService.startService(TimelineService.java:106)
at
org.apache.hudi.client.embedded.EmbeddedTimelineService.startServer(EmbeddedTimelineService.java:74)
at
org.apache.hudi.client.AbstractHoodieClient.startEmbeddedServerView(AbstractHoodieClient.java:105)
at
org.apache.hudi.client.AbstractHoodieClient.<init>(AbstractHoodieClient.java:72)
at
org.apache.hudi.client.AbstractHoodieWriteClient.<init>(AbstractHoodieWriteClient.java:81)
at
org.apache.hudi.client.HoodieWriteClient.<init>(HoodieWriteClient.java:121)
at
org.apache.hudi.client.HoodieWriteClient.<init>(HoodieWriteClient.java:108)
at
org.apache.hudi.client.HoodieWriteClient.<init>(HoodieWriteClient.java:104)
at
org.apache.hudi.utilities.deltastreamer.DeltaSync.setupWriteClientAddColumn(DeltaSync.java:673)
at
org.apache.hudi.utilities.deltastreamer.DeltaSync.syncOnce(DeltaSync.java:309)
at
org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer$DeltaSyncService.lambda$startService$0(HoodieDeltaStreamer.java:609)
at
java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1700)
at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: java.io.IOException: Failed to bind to 0.0.0.0/0.0.0.0:0
at
org.apache.hudi.org.eclipse.jetty.server.ServerConnector.openAcceptChannel(ServerConnector.java:346)
at
org.apache.hudi.org.eclipse.jetty.server.ServerConnector.open(ServerConnector.java:308)
at
org.apache.hudi.org.eclipse.jetty.server.AbstractNetworkConnector.doStart(AbstractNetworkConnector.java:80)
at
org.apache.hudi.org.eclipse.jetty.server.ServerConnector.doStart(ServerConnector.java:236)
at
org.apache.hudi.org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at
org.apache.hudi.org.eclipse.jetty.server.Server.doStart(Server.java:394)
at
org.apache.hudi.org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at
io.javalin.core.util.JettyServerUtil.initialize(JettyServerUtil.kt:110)
at io.javalin.Javalin.start(Javalin.java:140)
... 16 more
Caused by: java.net.BindException: Address already in use
at java.base/sun.nio.ch.Net.bind0(Native Method)
at java.base/sun.nio.ch.Net.bind(Net.java:461)
at java.base/sun.nio.ch.Net.bind(Net.java:453)
at
java.base/sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:227)
at
java.base/sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:80)
at
org.apache.hudi.org.eclipse.jetty.server.ServerConnector.openAcceptChannel(ServerConnector.java:342)
... 24 more
2021-01-11 19:29:01,976 [pool-19-thread-1] INFO
org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer - Delta Sync
shutdown. Error ?true
2021-01-11 19:29:01,978 [Monitor Thread] ERROR
org.apache.hudi.async.AbstractAsyncService - Monitor noticed one or more
threads failed. Requesting graceful shutdown of other threads
java.util.concurrent.ExecutionException:
org.apache.hudi.exception.HoodieException: java.lang.RuntimeException: Port
already in use. Make sure no other process is using port 0 and try again.
at io.javalin.Javalin.start(Javalin.java:157)
at io.javalin.Javalin.start(Javalin.java:119)
at
org.apache.hudi.timeline.service.TimelineService.startService(TimelineService.java:106)
at
org.apache.hudi.client.embedded.EmbeddedTimelineService.startServer(EmbeddedTimelineService.java:74)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
