[
https://issues.apache.org/jira/browse/FLINK-13889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jark Wu closed FLINK-13889.
---------------------------
Resolution: Cannot Reproduce
Can't reproduce in the latest version. Maybe has been fixed. Please reopen it
if it still exists.
> sql client fetch result oom
> ---------------------------
>
> Key: FLINK-13889
> URL: https://issues.apache.org/jira/browse/FLINK-13889
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Client
> Affects Versions: 1.8.1
> Reporter: richt richt
> Priority: Major
> Labels: stale-major
>
> i submit sql by sql-client to flink on yarn .
> in the flink dashboard , it said the job is finished ,
> but the client get this error
> {code:java}
> //
> [ERROR] Could not execute SQL statement. Reason:[ERROR] Could not execute SQL
> statement. Reason:org.apache.flink.runtime.rest.util.RestClientException:
> [Internal server error., <Exception on server
> side:java.lang.OutOfMemoryError: Java heap space at
> java.util.Arrays.copyOf(Arrays.java:3332) at
> java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:124)
> at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:596) at
> java.lang.StringBuffer.append(StringBuffer.java:367) at
> java.io.StringWriter.write(StringWriter.java:94) at
> org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.json.WriterBasedJsonGenerator._flushBuffer(WriterBasedJsonGenerator.java:1946)
> at
> org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.json.WriterBasedJsonGenerator._writeBinary(WriterBasedJsonGenerator.java:1485)
> at
> org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.json.WriterBasedJsonGenerator.writeBinary(WriterBasedJsonGenerator.java:602)
> at
> org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.JsonGenerator.writeBinary(JsonGenerator.java:1163)
> at
> org.apache.flink.runtime.rest.messages.json.SerializedValueSerializer.serialize(SerializedValueSerializer.java:54)
> at
> org.apache.flink.runtime.rest.messages.json.JobResultSerializer.serialize(JobResultSerializer.java:92)
> at
> org.apache.flink.runtime.rest.messages.json.JobResultSerializer.serialize(JobResultSerializer.java:41)
> at
> org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ser.BeanPropertyWriter.serializeAsField(BeanPropertyWriter.java:727)
> at
> org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ser.std.BeanSerializerBase.serializeFields(BeanSerializerBase.java:719)
> at
> org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ser.BeanSerializer.serialize(BeanSerializer.java:155)
> at
> org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._serialize(DefaultSerializerProvider.java:480)
> at
> org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ser.DefaultSerializerProvider.serializeValue(DefaultSerializerProvider.java:319)
> at
> org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ObjectMapper._configAndWriteValue(ObjectMapper.java:3905)
> at
> org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ObjectMapper.writeValue(ObjectMapper.java:3201)
> at
> org.apache.flink.runtime.rest.handler.util.HandlerUtils.sendResponse(HandlerUtils.java:81)
> at
> org.apache.flink.runtime.rest.handler.AbstractRestHandler.lambda$respondToRequest$0(AbstractRestHandler.java:78)
> at
> org.apache.flink.runtime.rest.handler.AbstractRestHandler$$Lambda$119/1537887475.accept(Unknown
> Source) at
> java.util.concurrent.CompletableFuture.uniAccept(CompletableFuture.java:656)
> at
> java.util.concurrent.CompletableFuture$UniAccept.tryFire(CompletableFuture.java:632)
> at
> java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474)
> at
> java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1962)
> at
> org.apache.flink.runtime.concurrent.FutureUtils$1.onComplete(FutureUtils.java:821)
> at akka.dispatch.OnComplete.internal(Future.scala:264) at
> akka.dispatch.OnComplete.internal(Future.scala:261) at
> akka.dispatch.japi$CallbackBridge.apply(Future.scala:191) at
> akka.dispatch.japi$CallbackBridge.apply(Future.scala:188) at
> scala.concurrent.impl.CallbackRunnable.run(Promise.scala:36) End of exception
> on server side>]
> {code}
>
> And yarn web ui i got message as below
> {code:java}
> //
> ERROR org.apache.flink.runtime.rest.handler.job.JobExecutionResultHandler -
> Unhandled exception. ERROR
> org.apache.flink.runtime.rest.handler.job.JobExecutionResultHandler -
> Unhandled exception.java.lang.OutOfMemoryError: Java heap space at
> java.util.Arrays.copyOf(Arrays.java:3332) at
> java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:124)
> at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:596) at
> java.lang.StringBuffer.append(StringBuffer.java:367) at
> java.io.StringWriter.write(StringWriter.java:94) at
> org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.json.WriterBasedJsonGenerator._flushBuffer(WriterBasedJsonGenerator.java:1946)
> at
> org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.json.WriterBasedJsonGenerator._writeBinary(WriterBasedJsonGenerator.java:1485)
> at
> org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.json.WriterBasedJsonGenerator.writeBinary(WriterBasedJsonGenerator.java:602)
> at
> org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.JsonGenerator.writeBinary(JsonGenerator.java:1163)
> at
> org.apache.flink.runtime.rest.messages.json.SerializedValueSerializer.serialize(SerializedValueSerializer.java:54)
> at
> org.apache.flink.runtime.rest.messages.json.JobResultSerializer.serialize(JobResultSerializer.java:92)
> at
> org.apache.flink.runtime.rest.messages.json.JobResultSerializer.serialize(JobResultSerializer.java:41)
> at
> org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ser.BeanPropertyWriter.serializeAsField(BeanPropertyWriter.java:727)
> at
> org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ser.std.BeanSerializerBase.serializeFields(BeanSerializerBase.java:719)
> at
> org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ser.BeanSerializer.serialize(BeanSerializer.java:155)
> at
> org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._serialize(DefaultSerializerProvider.java:480)
> at
> org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ser.DefaultSerializerProvider.serializeValue(DefaultSerializerProvider.java:319)
> at
> org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ObjectMapper._configAndWriteValue(ObjectMapper.java:3905)
> at
> org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ObjectMapper.writeValue(ObjectMapper.java:3201)
> at
> org.apache.flink.runtime.rest.handler.util.HandlerUtils.sendResponse(HandlerUtils.java:81)
> at
> org.apache.flink.runtime.rest.handler.AbstractRestHandler.lambda$respondToRequest$0(AbstractRestHandler.java:78)
> at
> org.apache.flink.runtime.rest.handler.AbstractRestHandler$$Lambda$119/1537887475.accept(Unknown
> Source) at
> java.util.concurrent.CompletableFuture.uniAccept(CompletableFuture.java:656)
> at
> java.util.concurrent.CompletableFuture$UniAccept.tryFire(CompletableFuture.java:632)
> at
> java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474)
> at
> java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1962)
> at
> org.apache.flink.runtime.concurrent.FutureUtils$1.onComplete(FutureUtils.java:821)
> at akka.dispatch.OnComplete.internal(Future.scala:264) at
> akka.dispatch.OnComplete.internal(Future.scala:261) at
> akka.dispatch.japi$CallbackBridge.apply(Future.scala:191) at
> akka.dispatch.japi$CallbackBridge.apply(Future.scala:188) at
> scala.concurrent.impl.CallbackRunnable.run(Promise.scala:36)
> {code}
> i tried some parameter below
> ./bin/yarn-session.sh -s 4 --container 64 -tm 8024m -m 12000m -yjm12100m
> -m5096
> sql client parameter max-table-result-rows
> and they seem dose not work.
> how to trace the error with flink on yarn , how to find the container log
> for flink ?
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
