Re: java.lang.OutOfMemoryError: Java heap space at com.google.protobuf.AbstractMessageLite.toByteArray(AbstractMessageLite.java:62)

[sohimankotia]

Hi Stefan ,

Here is main class code  :

final String outFile = getOutFileName(backupDir);

final Set<String> keys = getAllRedisKeys(parameters);

final ExecutionEnvironment env =
ExecutionEnvironment.getExecutionEnvironment();
env.setParallelism(parallelism);

env
    .fromCollection(keys)
    .rebalance()
    .flatMap(new RedisRead()).withParameters(parameters.getConfiguration())
    .writeAsText(outFile);

env.execute();


RedisRead  -> simply read key one by one .


Memory Per task  : 2048 MB

Attaching flink logs .

Let me know if I can help anything more .
error.log
<http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/file/t894/error.log>
  






--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/