Re: java.lang.OutOfMemoryError: Java heap space at com.google.protobuf.AbstractMessageLite.toByteArray(AbstractMessageLite.java:62)

2017-09-26 Thread sohimankotia
Hi Stefan , Here is main class code : final String outFile = getOutFileName(backupDir); final Set keys = getAllRedisKeys(parameters); final ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment(); env.setParallelism(parallelism); env .fromCollection(keys) .rebalance(

Re: java.lang.OutOfMemoryError: Java heap space at com.google.protobuf.AbstractMessageLite.toByteArray(AbstractMessageLite.java:62)

2017-09-26 Thread sohi mankotia
onGraph- Deploying DataSource (at takeBackup(GroupMetaBackupToHDFS.java:72) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) (attempt #0) to dh-cdh-m1d1 2017-09-25 22:31:23,411 ERROR akka.actor.ActorSystemImpl - Uncaught error from thre

Re: java.lang.OutOfMemoryError: Java heap space at com.google.protobuf.AbstractMessageLite.toByteArray(AbstractMessageLite.java:62)

2017-09-26 Thread Stefan Richter
Hi, could you give us some more information like the size of your heap space, information about where and how you implemented access to Redis and how you kep the retrieved data, and most importantly a stack trace or (much better) a log? Best, Stefan > Am 26.09.2017 um 06:52 schrieb sohimankoti

java.lang.OutOfMemoryError: Java heap space at com.google.protobuf.AbstractMessageLite.toByteArray(AbstractMessageLite.java:62)

2017-09-25 Thread sohimankotia
Hi, I am getting Java Heap Space error while running Flink Job (Flink 1.2 ) . Use case : I am getting all keys from REDIS with specific pattern . Then streaming over those keys and reading data from Redis for those key and writing to file in HDFS . Job was running fine for few days but suddenly