ory.size (MB). In
>> large memory setups, we have seen a slightly better performance using
>> off-heap memory allocation. This can be configured using
>> taskmanager.memory.off-heap: true.
>>
>> Please let us know if you experience any further issues.
>>
>>
Hello,
We are running into a strange problem with Direct Memory buffers. From what
I know, we are not using any direct memory buffers inside our code.
This is pretty trivial streaming application just doing some dedupliction
and union some kafka streams.
/Jakob
2015-10-19 13:27:59,064 INFO
nager.heap.mb too low (it constraints the number of
> direct memory at the moment).
>
> Thank you,
> Max
>
>
> On Mon, Oct 19, 2015 at 3:24 PM, Jakob Ericsson
> <jakob.erics...@gmail.com> wrote:
> > Hello,
> >
> > We are running into a strange pro
...@apache.org>
> >>> wrote:
> >>> > Hi Jakob,
> >>> >
> >>> > Thanks. Flink allocates its network memory as direct memory outside
> >>> > the normal Java heap. By default, that is 64MB but can grow up to
> >>>
Hi,
I'm testing Flink streaming but seems to have some problems with jvm core
dumps.
I haven't really looked at the heap dump yet.
It seems to be related to the G1 GC.
If I want to go back to CMS-GC, do you have any preferred settings?
#
# A fatal error has been detected by the Java Runtime
> configuration parameter in your flink-conf.yaml. Here you can basically
> specify all the JVM options which will be given to the JVMs. Thus, in your
> case you could try the following settings: env.java.opts:
> -XX:+UseConcMarkSweepGC.
>
> Cheers,
> Till
>
>
> On
wing an exception, the topic doesn't exist anymore.
>
>
> Robert
>
> On Fri, Sep 18, 2015 at 2:21 PM, Jakob Ericsson <jakob.erics...@gmail.com>
> wrote:
>
>> Hit another problem. It is probably related to a topic that still exist
>> in zk but is not used anymore (
oes not try to recover from these exceptions. We
> rely on Flink's fault tolerance mechanisms to restart the data consumption
> (from the last valid offset).
> Do you have set the setNumberOfExecutionRetries() on the ExecutionConfig?
>
>
> On Thu, Sep 24, 2015 at 9:57 PM, Jako
onsumer.java:280)
at
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer081.(FlinkKafkaConsumer081.java:55)
On Fri, Sep 18, 2015 at 11:02 AM, Jakob Ericsson <jakob.erics...@gmail.com>
wrote:
> That will work. We have some utility classes for exposing the ZK-info.
>
> On Fri, Sep 18, 2015 at
