Re: Externally load data into RocksDB backend

2020-10-13 Thread Akshay Aggarwal
Hi Arpith, You should look into the State Processor API [1], it can be used to bootstrap state, and also for reading and modifying existing state. [1] https://ci.apache.org/projects/flink/flink-docs-stable/dev/libs/state_processor_api.html#writing-new-savepoints Thanks, Akshay Aggarwal On Tue

Re: Checkpoint growth

2020-11-10 Thread Akshay Aggarwal
references and clearing older checkpoint directories. What we do instead to avoid ever increasing checkpoint directory size is to stop the job with a savepoint, clear the checkpoints directory and start the job from the savepoint periodically. Thanks, Akshay Aggarwal On Tue, Nov 10, 2020 at 10:55 PM

Re: DashBoard Name

2020-07-19 Thread Akshay Aggarwal
app/app.component.html#L22> [1] https://github.com/apache/flink/blob/master/flink-runtime-web/web-dashboard/src/app/app.component.html#L22 Thanks, Akshay Aggarwal On Mon, Jul 20, 2020 at 10:13 AM C DINESH wrote: > Hi All, > > In flink UI the name of the dashboard is Apache Flink dash Boa

Backfilling From Kafka Topics With Varied Ingestion Rates

2020-02-07 Thread Akshay Aggarwal
to tackle this problem? Thanks & Regards, Akshay Aggarwal -- *-* *This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they

Re: Backfilling From Kafka Topics With Varied Ingestion Rates

2020-02-12 Thread Akshay Aggarwal
source > interface ([1]) will enable us to add a feature that we call "event-time > alignment" where source readers would slow down reading from certain > source partitions if their watermark advances to far beyond the minimum > watermark over all source partitions. > > Best,

Persisting inactive state outside Flink

2020-02-14 Thread Akshay Aggarwal
king into Flink code? Thanks, Akshay Aggarwal -- *-* *This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are address

Re: Persisting inactive state outside Flink

2020-02-18 Thread Akshay Aggarwal
back edge (iteration edge). > > The problem with this approach is that Flink does not give you > exactly-once processing guarantees when using iterations at the moment. The > community is working on changing this, though. > > Cheers, > Till > > On Fri, Feb 14, 2020 at 6:05 PM

Re: Persisting inactive state outside Flink

2020-02-18 Thread Akshay Aggarwal
it behaves with your workload. > 3. You can use Flink's state processor API [1] to access Flink state. The > only thing you need to do is to take a savepoint of your job and then feed > the savepoint to the state processor API in order to access it. > > [1] > https://ci.ap