Re: Apache Ignite Sink Connector

ster server starts getting down. > > Can you help me with this? How can I tune it ? > > Also, I am using Ignite's native persistence performance for > transformation is not up to the mark. > > Can any configuration help me here ? > > Thanks & Regards, > Shubham >

Re: Apache Ignite Sink Connector

node will be down as > well. In distributed mode, JVMs are shared across connect nodes which makes > it more available. > > Thanks and Regards, > Shubham > > On Mon, Sep 13, 2021, 1:23 AM Saikat Maitra > wrote: > >> Are you looking for a parallel Ignite sink con

Re: Apache Ignite Sink Connector

s and > rebalancing happens for connectors tasks if any node goes down. In this > case I am able to create just 1 ignite connector at a time. No parallelism. > > Hope this gives better clarity. > > Thanks and regards, > Shubham > > On Sun, Sep 12, 2021, 11:50 PM

Re: Apache Ignite Sink Connector

mentation and could setup > and run connectors in standalone mode as described there in docs. But I > want to run it in distributed mode, can you help me with that? > > Thanks & Regards, > Shubham > > On Sun, Sep 12, 2021, 7:58 PM Saikat Maitra > wrote: > >

Re: Apache Ignite Sink Connector

Hi Shubham, Here are the documents for Apache Ignite Sink Connector using Kafka https://github.com/apache/ignite-extensions/tree/master/modules/kafka-ext Please let us know if you have any questions. Regards, Saikat On Wed, Aug 18, 2021 at 11:40 PM Shubham Shirur wrote: > Hi, > > I did not

Re: kafka ignite connector

Hi, You can choose to run the kafka connector in a separate machine as long as it is able to connect to Kafka cluster and Ignite cluster within the network Regards, Saikat On Mon, Jun 14, 2021 at 10:34 AM shubhamshirur wrote: > Where I should run my connector if Kafka and ignite are running

[Discussion] Kanban board for quick start issues to join the community

Hi, I was looking into our community page to find new open issues that I can contribute to and the easy and moderate tickets, tickets for beginners and SQL tasks help me to find open issues to contribute. I am also thinking if we should use a project Kanban board in jira and move these issues in

Re: scanquery is not working, however SQL select and retrieving a single records works fine

Hi Naveen, Did the scan query changes work for you? I had faced a similar issue earlier and updating the code to use scan query inside a try/catch block instead of try with resources block worked for me. Regards, Saikat On Mon, Jan 4, 2021 at 5:04 AM Ilya Kasnacheev wrote: > Hello! > > You

Re: Apache Ignite talks videos from IMC Summit 2000

Ignite’s Network >Components—by Stanislav Lukyanov >https://www.youtube.com/watch?v=zTpgE3ppfUM >7. Hyperparameter Tuning and Distributed Stacking with Apache Ignite >ML—by Alexey Zinoviev https://www.youtube.com/watch?v=vYXVqVtpFzo >8. Apache Ignite Extensions:

Re: Video overview of eight Ignite-specific talks scheduled for the IMCS Summit 2020

te-specific sessions scheduled for the >> In-Memory Computing Summit 2020. I've gone ahead and produced a quick >> overview of those sessions. Check and weigh up which one to join: >> https://youtu.be/SCqd4qfBY6Q >> >> The sessions are delivered by our community folks: @Saik

ApacheCon talk available

Hi, My talk about Data Streaming using Apache Flink and Apache Ignite in ApacheCon is available now https://www.youtube.com/watch?v=n74HMmTz5i0 Regards, Saikat

Re: [DISCUSSION] Renaming Ignite's product category

Hi, My thoughts are similar to as Denis and Val mentioned like Apache Ignite - "A Memory Centric Database". It aligns to current features of Apache Ignite as mentioned in the below post. https://thenewstack.io/memory-centric-architectures-whats-next-for-in-memory-computing Regards, Saikat On

Re: Ignite NPE when try to loadCache from persistent mysql database

Hi Can you please share if valid cache name can be passed in the loadCache method like below? https://github.com/apache/ignite/blob/56975c266e7019f307bb9da42333a6db4e47365e/examples/src/main/java/org/apache/ignite/examples/datagrid/store/jdbc/CacheJdbcStoreExample.java#L108 Regards, Saikat On

Re: Ignite 3.0 meetups

Hi Val, Thank you for scheduling the meetups. Will join and connect on Ignite 3.0 release planning. Regards, Saikat On Tue, Aug 25, 2020 at 4:49 PM Valentin Kulichenko < valentin.kuliche...@gmail.com> wrote: > Igniters, > > As was discussed before, we've scheduled two meetups devoted to Ignite

Re: [BLOG] Apache Ignite Extensions

article and the summary of this undergoing project. Keep it up! > > - > Denis > > > On Sat, Aug 8, 2020 at 1:37 PM Saikat Maitra > wrote: > > > Hi, > > > > I have published a blog on Apache Ignite Extensions and about migration > of > > exis

Re: Call for presentations for ApacheCon North America 2020 now open

ats. We could prepare a talking for "machine learning application > with Ignite", as we did store feature engineering data into ignite for > large-scale and fast access. > > regards. > > > Saikat Maitra wrote: > > Congrats!!! > > > > It looks like b

Re: Call for presentations for ApacheCon North America 2020 now open

n the events' page on the website. > https://ignite.apache.org/events.html > > - > Denis > > > On Tue, Aug 4, 2020 at 6:40 PM Saikat Maitra > wrote: > > > Hi, > > > > I learned that my proposal for talk about Data Streaming using Apache > >

Re: Call for presentations for ApacheCon North America 2020 now open

2020, 7:10 AM Saikat Maitra >> Hi, >> >> I learned that my proposal for talk about Data Streaming using Apache Ignite >> and Apache Flink has been accepted. >> >> I have not yet received the schedule yet. I will share as soon as I have >> it. >> >

Re: Call for presentations for ApacheCon North America 2020 now open

Hi, I learned that my proposal for talk about Data Streaming using Apache Ignite and Apache Flink has been accepted. I have not yet received the schedule yet. I will share as soon as I have it. Regards, Saikat On Wed, Jan 22, 2020 at 8:09 PM Saikat Maitra wrote: > Hi Denis, > >

Re: [DISCUSS] Apache Ignite mascot

n Sun, May 17, 2020 at 5:50 AM Manuel Núñez wrote: > >> What about a hellboy’s style animal?, with Ignite’s flame between the >> horns >> >> El 16 may 2020, a las 23:22, Saikat Maitra >> escribió: >> >>  >> Hi Denis, >> >> Awesome ideas

Re: [DISCUSS] Apache Ignite mascot

lt.jpg < > https://i.ytimg.com/vi/8lZeTTXyIk4/maxresdefault.jpg> > [3] ronald-mcdonald-052011.jpg > < > https://s3-prod.adage.com/s3fs-public/styles/800x600/public/ronald-mcdonald-052011.jpg > > > > - > Denis > > > On Sat, May 9, 2020

Re: [DISCUSSION] Major changes in Ignite in 2020

Hi Denis, Thank you for sharing the list of top changes. The list looks good. I wanted to share that efforts regarding IEP-36 is already underway and there are also open PRs under review and working through review feedback. One of the area that we are focussing is first we will merge changes in

Re: Call for presentations for ApacheCon North America 2020 now open

Hi Denis, Thank you for your email. I have submitted a talk about Data Streaming using Apache Ignite and Apache Flink. I would also like to co-present on Ignite internals and usecases deep dive. Regards, Saikat On Wed, Jan 22, 2020 at 6:22 PM Denis Magda wrote: > Igniters, > > I was

Re: Streamer and data loss

node failure, > then I won't > get optimal performance, right? > What's the best practice for dealing with data streamer node failures? Are > there examples? > > On Thu, Jan 9, 2020 at 9:12 PM Saikat Maitra > wrote: > >> Hi, >> >> AFAIK, the DataS

Re: Load Data with Streamer

Jan 10, 2020 at 4:36 AM narges saleh >> wrote: >> >>> Thanks Saikat. Please let me know if you find anything. I'll try to >>> debug on my side too. >>> >>> Does anyone have a working example for using socket streamer? >>> >&

Re: Streamer and data loss

Hi, AFAIK, the DataStreamer check for presence of key and if it is present in the cache then it does not allow overwrite of value if allowOverwrite is set to false. Regards, Saikat On Thu, Jan 9, 2020 at 6:04 AM narges saleh wrote: > Thanks Andrei. > > If the external data source client

Re: Load Data with Streamer

inar. thanks. >> 2) The socket streamer server code goes to the finally clause right after >> the socket streamer is starts. The screen snapshot with 2 servers and one >> client is here. >> >> [image: image.png] >> >> On Mon, Jan 6, 2020 at 7:59 PM Saik

Re: Load Data with Streamer

on > between the client data producer and streamer data consumer, right? > 2)Yes the nodes report number of servers=4 and clients=1 and but then the > number of clients goes to 0 when the streamer node stops (but the number of > servers stays at 4). > thanks. > > On Sun, Jan 5

Re: Ignite wallpapers for desktop & mobile - light your fire

; As for the logos, you can find them on the website repo: > https://svn.apache.org/repos/asf/ignite/site/trunk/images > > - > Denis > > > On Mon, Dec 30, 2019 at 1:28 PM Saikat Maitra > wrote: > >> Kseniya, Nacho >> >> Thank you for sharing the wall

Re: Load Data with Streamer

to use Ignite's rest API to call an ignite service method (via a service > proxy? If yes, is there an example? > 2) I started anywhere from 2 to 4 ExampleNodeStartup nodes (different > tries), but still got the "ignite node stopped" message. > > > On Sun, Jan 5,

Re: Load Data with Streamer

Hi, Thank you for your email and using DataStreamer. 1. Yes, there are rest endpoints available to send data in Ignite cache. Here is the docs for the same https://apacheignite.readme.io/docs/rest-api 2. As per the docs as mentioned below, can you please confirm if you have few nodes running

Re: Ignite wallpapers for desktop & mobile - light your fire

Kseniya, Nacho Thank you for sharing the wallpapers. They are very cool. IMO, we can add it in project website. Also, I have a query regarding Apache lgnite logo that can be used for external presentation. Can we add this also in Apache Ignite project website? http://apache.org/logos/#ignite

Re: [Webinar] Data Streaming Using Apache Flink and Apache Ignite

tok=eyJpIjoiWldKa05UZzVabVprWmpBeSIsInQiOiJwSDR1Yjd4alJSc1NcL3UzVlBqU1pqbXNwUHFqMUQrXC90OHZcL0lvSzRGS2dwajlIb1RTa0haM1d1bENFc1FuUkJZZk5JSzFjcVp1Y3dBXC93SEg0cDlkUXhTQ2EwQnlXVVZ2RVdlZUgybHhhakFrb2srWlVucVZyQkZZU3RJSXJjeTMifQ%3D%3D> Regards, Saikat On Mon, Dec 9, 2019 at 9:33 PM Saikat Maitra wrote: > Thank you Alexey, yes I think all the webin

[Webinar] Data Streaming Using Apache Flink and Apache Ignite

streaming connector enables users to inject Flink data into the Ignite cache. Join Saikat Maitra to learn how to build a simple data streaming application using Apache Flink and Apache Ignite. This stream processing topology will allow data streaming in a distributed, scalable, and fault-tolerant

Re: Streamer question

Hi Mikael, The data streamer will flush data in batches and each batch will contain entries of K,V. So, as long as key updates applies to single batch for a flush then it will write last value. Regards, Saikat On Wed, Oct 30, 2019 at 4:44 PM Mikael wrote: > Hi! > > If a data streamer with

Re: [DISCUSS] Proposal for Ignite Extensions as a separate Bahir module or Incubator project

and get feedback on the proposal and if we are ok to move the following Apache Ignite Extensions https://cwiki.apache.org/confluence/display/IGNITE/IEP-36%3A+Modularization#IEP-36:Modularization-IndependentIntegrations Regards, Saikat On Fri, Oct 18, 2019 at 9:44 PM Saikat Maitra wrote: > He

[DISCUSS] Proposal for Ignite Extensions as a separate Bahir module or Incubator project

Hello, We wanted to discuss on a proposal to move and support the Apache Ignite integrations as separate Ignite Extensions as discussed here http://apache-ignite-developers.2346864.n4.nabble.com/DISCUSS-Pub-Sub-Streamer-Implementation-td43944.html . The reason we wanted to move our Apache Ignite

Re: DataLoad using IgniteDataStreamer

Hello Ravichandra, Here are the docs for Data streamers https://apacheignite.readme.io/docs/streaming--cep Also, a sample implementation for data streaming using Apache Flink. https://dzone.com/articles/data-streaming-using-apache-flink-and-apache-ignit Please review and let us know if you

Re: Flink Streamer Compatibility.

Hi, There are multiple options available to check cache contents, separate client is one of the option or you can add dependency of ignite-rest-http and use the rest service. You can also deploy Ignite Web Console and use it. The details to use any of these options are available here

Re: Flink Streamer Compatibility.

Hi Here is the working example https://github.com/samaitra/streamers Let me know if you have any questions. Regards, Saikat On Tue, Sep 25, 2018 at 2:22 PM, Anand Vijai wrote: > Is there a working example of how the integration works to sink Flink data > into an Ignite Cache? > > > > -- >

Re: How to throttle/limit the cache-store read threads?

Hi Mridul, Have you considered the option of creating a dedicated Threadpool for the cache store operations. Here is an example http://commons.apache.org/dormant/threadpool/ Another option would be to consider Hystrix Command Threadpool since you mentioned that the cache store is remote web

Re: Need IgniteConfiguration and XML at the same time? IgniteStormStreamer?

Hi, Yes, you can connect to a remote(local running in some 475XX port or another host in network ) ignite node using IgniteClient. Please take a look into some examples available here

Re: Need IgniteConfiguration and XML at the same time? IgniteStormStreamer?

Hello, 1. I think the issue with Incompatible class error is due to backward incompatible changes between slf4j-api 1.7.25 and ignite-log4j. I agree for most cases we need not worry on the dependency compatibility but incase of incompatible changes excluding dependencies helps. 2. The link I

Re: Need IgniteConfiguration and XML at the same time? IgniteStormStreamer?

Hi, StormStreamer already creates Ignite instance as part of start() method. In your example since multiple thread is trying to create ignite instances you are getting the exception of "Ignite already started". Please take a look into the below sample test implementation of StormStreamer.

Re: Integrate Apache Ignite with Storm. Some question?

Hi, You can check if an ignite instance is already available and use it else create a new instance. Please find link for sample implementation below. https://github.com/apache/ignite/blob/master/modules/flink/src/main/java/org/apache/ignite/sink/flink/IgniteSink.java#L146-L151 Regards, Saikat

Re: Apache Flink Sink + Ignite: Ouch! Argument is invalid

16, 2018 at 10:47 PM, Saikat Maitra wrote: > Hi Ray, > > Thank you for validating the changes, I see that in cluster mode when I am > checking the IgniteSink it is working as desired. In stand alone mode I can > see we are getting the exception class org.apache.ignite.IgniteExcep

Re: Apache Flink Sink + Ignite: Ouch! Argument is invalid

Hi Ray, Thank you for validating the changes, I see that in cluster mode when I am checking the IgniteSink it is working as desired. In stand alone mode I can see we are getting the exception class org.apache.ignite.IgniteException: Default Ignite instance has already been started. Please take a

Re: Apache Flink Sink + Ignite: Ouch! Argument is invalid

Hello Ray, I have fixed the issue related to Flink IgniteSink. Please take a look on the changes [https://github.com/samaitra/ignite/blob/IGNITE-8697/ modules/flink/src/main/java/org/apache/ignite/sink/flink/IgniteSink.java] I am working on the testcases and will raise the PR soon. Regards

Re: Apache Flink Sink + Ignite: Ouch! Argument is invalid

Hi, When Ignite Sink Data Streamer start it checks if the cache name is already present in the grid before the streaming process can begin. Can you please confirm if cache got created before data sink process get executed Regards, Saikat On Mon, Jun 4, 2018 at 9:24 PM, Ray wrote: > I think

Re: REST servive command LOG

e modifications > are required and paste a link to the pull-request there? > > Otherwise the dev community might miss your changes. > > — > Denis > > On Jan 22, 2017, at 10:16 AM, Saikat Maitra <saikat.mai...@gmail.com> > wrote: > > Hello Sam, >

Re: REST servive command LOG

Hello Sam, Due to security reason the log file need to be chrooted to IGNITE_HOME/log. Please review this PR for the fix. https://github.com/apache/ignite/pull/420 Regards, Saikat On Sun, Jan 22, 2017 at 12:03 PM, Saikat Maitra <saikat.mai...@gmail.com> wrote: > Hi Sam, > &g

Re: REST servive command LOG

Hi Sam, You can pass path as query param to get the log details. Please see this jira ticket below for reference. https://issues.apache.org/jira/browse/IGNITE-944 Regards Saikat On Thu, Jan 19, 2017 at 2:21 PM, javastuff@gmail.com < javastuff@gmail.com> wrote: > Hi, > > I find LOG

Re: Ignite Rest Api

Hi 1. Is this the dependency you added in pom.xml org.apache.ignite ignite-rest-http ${project.version} 2. Did you ran mvn clean install -DskipTests -Dmaven.javadoc.skip=true to load the dependencies before running ExampleNodeStartup.java? Regards Saikat On Wed, Sep 28, 2016

Re: Not able to retrieve data from cache

Hello, Can you please share rest api you used to fetch the data from the cache. Can you use the Sql fields query execute rest api if you are able to get the data. http://host:port/ignite?cmd=qryfldexe=10=Person=select+firstName%2C+lastName+from+Person Regards Saikat On Mon, Sep 5, 2016 at

Re: Cannot get cache through the REST API

Hi If you know the type name you can use sql query field command. For example : http://ves-hx-40.ebi.ac.uk:8080 /ignite?cmd=qryfldexe=10=session-cache