Thanks for the clarification Michael..will try the streamer option. Regards, Sriveena
From: Michael Cherkasov [mailto:[email protected]] Sent: Tuesday, July 24, 2018 9:49 PM To: [email protected] Subject: Re: Batch insert into ignite I can't say for sure which one should be better for sure, it must be benchmarked. But if you can use SqlFieldsQuery this means that you can use native Ignite API, right? So, in this case, IgniteDataStreamer<https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fapacheignite.readme.io%2Fdocs%2Fdata-streamers&data=02%7C01%7CSriveena.Mattaparthi%40ekaplus.com%7Cd7a2e5237e04417740a408d5f1814956%7C2a5b4e9716be4be4b2d40f3fcb3d373c%7C1%7C0%7C636680459959631292&sdata=Vm%2BmWgmalYFrA6O9fZEWPzW0XRF%2BOYFVaAIwus%2FNU5k%3D&reserved=0> would be the best choice. 2018-07-24 9:36 GMT+03:00 Sriveena Mattaparthi <[email protected]<mailto:[email protected]>>: Hi Mikhail, Do we have this streaming/batch insert option, if we do a bulk insert using cache.query(new SqlFieldsQuery("sql"); Also could you please confirm which one would perform better 1. Insert using IgniteJdbcDriver 2. Insert using SqlFieldsQuery Thanks & Regards, Sriveena -----Original Message----- From: Mikhail [mailto:[email protected]<mailto:[email protected]>] Sent: Monday, July 23, 2018 10:32 PM To: [email protected]<mailto:[email protected]> Subject: Re: Batch insert into ignite Hi Sriveena, for data load you can try to use streaming mode for jdbc: https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fapacheignite.readme.io%2Fdocs%2Fjdbc-driver%23section-streaming-mode&data=02%7C01%7CSriveena.Mattaparthi%40ekaplus.com%7Cd2ff72f68e13451756c008d5f0be11d6%7C2a5b4e9716be4be4b2d40f3fcb3d373c%7C1%7C0%7C636679621511638203&sdata=QGfXouNn0Juxv18j1p0rgnBx%2Fle90Ioo3E6W3S6ohR8%3D&reserved=0 it will provide faster insert operation compare to regular insert, also you can disable WAL: https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fapacheignite.readme.io%2Fdocs%2Fwrite-ahead-log%23section-wal-activation-and-deactivation&data=02%7C01%7CSriveena.Mattaparthi%40ekaplus.com%7Cd2ff72f68e13451756c008d5f0be11d6%7C2a5b4e9716be4be4b2d40f3fcb3d373c%7C1%7C0%7C636679621511638203&sdata=pjwp4tCzN9KnUq8s0cvTbmmaIDVj8O4UPylv7acYEUg%3D&reserved=0 to get better throughput. Thanks, Mike. -- Sent from: https://apac01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapache-ignite-users.70518.x6.nabble.com%2F&data=02%7C01%7CSriveena.Mattaparthi%40ekaplus.com%7Cd2ff72f68e13451756c008d5f0be11d6%7C2a5b4e9716be4be4b2d40f3fcb3d373c%7C1%7C0%7C636679621511638203&sdata=0Z7q%2BpGVuPa2rpB4wjYg4tKt5MPDYi4denqAbskOtZg%3D&reserved=0
