RE: Slow Data Insertion On Large Cache : Spark Streaming

Thanks Stan, planning to move on to 2.7. Thanks -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

RE: Slow Data Insertion On Large Cache : Spark Streaming

To: user@ignite.apache.org Subject: Slow Data Insertion On Large Cache : Spark Streaming Hi Team, We have 6 node Ignite cluster with 72CPU, 256GB RAM and 5TB Storage . Data ingested using Spark Streaming into Ignite Cluster for SQL and Tableau Usage. I have couple of Large tables with 200ml rows

Slow Data Insertion On Large Cache : Spark Streaming

Hi Team, We have 6 node Ignite cluster with 72CPU, 256GB RAM and 5TB Storage . Data ingested using Spark Streaming into Ignite Cluster for SQL and Tableau Usage. I have couple of Large tables with 200ml rows with (200GB) and 800ml rows with (500GB) . The insertion is taking more than 40secs