Hi Spark guys, I am getting the information from Streaming and I transform the information:
questionStream.filter(_.getEntity.isEmpty).mapPartitions[Choice](questionHandler(_)).saveToCassandra("test","question" I am getting the information from Streaming, I do some filtering and I transform to Case class for saving, it is working fine but the information is not reflected in Cassandra immediately, it is reflected when stop my spark application. What is happening here? How can I get the information reflected in Cassandra immediately? Regards, favalos.