Re: help needed in perforance improvement of spark structured streaming

2018-05-30 Thread amit kumar singh
hi team any help with this I have a use case where i need to call stored procedure through structured streaming. I am able to send kafka message and call stored procedure , but since foreach sink keeps on executing stored procedure per message i want to combine all the messages in single

help needed in perforance improvement of spark structured streaming

2018-05-05 Thread amit kumar singh
Hi Community, I have a use case where i need to call stored procedure through structured streaming. I am able to send kafka message and call stored procedure , but since foreach sink keeps on executing stored procedure per message i want to combine all the messages in single dtaframe and then