Continuous task retry support

2018-11-02 Thread Basil Hariri
Hi all, I found that task retries are currently not supported in continuous processing mode. Is there

Help with basic stream action

2018-10-30 Thread Basil Hariri
Hi all, Sorry if this isn't the right place to ask basic questions, but I'm at the end of my rope here - please let me know where else I can get help if this isn't the right place. I'm trying to continuously read from a Kafka topic and send the number of rows Spark has received to a metric

Kafka Connector version support

2018-09-21 Thread Basil Hariri
Hi all, Are there any plans to backport the recent (2.4) updates to the Spark-Kafka adapter for use with Spark v2.3, or will the updates just be for v2.4+? Thanks, Basil

RE: Spark Kafka adapter questions

2018-08-20 Thread Basil Hariri
On Fri, Aug 17, 2018 at 3:53 PM Basil Hariri mailto:basil.har...@microsoft.com.invalid>> wrote: Hi all, I work on Azure Event Hubs (Microsoft’s PaaS offering similar to Apache Kafka) and am trying to get our new Kafka head<https://na01.safelinks.protection.outlook.com/?url=ht

Spark Kafka adapter questions

2018-08-17 Thread Basil Hariri
Hi all, I work on Azure Event Hubs (Microsoft's PaaS offering similar to Apache Kafka) and am trying to get our new Kafka head to play nice with Spark's Kafka adapter. The goal is for our Kafka