e, 9 Jan 2024 at 19:11, ashok34...@yahoo.com
wrote:
> Hey Mich,
>
> Thanks for this introduction on your forthcoming proposal "Spark
> Structured Streaming and Flask REST API for Real-Time Data Ingestion and
> Analytics". I recently came across an article by Databricks with
Hey Mich,
Thanks for this introduction on your forthcoming proposal "Spark Structured
Streaming and Flask REST API for Real-Time Data Ingestion and Analytics". I
recently came across an article by Databricks with title Scalable Spark
Structured Streaming for REST API Destinations.
Please also note that Flask, by default, is a single-threaded web
framework. While it is suitable for development and small-scale
applications, it may not handle concurrent requests efficiently in a
production environment.
In production, one can utilise Gunicorn (Green Unicorn) which is a WSGI (
We
Thought it might be useful to share my idea with fellow forum members. During
the breaks, I worked on the *seamless integration of Spark Structured
Streaming with Flask REST API for real-time data ingestion and analytics*.
The use case revolves around a scenario where data is generated through
RES