[
https://issues.apache.org/jira/browse/SPARK-28864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ke Li updated SPARK-28864:
--------------------------
Description:
Alibaba Log Service is a big data service which has been widely used in Alibaba
Group and thousands of customers of Alibaba Cloud. The core storage engine of
Log Service is named Loghub which is a large scale distributed storage system
which provides producer and consumer to push and pull data like Kafka, AWS
Kinesis and Azure Eventhub does.
There are a lot of users of Log Service are using Spark Streaming, Spark SQL
and Spark Structured Streaming to analysis data collected from both on premise
and cloud data sources.
Happy to hear any comments.
was:
Aliyun Log Service is a big data service which has been widely used in Alibaba
Group and thousands of customers of Alibaba Cloud. The core storage engine of
Log Service is named Loghub which is a large scale distributed storage system
which provides producer and consumer to push and pull data like Kafka, AWS
Kinesis and Azure Eventhub does.
There are a lot of users of Log Service are using Spark Streaming, Spark SQL
and Spark Structured Streaming to analysis data collected from both on premise
and cloud data sources.
Happy to hear any comments.
> Add spark source connector for Aliyun Log Service
> -------------------------------------------------
>
> Key: SPARK-28864
> URL: https://issues.apache.org/jira/browse/SPARK-28864
> Project: Spark
> Issue Type: New Feature
> Components: Input/Output
> Affects Versions: 3.0.0
> Reporter: Ke Li
> Priority: Major
>
> Alibaba Log Service is a big data service which has been widely used in
> Alibaba Group and thousands of customers of Alibaba Cloud. The core storage
> engine of Log Service is named Loghub which is a large scale distributed
> storage system which provides producer and consumer to push and pull data
> like Kafka, AWS Kinesis and Azure Eventhub does.
> There are a lot of users of Log Service are using Spark Streaming, Spark SQL
> and Spark Structured Streaming to analysis data collected from both on
> premise and cloud data sources.
> Happy to hear any comments.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
