Re: Spark-based ingestion into Druid

2020-04-28 Thread Julian Jaffe
> > > > > sosyalmedya.oguz...@gmail.com> >> > > > > > > wrote: >> > > > > > > > I think second option would be better. Many people use >> spark >> > > for >> > > > > batch >> > >

Re: Spark-based ingestion into Druid

2020-04-02 Thread Julian Jaffe
; spark > > > for > > > > > batch > > > > > > > operations with isolated clusters. Me and my friends will > > > taking time > > > > > for > > > > > > > t

Re: Spark-based ingestion into Druid

2020-03-22 Thread itai yaffe
t; > can > > > > > > write our aims, requirements and flows easily. > > > > > > > > > > > > > > On 2020/02/26 13:26:13, itai yaffe > > wrote: > > > > > > > > Hey, > > > > &

Re: Spark-based ingestion into Druid

2020-03-11 Thread itai yaffe
wing this thread in Druid > user group > > > ( > > > > > > > > https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fforum%2F%23!topic%2Fdruid-user%2FFqAuDGc-rUMdata=02%7C01%7Crmordani%40vmware.com%7C98a7d3

Re: Spark-based ingestion into Druid

2020-03-10 Thread Rajiv Mordani
TB8%2Fp1581452302483600data=02%7C01%7Crmordani%40vmware.com%7Ce1c4b7ca140f4eefb11808d7c13d7ad1%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C637190342111876048sdata=cYAEldtu1R8k0BuFoPty4%2BkNtI47gP12W3W4O%2BlRGgc%3Dreserved=0), I'd > > like > > > > to start discussing the options o

Re: Spark-based ingestion into Druid

2020-03-10 Thread Oguzhan Mangir
On 2020/02/26 13:26:13, itai yaffe wrote: > > > > > > Hey, > > > > > > Per Gian's proposal, and following this thread in Druid user group > > ( > > > > > > https://groups.google.com/forum/#!topic/druid-user/FqAuDGc-rUM) >

Re: Spark-based ingestion into Druid

2020-03-05 Thread Julian Jaffe
> > > > Per Gian's proposal, and following this thread in Druid user group > ( > > > > > https://groups.google.com/forum/#!topic/druid-user/FqAuDGc-rUM) > and > > > this > > > > > thread in Druid Slack channel ( > > > > > https://the-

Re: Spark-based ingestion into Druid

2020-03-05 Thread itai yaffe
oogle.com/forum/#!topic/druid-user/FqAuDGc-rUM) and > > this > > > > thread in Druid Slack channel ( > > > > https://the-asf.slack.com/archives/CJ8D1JTB8/p1581452302483600), I'd > > like > > > > to start discussing the options of having Spark-based ingest

Re: Spark-based ingestion into Druid

2020-03-05 Thread Julian Jaffe
thread in Druid user group ( > > > https://groups.google.com/forum/#!topic/druid-user/FqAuDGc-rUM) and > this > > > thread in Druid Slack channel ( > > > https://the-asf.slack.com/archives/CJ8D1JTB8/p1581452302483600), I'd > like > > > to start disc

Re: Spark-based ingestion into Druid

2020-03-05 Thread itai yaffe
> > https://groups.google.com/forum/#!topic/druid-user/FqAuDGc-rUM) and this > > thread in Druid Slack channel ( > > https://the-asf.slack.com/archives/CJ8D1JTB8/p1581452302483600), I'd like > > to start discussing the options of having Spark-based ingestion into Druid. >

Re: Spark-based ingestion into Druid

2020-03-03 Thread Julian Jaffe
thread in Druid user group ( > > https://groups.google.com/forum/#!topic/druid-user/FqAuDGc-rUM) and this > > thread in Druid Slack channel ( > > https://the-asf.slack.com/archives/CJ8D1JTB8/p1581452302483600), I'd > like > > to start discussing the options of having Spa

Re: Spark-based ingestion into Druid

2020-03-02 Thread Oğuzhan Mangır
ns of having Spark-based ingestion into Druid. > > There's already an old project (https://github.com/metamx/druid-spark-batch) > for that, so perhaps we can use that as a starting point. > > The thread on Slack suggested 2 approaches: > >1. *Simply replacing the Ha

Re: Spark-based ingestion into Druid

2020-03-02 Thread Oğuzhan Mangır
581452302483600), I'd like > to start discussing the options of having Spark-based ingestion into Druid. > > There's already an old project (https://github.com/metamx/druid-spark-batch) > for that, so perhaps we can use that as a starting point. > > The thread on Slack suggested

Re: Spark-based ingestion into Druid

2020-03-02 Thread Oğuzhan Mangır
like > to start discussing the options of having Spark-based ingestion into Druid. > > There's already an old project (https://github.com/metamx/druid-spark-batch) > for that, so perhaps we can use that as a starting point. > > The thread on Slack suggested 2 approaches: > >1.

Re: Spark-based ingestion into Druid

2020-02-27 Thread Julian Jaffe
r/FqAuDGc-rUM) and this > thread in Druid Slack channel ( > https://the-asf.slack.com/archives/CJ8D1JTB8/p1581452302483600), I'd like > to start discussing the options of having Spark-based ingestion into Druid. > > There's already an old project ( > https://github.com/metamx/druid-

Spark-based ingestion into Druid

2020-02-26 Thread itai yaffe
Spark-based ingestion into Druid. There's already an old project (https://github.com/metamx/druid-spark-batch) for that, so perhaps we can use that as a starting point. The thread on Slack suggested 2 approaches: 1. *Simply replacing the Hadoop MapReduce ingestion task* - having a Spark batch