Re: Is Spark the right tool for me?

2014-12-02 Thread Roger Hoover
king a fraction of the time (inserting all data in one transaction, > taking somewhere between sub-second and < 10 seconds for very large > projects). It’s currently not a concern. > > (searching for a Kafka+Spark example now) > > Cheers > Ben > > > Von: andy petr

Re: Is Spark the right tool for me?

2014-12-02 Thread andy petrella
y not a concern. > > (searching for a Kafka+Spark example now) > > Cheers > Ben > > > Von: andy petrella > Datum: Dienstag, 2. Dezember 2014 10:00 > > An: Benjamin Stadin , " > user@spark.apache.org" > Betreff: Re: Is Spark the right tool for me? >

Re: Is Spark the right tool for me?

2014-12-02 Thread Stadin, Benjamin
enjamin.sta...@heidelberg-mobil.com>>, "user@spark.apache.org<mailto:user@spark.apache.org>" mailto:user@spark.apache.org>> Betreff: Re: Is Spark the right tool for me? Not quite sure which geo processing you're doing are they raster, vector? More info will be apprec

Re: Is Spark the right tool for me?

2014-12-02 Thread andy petrella
gn all of the above as a workflow, runnable (or assignable) as >part of a user session. => Oozie > > Do you think this is ok? > > ~Ben > > > Von: andy petrella > Datum: Montag, 1. Dezember 2014 15:48 > > An: Benjamin Stadin , " > user@spark.apache.org

Re: Is Spark the right tool for me?

2014-12-01 Thread Stadin, Benjamin
l.com>>, "user@spark.apache.org<mailto:user@spark.apache.org>" mailto:user@spark.apache.org>> Betreff: Re: Is Spark the right tool for me? Indeed. However, I guess the important load and stress is in the processing of the 3D data (DEM or alike) into geometries/shades/wh

Re: Is Spark the right tool for me?

2014-12-01 Thread andy petrella
;> run a map server instance on each node, configure it to add the database >> location as map source once the task starts. >> >> Cheers >> Ben >> >> [1] http://www.deep-map.com >> >> Von: andy petrella >> Datum: Montag, 1. Dezember 20

Re: Is Spark the right tool for me?

2014-12-01 Thread andy petrella
add the database > location as map source once the task starts. > > Cheers > Ben > > [1] http://www.deep-map.com > > Von: andy petrella > Datum: Montag, 1. Dezember 2014 15:07 > An: Benjamin Stadin , " > user@spark.apache.org" > Betreff: Re: Is Spark the

Re: Is Spark the right tool for me?

2014-12-01 Thread Stadin, Benjamin
ser@spark.apache.org>" mailto:user@spark.apache.org>> Betreff: Re: Is Spark the right tool for me? Not quite sure which geo processing you're doing are they raster, vector? More info will be appreciated for me to help you further. Meanwhile I can try to give some hints, for ins

Re: Is Spark the right tool for me?

2014-12-01 Thread Stadin, Benjamin
:07 An: Benjamin Stadin mailto:benjamin.sta...@heidelberg-mobil.com>>, "user@spark.apache.org<mailto:user@spark.apache.org>" mailto:user@spark.apache.org>> Betreff: Re: Is Spark the right tool for me? Not quite sure which geo processing you're doing are they raster, vec

Re: Is Spark the right tool for me?

2014-12-01 Thread andy petrella
Not quite sure which geo processing you're doing are they raster, vector? More info will be appreciated for me to help you further. Meanwhile I can try to give some hints, for instance, did you considered GeoMesa ? Since you need a WMS (or alike), did you

Is Spark the right tool for me?

2014-12-01 Thread Stadin, Benjamin
Hi all, I need some advise whether Spark is the right tool for my zoo. My requirements share commonalities with „big data“, workflow coordination and „reactive“ event driven data processing (as in for example Haskell Arrows), which doesn’t make it any easier to decide on a tool set. NB: I have

Re: Is Spark the right tool?

2014-10-28 Thread Koert Kuipers
nd > lookup to be fast. > Is this something that can be done with Spark and is Spark the right tool > to > use in terms of latency and throughput? > > Pardon me if I don't know what I am talking about. All these are very new > to > me. > Thanks! > > > > >

Re: Is Spark the right tool?

2014-10-28 Thread Akhil
t; since different threads and > processes will be reading and modifying it. I need insertion, deletion, > and lookup to be fast. > Is this something that can be done with Spark and is Spark the right tool > to use in terms of latency and throughput? > > Pardon me if I

Is Spark the right tool?

2014-10-19 Thread kc66
an be done with Spark and is Spark the right tool to use in terms of latency and throughput? Pardon me if I don't know what I am talking about. All these are very new to me. Thanks! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Is-Spark-the-right-to