Re: Live Streamed Code Review today at 11am Pacific

2018-03-09 Thread Holden Karau
If anyone wants to watch the recording:
https://www.youtube.com/watch?v=lugG_2QU6YU

I'll do one next week as well - March 16th @ 11am -
https://www.youtube.com/watch?v=pXzVtEUjrLc

On Fri, Mar 9, 2018 at 9:28 AM, Holden Karau  wrote:

> Hi folks,
>
> If your curious in learning more about how Spark is developed, I’m going
> to expirement doing a live code review where folks can watch and see how
> that part of our process works. I have two volunteers already for having
> their PRs looked at live, and if you have a Spark PR your working on you’d
> like me to livestream a review of please ping me.
>
> The livestream will be at https://www.youtube.com/watch?v=lugG_2QU6YU.
>
> Cheers,
>
> Holden :)
> --
> Twitter: https://twitter.com/holdenkarau
>



-- 
Twitter: https://twitter.com/holdenkarau


[DISCUSS] Structured Streaming writers in DataSourceV2

2018-03-09 Thread Joseph Torres
Hi all,

I've been working for the past few months on figuring out a DataSourceV2
compatible interface for Structured Streaming sinks. I've written a document

proposing
an overarching design; please take a look and leave any comments you have.


Design doc JIRA: SPARK-23556

DataSourceV2: SPARK-15689


Jose


Re: [MLlib] QuantRegForest

2018-03-09 Thread Joseph Bradley
Hi Hadrien,

That does sound useful, but just to warn you, it can take a while to get
new algorithms into MLlib itself.  You can definitely make a case for that
on the Spark JIRA.  In the meantime, I'd recommend submitting it to Spark
Packages https://spark-packages.org/  which won't require waiting.  These
helper tools are useful for that:
https://github.com/databricks/spark-package-cmd-tool
https://github.com/databricks/sbt-spark-package

Thanks!
Joseph

On Fri, Mar 9, 2018 at 12:34 AM, Hadrien  wrote:

> Hi,
>
> we implemented a QuantRegForest to be used with Spark. We coded it in
> scala.
> I don't know if you could be interrested but we offer to share it with you
> (btw the original implementation is in R and called quantregForest :
> https://cran.r-project.org/web/packages/quantregForest/index.html)
>
> Can't wait to hear from you!
>
>
>
> --
> Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>


-- 

Joseph Bradley

Software Engineer - Machine Learning

Databricks, Inc.

[image: http://databricks.com] 


Re: Welcoming some new committers

2018-03-09 Thread Joseph Bradley
Congratulations!

On Mon, Mar 5, 2018 at 2:19 PM, Seth Hendrickson <
seth.hendrickso...@gmail.com> wrote:

> Thanks all! :D
>
> On Mon, Mar 5, 2018 at 9:01 AM, Bryan Cutler  wrote:
>
>> Thanks everyone, this is very exciting!  I'm looking forward to working
>> with you all and helping out more in the future.  Also, congrats to the
>> other committers as well!!
>>
>
>


-- 

Joseph Bradley

Software Engineer - Machine Learning

Databricks, Inc.

[image: http://databricks.com] 


Live Streamed Code Review today at 11am Pacific

2018-03-09 Thread Holden Karau
Hi folks,

If your curious in learning more about how Spark is developed, I’m going to
expirement doing a live code review where folks can watch and see how that
part of our process works. I have two volunteers already for having their
PRs looked at live, and if you have a Spark PR your working on you’d like
me to livestream a review of please ping me.

The livestream will be at https://www.youtube.com/watch?v=lugG_2QU6YU.

Cheers,

Holden :)
-- 
Twitter: https://twitter.com/holdenkarau


[MLlib] QuantRegForest

2018-03-09 Thread Hadrien
Hi,

we implemented a QuantRegForest to be used with Spark. We coded it in scala.
I don't know if you could be interrested but we offer to share it with you
(btw the original implementation is in R and called quantregForest :
https://cran.r-project.org/web/packages/quantregForest/index.html)

Can't wait to hear from you!



--
Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org