Re: Speeding up Toree Startup

2018-01-05 Thread Bradley Kaiser
I am timing the time it takes for KernelBootstrap.initialize() to complete, just like in Main. The times I gave are without YourKit profiling, sorry that was unclear. When I run the initialization with YourKit its more like 13-14 seconds. I moved all of the ScalaInterpreter creation and

Re: Speeding up Toree Startup

2018-01-04 Thread Chip Senkbeil
At one point, we were going to make Toree highly pluggable using our then-new plugin framework. Things like an interpreter and a spark context would be initialized via plugins and anything needing them would be plugins dependent on those objects. The scala interpreter wasn't necessary for the

Re: Speeding up Toree Startup

2018-01-04 Thread Corey Stubbs
When we originally started we chose to use Akka because we thought there might be the need to do remote interpretation of the code. If I remember correctly from some earlier performance evaluations, the Akka actor system initialization did take some time. We might be able to save some startup

Re: Speeding up Toree Startup

2018-01-04 Thread Luciano Resende
On Thu, Jan 4, 2018 at 1:09 PM, Bradley Kaiser wrote: > Hey Guys, > > I've been looking at ways to speed up Toree's startup and came up with a > quick proof of concept that took the startup time from around 6.5 seconds > to 5.5 seconds on my laptop. I'd like to check

Speeding up Toree Startup

2018-01-04 Thread Bradley Kaiser
Hey Guys, I've been looking at ways to speed up Toree's startup and came up with a quick proof of concept that took the startup time from around 6.5 seconds to 5.5 seconds on my laptop. I'd like to check committer interest in this before I go any further. This change will require rearranging