RE: Implementation of RNN/LSTM in Spark

2017-02-23 Thread Joeri Hermans
need to be aware that distributed optimization is a research topic, and has several approaches and caveats you need to be aware of. I wrote a blog post on this if you like to have some additional information on this topic https://db-blog.web.cern.ch/blog/joeri-hermans/2017-01-distributed-deep

RE: MinMaxScaler behaviour

2016-11-21 Thread Joeri Hermans
I see. I think I read the documentation a little bit too quick :) My apologies. Kind regards, Joeri From: Sean Owen [so...@cloudera.com] Sent: 21 November 2016 21:32 To: Joeri Hermans; dev@spark.apache.org Subject: Re: MinMaxScaler behaviour It's

MinMaxScaler behaviour

2016-11-21 Thread Joeri Hermans
Hi all, I observed some weird behaviour while applying some feature transformations using MinMaxScaler. More specifically, I was wondering if this behaviour is intended and makes sense? Especially because I explicitly defined min and max. Basically, I am preprocessing the MNIST dataset, and